When UnitedHealthcare incorporated AI into their system, particularly with the use of an algorithm called "nH Predict," they faced significant controversy and legal challenges. Here's a summary of the events:
Lawsuit Allegations: A class action lawsuit was filed against UnitedHealthcare, alleging that the company used nH Predict to systematically deny claims for post-acute care services, especially for elderly patients under Medicare Advantage plans. The lawsuit claims that this AI model had a 90% error rate but was still used to override doctors' recommendations for necessary care, leading to patients either paying out-of-pocket or forgoing critical medical treatment.
Impact on Patients: The AI system was accused of causing elderly patients to be prematurely discharged from care facilities or forced to deplete their savings to continue receiving care, as the AI's predictions often conflicted with actual medical needs assessed by doctors. This has resulted in significant financial and health burdens for patients, with some reports indicating that only a tiny fraction of affected patients appealed the decisions due to lack of knowledge or resources.
Company's Response: UnitedHealth Group, the parent company, has argued that the AI tool, nH Predict, is not used for making coverage determinations but rather as a guide to inform care providers and families about what care might be needed. They've maintained that coverage decisions are based on CMS criteria and the terms of the member's plan. However, despite these claims, the controversy has highlighted concerns over the ethical use of AI in healthcare decision-making.
Legal and Public Reaction: The lawsuit has brought attention to the potential misuse of AI in healthcare, where algorithms might prioritize cost-saving over patient care. This has led to broader discussions about the need for human oversight in AI-driven healthcare decisions and the ethical implications of such technologies. Moreover, there's been public sentiment expressed on social platforms criticizing the use of AI in this manner by UnitedHealthcare, reflecting a broader concern about AI's role in healthcare management.
Comments