TL;DR
Get health and wellness essentials delivered free with Prime
- Fast, free delivery on millions of items
- Prime Video, Amazon Music and more included
- Member-only deals all year
Researchers speaking at the Association of Health Care Journalists Fall Summit warned that workplace AI in healthcare can bring risks alongside its benefits. They pointed to possible skill loss, increased monitoring, reduced worker autonomy and algorithmically managed shifts; the scale of these effects and how responsibility for AI-related errors will be assigned remain unclear.
Researchers warned at the Association of Health Care Journalists Fall Summit that artificial intelligence may worsen working conditions in healthcare even when it does not eliminate jobs. Mishal Khan of the UC Berkeley Labor Center said possible harms include loss of clinical skills, worker monitoring and reduced control over work, concerns with implications for both healthcare staff and patient care.
Khan, a senior researcher in the Labor Center’s Technology and Work Program, grouped workplace AI uses into electronic monitoring, algorithmic management and task or job automation. Monitoring can involve cameras tracking workers, while algorithmic systems may analyze calls and prompt workers to change how they speak to customers. Automation assigns particular tasks to software or AI.
In her research on healthcare, Khan highlighted de-skilling: workers may lose expertise when automated tools take over parts of their jobs. She said this could affect healthcare workers’ scope of practice. Stanford biomedical informatics professor Tina Hernandez-Boussard raised a related concern, describing medical residents who were unable to confidently synthesize information to make recommendations when they were helping at a hospital in Uganda that had lost electricity and lacked AI tools to interpret electrocardiograms.
Khan also cited concerns about patient relationships and accountability, particularly when automated systems are used for patient handoffs or ambient documentation. Workers want to know what data these tools collect about them and whether those data could be used in employment decisions, she said. If an AI recommendation contributes to an error, who is responsible remains a question raised at the summit.
How AI Could Change Clinical Work
The concerns reach beyond whether AI replaces jobs. If automation changes how clinical tasks are performed, it could affect workers’ skills, autonomy and scope of practice, as well as the way care is coordinated. The residents’ experience in Uganda, as described by Hernandez-Boussard, illustrates a possible risk when clinicians rely on tools that may not be available during a power or technology outage. It does not establish how widespread that problem is.
Algorithmic management could also affect pay and scheduling. Khan warned that nursing platforms might ask nurses to bid for shifts and use algorithms to estimate the lowest wage a nurse would accept. That was presented as a possible direction, not as a documented description of every platform. The wider issue is who has the power to set workplace rules and how workers can challenge automated decisions.
As an affiliate, we earn on qualifying purchases.
Three Workplace Uses of AI
Khan’s framework separates workplace AI into three categories: monitoring, management and automation. Examples she gave included cameras used to track workers, software that listens to worker-customer calls and suggests responses, and systems that take over specific tasks. These uses can have different consequences, so the risks depend on how a tool is deployed and what decisions it informs.
Khan listed possible harms including job loss, theft of work product, de-skilling, lower wages or wage theft, faster work and injuries, discrimination, limits on labor organizing, and reduced autonomy. The report did not provide prevalence figures or evidence that each harm has occurred across healthcare workplaces. Khan’s central point was that the effects depend on workplace power, not just on the technology itself.
She also said lawmakers have begun addressing some concerns. According to Khan, Illinois and Vermont passed bills prohibiting the replacement of mental health workers with AI, while California law bars companies from advertising an AI chatbot as a health professional. A California bill under consideration would prevent workers from being required to train their replacements, including AI systems.
“Even if they don’t lose a single job to AI, it doesn’t mean there are no harms to workers.”
— Mishal Khan, senior researcher at the UC Berkeley Labor Center
clinical skill de-skilling training tools
As an affiliate, we earn on qualifying purchases.
As an affiliate, we earn on qualifying purchases.
How Widespread Are These Risks?
The summit report does not quantify how often healthcare workers are monitored or managed by AI, how many jobs or tasks have been automated, or how frequently automation has contributed to de-skilling or patient-care problems. The Uganda example was an account shared by Hernandez-Boussard; the report does not provide further details about the hospital, the residents’ training or the outcome of their recommendations.
It is also unclear how liability would be assigned when an AI recommendation contributes to a mistake, and what workplace data ambient documentation systems collect or how employers may use it. The account of algorithmic nursing shift platforms was a warning about a potential model, not evidence that the described pay-setting practice is already standard.
As an affiliate, we earn on qualifying purchases.
Policy and Workplace Decisions Ahead
Further developments will depend on how healthcare employers deploy AI systems, what protections workers receive, and whether proposed legislation advances. The California bill described by Khan was still under consideration at the time of the report; its status and any later action are not provided. The report also does not identify a timetable for additional legislation or implementation of the measures in Illinois and Vermont.
For healthcare organizations and workers, the issues raised at the summit include whether AI tools preserve clinical skills, what information they collect, how workers can contest automated decisions, and who is accountable when a tool contributes to an error. Those questions remain open; the summit remarks raise risks to examine but do not establish a single outcome for healthcare AI.
hospital shift scheduling algorithms
As an affiliate, we earn on qualifying purchases.
As an affiliate, we earn on qualifying purchases.
Key Questions
What did researchers warn about healthcare AI?
They warned that AI may affect workers through de-skilling, monitoring, reduced autonomy and algorithmic management, even if it does not replace jobs. These were identified as potential risks, not quantified outcomes across the sector.
What is de-skilling in this report?
De-skilling is the loss of specialized worker skills when AI or other automation takes over tasks people previously performed. Khan said it could threaten healthcare workers’ scope of practice.
What happened to the medical residents in Uganda?
Hernandez-Boussard said a group of residents sent to help at a hospital’s cardiac ward lost access to electricity and had no AI system to read electrocardiograms. She said they were not confident synthesizing information to make recommendations. The report gives no further details about the episode.
What AI-related laws did Khan mention?
Khan said bills passed in Illinois and Vermont prohibit replacing mental health workers with AI, and that California law bars advertising an AI chatbot as a health professional. She said a separate California bill concerning workers training AI replacements was under consideration.
Is AI already setting nurses’ wages and shifts?
The report does not establish that as a widespread current practice. Khan warned that algorithmically managed nursing platforms could have nurses bid for shifts and use algorithms to estimate the lowest wage a nurse would accept.
Source: rss
Columbus Day / Indigenous Peoples' Day Picks
long weekend sales
As an affiliate, we earn on qualifying purchases.
