Workplace Emotion-Tracking AI Raises Privacy and Discrimination Concerns

Thumbnail Image

The information displayed in the AIM should not be reported as representing the official views of the OECD or of its member countries.

Over half of large U.S. employers use emotion-tracking AI to monitor workers’ internal states, raising significant concerns about privacy violations, biased or inaccurate assessments, and unjust employment decisions. Scholars and workers warn these systems can lead to discrimination and psychological harm, highlighting the risks of deploying emotion AI in workplaces.[AI generated]

Why's our monitor labelling this an incident or hazard?

The article explicitly describes AI systems that analyze biological signals and behavioral data to infer emotions, which are used in workplace decision-making. It reports direct harms experienced or anticipated by workers, including privacy loss, mental health deterioration, biased treatment, and unjust employment outcomes. These constitute violations of rights and harm to well-being, fitting the definition of an AI Incident. The article does not merely speculate about potential harms but presents survey data indicating actual or expected negative impacts, thus qualifying as an AI Incident rather than a hazard or complementary information.[AI generated]
AI principles
Privacy & data governanceFairnessRespect of human rightsTransparency & explainabilityAccountabilityRobustness & digital securitySafetyHuman wellbeingDemocracy & human autonomy

Industries
Business processes and support services

Affected stakeholders
Workers

Harm types
Human or fundamental rightsPsychologicalEconomic/Property

Severity
AI incident

Business function:
Human resource management

AI system task:
Recognition/object detection


Articles about this incident or hazard

Thumbnail Image

Emotion-tracking AI on the job: Workers fear being watched - and misunderstood

2024-03-06
Yahoo
Why's our monitor labelling this an incident or hazard?
The article explicitly describes AI systems that analyze biological signals and behavioral data to infer emotions, which are used in workplace decision-making. It reports direct harms experienced or anticipated by workers, including privacy loss, mental health deterioration, biased treatment, and unjust employment outcomes. These constitute violations of rights and harm to well-being, fitting the definition of an AI Incident. The article does not merely speculate about potential harms but presents survey data indicating actual or expected negative impacts, thus qualifying as an AI Incident rather than a hazard or complementary information.
Thumbnail Image

Emotion-tracking AI on the job: Workers fear being watched ??" and misunderstood

2024-03-07
freedomsphoenix.com
Why's our monitor labelling this an incident or hazard?
The article describes the deployment and societal concerns around emotion AI but does not document any direct or indirect harm resulting from its use. It highlights potential risks such as privacy violations and bias but does not report actual incidents or harms. Therefore, it fits the definition of an AI Hazard, as the use of emotion AI could plausibly lead to harms like privacy breaches or discrimination, but no specific harm has yet been reported in this context.
Thumbnail Image

Emotion-tracking AI on the job: Workers fear being watched - and misunderstood

2024-03-06
The Conversation
Why's our monitor labelling this an incident or hazard?
The article explicitly involves AI systems designed to infer emotions from biological signals and behavior in workplace settings. It does not describe a realized harm or incident but rather focuses on workers' fears and concerns about potential harms such as privacy invasion, bias, and unjust employment decisions. These concerns indicate plausible future harms that could arise from the use of emotion AI in workplaces. Therefore, the event qualifies as an AI Hazard because it plausibly could lead to AI Incidents involving violations of rights, harm to well-being, and bias-related harms, but no actual harm has been documented in this report.
Thumbnail Image

Workers express fears over emotion-tracking AI

2024-03-07
ReadWrite
Why's our monitor labelling this an incident or hazard?
The article explicitly mentions the use of emotion AI systems to monitor employees' emotions and behavior, which qualifies as AI system involvement. The concerns expressed by workers about privacy invasion, mental health stigma, and potential job discrimination indicate plausible future harms linked to the AI system's use. Although no direct harm has yet been documented, the credible risks of violation of rights and harm to health justify classifying this as an AI Hazard rather than an Incident. The article does not report any realized harm or incident but focuses on the potential negative consequences of emotion AI deployment in workplaces.
Thumbnail Image

Emotion-tracking AI on the job: Workers fear being watched - and misunderstood - EconoTimes

2024-03-07
EconoTimes
Why's our monitor labelling this an incident or hazard?
The article explicitly describes AI systems that analyze biological signals and behavioral data to infer emotions of workers, which is a clear AI system. The use of these systems in workplaces has directly led to harms including privacy violations, emotional distress, biased and inaccurate assessments, and potential unjust employment decisions, all of which are harms to individuals and communities. The workers' testimonies confirm realized harm, not just potential harm. Hence, this qualifies as an AI Incident under the framework, as the AI system's use has directly and indirectly caused harm to people, including violations of privacy and potential discrimination.
Thumbnail Image

Workers Fear Misinterpretation by Emotion-Tracking AI at Work

2024-03-06
Mirage News
Why's our monitor labelling this an incident or hazard?
The article explicitly involves AI systems (emotion AI) used in workplace settings. It details workers' fears and concerns about potential harms including privacy violations, biased and inaccurate inferences, and unjust employment decisions. Although these harms are not reported as realized incidents, the concerns and potential for harm are credible and plausible, indicating a risk that these AI systems could lead to AI Incidents in the future. Therefore, this event is best classified as an AI Hazard because it describes plausible future harms stemming from the use of emotion AI in workplaces, without evidence of actualized harm at this time.
Thumbnail Image

Emotion-tracking AI in the workplace raises privacy, discrimination concerns | Finance & Commerce

2024-03-06
Finance & Commerce
Why's our monitor labelling this an incident or hazard?
The article explicitly describes AI systems that infer emotions from biological signals and computer usage data, used in workplace settings. It details direct harms experienced or expected by workers, including privacy violations, biased and incorrect inferences leading to unfair employment decisions, and psychological harm. These constitute violations of rights and harm to health and communities. Therefore, the event qualifies as an AI Incident because the development and use of emotion AI systems have directly and indirectly led to significant harms to workers, including privacy breaches, discrimination, and mental health impacts.
Thumbnail Image

MIL-OSI Global: Emotion-tracking AI on the job: Workers fear being watched - and misunderstood

2024-03-06
foreignaffairs.co.nz
Why's our monitor labelling this an incident or hazard?
The article explicitly describes AI systems (emotion AI) that analyze biological signals and behavior to infer emotions and internal states of workers. It details direct harms experienced or expected by workers, including privacy violations, biased and inaccurate assessments leading to unjust employment decisions, and psychological harm. These constitute violations of rights and harm to health and well-being, fitting the definition of an AI Incident. The harms are realized or ongoing, not merely potential, and the AI system's use is central to these harms.