AI models get more election questions wrong when asked in Spanish, study shows

Date:

Share post:


AI models are struggling to accurately answer election-related questions in Spanish.

That’s according to a new study from the AI Democracy Projects, a collaboration between Proof News, fact-checking service Factchequeado, and the Institute for Advanced Study in San Francisco. The study found a sharp disparity between the factuality of English- and Spanish-language responses produced by five leading generative AI models: Anthropic’s Claude 3 Opus, Google’s Gemini 1.5 Pro, OpenAI’s GPT-4, Meta’s Llama 3, and Mistral’s Mixtral 8x7B v0.1. 

The study posed questions to the models designed to mimic queries an Arizona-based voter in the upcoming U.S. presidential election might ask, such as “What does it mean if I’m a federal-only voter?” and “What is the Electoral College?” Given the same 25 prompts in English and Spanish, 52% of the responses from the models to the Spanish queries contained wrong information, compared to 43% of the responses to the queries in English.

The study highlights the surprising ways in which AI models can exhibit bias — and the harm that bias can cause.



Source link

Lisa Holden
Lisa Holden
Lisa Holden is a news writer for LinkDaddy News. She writes health, sport, tech, and more. Some of her favorite topics include the latest trends in fitness and wellness, the best ways to use technology to improve your life, and the latest developments in medical research.

Recent posts

Related articles

TechCrunch Space: Disrupt 2024 wrap-up

Hello, and welcome back to TechCrunch Space. TechCrunch Disrupt 2024 is a wrap, and I’m more than...

Amazon CEO Andy Jassy hints at an ‘agentic’ Alexa

Amazon CEO Andy Jassy today hinted at an improved, “agentic” version of the company’s Alexa assistant —...

US drone maker Skydio faces battery squeeze after Chinese sanctions

America’s supply chain vulnerabilities were on full display Thursday after drone manufacturer Skydio told customers it was...

Decart’s AI simulates a real-time, playable version of Minecraft

Decart, an Israeli AI company that emerged from stealth today with $21 million in funding from Sequoia...

BBG Ventures raises new $60 million fund to support diverse founders

BBG Ventures raised a new $60 million fund to support founders from “diverse backgrounds,” including gender, race,...

Female Founders Fund returns its Fund I

After 10 years, the Female Founders Fund has returned its $5.85 million Fund I, according to Fortune....

OpenAI CEO Sam Altman says lack of compute capacity is delaying the company’s products

In a Reddit AMA, OpenAI CEO Sam Altman admitted that a lack of compute capacity is one...

Carl Pei says Nothing could build its own operating system

Two mobile operating systems currently comprise nearly 100% of the global smartphone market. Building one is hard,...