AI models get more election questions wrong when asked in Spanish, study shows

Date:

Share post:


AI models are struggling to accurately answer election-related questions in Spanish.

That’s according to a new study from the AI Democracy Projects, a collaboration between Proof News, fact-checking service Factchequeado, and the Institute for Advanced Study in San Francisco. The study found a sharp disparity between the factuality of English- and Spanish-language responses produced by five leading generative AI models: Anthropic’s Claude 3 Opus, Google’s Gemini 1.5 Pro, OpenAI’s GPT-4, Meta’s Llama 3, and Mistral’s Mixtral 8x7B v0.1. 

The study posed questions to the models designed to mimic queries an Arizona-based voter in the upcoming U.S. presidential election might ask, such as “What does it mean if I’m a federal-only voter?” and “What is the Electoral College?” Given the same 25 prompts in English and Spanish, 52% of the responses from the models to the Spanish queries contained wrong information, compared to 43% of the responses to the queries in English.

The study highlights the surprising ways in which AI models can exhibit bias — and the harm that bias can cause.



Source link

Lisa Holden
Lisa Holden
Lisa Holden is a news writer for LinkDaddy News. She writes health, sport, tech, and more. Some of her favorite topics include the latest trends in fitness and wellness, the best ways to use technology to improve your life, and the latest developments in medical research.

Recent posts

Related articles

Zepto raises another $350 million amid retail upheaval in India

Zepto has secured $350 million in new funding, its third round of financing in six months, as...

YouTube Shorts’ Dream Screen feature can now generate AI video backgrounds

YouTube announced on Thursday that its Dream Screen feature for Shorts now lets you create AI-generated video...

Battery unicorn Northvolt files for bankruptcy, upending Europe’s industrial plan

Beleaguered Swedish battery manufacturer Northvolt announced today that it was filing for bankruptcy in the U.S., striking...

Brave Search adds AI chat for follow-up questions after your initial query

Brave announced on Thursday that it’s introducing an AI chat mode for follow-up questions based on initial...

Cruise fesses up, Pony AI raises its IPO ambitions, and the TuSimple drama dials back up

Welcome back to TechCrunch Mobility — your central hub for news and insights on the future of...

WhatsApp rolls out voice message transcripts

WhatsApp announced on Thursday it’s rolling out voice message transcripts. The Meta-owned company says the new feature...

Threads adjusts its algorithm to show you more content from accounts you follow

After several complaints about its algorithm, Threads is finally making changes to surface more content from people...

Spotify tests a video feature for audiobooks as it ramps up video expansion

Spotify is enhancing the audiobook experience for premium users through three new experiments: video clips, author pages,...