Google is using Anthropic’s Claude to improve its Gemini AI

Date:

Share post:


Contractors working to improve Google’s Gemini AI are comparing its answers against outputs produced by Anthropic’s competitor model Claude, according to internal correspondence seen by TechCrunch. 

Google would not say, when reached by TechCrunch for comment, if it had obtained permission for its use of Claude in testing against Gemini.

As tech companies race to build better AI models, the performance of these models are often evaluated against competitors, typically by running their own models through industry benchmarks rather than having contractors painstakingly evaluate their competitors’ AI responses.

The contractors working on Gemini tasked with rating the accuracy of the model’s outputs must score each response that they see according to multiple criteria, like truthfulness and verbosity. The contractors are given up to 30 minutes per prompt to determine whose answer is better, Gemini’s or Claude’s, according to the correspondence seen by TechCrunch. 

The contractors recently began noticing references to Anthropic’s Claude appearing in the internal Google platform they use to compare Gemini to other unnamed AI models, the correspondence showed. At least one of the outputs presented to Gemini contractors, seen by TechCrunch, explicitly stated: “I am Claude, created by Anthropic.”

One internal chat showed the contractors noticing Claude’s responses appearing to emphasize safety more than Gemini. “Claude’s safety settings are the strictest” among AI models, one contractor wrote. In certain cases, Claude wouldn’t respond to prompts that it considered unsafe, such as role-playing a different AI assistant. In another, Claude avoided answering a prompt, while Gemini’s response was flagged as a “huge safety violation” for including “nudity and bondage.” 

Anthropic’s commercial terms of service forbid customers from accessing Claude “to build a competing product or service” or “train competing AI models” without approval from Anthropic. Google is a major investor in Anthropic. 

Shira McNamara, a spokesperson for Google DeepMind, which runs Gemini, would not say — when asked by TechCrunch — whether Google has obtained Anthropic’s approval to access Claude. When reached prior to publication, an Anthropic spokesperson did not comment by press time.

McNamara said that DeepMind does “compare model outputs” for evaluations but that it doesn’t train Gemini on Anthropic models.

“Of course, in line with standard industry practice, in some cases we compare model outputs as part of our evaluation process,” McNamara said. “However, any suggestion that we have used Anthropic models to train Gemini is inaccurate.”

Last week, TechCrunch exclusively reported that Google contractors working on the company’s AI products are now being made to rate Gemini’s AI responses in areas outside of their expertise. Internal correspondence expressed concerns by contractors that Gemini could generate inaccurate information on highly sensitive topics like healthcare.

You can send tips securely to this reporter on Signal at +1 628-282-2811.

TechCrunch has an AI-focused newsletter! Sign up here to get it in your inbox every Wednesday.



Source link

Lisa Holden
Lisa Holden
Lisa Holden is a news writer for LinkDaddy News. She writes health, sport, tech, and more. Some of her favorite topics include the latest trends in fitness and wellness, the best ways to use technology to improve your life, and the latest developments in medical research.

Recent posts

Related articles

AI companies upped their federal lobbying spend in 2024 amid regulatory uncertainty

Companies spent significantly more lobbying AI issues at the U.S. federal level last year compared to 2023...

ElevenLabs has raised a new round at $3B+ valuation led by ICONIQ Growth, sources say

Companies that want to build AI voice into their products are rushing to work with ElevenLabs, the...

X expands its vertical video feed to global users

Elon Musk’s X has started expanding the rollout of its dedicated vertical video feed to users around...

Waymo lobbyist activity in SF skyrocketed in 2024

Waymo lobbyists had a busy 2024. A recent review of lobbyist disclosure data by the San...

iOS 18 hits 68% adoption across iPhones, per new Apple figures

Apple released new figures Friday, highlighting user adoption of iOS 18. Released in public form back in...

Kodiak has made its first driverless truck deliveries to customer Atlas Energy

Kodiak Robotics has officially handed off two autonomous trucks to customer Atlas Energy Solutions, marking the startup’s...

Flip, the TikTok Shop rival, launches a creator fund that grants up to $100M of equity

Flip is a social commerce app that lets shoppers become creators. They can share honest reviews and...

OpenAI’s Stargate project reportedly doesn’t have the money it needs

Stargate — the massive infrastructure project to build data centers for OpenAI in the U.S. — lacks...