OpenAI partners with Scale AI to allow companies to fine-tune GPT-3.5


Share post:

OpenAI, the AI startup behind the viral AI-powered chatbot ChatGPT, plans to partner with third party vendors to make it easier for developers — specifically enterprises — to fine-tune its AI models using custom data.

Today, OpenAI announced that it’ll team up with Scale AI, the San Francisco-based data labeling startup, to bring together Scale AI’s fine-tuning tools and OpenAI’s GPT-3.5 text-generating model. (GPT-3.5 is the predecessor to GPT-4, OpenAI’s flagship model, which understands images as well as text.)

Fine-tuning lets developers tailor an AI model to specific tasks. For example, a business could fine-tune a model to match its brand voice and tone, or have it respond to questions in a particular language.

Scale customers will be able to prep and “enhance” their data using Scale’s Data Engine platform, then fine-tune GPT-3.5 with their data and further customize the model with features like the ability to reference or cite their proprietary data in its responses.

Scale says that fine-tuned GPT-3.5 models will be reviewed by human experts to “ensure that the model exceeds performance expectations and safety requirements.”

“The partnership incorporates OpenAI’s GPT-3.5 fine-tuning APIs with Scale’s fine-tuning and data expertise from over seven years of building and deploying pioneering AI solutions for customers,” Scale CEO Alexandr Wang told TechCrunch in an email interview. “Scale is OpenAI’s preferred fine-tuning partner to deploy the most performative models, and we look forward to expanding our relationship. OpenAI has chosen to partner with Scale because of our expertise and proven track record of delivering high-quality models with real business impact for our customers.”

News of the collaboration comes a day after OpenAI said that it would begin letting customers fine-tune GPT-3.5 Turbo, the lightweight version of GPT-3.5, using its fine-tuning API. In the announcement, OpenAI hinted that it was developing an in-house tuning tool; it’s unclear whether that tool’s meant to complement platforms like Scale AI or serve a different purpose altogether.

In any case, OpenAI COO Brad Lightcap pitched the team-up with Scale AI as a way to allow companies customizing GPT-3.5 to benefit from additional services and expertise beyond what OpenAI provides.

“We want to serve customers wherever they are. We’re excited to work with great partners like Scale that help us serve the needs of our customers as they put AI to work in their organizations,” he said via email. “This new partnership allows us to extend the benefits of our capabilities to more companies given Scale’s leadership and experience helping organizations effectively leverage enterprise data for AI. Our customers can now fine-tune OpenAI models just as they would through OpenAI, while also benefiting from Scale’s enterprise AI expertise and Data Engine.”

When asked whether to expect new fine-tuning partners for OpenAI models down the line — such as GPT-4, which OpenAI says will gain fine-tuning capabilities in the fall — Lightcap declined to say.

Source link

Lisa Holden
Lisa Holden
Lisa Holden is a news writer for LinkDaddy News. She writes health, sport, tech, and more. Some of her favorite topics include the latest trends in fitness and wellness, the best ways to use technology to improve your life, and the latest developments in medical research.

Recent posts

Related articles

Waabi and Uber Freight partner to accelerate autonomous trucking

Autonomous trucking startup Waabi is committing billions of miles of driverless capacity to the Uber Freight network...

Here are the 6 finalists of Startup Battlefield at Disrupt 2023

During the last two days, 20 startups pitched their companies as part of TechCrunch Startup Battlefield at...

Libra’s co-creator had geopolitical motivations to build the digital currency

“What got me out of bed every morning was China” Morgan Beller, the co-creator of Meta’s now-defunct Libra...

Auctoria uses generative AI to create video game models

Several years ago, Aleksander Caban, the co-founder of Carbon Studio, a Polish VR game developer, observed a...

Cruise CEO says winter version of Origin AV is two years away

Cruise is planning to build a winterized version of the Origin, the company’s autonomous vehicle model that...

GitHub CEO: Despite AI gains, demand for software developers will still outweigh supply

GitHub CEO Thomas Dohmke considers AI and software development to now be inextricably linked, powered by assistive...

PureSpace prevents spoiled produce by removing ripening gas

The UN estimates that about one third of all food produced goes to waste before it even...

Betweened wants to teach kids how to use social media, not shut them out of it

Instead of adding parental controls to an already existing platform, Betweened is designed for kids Keeping kids off...