Hugging Face makes it easier for devs to run AI models on third-party clouds

Date:

Share post:


AI dev platform Hugging Face has partnered with third-party cloud vendors including SambaNova to launch Inference Providers, a feature designed to make it easier for devs on Hugging Face to run AI models using the infrastructure of their choice.

Other partners involved with the new effort include Fal, Replicate, and Together AI.

Hugging Face says its partners have worked with it to build access to their respective data centers for running models into Hugging Face’s platform. Now, developers on Hugging Face can, for example, spin up a DeepSeek model on SambaNova’s servers from a Hugging Face project page in just a few clicks.

Hugging Face has long offered its own in-house solution for running AI models. But in a blog post Tuesday, the company explained that its focus has shifted to collaboration, storage, and model distribution capabilities.

Inference provider options as they appear on Hugging Face project pages.Image Credits:Hugging Face

“Serverless providers have flourished, and the time was right for Hugging Face to offer easy and unified access to serverless inference through a set of great providers,” the company wrote in the post. “[I]t was natural to partner with the next generation of serverless inference providers for model-centric, serverless inference.”

Serverless inference lets developers deploy and scale AI models without configuring or managing any of the underlying hardware. Providers like SambaNova automatically launch the necessary computing resources and scale them up or down depending on usage.

Hugging Face says that developers who use third-party cloud providers through its platform will pay the standard provider API rates, at least for now. (Hugging Face may establish revenue-sharing agreements with provider partners in the future, it says.) All Hugging Face users get a small quota of credits to put toward inference, and subscribers to Hugging Face Pro, Hugging Face’s premium tier, get an additional $2 of credits a month.

Hugging Face Inference Providers
The settings menu for Inference Providers.Image Credits:Hugging Face

Founded in 2016 as a chatbot startup, Hugging Face has become one of the largest AI model hosting and development platforms globally. To date, Hugging Face has raised close to $400 million in capital from investors including Salesforce, Google, Amazon, and Nvidia. The company claims to be profitable.



Source link

Lisa Holden
Lisa Holden
Lisa Holden is a news writer for LinkDaddy News. She writes health, sport, tech, and more. Some of her favorite topics include the latest trends in fitness and wellness, the best ways to use technology to improve your life, and the latest developments in medical research.

Recent posts

Related articles

SoftBank in talks to invest as much as $25B in OpenAI, report says

SoftBank is in talks to invest up to $25 billion in OpenAI as part of a broader...

Meta says end of fact-checking hasn’t impacted ad spend

Meta says its controversial decision to put an end to its fact-checking program hasn’t impacted advertiser spend....

Zuck shrugs off DeepSeek, vows to spend hundreds of billions on AI

U.S. markets panicked on Monday over speculation that DeepSeek’s AI models would crush demand for GPUs, with...

LinkedIn passes $2B in premium revenue in 12 months, with overall revenue up 9% on the year

LinkedIn, the social platform where people look for and talk about work, may be less visible in...

Elon Musk claims Tesla will launch a self-driving service in Austin in June

Tesla CEO Elon Musk said Wednesday his company will launch a paid ride-hailing robotaxi service in Austin,...

Threads adds another 20M monthly users since December, reaching 320M

Threads, Meta’s microblogging service, is growing at a fast pace as users gravitate to the app over...

Hackers are hijacking WordPress sites to push Windows and Mac malware

Hackers are exploiting outdated versions of WordPress and plugins to alter thousands of websites in an attempt...

Microsoft brings a DeepSeek model to its cloud

Microsoft’s close partner and collaborator, OpenAI, might be suggesting that DeepSeek stole its IP and violated its...