Databricks acquires Tabular to build a common data lakehouse standard

Date:

Share post:


Databricks, the analytics and AI giant, has acquired data management company Tabular for an undisclosed sum. (CNBC reports that Databricks payed over $1 billion.)

According to Tabular co-founder Ryan Blue, he and Tabular’s other two co-founders, Daniel Weeks and Jason Reid, will be joining Databricks in some capacity. There, they’ll work to unify Tabular’s and Databrick’s customer bases and communities.

“Joining Databricks means that there will be more contributions from our new colleagues,” Blue writes in a blog post. “While doing this, we assure that our approach to [our community] is not changing.”

Tabular, which was founded by Blue, Weeks and Reid in 2021, offers data management products built on Apache Iceberg, a project Blue and Weeks developed while at Netflix and later donated to the Apache Software Foundation. Iceberg is an open source, high-performance format for databases that optimizes tables in databases for big data while at the same time allowing data engines to work with the tables.

Iceberg competed with Databricks’ Delta Lake in the format wars for data lakehouses — data architectures built to store large amounts of raw data while providing structure and management functions. While both Iceberg and Delta Lake use the Apache Parquet data storage format, they’re incompatible in key aspects.

Soon, however, Delta Lake and Iceberg will converge into one. Databricks and Tabular are pledging to work toward a common standard in light of the acquisition news.

“[We will be] working to improve Iceberg support throughout the Databricks platform,” Blue said. “Our goal is to improve interoperability so that you can take advantage of the amazing work of both communities and don’t need to worry about the underlying format.”

The market for data lakehouses is enormous — according to MIT Tech Review, about 74% of organizations have one — and so, from Databricks’ perspective, bringing Tabular into its corporate family was probably the clear choice. Fewer competing data lakehouse formats — or, alternatively, platforms with strong support for multiple formats — makes Databricks’ platform more attractive to corporate clients, after all, even if those formats aren’t vendor-proprietary.

In a blog post co-authored by Databricks CEO Ali Ghodsi and chief architect Reynold Xin, Databricks says that it intends to “work closely” with the Iceberg and Delta Lake communities to “bring interoperability to the formats themselves.”

“This acquisition highlights our commitment to open formats and open source data in the cloud,” the blog post reads. “This is a long journey, one that will likely take several years to achieve in [the data lakehouse] communities.”

Prior to the acquisition, San Jose-based Tabular had raised $37 million in venture capital from investors including Andreessen Horowitz, Zetta Venture Partners and Altimeter Capital. Databricks says that it expects the purchase to close sometime in Q2 2024, subject to customary closing conditions.



Source link

Lisa Holden
Lisa Holden
Lisa Holden is a news writer for LinkDaddy News. She writes health, sport, tech, and more. Some of her favorite topics include the latest trends in fitness and wellness, the best ways to use technology to improve your life, and the latest developments in medical research.

Recent posts

Related articles

Waymo robotaxi pulled over by Phoenix police after driving into the wrong lane

A police officer pulled over a self-driving Waymo vehicle in Phoenix after it ran a red light...

Figma pauses its new AI feature after Apple controversy

Welcome back to TechCrunch’s Week in Review — TechCrunch’s newsletter recapping the week’s biggest news. Want it...

How to set up parental controls on Facebook, Snapchat, TikTok and more popular sites

Parental controls are offered by almost every popular media network, but many parents aren’t aware of them....

You could learn a lot from a CIO with a $17B IT budget

Lori Beer, global CIO at JPMorgan Chase, oversees a massive IT operation that’s bigger than many companies....

Tesla makes it onto Chinese government purchase list

For the first time, Chinese government workers will be able to purchase Tesla’s Model Y for official...

Tokens are a big reason today’s generative AI falls short

Generative AI models don’t process text the same way humans do. Understanding their “token”-based internal environments may...

OpenAI breach is a reminder that AI companies are treasure troves for hackers

There’s no need to worry that your secret ChatGPT conversations were obtained in a recently reported breach...

Space for newcomers, biotech going mainstream, and more

Welcome to Startups Weekly — TechCrunch’s weekly recap of everything you can’t miss from the world of...