Databricks acquires Tabular to build a common data lakehouse standard

Date:

Share post:


Databricks, the analytics and AI giant, has acquired data management company Tabular for an undisclosed sum. (CNBC reports that Databricks payed over $1 billion.)

According to Tabular co-founder Ryan Blue, he and Tabular’s other two co-founders, Daniel Weeks and Jason Reid, will be joining Databricks in some capacity. There, they’ll work to unify Tabular’s and Databrick’s customer bases and communities.

“Joining Databricks means that there will be more contributions from our new colleagues,” Blue writes in a blog post. “While doing this, we assure that our approach to [our community] is not changing.”

Tabular, which was founded by Blue, Weeks and Reid in 2021, offers data management products built on Apache Iceberg, a project Blue and Weeks developed while at Netflix and later donated to the Apache Software Foundation. Iceberg is an open source, high-performance format for databases that optimizes tables in databases for big data while at the same time allowing data engines to work with the tables.

Iceberg competed with Databricks’ Delta Lake in the format wars for data lakehouses — data architectures built to store large amounts of raw data while providing structure and management functions. While both Iceberg and Delta Lake use the Apache Parquet data storage format, they’re incompatible in key aspects.

Soon, however, Delta Lake and Iceberg will converge into one. Databricks and Tabular are pledging to work toward a common standard in light of the acquisition news.

“[We will be] working to improve Iceberg support throughout the Databricks platform,” Blue said. “Our goal is to improve interoperability so that you can take advantage of the amazing work of both communities and don’t need to worry about the underlying format.”

The market for data lakehouses is enormous — according to MIT Tech Review, about 74% of organizations have one — and so, from Databricks’ perspective, bringing Tabular into its corporate family was probably the clear choice. Fewer competing data lakehouse formats — or, alternatively, platforms with strong support for multiple formats — makes Databricks’ platform more attractive to corporate clients, after all, even if those formats aren’t vendor-proprietary.

In a blog post co-authored by Databricks CEO Ali Ghodsi and chief architect Reynold Xin, Databricks says that it intends to “work closely” with the Iceberg and Delta Lake communities to “bring interoperability to the formats themselves.”

“This acquisition highlights our commitment to open formats and open source data in the cloud,” the blog post reads. “This is a long journey, one that will likely take several years to achieve in [the data lakehouse] communities.”

Prior to the acquisition, San Jose-based Tabular had raised $37 million in venture capital from investors including Andreessen Horowitz, Zetta Venture Partners and Altimeter Capital. Databricks says that it expects the purchase to close sometime in Q2 2024, subject to customary closing conditions.



Source link

Lisa Holden
Lisa Holden
Lisa Holden is a news writer for LinkDaddy News. She writes health, sport, tech, and more. Some of her favorite topics include the latest trends in fitness and wellness, the best ways to use technology to improve your life, and the latest developments in medical research.

Recent posts

Related articles

OpenAI closes the largest VC round of all time

Welcome back to Week in Review. This week, we’re diving into OpenAI’s $6.6 billion fundraising round, the...

What’s in the rug? How TikTok got swept into a real-time true crime story

A woman in Ohio is being haunted by ghosts. Or maybe she’s not. There’s a dead body...

Fisker’s HQ abandoned in “complete disarray” with apparent hazardous waste, clay models left behind

The headquarters Fisker used in its waning days was recently abandoned and left in “complete disarray,” with...

SoCreate wants to transform screenwriting software with AI imagery and community sharing tools

Many screenwriters have embraced modern tools over traditional PDFs to craft their film or TV show pilots....

5 ‘dumbphones’ that can still run WhatsApp

Smartphones have long been the dominant device for communicating on the move, outselling their pared-down feature phone...

The ‘Mozart of Math’ isn’t worried about AI replacing math nerds — ever

Terence Tao, a UCLA professor considered to be the “world’s greatest living mathematician,” last month compared ChapGPT’s...

YouTube apologizes for falsely banning channels for spam, canceling subscriptions

A misfire of YouTube’s systems led to the accidental banning of YouTube channels affecting numerous creators who...

OpenAI secured more billions, but there’s still capital left for other startups

Welcome to Startups Weekly — your weekly recap of everything you can’t miss from the world of...