Member-only story

Open Sourcing Unity Catalog

Caio Moreno
11 min readJun 17, 2024

--

Dear Databricks and Open Source community,

As most of you already know, last week during DAIS 2024, Matei Zaharia promoted Unity Catalog Project from a private repo to a public repo in GitHub.

Yes, Unity Catalog is open source now!

Below, we have the full story about this great news from Databricks Team.

Unity Catalog — Public Repo in GitHub

Project:
https://www.unitycatalog.io/
https://www.databricks.com/blog/open-sourcing-unity-catalog
https://github.com/unitycatalog/unitycatalog/tree/main

Creating the industry’s only universal catalog for data and AI

We are excited to announce that we are open sourcing Unity Catalog, the industry’s first open source catalog for data and AI governance across clouds, data formats, and data platforms. Here are the most important pillars of the Unity Catalog vision:

  • Open source API and implementation: It is built on OpenAPI spec and an open source server implementation under Apache 2.0 license. It is also compatible with Apache Hive’s metastore API and Apache Iceberg’s REST catalog API.
  • Multi-format support: It is extensible and supports Delta Lake, Apache Iceberg via UniForm, Apache…

--

--

Caio Moreno
Caio Moreno

Written by Caio Moreno

Solutions Architect @databricks | Professor | PhD | Ex-Microsoft | Ex-Avanade/Accenture | Ex-Pentaho/Hitachi | Ex-AOL | Ex-IT4biz CEO. (Opinions are my own)

No responses yet