Category: Ecosystem

ACID Transactions on Data Lakes

As part of our Data + AI Online Meetup, we’ve explored topics ranging from genomics (with guests from Regeneron) to

XGBoost is currently one of the most popular machine learning libraries and distributed training is becoming more frequently required to

Genomic annotations augment variant data by providing context for each change in the genome. For example, annotations help answer questions

Algorand is a public, decentralized blockchain system that uses a proof of stake consensus protocol. It is fast and energy-efficient,

Diving Into Delta Lake: DML Internals (Update, Delete, Merge) In previous blogs Diving Into Delta Lake: Unpacking The Transaction Log

We are pleased to announce integration for deploying and managing Databricks environments on Microsoft Azure and Amazon Web Services (AWS)

Apache Spark™ has reached its 10th anniversary with Apache Spark 3.0 which has many significant improvements and new features including

Last week, we had a fun Delta Lake 0.7.0 + Apache Spark 3.0 AMA where Burak Yavuz, Tathagata Das, and

Koalas is an open source project which provides a drop-in replacement for pandas, enabling efficient scaling out to hundreds of

What is a Databricks cluster policy? A Databricks cluster policy is a template that restricts the way users interact with