Introducing Databricks Ingest: Easy and Efficient Data Ingestion from Different Sources into Delta Lake
We are excited to introduce a new feature – Auto Loader – and a set of partner integrations, in a public preview, that…
Announcing the Delta Lake 0.3.0 Release
We are excited to announce the release of Delta Lake 0.3.0 which introduces new programmatic APIs for manipulating and managing data in Delta…
Getting Data Ready for Data Science: On-Demand Webinar and Q&A Now Available
On June 25th, our team hosted a live webinar — Getting Data Ready for Data Science — with Prakash Chockalingam, Product Manager at…
Open Sourcing Delta Lake
Build reliable data lakes effortlessly at scale We are excited to announce the open sourcing of the Delta Lake project. Delta Lake is…
Efficient Upserts into Data Lakes with Databricks Delta
Simplify building big data pipelines for change data capture (CDC) and GDPR use cases. Databricks Delta Lake, the next-generation engine built on top…
Introducing Delta Time Travel for Large Scale Data Lakes
Data versioning for reproducing experiments, rolling back, and auditing data We are thrilled to introduce time travel capabilities in Databricks Delta Lake, the…
Apache Spark™ Clusters in Autopilot Mode
Apache Spark™ is a unified analytics engine that helps users use a single distributed computing framework for various use cases. With the advent…
Introducing Databricks Optimized Autoscaling on Apache Spark™
Databricks is thrilled to announce our new optimized autoscaling feature. The new Apache Spark™-aware resource manager leverages Spark shuffle and executor statistics to…
Transparent Autoscaling of Instance Storage
Big data workloads require access to disk space for a variety of operations, generally when intermediate results will not fit in memory. When…
What AWS Per-Second Billing Means for Big Data Processing
Databricks, the Unified Analytics Platform, has always been a cloud-first platform. We believe in the scalability and elasticity of the cloud so that…
