Company Blog › Announcements

The financial services industry is transforming rapidly. Customers today demand more personalized experiences, better returns on their investments and improved protection against fraud. As a result,  every bank, insurance company and institutional investor is turning towards big data and AI to meet these demands and outmaneuver the competition. Spark + AI Summit is the premier...

We are proud to announce the release of Databricks Runtime 5.3, which includes several new features and improvements, including: GA of Delta Time Travel Public Preview of MySQL table replication to Delta Optimized DBFS FUSE folder for deep learning workloads (Azure-only) Databricks Delta Time Travel (Generally Available) Delta Time Travel has graduated to general availability....

We are excited to announce the general availability (GA) of Databricks Runtime for Machine Learning, as part of the release of Databricks Runtime 5.3 ML. Built on top of Databricks Runtime, Databricks Runtime ML is the optimized runtime for developing ML/DL applications in Databricks. It offers native integration with popular ML/DL frameworks, such as scikit-learn,...

Over the past several years, Spark + AI Summit has become the premier event for data scientists, engineers, and Apache SparkTM enthusiasts to come together and share how they’re driving innovation with the latest data and machine learning technologies. Last year’s Summit set a new record, with more than 4000 attendees and over 100 talks...

From Static Data Warehouse to Scalable Insights and AI On-Demand Government agencies today are dealing with a wider variety of data at a much larger scale. From satellite imagery to sensor data to citizen records, petabytes of semi- and unstructured data is collected each day. Unfortunately, traditional data warehouses are failing to provide government agencies...

Adding a Lower Tier, Lower Price Option Since its inception a guiding principle for Databricks has been the unification of data science and engineering helping to bring together silos and raising the level of collaboration and productivity among the analytics professionals. And our customers have been reaping the benefits of this to solve some of...

Simplify building big data pipelines for change data capture (CDC) and GDPR use cases. Databricks Delta, the next-generation engine built on top of Apache Spark™, now supports the MERGE command, which allows you to efficiently upsert and delete records in your data lakes. MERGE dramatically simplifies how a number of common data pipelines can be...

With 2019 in full swing, the excitement for data and AI driven innovation continues. Over the past few years, we’ve seen leading innovators - like Riot Games, Regeneron and Shell - become early adopters of the latest machine learning and AI technologies, building and deploying AI applications into production. But with great promise comes great...

Building production machine learning applications is challenging because there is no standard way to record experiments, ensure reproducible runs, and manage and deploy models. To address these challenges, last June we introduced MLflow, an open source platform to manage the ML lifecycle that works with any machine learning library and environment. The project has grown...

Artificial Intelligence (AI) adoption is picking up steam. Enterprises are looking for new ways to deploy AI to transform their business and gain a competitive edge. With the power of machine learning (ML) fueled by the insights mined from massive volumes of data, AI is no longer only for the 1%, but quickly becoming an...