Evolution of the SQL language at Databricks: ANSI standard by default and easier migrations from data warehouses
Today, we are excited to announce that Databricks SQL will use the ANSI standard SQL dialect by default. This follows the announcement earlier this month about Databricks SQL’s record-setting performance and marks a major milestone in our quest to support open standards. This blog post discusses how this update makes it easier to migrate your...
New Performance Improvements in Databricks SQL
Originally announced at Data + AI Summit 2020 Europe, Databricks SQL lets you operate a multi-cloud lakehouse architecture that provides data warehousing performance at data lake economics. Our vision is to give data analysts a simple yet delightful tool for obtaining and sharing insights from their lakehouse using a purpose-built SQL UI and world-class support...
Simplifying Data and ML Job Construction With a Streamlined UI
Databricks Jobs make it simple to run notebooks, Jars and Python eggs on a schedule. Our customers use Jobs to extract and transform data (ETL), train models and even email reports to their teams. Today, we are happy to announce a streamlined UI for jobs and new features designed to make your life easier. The...
Announcing Support for Google BigQuery in Databricks Runtime 7.1
At Databricks, we are building a unified platform for data and AI. Data in enterprises lives in many locations, and Databricks excels at unifying data wherever it may reside. Today, we are happy to announce support for reading and writing data in Google BigQuery within Databricks Runtime 7.1. Introduction to BigQuery In Google’s own words,...
How Databricks makes distributed sites successful
Credit: Pexels.com Databricks recently announced signing a lease for new office space in Toronto. After Amsterdam, Toronto is our second geographically-distributed engineering site and a major expansion milestone for the company. This is a good time to reflect on how we work hard to make distributed offices successful and make sure employees do their best...
Announcing Databricks Runtime 5.5 with Conda (Beta)
Databricks is pleased to announce the release of Databricks Runtime 5.5 with Conda (Beta). We introduced Databricks Runtime 5.4 with Conda (Beta), with the goal of making Python library and environment management very easy. This release includes several important improvements and bug fixes as noted in the latest release notes [Azure|AWS]. We recommend all users...
Announcing Databricks Runtime 5.5 and Runtime 5.5 for Machine Learning
Databricks is pleased to announce the release of Databricks Runtime 5.5. This release includes Apache Spark 2.4.3 along with several important improvements and bug fixes as noted in the latest release notes [Azure|AWS]. We recommend all users upgrade to take advantage of this new runtime release. This blog post gives a brief overview of some...
Making the Move to Amsterdam: Bilal Aslam
While we are proud of our Berkeley roots, Databricks now calls many cities around the world our home. In addition to offices in London, Singapore, New York and our headquarters in San Francisco, we have one of our major engineering hubs in the fast-growing European R&D center, Amsterdam. Databricks offers the exciting opportunity to relocate...
