Databricks and University of Rochester
At Databricks, we strongly believe (“know” you could say) that data and AI are mission-critical for solving the biggest problems our world faces. From healthcare to sustainability to transportation, data is a key to understanding and analyzing these issues at the deepest level – often in real time – and in turn shapes effective solutions....
Efficiently Building ML Models for Predictive Maintenance in the Oil and Gas Industry With Databricks
Guest authored post by Halliburton’s Varun Tyagi, Data Scientist, and Daili Zhang, Principal Data Scientist, as part of the Databricks Guest Blog Program Halliburton is an oil field services company with a 100-year-long proven track record of best-in-class oilfield offerings. With operations in over 70 countries, Halliburton provides services related to exploration, development and production...
Data + AI Summit Is Back
Data + AI Summit, the global event for the data community, returns May 24-28. We are thrilled to announce that registration for this free virtual event is now open! The future is open Data and AI are rapidly opening up new possibilities and solving stubborn problems. Unifying data opens up collaboration and solutions that were...
Introducing Delta Time Travel for Future Data Sets
We are thrilled to introduce enhanced time travel capabilities in Databricks Delta, the next-gen unified analytics engine built on top of Apache Spark, for all of our users. With this new feature, Delta can automatically extrapolate big datasets stored in your data lake, enabling access to any future version of your data today. This temporal...
Top Questions from Customers About Data Management
Last week, we hosted a virtual event highlighting Delta Lake, an open source storage layer that brings reliability, performance and security to your data lake. We had amazing engagement from the audience, with almost 200 thoughtful questions submitted! While we can’t answer all in this blog, we thought we should share answers to some of...
Databricks Notebook Dark Theme
This became the most-requested feature in Databricks’ history, and now it’s here: a dark theme for the Databricks notebook! We’re excited for you to try it out. To turn it on, open a notebook and navigate to the View menu > Notebook Theme > Dark Theme. Enjoy!
Creating Growth and Advancement Opportunities: Introducing the Women in Tech Mentorship Program
At Databricks, we recognize the importance of offering professional growth and advancement opportunities for all communities and are committed to fostering a work environment where every employee can contribute the best work of their careers. This week, we’re wrapping up our celebration of Women’s History Month. In alignment with our commitment to employee growth, we...
It’s Time to Re-evaluate Your Relationship With Hadoop
With companies forced to adapt to a remote, distributed workforce this past year, cloud adoption has accelerated at an unprecedented pace by +14% resulting in 2% or $13B above pre-pandemic forecasts for 2020 - with possibly more than $600B in on-prem to cloud migrations within the next few years. This shift to the cloud places...
Simplifying Data and ML Job Construction With a Streamlined UI
Databricks Jobs make it simple to run notebooks, Jars and Python eggs on a schedule. Our customers use Jobs to extract and transform data (ETL), train models and even email reports to their teams. Today, we are happy to announce a streamlined UI for jobs and new features designed to make your life easier. The...
Introducing Databricks on Google Cloud – Now in Public Preview
Last month, we announced Databricks on Google Cloud, a jointly-developed service that allows data teams (data engineering, data science, analytics, and ML professionals) to store data in a simple, open lakehouse platform for all data, AI and analytics workloads. Today, we are launching the public preview of Databricks on Google Cloud. When speaking to our...