Machine Learning, Alternative Data, Delta Lake and More: My Picks for Data + AI Summit 2021
The Data + AI Summit has become an essential conference for analysts, data scientists, developers, data engineers and data teams across the globe. Once again, I’ve had the pleasure of collaborating with Jules Damji and Jen Aman to put together the agenda for the conference. Built for the data community, Data + AI Summit offers...
Data + AI Summit Europe Goes Virtual With a Data-Centric Agenda
Technical conferences evolve over time. They expand beyond their initial focus, adding new technologies, attracting new attendees and broadening their range of sessions and speakers. Formerly known as Spark + AI Summit Europe, the new Data + AI Summit Europe has embraced a data-centric approach — focusing on Apache Spark, MLflow and Delta Lake use...
MLOps takes center stage at Spark + AI Summit
As companies ramp up machine learning, the growth in the number of models they have under development begins to impact their set of tools, processes and infrastructure. Machine learning involves data and data pipelines, model training and tuning (i.e., experiments), governance, and specialized tools for deployment, monitoring and observability. About three years ago, we started...
Spark + AI Summit Is Going Virtual with an Expanded Agenda
Over the years, technical conferences tend to expand beyond their initial focus, adding new technologies, types of attendees, and a broader range of sessions and speakers. From its original focus on Apache Spark™, the Spark + AI Summit has extended its scope to include not only data engineering and infrastructure, but also machine learning automation...
What Is a Lakehouse?
Over the past few years at Databricks, we've seen a new data management architecture that emerged independently across many customers and use cases: the lakehouse. In this post we describe this new architecture and its advantages over previous approaches. Data warehouses have a long history in decision support and business intelligence applications. Since its inception...
