Hunting for IOCs Without Knowing Table Names or Field Labels
There is a breach! You are an infosec incident responder and you get called in to investigate. You show up and start asking...
Using Spark Structured Streaming to Scale Your Analytics
This is a guest post from the M Science Data Science & Engineering Team. Modern data doesn't stop growing "Engineers are taught by...
Introducing Spark Connect - The Power of Apache Spark, Everywhere
At last week's Data and AI Summit, we highlighted a new project called Spark Connect in the opening keynote. This blog post walks...
Designing a Java Connector for Delta Sharing Recipient
Making an open data marketplace Stepping into this brave new digital world we are certain that data will be a central product for...
Introducing MLflow Pipelines with MLflow 2.0
Since we launched MLflow in 2018, MLflow has become the most popular MLOps framework, with over 11M monthly downloads! Today, teams of all...
Connect From Anywhere to Databricks SQL
Today we are thrilled to announce a full lineup of open source connectors for Go , Node.js , Python , as well as...
Project Lightspeed: Faster and Simpler Stream Processing With Apache Spark
Streaming data is a critical area of computing today. It is the basis for making quick decisions on the enormous amounts of incoming...
Databricks SQL Serverless Now Available on AWS
Databricks SQL Serverless is now generally available. Read our blog to learn more. We are excited to announce the availability of serverless compute...
Data Warehousing Modeling Techniques and Their Implementation on the Databricks Lakehouse Platform
The lakehouse is a new data platform paradigm that combines the best features of data lakes and data warehouses. It is designed as...
Prescriptive Guidance for Implementing a Data Vault Model on the Databricks Lakehouse Platform
There are many different data models that you can use when designing an analytical system, such as industry-specific domain models, Kimball, Inmon, and...