Streaming Windows Event Logs into the Cybersecurity Lakehouse
Streaming windows events into the Cybersecurity Lakehouse Enterprise customers often ask, what is the easiest and simplest way to send Windows endpoint logs…
Data Engineering
Speed Up Streaming Queries With Asynchronous State Checkpointing
Background / Motivation Stateful streaming is becoming more prevalent as stakeholders make increasingly sophisticated demands on greater volumes of data. The tradeoff, however,…
Build Data and ML Pipelines More Easily With Databricks and Apache Airflow
We are excited to announce a series of enhancements in Apache Airflow’s support for Databricks. These new features make it easy to build…
Implementing the GDPR ‘Right to be Forgotten’ in Delta Lake
Databricks’ Lakehouse platform empowers organizations to build scalable and resilient data platforms that allow them to drive value from their data. As the…
Structured Streaming: A Year in Review
As we enter 2022, we want to take a moment to reflect on the great strides made on the streaming front in Databricks…
Building a Geospatial Lakehouse, Part 1
An open secret of geospatial data is that it contains priceless information on behavior, mobility, business activities, natural resources, points of interest and…
Ray on Databricks
Ray is an open-source project first developed at RISELab that makes it simple to scale any compute-intensive Python workload. With a rich set…
10 Powerful Features to Simplify Semi-structured Data Management in the Databricks Lakehouse
Hassle Free Data IngestionDiscover how Databricks simplifies semi-structured data ingestion into Delta Lake with detailed use cases, a demo, and live Q&A. WATCH…
GPU-accelerated Sentiment Analysis Using Pytorch and Huggingface on Databricks
Sentiment analysis is commonly used to analyze the sentiment present within a body of text, which could range from a review, an email…
Introducing Apache Spark™ 3.2
We are excited to announce the availability of Apache Spark™ 3.2 on Databricks as part of Databricks Runtime 10.0. We want to thank…
