Get Your Free Copy of Delta Lake: The Definitive Guide (Early Release)
At the Data + AI Summit, we were thrilled to announce the early release of Delta Lake: The Definitive Guide, published by O’Reilly. The guide teaches how to build a modern lakehouse architecture that combines the performance, reliability and data integrity of a warehouse with the flexibility, scale and support for unstructured data available in...
How Databricks Supports Digital Native Companies in Their Hyper-growth Journey
In a recent panel discussion, Richard Zananiri, Director of EMEA Mid-market at Databricks, was joined by four globally operating, high-growth cloud-native companies. Each organization is at the forefront of utilizing the power of data, ML and AI to solve business-critical issues within their respective sectors. The company representatives were asked to explain how they are...
The Modern Chief Data Officer: Transitioning From Defense to Offense
The Chief Data Officer (CDO) is not a new position – Capital One reportedly had a CDO all the way back in 2002. But only recently has it become a mainstream, business-critical role for enterprises. In a recent study by NewVantage Partners, 65% of surveyed companies have a CDO position within their organization. And as...
Announcing Photon Public Preview: The Next Generation Query Engine on the Databricks Lakehouse Platform
Today, we're excited to announce the availability of Photon in public preview. Photon is a native vectorized engine developed in C++ to dramatically improve query performance. All you have to do to benefit from Photon is turn it on. Photon will seamlessly coordinate work and resources and transparently accelerate portions of your SQL and Spark...
Solution Accelerator: Toxicity Detection in Gaming
Across massively multiplayer online video games (MMOs), multiplayer online battle arena games (MOBAs) and other forms of online gaming, players continuously interact in real time to either coordinate or compete as they move toward a common goal -- winning. This interactivity is integral to game play dynamics, but at the same time, it’s a prime...
How to Build a Scalable Wide and Deep Product Recommender
Download the notebooks referenced throughout this article. I have a favorite coffee shop I’ve been visiting for years. When I walk in, the barista knows me by name and asks if I’d like my usual drink. Most of the time, the answer is “yes”, but every now and then, I see they have some seasonal...
How to Simplify CDC With Delta Lake’s Change Data Feed
Try this notebook in Databricks Change data capture (CDC) is a use case that we see many customers implement in Databricks – you can check out our previous deep dive on the topic here. Typically we see CDC used in an ingestion to analytics architecture called the medallion architecture. The medallion architecture that takes...
Women in Product at Databricks
Databricks was a proud sponsor of the 2021 Women In Product Conference, which this year, had a theme of igniting possibility. We interviewed a few of the women on our product team – designers, program managers and product managers – all of whom play an integral role in Databricks’ success. We had the opportunity to...
Don’t Miss These Top 10 Announcements From Data + AI Summit
The 2021 Data + AI Summit was filled with so many exciting announcements for open source and Databricks, talks from top-tier creators across the industry (such as Rajat Monga, co-creator of TensorFlow) and guest luminaries like Bill Nye, Malala Yousafzai and the NASA Mars Rover team. You can watch the keynotes, meetups and hundreds of...
Celebrating Asian American Pacific Islander Heritage Month
We joined Databricks in early October of 2020, in the middle of the pandemic with no clear end in sight. Our remote onboarding began with a few emails, some icebreaker slides, Kahoots and the ubiquitous Zoom session. Our cohort was a diverse group consisting of new hires from at least four different departments in the...
