Databricks and Apache Spark™ 2017 Year in Review
At Databricks we welcome the dawn of the New Year 2018 by reflecting on what we achieved collectively as a company and community...
Women in Big Data, Apache Spark and AI: Bay Area Spark Meetup at Databricks Summary
When Fei-Fei Li , the director of Stanford’s AI Lab and now a chief scientist at Google Cloud, was asked in an interview...
Cloud-based Relational Database Management Systems at Databricks
Databricks and Microsoft have jointly developed a new cloud service called Microsoft Azure Databricks , which makes Apache Spark analytics fast, easy, and...
Spark Summit EU 2017 Recap and Reflections
“Dublin is now a truly cosmopolitan capital, with an influx of people, energy, and ideas infusing the ever-beguiling, multi-layered city with fresh flavors...
Arbitrary Stateful Processing in Apache Spark’s Structured Streaming
This is the seventh post in a multi-part series about how you can perform complex streaming analytics using Apache Spark and Structured Streaming...
Building Complex Data Pipelines with Unified Analytics Platform
Introduction Big data practitioners often post recurring questions on Quora: What is data engineering? How to become a data scientist? What’s a data...
Bay Area Apache Spark Meetup at HPE/Aruba Networks Summary
On September 7th, we held our monthly Bay Area Apache Spark Meetup (BASM) at HPE/Aruba Networks in Santa Clara. We had two Apache...
Learn about Apache Spark APIs and Best Practices
Since Apache Spark 1.3, Spark and its APIs have evolved to make them easier, faster, and smarter. The goal has been to unify...
Bay Area Apache Spark Meetup at Pinterest Summary
On August 22, we held our monthly Bay Area Apache Spark Meetup (BASM) at Pinterest in San Francisco. In all, we had three...
Anthology of Technical Assets on Apache Spark's Structured Streaming
Older anthologies collated a collection of contributions from various authors around a theme—bounded then as a journal or periodical. Newer anthologies, however, include...