Notebook Workflows: The Easiest Way to Implement Apache Spark Pipelines
[glossary_parse]Today we are excited to announce Notebook Workflows in Databricks. Notebook Workflows is a set of APIs that allow users to chain notebooks...
On-demand webinar available: Databricks’ Data Pipeline
Two weeks ago we held a live webinar – Databricks' Data Pipeline: Journey and Lessons Learned – to show how Databricks used Apache...
How to use SparkSession in Apache Spark 2.0
Generally, a session is an interaction between two or more entities. In computer parlance, its usage is prominent in the realm of networked...
The Quest for Hidden Treasure: An Apache Spark Connector for the Riak NoSQL database
View this notebook in Databricks This is a guest blog from our friends at Basho. Pavel Hardak is a director of product management...
Databricks Bi-Weekly Digest: 8/8/16
Continuing with our bi-weekly digest series, here’s our recap of what’s transpired over the last two weeks with Apache Spark since our previous...
Agenda Announced for #SparkSummit Europe 2016 in Brussels
Brussels, the de facto capital of the European Union, has its draw not only to politicians and tourists but technologists and entrepreneurs. So...
Developing Apache Spark Applications in .NET using Mobius
To address the gap between Spark and .NET, Microsoft created Mobius, an open source project, with guidance from Databricks. By adding the C#...
Spark Structured Streaming
Apache Spark 2.0 adds the first version of a new higher-level API, Structured Streaming, for building continuous applications . The main goal is...
Continuous Applications: Evolving Streaming in Apache Spark 2.0
Since its release, Spark Streaming has become one of the most widely used distributed streaming engines, thanks to its high-level API and exactly-once...
Introducing Apache Spark 2.0
Today, we're excited to announce the general availability of Apache Spark 2.0 on Databricks. This release builds on what the community has learned...