Introducing Getting Started with Apache Spark on Databricks
We are proud to introduce the Getting Started with Apache Spark on Databricks Guide. This step-by-step guide illustrates how to leverage the Databricks’ platform to work with Apache Spark. Our just-in-time data platform simplifies common challenges when working with Spark: data integration, real-time experimentation, and robust deployment of production applications. Databricks provides a simple, just-in-time...
Apache Spark Key Terms, Explained
As observed in the Fortune article Survey shows huge popularity spike for Apache Spark: "Apache Spark is the Taylor Swift of big data software. The open source technology has been around and popular for a few years. But 2015 was the year Spark went from an ascendant technology to a bona fide superstar." One of...
Another Record-Setting Spark Summit
The lure of San Francisco is indisputable as is its position as the preeminent high-tech hub. On day one of Spark Summit 2016, the largest community event dedicated to Apache Spark, drew more than 2500+ Spark enthusiasts from 720+ companies. Such a draw is a strong testament to Apache Spark’s open source roots, its fast-growing...
Genome Sequencing in a Nutshell
This is a guest post from Deborah Siegel from the Northwest Genome Center and the University of Washington with Denny Lee from Databricks on their collaboration on genome variant analysis with ADAM and Spark. This is part 1 of the 3 part series Genome Variant Analysis using K-Means, ADAM, and Apache Spark: 1. Genome Sequencing in...
Parallelizing Genome Variant Analysis
This is a guest post from Deborah Siegel from the Northwest Genome Center and the University of Washington with Denny Lee from Databricks on their collaboration on genome variant analysis with ADAM and Spark. This is part 2 of the 3 part series Genome Variant Analysis using K-Means, ADAM, and Apache Spark: 1. Genome Sequencing in...
Predicting Geographic Population using Genome Variants and K-Means
This is a guest post from Deborah Siegel from the Northwest Genome Center and the University of Washington with Denny Lee from Databricks on their collaboration on genome variant analysis with ADAM and Spark. This is part 3 of the 3 part series Genome Variant Analysis using K-Means, ADAM, and Apache Spark: 1. Genome Sequencing in...
On-Time Flight Performance with GraphFrames for Apache Spark
Introduction Graph structures are a more intuitive approach to many classes of data problems. Whether traversing social networks, restaurant recommendations, or flight paths, it is easier to understand these data problems within the context of graph structures: vertices, edges, and properties. For example, the analysis of flight data is a classic graph problem as airports...
Findify’s Smart Search Gets Smarter with Apache Spark MLlib and Databricks
Spark Summit East is just around the corner! If you haven’t registered yet, you can get tickets here with this promo code for 20% off: Databricks20 We are happy to announce that Findify has deployed Databricks as its machine learning and analytics platform, achieving faster time to complete projects, more efficient operations, and improved collaboration. You can...
An Illustrated Guide to Advertising Analytics
To learn the latest developments in Apache Spark, register today to join the Spark community at Spark Summit in New York City! This is a joint blog with our friend at Celtra. Grega Kešpret is the Director of Engineering. He leads a team of engineers and data scientists to build analytics pipeline and optimization systems...
Spark Summit East 2016 Agenda is now available
This February, join the Apache Spark community in New York City at the New York Midtown Hilton for the second annual Spark Summit East on February 16th-18th! We are happy to announce that the community talks agenda has been finalized and you can find the full list of 60 community talks available at the Spark...
