Announcing Single-Node Clusters on Databricks
Databricks is used by data teams to solve the world's toughest problems. This can involve running large-scale data processing jobs to extract, transform, and analyze data. However, it often also involves data analysis, data science, and machine learning at the scale of a single machine, for instance using libraries like scikit-learn. To streamline these single...
Announcing Summit Keynotes: Malcolm Gladwell, Dr. Kira Radinsky, Jeremy Singer-Vine
In less than a month, we kick off the inaugural Data + AI Summit Europe, with free general admission and expanding upon the Spark + AI Summit to cover all things data -- analytics, science, engineering and AI. We have an amazing lineup of speakers and training courses, covering the latest in SQL on data...
Building the Latinx Network and Celebrating Our Heritage
Virtual performance from Mariachi Sol Mixteco during the Cafe con Leche event This past spring, we launched our Latinx Network Employee Resource Group with a lot of excitement. We co-founded this group to foster a comunidad (community) that supports, learns and grows together. We love the diversity of our culture and want to embrace it...
Azure Databricks in Public Preview for the Azure China Region
We are excited to announce that Azure Databricks is now available in public preview for Microsoft’s Azure China region, enabling new data and AI use cases with fast, reliable and scalable data processing, analytics, data science and machine learning on the cloud. With availability across more than 30 Azure regions, global organizations appreciate the consistency,...
Using MLOps with MLflow and Azure
The blog contains code examples in Azure Databricks, Azure DevOps and plain Python. Please note that much of the code depends on being inside an Azure environment and will not work in the Databricks Community Edition or in AWS-based Databricks. Most organizations today have a defined process to promote code (e.g. Java or Python) from...
Integrating large-scale Genomic Variation and Annotation Data with Glow
Genomic annotations augment variant data by providing context for each change in the genome. For example, annotations help answer questions like does this mutation cause a change in the protein-coding sequence of a gene? If so, how does it change the protein? Or is the mutation in a low information part of the genome, also...
Analyzing Algorand Blockchain Data with Databricks Delta
Algorand is a public, decentralized blockchain system that uses a proof of stake consensus protocol. It is fast and energy-efficient, with a transaction commit time under 5 seconds and throughput of one thousand transactions per second. The Algorand system is composed of a network of distributed nodes that work collaboratively to process transactions and add...
Flipp Presents Their Lakehouse Architecture with Delta Lake at Tableau Conference
Databricks at the Tableau Conference 2020 Our session Our page The Tableau Conference 2020 begins tomorrow, with our session Databricks: Data Science & Analytics for Data Lakes at 1:30 PM PDT. In this session, Ameya Malondkar and Yana Yang from Flipp, a joint customer using Dataricks and Tableau together, will present how they enable all...
Measuring Advertising Effectiveness with Sales Forecasting and Attribution
Click below to download the notebooks for this solution accelerator: Campaign Effectiveness -- ETL Campaign Effectiveness -- Machine Learning How do you connect the impact of marketing and your ad spend toward driving sales? As the advertising landscape continues to evolve, advertisers are finding it increasingly challenging to efficiently pinpoint the impact of various revenue-generating...
Detecting Criminals and Nation States through DNS Analytics
You are a security practitioner, a data scientist or a security data engineer; you’ve seen the Large Scale Threat Detection and Response talk with Databricks . But you're wondering, “how can I try Databricks in my own security operations?” In this blog post, you will learn how to detect a remote access trojan using passive...
