How Informatica Data Engineering Goes Hadoop-less with Databricks
Back in May, we announced our partnership with Informatica to build out a rich set of integrations between our two platforms. It’s been exciting work for the team because of what we can do for joint customers that combine our Managed Delta Lake with Informatica’s Big Data Management and Enterprise Data Catalog. The vision led...
Guest Blog: Using Databricks, MLflow, and Amazon SageMaker at Brandless to Bring Recommendation Systems to Production
This is a guest blog from Adam Barnhard, Head of Data at Brandless, Inc., and Bing Liang, Data Scientist at Brandless, Inc. Launched in July 2017, Brandless makes hundreds of high-quality items, curated for every member of your family and room of your home, and all sold at more accessible price points than similar products on the market. We...
Using ML and Azure to improve Customer Lifetime Value: On-Demand Webinar and FAQ Now Available!
On July 18th, we hosted a live webinar —Using ML and Azure to improve customer lifetime value - with Rob Saker, Industry Leader - Retail Industry, Colby Ford, Associate Faulty - School of Data Science, UNC Charlotte and Navin Albert, Solutions Marketing Manager at Databricks. This blog has a recording of the webinar and some of...
Migrating Transactional Data to a Delta Lake using AWS DMS
Note: We also recommend you read Efficient Upserts into Data Lakes with Databricks Delta which explains the use of MERGE command to do efficient upserts and deletes. Challenges with moving data from databases to data lakes Large enterprises are moving transactional data from scattered data marts in heterogeneous locations to a centralized data lake. Business data...
Databricks is a Diamond Partner at Snowflake Summit
Here at Databricks, we are excited to participate in the first Snowflake Summit as a Diamond Partner. The event takes place June 3-6 at the Hilton San Francisco Union Square and is another great opportunity to share how Databricks and Snowflake have partnered together to provide: Massively scalable data pipelines. Pipelines running on Databricks can...
AWS + Databricks – Developer Day Events
Every enterprise today wants to accelerate innovation by building AI into their business. However, most companies struggle with preparing large datasets for analytics, managing the proliferation of ML frameworks, and moving models in development to production. AWS and Databricks are presenting a series of Dev Day events where we will cover best practices for enterprises...
Databricks and Tableau Lean In to Improve BI User Experience
Since 2014, Tableau and Databricks have partnered to improve the speed and user experience of visualizing massive data sets. This is a natural partnership - Databricks provides a Unified Analytics Platform while Tableau provides a highly popular interactive visualization tool. This year, Tableau won the Databricks Partner Innovation Award for our shared effort in creating...
High-Performance Modern Data Warehousing with Azure Databricks and Azure SQL Data Warehouse
As organizations move to the cloud, the architecture for a Modern Data Warehouse (MDW) allows a new level of performance and scalability. A modern data warehouse enables bringing together data at any scale easily, and to get insights through analytical dashboards, operational reports, or advanced analytics. But what does an MDW look like? The following...
Apparate: Managing Libraries in Databricks with CI/CD
This is a guest blog from Hanna Torrence, Data Scientist at ShopRunner. Introduction As leveraging data becomes a more vital component of organizations' tech stacks, it becomes increasingly important for data teams to make use of software engineering best-practices. The Databricks platform provides excellent tools for exploratory Apache Spark workflows in notebooks as well as...
MongoDB Atlas: Connector for Apache Spark now Officially Certified for Azure Databricks
This is a guest blog from our partners at MongoDB Bryan Reinero and Dana Groce We are happy to announce that the MongoDB Connector for Apache Spark is now officially certified for Azure Databricks. MongoDB Atlas users can integrate Spark and MongoDB in the cloud for advanced analytics and machine learning workloads by using the...
