This virtual event will take you from strategic keynotes to help you unlock the power of your data in the cloud right through to hands-on labs and workshops to enable and advance data teams and practitioners. Discover more about Lakehouse vision and how Delta Lake delivers reliability, security and performance to data lakes. Hear from high growth cloud-native companies on the challenges of reaching scale. Join workshops and hands-on labs.
In this workshop, we’ll discuss how organizations that successfully modernize their claims lifecycle with data and AI will be set up to process claims quicker and provide more value to the business.
Join us for the third in a four part series with Salesforce Engineering. Abstract: One of the great features provided by Delta Lake is ACID Transactions (https://docs.databricks.com/delta/index.html). This feature is critical to maintain data integrity when multiple independent write streams are modifying the same delta table. Running this in the real world, we observe frequent Conflicting Commits (https://docs.delta.io/latest/concurrency-control.html#id4) errors which fail our pipeline. We realize that, while ACID Transactions maintain data integrity, there is no mechanism to resolve writing conflicts. In this talk, we share a solution to ensure global synchronization and ordering of multiple process streams that perform concurrent writes to the shared Delta Lake. With this mechanism, we greatly improved our pipeline stability by eliminating Conflicting Commits errors and maintaining data integrity Part 1: Engagement Activity Delta Lake Recording: https://youtu.be/a7_I1Qi1LoU Part 2: Boost Delta Lake Performance with Data Skipping and Z-Order - https://www.meetup.com/data-ai-online/events/276974926/
In this interactive virtual workshop, the Databricks Media and Entertainment Technical Director will walk through the different Databricks solution accelerators we have developed for every stage of the customer journey — from acquisition to engagement, retention and beyond.
On April 21 and 22 2021, more than 2,000 experts and decision-makers will discuss new trends and exciting challenges around #BigData and #AI at the Big-Data.AI-Summit 2021. Meet the Databricks team in the virtual expo area or join the presentation "Data Mesh in Practice: how to set up a data-driven organization" by Zalando on April 21, 4:10-4:30 pm CEST, Hari Seldon Stage
Run by Databricks and Spark experts, this online session is designed to help data engineers, SQL analysts, and BI professionals come away with a deeper understanding of the fundamentals of Databricks’ lakehouse architecture, which combines the best elements of data lakes and data warehouses.
Join us for virtual tech talks at Data + AI Meetup about MLflow Integration from Azure ML and Algorithma sponsored by the Databricks MLflow Team. It will be simultaneously broadcasted live on YouTube and LinkedIn.
In this live workshop, we’ll discuss how to get started with Databricks on Google Cloud to build an open data lake for all your data, analytics and AI. Learn how to build a curated data lake that is reliable, highly scalable and performant for all big data engineering, streaming, data science and machine learning, SQL Analytics, BI and reporting workloads.
Run by Databricks and Spark experts, this online session is designed to help data scientists and machine learning engineers explore their data, build and productionise models, and share their analyses using the Databricks Lakehouse platform. You will get a deeper understanding of the fundamentals of how Databricks’ collaborative environment allows data teams to run all analytics processes in one place, and manage ML models across the full life cycle with MLflow.
The potential of data and AI is extraordinary. But how can practitioners apply it to tangible, real-use cases? Data and AI can address multiple challenges. For example, in digital marketing, personalising the user experience is becoming a critical success factor. Personalisation requires data in large quantities, and in the appropriate format and quality. However, exploiting the available information presents a significant challenge for most companies. Smart Digital utilises Databricks for the automated processing of big data, and as the basis for AI-driven, individualised user experiences in real-time.