Data Science and ML | Databricks Blog

Page 1

Providence Health: Scaling ML/AI Projects with Databricks Mosaic AI

November 14, 2024 by Susan McNerney (Providence Health) and Dan McCurley in AI

Providence Health's extensive network spans 50+ hospitals and numerous other facilities across multiple states, presenting many challenges in predicting patient volume and daily...

Logically: Turbocharging GPU Inference with Databricks Mosaic AI

October 22, 2024 by David Fodor (Logically AI), Neeraj Bhadani (Logically AI), Marc de Fontenay and Maria Zervou in Generative AI

Founded in 2017, Logically is a leader in using AI to augment clients’ intelligence capability. By processing and analyzing vast amounts of data...

Build Compound AI Systems Faster with Databricks Mosaic AI

October 1, 2024 by Ahmed Bilal, Kasey Uhlenhuth, Siddharth Murching, Akhil Gupta and Eric Peter in Generative AI

Many of our customers are shifting from monolithic prompts with general-purpose models to specialized compound AI systems to achieve the quality needed for...

From Generalists to Specialists: The Evolution of AI Systems toward Compound AI

October 1, 2024 by Yared Gudeta in Generative AI

The buzz around compound AI systems is real, and for good reason. Compound AI systems combine the best parts of multiple AI models...

ICE/NYSE: Unlocking Financial Insights with a Custom Text-to-SQL Application

October 1, 2024 by Li Yu, Chengyin Eng, Suresh Koppisetti (NYSE/ICE), Meenakshi Venkatasubramanian (NYSE/ICE) and Lavanya Mallapragada (NYSE/ICE) in Generative AI

Introduction Retrieval-augmented generation (RAG) has revolutionized how enterprises harness their unstructured knowledge base using Large Language Models (LLMs), and its potential has far-reaching...

Introducing Meta Llama 3.2 on Databricks: faster language models and powerful multi-modal models

September 25, 2024 by Daniel King, Hanlin Tang and Patrick Wendell in Generative AI

We are excited to partner with Meta to launch the latest models in the Llama 3 series on the Databricks Data Intelligence Platform...

Announcing Databricks Support for Amazon EC2 G6 Instances

September 23, 2024 by Lu Wang (Mosaic AI) in Generative AI

We are excited to announce that Databricks now supports Amazon EC2 G6 instances powered by NVIDIA L4 Tensor Core GPUs. This addition marks...

Integrating Entra ID, Azure DevOps and Databricks for Better Security in CI/CD

September 11, 2024 by Erik Baumert and Nicole Jingting Lu in Engineering Blog

Personal Access Tokens (PATs) are a convenient way to access services like Azure Databricks or Azure DevOps without logging in with your password...

Databricks announces significant improvements to the built-in LLM judges in Agent Evaluation

September 5, 2024 by Max Marion, Arnav Singhvi, Samraj Moorjani, Avesh Singh, Michael Carbin and Alkis Polyzotis in Generative AI

An improved answer-correctness judge in Agent Evaluation Agent Evaluation enables Databricks customers to define, measure, and understand how to improve the quality of...

Training Highly Scalable Deep Recommender Systems on Databricks (Part 1)

September 4, 2024 by Rithwik Ediga Lakhamsani, Asfandyar Qureshi, Karan Jariwala, Lin Yuan, Lu Wang (Mosaic AI), Saaketh Narayan and Ning Wang in Generative AI

Recommender systems (RecSys) have become an integral part of modern digital experiences, powering personalized content suggestions across various platforms. These sophisticated systems and...