AI | Databricks Blog

Page 2

Training Highly Scalable Deep Recommender Systems on Databricks (Part 1)

September 4, 2024 by Rithwik Ediga Lakhamsani, Asfandyar Qureshi, Karan Jariwala, Lin Yuan, Lu Wang (Mosaic AI), Saaketh Narayan and Ning Wang in Generative AI

Recommender systems (RecSys) have become an integral part of modern digital experiences, powering personalized content suggestions across various platforms. These sophisticated systems and...

Mastering Multimodal AI for Advanced Video Understanding with Twelve Labs + Databricks Mosaic AI

August 29, 2024 by James Le (Twelve Labs), Nina Williams, Austin Zaccor and Fernanda Heredia in Generative AI

Twelve Labs Embed API enables developers to get multimodal embeddings that power advanced video understanding use cases, from semantic video search and data...

Announcing Hybrid Search General Availability in Mosaic AI Vector Search

August 26, 2024 by Sergei Tsarev and Erik Lindgren in Generative AI

We're excited to announce the general availability of hybrid search in Mosaic AI Vector Search. Hybrid search is a powerful feature that combines...

Unlock Faster Machine Learning with Graviton

August 15, 2024 by Ying Chen, Lu Wang (Mosaic AI) and Lin Yuan in Generative AI

We are excited to announce that Graviton , the ARM-based CPU instance offered by AWS, is now supported on the Databricks ML Runtime...

Announcing the Generative AI World Cup: A Global Hackathon by Databricks

August 13, 2024 by Jackie Zhang, Kristen Staffieri, June Tan and Lynda Aboub in Generative AI

Welcome to the Generative AI World Cup , a global hackathon inviting participants to develop innovative Generative AI applications that solve real-world problems...

Harnessing the Power of Databricks Mosaic AI for Image Generation at Rolls-Royce

August 8, 2024 by Jack Kelleher, Marjorie Adriaenssens, Puneet Jain, Marco Nunez (Rolls-Royce), Nima Ameri (Rolls-Royce), Shiva Babu (Rolls-Royce), Siddharth Ravichandran (Rolls-Royce) and Yashwant Gurbani (Rolls-Royce) in Generative AI

Rolls-Royce has witnessed the transformative power of the Databricks Data Intelligence Platform in various AI projects. One example is a collaboration between Rolls-Royce...

Accelerate Feature Engineering With Photon

August 2, 2024 by Ying Chen and Xiao Zhu in Generative AI

Training a high-quality machine learning model requires careful data and feature preparation. To fully utilize raw data stored as tables in Databricks, running...

Enhancing LLM-as-a-Judge with Grading Notes

July 22, 2024 by Yi Liu, Matei Zaharia and Ritendra Datta in Generative AI

Evaluating long-form LLM outputs quickly and accurately is critical for rapid AI development. As a result, many developers wish to deploy LLM-as-judge methods...

Patronus AI x Databricks: Training Models for Hallucination Detection

July 12, 2024 by Rebecca Qian (PatronusAI), Connor Jennings, Sunitha Ravi (PatronusAI) and Brandon Cui in Generative AI

Hallucinations in large language models (LLMs) occur when models produce responses that do not align with factual reality or the provided context. This...

Santalucía Seguros: Enterprise-level RAG for Enhanced Customer Service and Agent Productivity

June 21, 2024 by Eduardo Fernández Carrión (Santalucía Seguros), Manuel Valero Méndez (Santalucía Seguros) and Luis Herrera in Generative AI

In the insurance sector, customers demand personalized, fast, and efficient service that addresses their needs. Meanwhile, insurance agents must access a large amount...