Characterizing Datasets and Building Better Models with Continued Pre-Training
While large language models (LLMs) are increasingly adept at solving general tasks, they can often fall short on specific domains that are dissimilar...
Introducing Structured Outputs for Batch and Agent Workflows
Many AI use cases now depend on transforming unstructured inputs into structured data. Developers are increasingly relying on LLMs to extract structured data...
Securing the Future: How AI Gateways Protect AI Agent Systems in the Era of Generative AI
The Future: From Rules Engines to Instruction-Following AI Agent Systems In sectors such as banking and insurance, rules engines have long played a...
AI Agent Systems: Modular Engineering for Reliable Enterprise AI Applications
Monolithic to Modular The proof of concept (POC) of any new technology often starts with large, monolithic units that are difficult to characterize...
Aimpoint Digital: Leveraging Delta Sharing for Secure and Efficient Multi-Region Model Serving in Databricks
When serving machine learning models, the latency between requesting a prediction and receiving a response is one of the most critical metrics for...
Logically: Turbocharging GPU Inference with Databricks Mosaic AI
Founded in 2017, Logically is a leader in using AI to augment clients’ intelligence capability. By processing and analyzing vast amounts of data...
Introducing Simple, Fast, and Scalable Batch LLM Inference on Mosaic AI Model Serving
Over the years, organizations have amassed a vast amount of unstructured text data—documents, reports, and emails—but extracting meaningful insights has remained a challenge...
The Long Context RAG Capabilities of OpenAI o1 and Google Gemini
Retrieval Augmented Generation (RAG) is the top use case for Databricks customers who want to customize AI workflows on their own data. The...
Build Compound AI Systems Faster with Databricks Mosaic AI
Many of our customers are shifting from monolithic prompts with general-purpose models to specialized compound AI systems to achieve the quality needed for...
From Generalists to Specialists: The Evolution of AI Systems toward Compound AI
The buzz around compound AI systems is real, and for good reason. Compound AI systems combine the best parts of multiple AI models...