Introducing Structured Outputs for Batch and Agent Workflows
Many AI use cases now depend on transforming unstructured inputs into structured data. Developers are increasingly relying on LLMs to extract structured data...
Securing the Future: How AI Gateways Protect AI Agent Systems in the Era of Generative AI
The Future: From Rules Engines to Instruction-Following AI Agent Systems In sectors such as banking and insurance, rules engines have long played a...
AI Agent Systems: Modular Engineering for Reliable Enterprise AI Applications
Monolithic to Modular The proof of concept (POC) of any new technology often starts with large, monolithic units that are difficult to characterize...
Aimpoint Digital: Leveraging Delta Sharing for Secure and Efficient Multi-Region Model Serving in Databricks
When serving machine learning models, the latency between requesting a prediction and receiving a response is one of the most critical metrics for...
Introducing Simple, Fast, and Scalable Batch LLM Inference on Mosaic AI Model Serving
Over the years, organizations have amassed a vast amount of unstructured text data—documents, reports, and emails—but extracting meaningful insights has remained a challenge...
Pentavere: Powering Healthcare Data Insights with Databricks Mosaic AI
In industries like finance and retail, vast data is leveraged to generate billions in profits. Yet, in healthcare, the struggle to access critical...
From Generalists to Specialists: The Evolution of AI Systems toward Compound AI
The buzz around compound AI systems is real, and for good reason. Compound AI systems combine the best parts of multiple AI models...
Announcing Databricks Support for Amazon EC2 G6 Instances
We are excited to announce that Databricks now supports Amazon EC2 G6 instances powered by NVIDIA L4 Tensor Core GPUs. This addition marks...
Fine-tuning Llama 3.1 with Long Sequences
We are excited to announce that Mosaic AI Model Training now supports the full context length of 131K tokens when fine-tuning the Meta...
Announcing Advanced Security and Governance in Mosaic AI Gateway
We are excited to introduce several powerful new capabilities to Mosaic AI Gateway, designed to help our customers accelerate their AI initiatives with...