Skip to main content
Page 1
Engineering blog

Using MLflow AI Gateway and Llama 2 to Build Generative AI Apps

To build customer support bots, internal knowledge graphs, or Q&A systems, customers often use Retrieval Augmented Generation (RAG) applications which leverage pre-trained models...
Platform blog

Building your Generative AI apps with Meta's Llama 2 and Databricks

Today, Meta released their latest state-of-the-art large language model (LLM) Llama 2 to open source for commercial use 1 . This is a...
Engineering blog

Introducing English as the New Programming Language for Apache Spark

Introduction We are thrilled to unveil the English SDK for Apache Spark, a transformative tool designed to enrich your Spark experience. Apache Spark™...
Platform blog

Lakehouse AI: A Data-Centric Approach to Building Generative AI Applications

Generative AI will have a transformative impact on every business. Databricks has been pioneering AI innovations for a decade, actively collaborating with thousands...
Engineering blog

Databricks ❤️ Hugging Face

Generative AI has been taking the world by storm. As the data and AI company, we have been on this journey with the...
Company blog

Hello Dolly: Democratizing the magic of ChatGPT with open models

Update Apr 12, 2023: We have released Dolly 2.0, licensed for both research and commercial use. See the new blog post here...
Engineering blog

Announcing Ray support on Databricks and Apache Spark Clusters

Ray is a prominent compute framework for running scalable AI and Python workloads, offering a variety of distributed machine learning tools, large-scale hyperparameter...
Platform blog

Announcing Availability of MLflow 2.0

MLflow , with over 13 million monthly downloads, has become the standard platform for end-to-end MLOps, enabling teams of all sizes to track...
Engineering blog

Introducing MLflow Pipelines with MLflow 2.0

Since we launched MLflow in 2018, MLflow has become the most popular MLOps framework, with over 11M monthly downloads! Today, teams of all...
Engineering blog

Automate Your Data and ML Workflows With GitHub Actions for Databricks

As demand for data and machine learning (ML) applications grows, businesses are adopting continuous integration and deployment practices to ensure they can deploy...
Platform blog

Supercharge Your Machine Learning Projects With Databricks AutoML — Now Generally Available!

Machine Learning (ML) is at the heart of innovation across industries, creating new opportunities to add value and reduce cost. At the same...
Engineering blog

New Features in MLlib in Apache Spark 1.0

July 16, 2014 by Xiangrui Meng in Engineering Blog
MLlib is an Apache Spark component focusing on machine learning. It became a standard component of Spark in version 0.8 (Sep 2013). The...