While nearly 80% of the world’s data is in video format, enabling search and understanding on video data has historically been a challenging, manual and time-consuming endeavor. The team at Twelve Labs set out to change that by developing multimodal foundational models focused on video — and by building a powerful platform around these advanced models to enable enterprises to extract value from their vast archives of video content. During that process, the Twelve Labs team partnered with MosaicML and Databricks to create their industry-leading models and add video intelligence to the Databricks Data Intelligence Platform.
Today, we’re excited to announce that Databricks Ventures has invested in Twelve Labs. This investment deepens our longstanding partnership with Twelve Labs and opens the door for additional integration points between Databricks and Twelve Labs to help unlock the context contained within video data for a broader set of customers.
Twelve Labs has been at the forefront of solving one of the most complex challenges in AI today: video reasoning. Combining deep research with real-world customer feedback, Twelve Labs has developed a suite of proprietary models that generate powerful video embeddings that capture the intricate relationships between visual expressions, body language, spoken words, and overall context within videos. With Twelve Labs, enterprises are now able to effortlessly search and monetize extensive video libraries, extract insights, and repurpose content at scale.
Twelve Labs’ unique research-driven, video-first approach has allowed the company to land an impressive array of enterprise customers across a breadth of video-intensive industries including sports, media and entertainment, advertising and more. Our customers in these industries have increasingly been asking Databricks to extend the analytical capabilities of the Databricks Data Intelligence Platform into video data, so finding ways to work more closely with Twelve Labs, the leader in video understanding, was a natural move.
Recently, we announced an integration between Twelve Labs and Databricks Mosaic AI that reduces development time and resource needs for advanced video applications. By leveraging multimodal embeddings and efficient Vector Search capabilities provided by Databricks Mosaic AI Vector Search, our integration enables developers to construct sophisticated video search, recommendation, and analysis systems.
In the future, we anticipate working with Twelve Labs to deepen our technology integrations, such as by enabling access to Twelve Labs’ video models natively within the Mosaic AI Model Serving solution. This would allow our joint customers to much more seamlessly power advanced video understanding use cases — from searching vast amounts of video content using natural language, to indexing and analyzing video clips and scenes based on text or images — allowing easier incorporation of video understanding into existing Databricks data pipelines and machine learning workflows. As video content continues to proliferate across industries, from media and entertainment to e-commerce and security, the ability to efficiently analyze and extract value from video data will become increasingly crucial.
We’re thrilled to be working even more closely with the Twelve Labs team. Stay tuned for news on future collaboration.
