Sponsored by: Oracle | Deploying DBRX on OCI with NVIDIA NIM leveraging Delta Sharing

The deployment of Large Language Models like DBRX can run on Oracle Cloud Infrastructure (OCI) with NVIDIA NIM represents an advancement in artificial intelligence applications. This session covers the DBRX deployment and and sharing data with the Delta Sharing protocol to achieve data collaboration and AI outcomes.. By leveraging OCI's robust and secure cloud platform alongside NVIDIA's cutting-edge AI capabilities, we’ll show how DBRX is empowered to deliver high-performance, real-time inference services tailored for generative AI applications. The deployment framework showcases how OCI's flexible infrastructure, combined with NVIDIA's GPUs and optimized inference microservices, efficiently handles large-scale data, accelerating research and innovation.