Skip to main content

We recently hosted the webinar — CIO Survey: Enterprise Challenges to AI and How to Overcome Them — featuring Jen Garofalo, Research Director at IDG, the parent company to CIO.com, and Pat McDonough, VP of Customer Success at Databricks. This webinar covered key findings from a recent CIO.com survey of 200 executives on the topic of AI adoption and the challenges inhibiting program success.

The survey and report focused on the rapid growth of AI across industries to fuel new and innovative use cases ranging from accelerating drug discovery through genomic medicine to powering intelligent recommendation engines that delight and engage customers.

As Garofalo highlighted in the webinar, the survey showed that  90% of companies are investing in AI-related technologies. In fact, enterprises worldwide are expected to invest $185 billion in big data and analytics, AI, and cognitive solutions by the end of 2019*.

But Garofalo was quick to point out that although AI is the hottest trend in technology, the pace of actual adoption and deployment is a different story. Most notably, she cited that only 1 in 3 AI projects are successful. This means that the greater majority of projects are not being completed on time, are exceeding expected budgets, and are not yielding the expected outcomes.

So what are the major obstacles keeping companies from successfully deploying AI in their business? In short, these are the three challenges highlighted in the webinar:

Key Challenges to AI Success

Challenge #1: Data is the key to success, but difficult to harness

The survey results found that 96% of companies cite data-related challenges with AI projects. These challenges have a direct impact on the amount of complexity in delivering an AI solution to production — with an AI project taking an average of 6 months to complete. Interestingly, more than half of that time is typically spent on data preparation activities.

Challenge #2: Data science and engineering silos, resulting in poor collaboration

Another contributor to AI projects getting stalled is the inherent silos between and among data science and engineering teams. 80% of teams cite collaboration as a challenge with technology skills gaps and project management and oversight as the primary drivers of this divide — resulting in communication breakdowns and friction that slow productivity.

Challenge #3: The explosion of ML frameworks and technologies adds complexity

As AI continues to evolve, the number of frameworks and tools available are increasing at a rapid rate. Garofalo cites that organizations are using an average of 7 different tools across data processing, machine learning, data streaming, and deep learning. This fast-moving technology landscape is adding enormous complexity to the overall process, hindering companies who don’t have the expertise and resources to take advantage of the latest available frameworks and tools.

Best Practices from Industry Leaders

The webinar not only highlighted the drivers and challenges of AI adoption but also offered tips to overcome these challenges. Pat McDonough, VP of Customer Success at Databricks, shared stories and experiences from a number of our customers including Regeneron and Riot Games and the best practices they have employed to help them extract benefits from their work around AI.

Here are some of the key best practices shared by industry-leading companies:

  1. Leverage the cloud to simplify infrastructure, reduce on-prem costs and provide the elastic scale your teams need to meet the demands of modern analytics workflows.
  2. Make data and the output of the data (e.g. models) available to all teams to foster transparency, collaboration and productivity.
  3. Focus on providing the necessary architecture and scaffolding so your teams can leverage the best ML tools and frameworks to drive innovation.

If you would like to learn more about the other best practices, watch the webinar on-demand.

A Unified Approach to Analytics

A final takeaway from the survey results that Garofalo shared was that most companies echoed a common theme: the importance of a unified approach to data and AI. By bringing together teams and data workflows the expected benefits include increased operational efficiency, accelerated time-to-market, increased innovation, and more.

If you weren’t able to attend the live webinar and would like to learn about all of the best practices to ensure AI success, click here to watch the webinar on-demand. You can also download the full report “2018 Trend Report: Enterprise AI Adoption” based on the CIO Survey by IDG/CIO.com.

*IDC’s Worldwide Big Data and Analytics Spending Guide and Cognitive/Artificial Intelligence Systems Spending Guide

Next Steps

  • Download the full survey report to read the detailed findings
  • Watch the webinar recording on-demand
  • Read this ebook to learn how to accelerate innovation through a Unified Approach to Analytics
Try Databricks for free

Related posts

Databricks adds new migration Brickbuilder Solutions to help customers succeed with AI

February 14, 2024 by Christine Gauthier in
For the past two years, Databricks has collaborated with leading consulting partners to build innovative solutions for industry, migration, and data and AI...

Applying Natural Language Processing to Healthcare Text at Scale

This is a co-authored post written in collaboration with Moritz Steller, AI Evangelist, at John Snow Labs. Watch our on-demand workshop, Extract Real-World...

Treating Data and AI as a Product Delivers Accelerated Return on Capital

August 17, 2022 by David LeGrand in
The outsized benefits of data and AI to the Manufacturing sector have been thoroughly documented. As a recent McKinsey study reported, the Manufacturing...
See all Product posts