David Menninger's Analyst Perspectives

Recognize and Plan for the AI and Machine Learning Skills Gap

Posted by David Menninger on Dec 15, 2022 3:00:00 AM

Recently, I suggested you need to “mind the gap” between data and analytics. This perspective addresses another gap — the gap in skills between business intelligence (BI) and artificial intelligence/machine learning (AI/ML).

There’s a lot of hype surrounding AI/ML, and for good reason too. Our research shows that the interest in AI/ML is justified. Organizations using AI/ML report it has helped them gain a competitive advantage, improve Ventana_Research_Benchmark_Research_Analytics_39_AI_ML_Skills_20220627-1customer experiences and respond faster to opportunities and threats in the market. As a result, it’s not surprising to see that 87% of organizations are using or plan to use AI/ML. The reality, however, is that only one-quarter of organizations are using it today. One of the obstacles to adopting AI/ML is the specialized skill set required to effectively build and deploy models today. Less than one-quarter of organizations (23%) report they have enough AI/ML skilled resources available within their organizations.

We’ve seen the rise of augmented intelligence and the use of autoML and other automated analytics based on AI/ML, in part to help address this skills shortage. However, augmented intelligence should not be considered a substitute for robust data science activities. Many situations still require a dedicated, highly skilled data science team for production-quality AI/ML deployments where “good enough” is not good enough.

The complicated nature of building and maintaining AI/ML models requires knowledge of many different algorithms, each with many different parameter settings. Even with hyperparameter optimization included in many AI/ML platforms to speed up the process of finding the optimal parameters to use, there are many steps in the process that require data science expertise. Data preparation remains a critical step, requiring knowledge of how data should be prepared for each algorithm. For instance, does the algorithm require continuous or discreet inputs? If it requires discreet inputs, should the intervals contain equal populations or equal ranges of values? Not only must the data be prepared properly, but it must also be evaluated for bias. If bias exists in the data, it will be reflected in the models it produces. What about overfitting — the generation of a model that corresponds too closely to the data set? Overfit models struggle to perform accurately over unseen data.

For these reasons, we assert that through 2025, AI and machine learning approaches will remain largely independent of business intelligence approaches, requiring three-quarters of organizations to maintain multiple, VR_2022_AI&ML_Assertion_1_Square-1separate skill sets. All is not lost, however. The outputs of AI/ML models can be valuable to many throughout the organization. They can be shared via standard BI tools and used, for instance, in customer segmentation analyses or customer service recommendations. The expansion and improvement of autoML capabilities will take some burden off the shoulders of data science specialists, both as a result of enabling some simple model development in limited situations, but also by automating some of the routine, repetitive tasks required in AI/ML model development. In addition, once a model is developed, it must be deployed into production and, once in production, needs to be monitored and updated regularly. Fortunately, vendors have developed MLOps tools to address many of these issues which will also help make data science resources more productive.

Organizations need to understand where they may have a gap in skill sets and make realistic plans for the AI/ML deployments. They should also stay on top of technology trends and advances. This segment of the market is changing rapidly. But for the near term, tread lightly on turning over all AI/ML to automated processes. Anticipate the need for a dedicated, highly skilled data science team for production-quality AI/ML deployments where “good enough” is not good enough.

Regards,

David Menninger

Topics: Analytics, Business Intelligence, Digital Technology, AI & Machine Learning, Analytics & Data

David Menninger

Written by David Menninger

David is responsible for the overall research direction of data, information and analytics technologies at Ventana Research covering major areas including Analytics, Big Data, Business Intelligence and Information Management along with the additional specific research categories including Information Applications, IT Performance Management, Location Intelligence, Operational Intelligence and IoT, and Data Science. David is also responsible for examining the role of cloud computing, collaboration and mobile technologies as they affect these areas. David brings to Ventana Research over twenty-five years of experience, through which he has marketed and brought to market some of the leading edge technologies for helping organizations analyze data to support a range of action-taking and decision-making processes. Prior to joining Ventana Research, David was the Head of Business Development & Strategy at Pivotal a division of EMC, VP of Marketing and Product Management at Vertica Systems, VP of Marketing and Product Management at Oracle, Applix, InforSense and IRI Software. David earned his MS in Business from Bentley University and a BS in Economics from University of Pennsylvania.