David Menninger's Analyst Perspectives

Artificial intelligence (AI) has evolved from a highly specialized niche technology to a worldwide phenomenon. Nearly 9 in 10 organizations use or plan to adopt AI technology. Several factors have contributed to this evolution. First, the amount of data they can collect and store has increased dramatically while the cost of analyzing these large amounts of data has decreased dramatically. Data-driven organizations need to process data in real time which requires AI. In addition, analytics vendors have been augmenting business intelligence (BI) products with AI. And recently, ChatGPT has raised awareness of AI and instigated research and experimentation into new ways in which AI can be applied. This perspective, the second in a series on generative AI, introduces some of the concepts behind ChatGPT, including large language models and transformers. Understanding how these models work can help provide a better understanding of how they should be applied and what cautions are necessary.

Generative AI is a class of artificial intelligence used to generate new, seemingly real content. Broadly speaking, AI has traditionally been used to identify patterns in data and apply those patterns to categorize and predict behaviors. For instance, it can organize customers into groups (or clusters) with similar characteristics, or predict which customers are most likely to respond to certain offers.

Organizations are continuously searching for new business opportunities hidden in their data. They are using various technologies including artificial intelligence and machine learning (AI/ML) to uncover granular insights that can support decision-making. Existing tools and dashboards are effective for observing standard metrics; however, they do not address follow-up questions, such as why things are happening or how those events impact performance. Organizations also struggle to derive complete value from big data. Our Analytics and Data Benchmark Research shows that only 1 in 5 organizations are very confident in their ability to analyze large volumes of data.

I’ve previously written about the analytics continuum, which spans a range of capabilities including reporting, visualization, planning, real-time processes, natural language processing, artificial intelligence and machine learning. I’ve also written about the analysis that goes into making intelligent decisions with decision intelligence. In this perspective, I’d like to focus on one end of the analytics continuum, which I’ll label advanced analytics.

Markets have been more volatile than ever. It creates a need for decision makers to utilize technologies such as artificial intelligence and machine learning (AI/ML) to better understand the external factors that impact their business. By identifying these factors, organizations can better plan for changing market environments and seize market opportunities. However, manual modeling is a time-consuming process and results in a limited number of models and tests. Also, updating those models is slow and laborious. With the addition of market volatility, it creates multiple challenges for CFOs, managers and financial planning specialists. With limited exposure to external drivers of demand and delivery, the process becomes very costly. Developing accurate forecasts requires integrating exogenous data with the internal performance data, but it’s challenging to find quality external data and then get that raw data clean enough to input into any model. My colleague, Robert Kugel, recently shared his perspective on using external data for forecasting, budgeting and planning to enhance predictive capabilities.

Organizations conduct data analysis in many ways. The process can include multiple spreadsheets, applications, desktop tools, disparate data systems, data warehouses and analytics solutions. This creates difficulties for management to provide and maintain updated information across multiple departments. Our Analytics and Data Benchmark Research shows that organizations face a variety of challenges with analytics and business intelligence. One-third of participants find it difficult to integrate analytics and BI with other business processes. Participants also find that not all software is flexible enough for the constantly changing business environment, and that it is hard to access all data sources.

In previous perspectives in this series, I’ve discussed some of the realities of cloud computing including costs, hybrid and multi-cloud configurations and business continuity. This perspective examines the realities of security and regulatory concerns associated with cloud computing. These issues are often cited by our research participants as reasons they are not embracing the cloud. To be fair, the majority of our research participants are embracing the cloud. However, among those that have not yet made the transition to the cloud, security and regulatory concerns are among the most common issues cited across the various studies we have conducted.

Recently, I suggested you need to “mind the gap” between data and analytics. This perspective addresses another gap — the gap in skills between business intelligence (BI) and artificial intelligence/machine learning (AI/ML).

Embedded business intelligence (BI) continues to transform the business landscape, enabling organizations to quickly interpret data and convert it into actionable insights. It allows organizations to extract information in real time and answer wide-ranging business questions. Embedding analytics helps tackle the issue of extracting information from data which is a time-consuming process. Our research shows organizations spend more time cleaning and optimizing data for analysis rather than creating insights. On top of that, they are adding more data sources and information systems which in turn introduces more complexity. Our Analytics and Data Benchmark Research shows that organizations face various challenges with analytics and BI. More than one-third of participants (35%) responded that they find it hard to integrate analytics and BI with business processes and connect to multiple data sources. By embedding analytics and BI into business processes and workflows, organizations can enable users to make critical decisions fast, enhancing overall business agility.

Artificial intelligence and machine learning are valuable to data and analytics activities. Our research shows that organizations using AI/ML report gaining competitive advantage, improving customer experiences, responding faster to opportunities and threats and improving the bottom line with increased sales and lower costs. No wonder nearly 9 in 10 (87%) research participants report using AI/ML or planning to do so.