David Menninger's Analyst Perspectives

Now more than ever, effective data management is crucial to enable decision-makers to better assess information and take calculated actions. It is also important to keep up with the latest trends and technologies to derive higher value from data and analytics and maintain a competitive edge in the market. However, every organization faces challenges with data management and analytics. And as organizations scale, the complexity only increases, creating a need for better data governance, data quality and streamlined and automated processes. DataOps can help solve many of the challenges organizations encounter when trying to unlock the power of data by expanding data use to various parts of an organization. Hitachi Vantara offers DataOps technology that enables organizations to improve data agility and automation. It provides cloud-ready infrastructure, advanced data management software and a broad range of support services.

Data analytics provide valuable insights and enable organizations to make better decisions, improve performance and gain a competitive advantage in the marketplace. Analytics can change frequently depending on the data being analyzed and the methods used to gather and process it. Factors such as new data, changes in the underlying systems or updates to algorithms can all contribute to differences in an analysis. AnalyticOps helps ensure data is accurate, up-to-date and consistent across different systems and teams, and that analytical models are robust, reliable and continuously improved.

For years various types of systems have produced log files to help with monitoring, debugging and performance management. Often, this information was used in forensic analyses of why interruptions in service or other problems occurred. In many cases, log files are still used this way. But systems have grown more complicated, and many more devices are instrumented. Systems have been decomposed into much finer-grained, interdependent services. Infrastructure is now distributed between on-premises and multiple cloud providers. In addition, expectations now include 24x7 operation and real-time responsiveness. All of these factors combine to create challenges with volume and velocity of data that is collected and analyzed.

I’ve previously written about the analytics continuum, which spans a range of capabilities including reporting, visualization, planning, real-time processes, natural language processing, artificial intelligence and machine learning. I’ve also written about the analysis that goes into making intelligent decisions with decision intelligence. In this perspective, I’d like to focus on one end of the analytics continuum, which I’ll label advanced analytics.

Markets have been more volatile than ever. It creates a need for decision makers to utilize technologies such as artificial intelligence and machine learning (AI/ML) to better understand the external factors that impact their business. By identifying these factors, organizations can better plan for changing market environments and seize market opportunities. However, manual modeling is a time-consuming process and results in a limited number of models and tests. Also, updating those models is slow and laborious. With the addition of market volatility, it creates multiple challenges for CFOs, managers and financial planning specialists. With limited exposure to external drivers of demand and delivery, the process becomes very costly. Developing accurate forecasts requires integrating exogenous data with the internal performance data, but it’s challenging to find quality external data and then get that raw data clean enough to input into any model. My colleague, Robert Kugel, recently shared his perspective on using external data for forecasting, budgeting and planning to enhance predictive capabilities.

Ventana Research recently announced its 2023 Market Agenda for Analytics, continuing the guidance we have offered for nearly two decades to help organizations derive optimal value from technology investments to improve business outcomes.

I’m proud to share Ventana Research’s 2023 Market Agenda for Digital Technology. Our focus in this agenda is to deliver expertise to help organizations prioritize technology investments that improve customer, partner and workforce experiences while also increasing organizational effectiveness and agility.

Organizations conduct data analysis in many ways. The process can include multiple spreadsheets, applications, desktop tools, disparate data systems, data warehouses and analytics solutions. This creates difficulties for management to provide and maintain updated information across multiple departments. Our Analytics and Data Benchmark Research shows that organizations face a variety of challenges with analytics and business intelligence. One-third of participants find it difficult to integrate analytics and BI with other business processes. Participants also find that not all software is flexible enough for the constantly changing business environment, and that it is hard to access all data sources.

For far too long, business intelligence technologies have left the rest of the exercise to the reader. Many of these tools do an excellent job providing information in an interactive way that lets organizations dive into the data and learn a lot about what has happened across all aspects of the business. More recently, many of these tools have added augmented intelligence capabilities that help explain why things happened. But rarely did any of these tools provide information about what to do or how to evaluate the alternative ways in which you might respond.

Analytics processes are all about how organizations use data to create metrics that help manage and improve operations. Yet, the discipline applied to analytics processes seems to be lacking compared to data processes. I’ve pointed out that the weak link in data governance is often analytics. Organizations can also do a better job tying AnalyticOps to DataOps and do more to define and manage metrics. Our research has shown that creating and managing metrics in a semantic model improves analytics processes.