David Menninger's Analyst Perspectives

I am happy to share insights gleaned from our latest Value Index research, an assessment of how well vendors’ offerings meet buyers’ requirements. The Ventana Research Value Index: Analytics and Data 2021 is the distillation of a year of market and product research by Ventana Research. Drawing on our Benchmark Research, we apply a structured methodology built on evaluation categories that reflect the real-world criteria incorporated in a request for proposal to analytics and data vendors supporting the spectrum of business intelligence. Using this methodology, we evaluated vendor submissions in seven categories: five relevant to the product experience ﹘ adaptability, capability, manageability, reliability and usability ﹘ and two related to the customer experience ﹘ TCO/ROI and vendor validation.

This research-based index evaluates the full business and information technology value of analytics and data software offerings. I encourage you to learn more about our Value Index and its effectiveness as a vendor selection and RFI/RFP tool.

This Value Index research evaluates the following vendors that offer products for analytics and data as we define it: Amazon.com Inc., Board International, Domo Inc., Google Inc., Information Builders Inc. (a Tibco company), Infor, International Business Machines Corp., Microsoft Corp., MicroStrategy Inc., Oracle Corp., QlikTech International AB, SAP America Inc., SAS Institute Inc., Sisense Inc., Tableau Software LLC, ThoughtSpot Inc., Tibco Software Inc. and Yellowfin International. Ten of these 18 suppliers responded positively to our requests for information and provided completed questionnaires and demonstrations to aid our analysis of their analytics and business intelligence products. Along with briefings and information where provided, all online material that was generally available was used for the analysis. This report includes products generally available as of December 15, 2020.

The following vendors declined to participate or did not respond to our invitation: Amazon, Google, Microsoft, Sisense, Tableau, ThoughtSpot and Tibco. To organizations considering products from these vendors, we recommend extra scrutiny as part of the software assessment because they did not make their technology available for the Value Index evaluation process.

Unlike many IT analyst firms that rank vendors from an IT-only perspective or focus on a specific type of analytics, Ventana Research has designed the Value Index to provide a balanced perspective, rooted in an understanding of business drivers and needs. This approach not only reduces cost and time but also minimizes the risk of making a decision that is bad for the business.

Using the Value Index will enable your organization to achieve levels of efficiency and effectiveness needed to optimize analytics and business intelligence.

We urge organizations to do a thorough job of evaluating analytics and data offerings in this Value Index as both the results of our in-depth analysis of these vendors and as an evaluation methodology. The Value Index can be used to evaluate existing suppliers, plus provides evaluation criteria for new projects. Using it can shorten the cycle time for an RFP.

The Value Index for Analytics and Data in 2021 finds IBM first on the list, followed by MicroStrategy and Information Builders.

Companies that rated in the top three of any category ﹘ including the product and customer experience dimensions ﹘ earn the designation Value Index Leader. The Value Index leaders in Product Experience are:

• MicroStrategy.
• IBM.
• Oracle.

Leaders in Customer Experience are:

• SAP.
• Qlik.
• IBM.

Value Index Leaders across any of the seven categories are:

• Qlik, which has achieved this rating in four of the seven categories.
• IBM and MicroStrategy in three categories.
• Board, Information Builders, Oracle, SAP and Yellowfin in two categories.
• Tableau in one category.

The overall performance chart provides a visual representation of how vendors rate across product and customer experience. Vendors with products scoring higher in a weighted rating of the five product experience categories place farther to the right. The combination of ratings for the two customer experience categories determines their placement on the vertical axis. As a result, vendors that place closer to the upper-right are “exemplary” and rated higher than those closer to the lower-left and identified as vendors of “merit.” Vendors that excelled at customer experience over product experience have an “assurance” rating, and those excelling instead in product experience have an “innovative” rating.

Note that close vendor scores should not be taken to imply that the packages evaluated are functionally identical or equally well-suited for use by every organization or process. Although there is a high degree of commonality in how organizations handle analytics and data, there are many idiosyncrasies and differences that can make one vendor’s offering a better fit than another.

After more than a decade of technological advances, all the products we evaluated are feature-rich, but not all the capabilities they offer are equally valuable to users. Moreover, the existence of too many capabilities may be a negative factor for an organization if it introduces unnecessary complexity. Nonetheless, an organization may decide that a larger number of options is a plus, especially if some of them match its established practices or better support a new initiative that is driving the purchase of new software.

Features, functions and vendor assessments are not the only deciding factors. For example, an organization may face budget constraints such that the TCO evaluation can tip the scale to one vendor or another. This is where the Value Index methodology and appropriate weighting can be applied to determine the best fit of vendors and products to an organization’s specific needs.

Our firm has made every effort to encompass in this Value Index the overall product and customer experience from our Analytics and Data blueprint, which we believe reflects what a well-crafted RFP should contain. We also have examined further the collaborative, embedded and mobile needs of organizations. Even so, there may be additional areas that affect which vendor and products best fit an organization’s particular requirements. Therefore, while this research is complete as it stands, utilizing it in your own organizational context is critical to ensure that products deliver the highest level of support for your projects.

You can find more details on our site as well as in the Value Index Market Report.

Regards,

David Menninger