There’s been some speculation in the market that Hadoop may be disappearing. Some of this speculation has been driven by vendors that have recently downplayed Hadoop in their marketing efforts. For example, the Strata+Hadoop World conference is now known as the Strata Data Conference. The Hadoop Summit is now known as the Dataworks Summit. In Cloudera’s S-1 filing with the SEC for its initial public offering, the term “Hadoop” appears only 14 times, while the term “machine learning” appears 83 times. So, if some of the vendors that created the market appear to be pivoting away from Hadoop, does your organization need to do something similar, or is there a role for Hadoop in your IT architecture?
Recently Hortonworks announced some significant additions to its products at the DataWorks Summit. These additions reflect the fact that the big data market continues to evolve, as I have previously written.
Natural language generation (NLG), the process of generating text or narratives based on a set of data values, can reach a broader audience. NLG narratives can be used for a variety of purposes, but in this perspective I focus on how NLG can be used to enhance business intelligence (BI) processes. In the case of BI, NLG can be used to explain what has happened and why it is happening, and even what actions to take. The NLG narratives can be understood by a broader range of business users than the tables and charts of data that are the typical output of most BI applications or analytics tools.
Many organizations continue to struggle with preparing data for use in operational and analytical processes. We see these issues reported in our Data and Analytics in the Cloud benchmark research, where 55 percent of organizations identify data preparation as the most time-consuming task in their analytical processes. Similarly, in our Next-Generation Predictive Analytics research, 62 percent of companies report that they’re unsatisfied because data needed for access or integration is not readily available. In our Big Data Integration research, 52 percent report spending that in working with big data integration processes, they spend the most time reviewing data for quality and consistency. And nearly half of companies (48%) report this same issue in our Internet of Things research. We are currently conducting further research into this critical issue with our Data Preparation benchmark research.
This is my second analyst perspective based on our IoT Benchmark Research. In the first, I discussed the business focus of IoT applications and some of the challenges organizations are facing. Now I’ll share some of the findings about technologies used in IoT applications and the impact those technologies appear to have on the success of users’ projects.
This year various types of organizations are embracing machine learning like it is going out of style – or maybe it would be better to say coming into style. And now with a little investigation on LinkedIn finds over half million professionals with machine learning in their job title. Machine learning is the application of specific data science algorithms that become more accurate as the system records more outcomes and processes more data. This improvement is referred to as “learning,” hence the name. There are good reasons machine learning is growing so rapidly, but there are pitfalls to avoid as well.
Informatica reintroduced itself to the world at its recent customer conference, Informatica World, in San Francisco. The company took advantage of the event to showcase its new branding in an effort to change the way customers think about the company. Informatica has been providing information services in the cloud for more than a decade. Even though cloud revenue comprises a minority of Informatica’s business, in absolute terms, the revenue is significant, and company executives want the public to recognize Informatica as a leader in cloud-based data management services for enterprises. Presenters also made notable product announcements, discussed below, including the application of machine learning to the data management process.
Topics: Analytics, Business Intelligence, data science, Big Data, Data Integration, Data Governance, Data Preparation, Information Optimization, Machine Learning Digital Technology, Machine Learning and Cognitive Computing, Cloud Computing
I recently attended the MicroStrategy World conference, which was held in Washington, D.C. and it celebrate its 20th anniversary, which is why MicroStrategy hosted the event near its headquarters. Over the past 20 years, the market and technology for business intelligence and analytics have significantly changed, and in several changes, MicroStrategy has been at the forefront. Now is a good time to examine the company’s position in the market and its latest offerings in context of the analytics market direction that I recently presented.
Some 3,000 people attended Domo’s recent customer event, called Domopalooza. That’s nearly double the attendance of the previous event, which my colleague Mark Smith covered. Formerly a bit “stealthy,” Domo has started sharing more information, some of which I’ll pass along, as well as observations about product announcements made at the event.
Topics: Business Intelligence, Collaboration, data science, Mobile, Machine Learning Digital Technology, Machine Learning and Cognitive Computing, Mobile Technology, Analytics, Cloud Computing, Big Data
I recently attended SAS Institute’s analyst relations conference. There the company provided updates on its financial performance and its Viya platform and a glimpse into some of its future plans.
Topics: business intelligence, data science, Internet of Things, Data Integration, Data Governance, Data Preparation, Information Optimization, Machine Learning Digital Technology, Big Data, Machine Learning and Cognitive Computing, Mobile Technology, Analytics, Cloud Computing, Collaboration