My Reflections on the Wisdom of the Crowds Business Intelligence Market Study

I recently came across a very interesting study that has been published by Dresner Advisory Services. The Business Intelligent market study titled, “Wisdom of the Crowds”, is written by Howard Dresner, one of the foremost thought leaders in the BI market. This in-depth research has used a survey tactic to gather the wisdom of 457 BI users (quite a crowd!) on 32 essential metrics for choosing a BI technology. The results are astonishing.

Among the many trends two were the most interesting to me:

1. Today, smaller BI deployments dominate across all geographies and all industries.
2. Smaller BI deployments have started to take off in the last 2 years or so and are growing in the expense of large deployments that were once popular 5 to 15 years ago.

This is a huge market shift. 1,000+ user base deployments are no longer ideal or even desired. They have been replaced by smaller deployments for individual organizations, departments, and line of businesses.

While this is no surprise due to the economic conditions that has forced companies to cut back in their capital expenditure, including huge licensing costs just to entitle “every” user to the software and tools in hand, plus money spent on training and hiring skilled users, what has truly made this “shift” possible is the opportunity that open source BI has presented to these clients.

In my opinion, Open Source BI provides this opportunity in two ways:

1. Lower cost and easier to deploy BI software is now available. Notice that I am not just talking about the low cost here. Yes, Open Source BI has been a disruptive technology in the past couple of decades. Newer to the BI world, Open Source bears no acquisition cost for the software. Instead it offers a subscription model for support, which has made it the most attractive alternative for most clients. All the required functionality with only 10% of the cost! What else is new?!

Here, however, my emphasis is on the “easier to deploy” factor. What in the past took a symphony of data modelers, BI developers, ETL developers, data analysts, data architects, data warehouse managers, and DBAs, and a 12 month implementation cycle, is now done “only by a few and only in a few weeks”.

What does this mean for smaller organizations or even departments within larger organizations? It means that now they are able to invest in BI. Something that was not viable a few years ago. They not only don’t have to pay high dollars for BI tools, but also don’t need an exhaustive list of skills, consulting, and expertise to get going.

Dresner’s report shows exactly this. More and more smaller deployments are becoming popular in the last couple of years and are replacing the large ones that were on most corporate priority lists 5-10 years ago.

2. The second reason for this market shift is due to the connection that emerging technologies (such as open source) have made to the line of business owners. Business users have found a way to “free” themselves from IT latency. There is no question that you need your technical staff to initially set up the BI infrastructure and build the first round of reports and analysis, but that shouldn’t mean that every time you want add a dimension to your calculations, or measure something slightly different, you would have to go in a waiting list queue behind several other requests and get an answer 3-4 weeks later. Business users now realize that they can take control, and find the answers for themselves — at least in most cases.

Open Source BI has emerged to enable these folks with tools that let them manage changes in their business processes a lot faster. Dresner’s report is an evident to this fact. The study shows that business users are the most likely to chose emerging technologies over BI tools from the Titans (IBM, SAP, Oracle, and Microsoft) and the BI Pure Plays (Actuate, MicroStrategy).

I would encourage you to download and study this report further. You will be intrigued!

To conclude my points, I’d like to point out a chart from the 2010 Wisdom of Crowds Market Study (The 2011 study is underway). It shows the life cycle of all BI vendors.
Several vendors matured 2 to 5 years ago. They saw the most deployments and new customer acquisitions in that time frame. But since then, their deployments have declined. Among these vendors are SAP Business Objects, Oracle, MicroSoft, IBM Cognos, and Actuate. With cobbled together tools from different acquisitions that are not integrated and require deep technical skills and long deployment cycles, not to mention the huge software acquisition costs for clients, there is no wonder to this trend. These tools are anything but suitable for small, agile, and high-value projects.