LLM and BI System Synergy — First results and Mid-Term Perspectives
The New BI Challenge
Business Intelligence team often acts like a superhero for companies now, guiding management through the entire journey from raw data to analysis on the top of dashboards. But here’s the catch — not many companies are using BI System as much as they could. Factors such as poor data quality, mismatches in information needs, a trust gap among users, bad delivery quality, and more contribute to an adoption rate of around 15% (active BI users to the total number of employee), as revealed by a BARC/Eckerson Group joint survey.
The big talk about ChatGPT and other fancy language models last year, has led big BI vendors to race against the clock to make BI even better. Tableau, Power BI, ThoughtSpot are in a rush to improve BI and have already shown off their plans and sneak peeks of how things will look for users in the future.
The challenge lies in the fact that the urgency to incorporate LLMs into BI has outpaced the development of a clear plan on how they should work together with numerical data, multiple data contexts, and hidden assumptions, as well as what interface to provide for the user. There are also formal blockers, such as prompt length limits and corporate data security concerns.
Our Vision: Making Good Old BI smarter step by stepIn response to the uncertainties surrounding the integration of LLMs and BI, our Reporting & Analytics and AI Teams at Luxoft have taken on the challenge and begun testing the Conversational experience for our Tableau users by leveraging the capabilities of Azure OpenAI.
Here are our 2 scenarios we started with:
Glossary Terms Consultant: The bot helps explain tricky company terms in a way that everyone can understand. Answering questions like “What is [term]?”, “What does [metric] mean?”
Report Navigator: The bot guides you to the relevant reports based on what you need. Queries like “What report can I use to monitor [metric]?”. It not only recommends the reports but also helps to understand them better. Queries like: “Tell me more about this report” or “How should I read this report”
The value of these use cases is apparent — bridging the gap between the user and existing certified reports. Addressing navigation issues is crucial, as it is one of the key reasons for challenges faced by casual users in our company.
0 Comments