Crawling web pages was sufficient to build a video search capability because essentially the problem that video search systems try to solve is – determining the degree of similarity between data object A and data object B. But business intelligence applications have deeper requirements driven by the need to answer more specific questions.
For example, a call analytics Voice-Of-The-Customer application may want to know why the same issue sometimes can be resolved on a single customer service phone call, but can also take more than five calls on a separate occasion. In such case the system needs to determine negative sentiment associated with very specific business objects. Also in such cases, only limited amounts of linguistic data may be available. The language patterns required may not be available through crawling of web pages, and in such cases class based language models can be used very effectively.