Add to Technorati Favorites

 Subscribe in a reader

Trends and Outliers

TIBCO Spotfire's Business Intelligence Blog


Text Analytics – What To Do With The Other 80% Of Your Data

ROI1 150x150 Text Analytics – What To Do With The Other 80% Of Your DataIt is commonly estimated that 80% of enterprise data exists as text and other unstructured data. Text is everywhere – in emails, documents, reports, forms, call logs, press releases, blogs, tweets and more. Text analytics, or text data mining, is the process of automatically extracting concepts, topics, facts, sentiments, relationships and other information from text. It can be used to classify documents, automatically route emails to the right person, identify specific quality or service problems, monitor the competitive marketplace and better understand the “voice of the customer.”

While text analytics is clearly much more difficult than quantitative analysis, it can provide insight that is even more specific and actionable than traditional quantitative BI data. It also offers the potential to be able to respond in real-time to customer comments because of the speed at which computers can process text information. But the greatest insight will come from combining both text and quantitative data mining results together, often in combination with predictive analytics, to identify issues, take specific actions and improve business results. Here are a few ways that companies have gained insight through text analytics.

  • A large global hotel chain analyzed customer service call logs, letters, comment cards, surveys and emails. A manual analysis that took days identified lobby cleanliness as a problem at a specific property. Automated text analysis on the same data took hours to identify that a dirty carpet in the hotel lobby was the source of complaints.
  • Another hotel chain discovered that, in large resorts, guests who were looking for a location at the resort had a much better customer experience when the bell staff walked them to the location rather than just pointing them in the right direction. These are both good examples of the kind of specific, actionable information that can be extracted from text data.
  • A consumer product company used text analytics to understand what customers were saying about their product in surveys and social media. They mapped Twitter handles to their customer database to better understand why some customers are brand promoters and others are brand detractors. They were able to discover new information about what is most important to customers and why customers use their product. The information gleaned from text analysis led to changes in product development, marketing and customer service.
  • A telecommunications company knew from quantitative analysis that many customers called prior to canceling their service. By mining call logs and combining that with customer information, the company was able to identify the specific questions asked by customers who were likely to cancel their service and to take action to try and prevent cancellations.
  • ConAgra has hundreds of work-from-home call center agents who record customer comments verbatim. The company mines these comments in real-time to identify and act on trends. When a number of comments appeared that a particular product had too much vinegar, the company was able to track down the specific plant that produced it and take corrective action immediately. When some customers began complaining that their ReddiWhip was watery, ConAgra identified that a certain grocery chain was not refrigerating the whipped cream properly and they were able to resolve the problem.

Subscribe to our blog to stay informed on text analytics and other data analytics topics.

Steve McDonnell
Spotfire Blogging Team

Print post

Is your data hiding something?
Download Your Free 30-Day Evaluation of TIBCO Spotfire®

Filed under: Text Analytics


Seth Grimes

Does TIBCO have a text-analytics offering or partnership(s)? If so, I’d love to know more!


Spotfire Blogging Team

Seth, thanks for your inquiry. We do a good bit of text related analysis in a number of industries with our visual approach. Out Network Analytics in particular has proven useful in looking at relationships between documents, people, time, and events. We also provide nice means of running statistics and complex searches across structured text information. That said, just to be transparent, we don’t do entity extraction or create the relationship from unstructured data. Our customers use a number of tools for that – and often multiple ones – in order to classify and structure the text. The result of that is then analyzed in Spotfire and S+ to find out what these relationships look like and what they mean. This blog entry was about general industry
trends vs. our product offerings as we are interested in the market perception and trends.


Arun Bala Ganesan

Very true! Usage of Text Based Data Mining tools to relate patterns, understand the sentiments, translate grammars, predetermine relationship models & forsee complexes must be the primary focus for any intelligence developer. Sometimes, its pityful to find in many #BI related projects, use of some #EDW tools are just to create a simple spreadsheet based report! Text Analytics unlike other reporting based stacks must focus to bring in the relevancies & provide better insights.


One Trackback

[...] who were likely to cancel their service and to take action to try and prevent cancellations…. Read more This entry was posted in Customer Relationship Management, Predicitve Marketing, Technologies, [...]


Post a Comment

Your email is never shared. Required fields are marked