Mine Your Business: Text Mining Insights from Social Media
NEW YORK—October 10, 2012—Thanks to blogs, online forums, and product review sites, companies and marketers now have access to a seemingly endless array of data on consumers’ opinions and experiences. In principle, businesses should be able to use this information to gain a better understanding of the general market and of their own and their competitors’ customers.
Yet this wealth of consumer–generated content can be both a blessing and a curse. A new approach, described in a study by Oded Netzer, the Philip H. Geier Jr. Associate Professor at Columbia Business School, offers a way to efficiently aggregate and analyze this content. The study, co–authored with Ronen Feldman and Moshe Fresko of Hebrew University, and Jacob Goldenberg, visiting professor at Columbia Business School and Professor of Marketing at Hebrew University, shows how text mining—the process of extracting useful information from unstructured text—combined with network–analysis tools can help businesses leverage the web as a marketing research playground, generating meaningful insights on market structure and the competitive landscape without asking consumers a single question.
The researchers developed a text–mining tool specifically designed for the complexity of consumer forums, as well as a method of converting this information into quantifiable perceptual associations and similarities between brands. Companies can use this method to monitor their market positions over time—with greater detail and at a lower cost than through traditional methods based on sales and survey data.
The method proved successful in empirical tests, including one focused on consumer forums about sedan cars. In the first test, the researchers downloaded data from the sedan forum Edmunds.com, and text mined more than 860,000 consumer messages, consisting of close to six million sentences posted by about 76,000 unique consumers between 2001 and 2007. Using their combination of text mining and network–analysis techniques, they created visual maps of consumer perceptions and discussions about 169 different sedan cars. The maps can be used to evaluate the competitive market structure, and assess the effectiveness of marketing campaigns. The study demonstrates how a large scale marketing campaign by Cadillac aimed at positioning Cadillac as a stronger rival for import luxury cars was indeed able to move the needle in terms of consumers’ top–of–mind association of Cadillac.
This new method can also be used to analyze more structured textual data such as blogs, reviews, and articles to explore consumer perceptions and opinions.
About Columbia Business School
Led by Dean Glenn Hubbard, the Russell L. Carson Professor of Finance and Economics, Columbia Business School is at the forefront of management education for a rapidly changing world. The school’s cutting–edge curriculum bridges academic theory and practice, equipping students with an entrepreneurial mindset to recognize and capture opportunity in a competitive business environment. Beyond academic rigor and teaching excellence, the school offers programs that are designed to give students practical experience making decisions in real–world environments. The school offers MBA and Executive MBA (EMBA) degrees, as well as non–degree Executive Education programs. For more information, visit www.gsb.columbia.edu.