Data Mining
Data mining uses statistics from large amounts of data to learn about target markets and customer behaviors. This method can make use of data warehouses or big data.
Who is our customer?
What are their preferences?
How do they rank planned feature sets?
B2C
B2B
Customer
Quantitative
Data mining can start with the results from a few questionnaires. However, it is more effective to use a large dataset. Identifying the source information (where you get the data) and extracting key values (how you pick the data points) are important to get quality results.
Data mining is best used for pattern discovery in customer perceptions and behaviors. It is useful in understanding your customers and/or your target market.
For example, you can identify the profile of potential buyers or customers by running email campaigns and gathering the results. This data can help in customer acquisition efforts.
You can also gather customer information by sending out customer satisfaction questionnaires or feedback forms. Alternatively, you can track customer behaviors or mouse clicks on your websites. By combining these two data points, you can determine customer behavioral links between reported satisfaction and actual usage. This can identify key drivers for customer loyalty and churn.
Depending on the amount of data that you need to crunch and data points that you want to discover, it will take 2-3 hours to a few weeks. You should pick one or two of the most important data points to start the learning process.
You can either acquire outside (industry or market) data or distill your own (customer or product) data. Once you identify the area that you want to test:
Acquire data (integrate from various sources, if required).
Identify data points (determine which data or information is relevant to the research).
Transform and extract data (there are many tools to choose from, from business intelligence tools to database software with built-in reporting tools).
Recognize and search for patterns.
Draw conclusions or refine the process by going back to step 2 (or even step 1 if you need to get better data).
In data mining, data matters but perspective matters more. There is a saying, “Garbage in, garbage out.” But as human beings, we tend to see what we want to see and draw conclusions based on our own biases.
To counter these biases, you can: 1. Get outside help or another pair of eyes to help interpret the data. 2. Get two data points that are counter to each other. (In research methodology, that is called the control group and experimental group.)
Confirmation bias
False positives
Ignorance of black swans (rare and unprecedented events that can dramatically change or determine the future outcome)
Got a tip? Add a tweetable quote by emailing us: [email protected]
Got a case study? Add a link by emailing us: [email protected]
Got a tool to recommend? Add a link by emailing us: [email protected]
Got a reference? Add a link by emailing us: [email protected]
