Survey platforms such as Qualtrics are excellent at what they were built for: asking many people the same structured questions and counting the answers. An online bulletin board is a different tool for a different job. It follows a smaller group of people over several days and gathers stories, photos, and reasoning. Mixing the two up in a research RFP leads to disappointing studies, so it helps to understand the difference.
Two methods, two goals
Quantitative research asks “how many?” and “how much?” It needs large samples so percentages mean something. Qualitative research asks “why?” and “how?” It needs depth with smaller groups so you can understand reasoning, language, and context. Neither replaces the other, and many strong projects use a board to discover what matters and a survey to measure it.
| Question | Survey platform | Qualitative bulletin board |
|---|---|---|
| Main goal | Measure and count at scale | Understand why and how in depth |
| Sample size | Hundreds or thousands | Usually a few dozen |
| Time frame | One session | Several days |
| Typical output | Charts and percentages | Themes, quotes, photos, and stories |
| Respondent experience | Short, structured form | Daily conversation with prompts |
| Analysis | Dashboards and statistics | Coding and narrative |
What goes wrong when you duct-tape a diary onto a survey tool
You can build a multi-day diary in a survey platform. Respondents feel it. Analysts feel it. Clients feel it when the story is a pile of open-ended answers without day-shaped meaning.
- Boards need day unlocks and progress cues so people come back.
- Media ethnography is not an attachment field. Photos and video need capture, transcripts, and review.
- Theme narrative is not a dashboard widget. It needs reading, coding, and judgment.
- Follow-up probing across days is awkward in a form built for one pass.
- Respondents get a rigid form instead of a conversation.
Why sample size means different things
In surveys, sample size controls statistical confidence: more respondents mean a smaller margin of error. In qualitative work, the aim is not statistical precision but coverage of the range of experiences. You keep adding people until new respondents stop telling you new things (often called saturation). That is why 30 well-chosen people in a board can be enough, and why you should not report board results as percentages of a population.
How to word the RFP
- 1Say what you need to learn: counts, or understanding?
- 2State how many days and what kinds of media you expect.
- 3Ask vendors how respondents are supported during multi-day tasks.
- 4Ask when researchers can see themes: during field or after close.
- 5Request a sample debrief output, not just a feature list.
Using the two together
- Board first, survey second: discover the themes and language, then measure how widespread they are.
- Survey first, board second: find a surprising result, then explore why with a small group.
- Use survey screeners to recruit the right people into a board.
Example: a team wants to know why people stop using a budgeting app. A survey can tell them how many stopped and when. A board over four days can reveal the moments of frustration, with screenshots, short videos, and stories that explain the numbers.
FAQ