Open ended question definition
Closed ended questions
Open ended vs. closed ended questions
Open ended questions examples
- What are your expectations for the course?
- How could we improve the event?
- What is it like living in New York?
- Tell us about your experience so far:
- Why did you choose that answer?
- What are your plans for the weekend?
- How does this make you feel?
Advantages of open ended questions
- Open ended questions require more in-depth answers. Meaning you collect more meaningful results.
- You may collect feedback you wouldn’t otherwise have anticipated. E.g. problems with a product/service.
- The information allows you to build profiles on your target population. E.g. demographics, hopes and fears.
- No restrictions on the length or complexity of a participants answer.
- Even with a smaller research population, you’d still collect ample data for analysis and discussion.
Disadvantages of open ended questions
- Open questions can be more time consuming for participants, meaning they’re more likely to experience survey fatigue.
- Analyzing responses also takes more time and effort.
- The results are generally qualitative, meaning you cannot be generalize them to a wider population.
- If your question is framed or worded incorrectly, there is a risk of influencing answer choices. E.g. Leading questions, loaded words and phrases.
Tips for using open ended questions
1. Don’t write leading questions
The whole point of open question is to allow respondents to write a unique answer. If you influence their response in anyway, your data will not be accurate.
2. Ensure all questions are necessary
Draft a list of questions and identify those most important to meeting your research goals. You’ll want your questionnaire to be as short as possible, otherwise you risk taxing participants. Which will lead to answer dishonesty or drop-outs.
3. Use open ended and close ended questions
This will provide you with both statistical and inferential data. Giving you a fuller understanding of your target population and two sources of data to draw from in your conclusion.
4. Avoid ‘Why?’ questions
Not all respondents can provide a reason for something, or may not be aware of their reasoning for things. In these cases, it’s possible for respondents to make up reasons without necessarily believing it. This will negatively impact your results.
5. Don’t write questions that illicit a one word response
When writing your questions, frame them in a way that requires a story rather than a one or two-word answer. The more engaging a question is, the more likely you are to receive a genuine response.
Analyzing open questions with ‘Bucketing’
‘Bucketing’ is a useful method for sorting qualitative data into categories for analysis.
1. Read every answer
Naturally, evaluating open feedback can be time consuming. However, it is essential to understand the full scope of opinions and experiences detailed in your data.
2. Identify trends and patterns
Sort similar responses into categories (or ‘Buckets’) for each of your questions. These could be as simple as ‘Positive Opinions’, ‘Neutral Opinions’, and ‘Negative Opinions’. This is also known as multi-coding.
It’s fine if a response goes in more than one Bucket, as multiple ideas or opinions may be expressed. But it’s important that each response is in at least one category.
3. Create sub-categories (optional)
If you have a wide range of opinions expressed in one Bucket, we’d suggest you create sub-categories.
This will make your analysis more manageable.
4. Review each category
Once every response has been placed into a Bucket, decide if you should combine or split any. Each bucket should clearly illustrate a trend or pattern in your results.
If you’ve also used closed questions, they should be used to provide context to open feedback and trends.
5. Write a summary of the major trends
There should be some meaningful correlation to the trends in your responses you can use to summarize your results. This summary can be supported by words/ quotes from respondents.
Once this is done, your conclusion should be clear. Whether it’s to action changes to product development or to improve web page usability.
If the above method of analyzing open feedback isn’t quite right right for you, take a look at this article from Research Methodology on qualitative data analysis.
Open ended survey questions examples
Market research surveys
- How would you improve our product/ service?
- How do you feel about the price of the product?
- What challenges did you have in the customer service process?
- Why did you choose our product over our competitors’?
- What is holding you back from a purchase?
- Tell us about your relationship with your line manager?
- How do you feel about the communication processes in the company?
- What do you know about our mission statement?
- Why did you apply for a position with us?
- What was the most rewarding aspect of the course?
- How would you improve the course content?
- Why did you sign up for the course?
- In what ways would you change the course delivery?