Good vs Bad Survey Questions

Good vs Bad Survey Questions

Võ Thị Mỹ HạnhHUF04 -

1. Good Question

"On a scale of 1 (Not helpful at all) to 5 (Extremely helpful), how effective do you find AI-generated suggestions for correcting grammatical errors in ...

更多...

1. Good Question

"On a scale of 1 (Not helpful at all) to 5 (Extremely helpful), how effective do you find AI-generated suggestions for correcting grammatical errors in your technical reports?"

=> Question 1 is good because it focuses on a single, clear aspect of writing (grammatical errors) rather than "writing" as a broad concept.

2. Bad Question

"Do you think AI feedback is faster and more useful than teacher feedback because it helps you write better code and English essays?"

=> Question 2 is Not Good because 2 reasons: 

  • Double-Barreled: It asks about two different things at once: "faster" and "more useful." A student might think it's faster but not more useful, making it impossible to answer accurately.
  • Leading/Biased: By starting with "because it helps you write better," the question leads the student to agree that the AI is beneficial.

 

Good vs Bad Survey Questions

Vo Dao Trang ThyHUF04 -
Dear My Hanh,
I think your good survey question is clear, focused, and well-designed. It looks at one specific aspect of writing, which makes it easy for respondents to ...

更多...

Dear My Hanh,
I think your good survey question is clear, focused, and well-designed. It looks at one specific aspect of writing, which makes it easy for respondents to understand and answer accurately. The rating scale is also clear and appropriate.
I also agree with your explanation of why the second question is not well constructed, as it is both double-barreled and leading. As a small suggestion, you might consider adding a short condition such as “if you have used AI-generated suggestions” to the good question, which could make it even clearer for respondents with different levels of experience.