Good vs Bad Survey Questions

Good vs Bad Survey Questions

Võ Thị Mỹ Hạnh HUF04

1. Good Question

"On a scale of 1 (Not helpful at all) to 5 (Extremely helpful), how effective do you find AI-generated suggestions for correcting grammatical errors in ...

좀 더...

1. Good Question

"On a scale of 1 (Not helpful at all) to 5 (Extremely helpful), how effective do you find AI-generated suggestions for correcting grammatical errors in your technical reports?"

=> Question 1 is good because it focuses on a single, clear aspect of writing (grammatical errors) rather than "writing" as a broad concept.

2. Bad Question

"Do you think AI feedback is faster and more useful than teacher feedback because it helps you write better code and English essays?"

=> Question 2 is Not Good because 2 reasons: 

  • Double-Barreled: It asks about two different things at once: "faster" and "more useful." A student might think it's faster but not more useful, making it impossible to answer accurately.
  • Leading/Biased: By starting with "because it helps you write better," the question leads the student to agree that the AI is beneficial.

 

Good vs Bad Survey Questions

Vo Dao Trang Thy HUF04
Dear My Hanh,
I think your good survey question is clear, focused, and well-designed. It looks at one specific aspect of writing, which makes it easy for respondents to ...

좀 더...

Dear My Hanh,
I think your good survey question is clear, focused, and well-designed. It looks at one specific aspect of writing, which makes it easy for respondents to understand and answer accurately. The rating scale is also clear and appropriate.
I also agree with your explanation of why the second question is not well constructed, as it is both double-barreled and leading. As a small suggestion, you might consider adding a short condition such as “if you have used AI-generated suggestions” to the good question, which could make it even clearer for respondents with different levels of experience.