Effective survey question:
How frequently do you use AI-based tools, such as ChatGPT, when brainstorming ideas for your academic writing tasks?
Ineffective survey question:...
Effective survey question:
How frequently do you use AI-based tools, such as ChatGPT, when brainstorming ideas for your academic writing tasks?
Ineffective survey question:
Do you find ChatGPT useful, simple to use, and more effective than completing academic writing assignments on your own?
The first question is considered effective because it is clear, direct, and focused on a single aspect. It asks only about the frequency of using AI tools for generating ideas, which makes it easier for respondents to understand exactly what is being asked. In addition, the wording remains neutral and does not imply that using AI is either good or bad, allowing participants to answer honestly without pressure.
In contrast, the second question is not well designed because it combines multiple ideas within one item. It asks respondents to evaluate usefulness, ease of use, and effectiveness compared to independent writing all at once. These are separate issues and should be measured through different questions. For example, a respondent may think ChatGPT is easy to use but may not believe it improves writing quality. Because of this, the responses may become confusing and difficult to interpret.
Furthermore, the question contains biased and leading language, particularly in the phrase “more effective than completing academic writing assignments on your own.” This wording may encourage respondents to view ChatGPT positively before answering, which can affect the reliability of the collected data.