NGUYEN DOAN TRI - When to Use Which t-test?

NGUYEN DOAN TRI - When to Use Which t-test?

Nguyễn Đoan Trí HUF04

In a hypothetical study, I want to examine whether a new vocabulary learning app improves students’ test scores. I collect scores from the same group of 30 students before ...

좀 더...

In a hypothetical study, I want to examine whether a new vocabulary learning app improves students’ test scores. I collect scores from the same group of 30 students before using the app (pre-test) and again after four weeks (post-test). Because the data come from one group measured at two different times, the scores are naturally paired. For this reason, I would use a paired samples t-test. This test is appropriate when the two sets of scores come from the same participants, and we want to see whether there is a significant change within that group.

If I instead compared two different classes—one using the app and one not using it—then I would choose an independent samples t-test, because the groups would involve different participants and we would be comparing their mean scores. But for the original scenario with pre-test and post-test scores from the same students, the paired samples t-test is the correct choice.

NGUYEN DOAN TRI - When to Use Which t-test?

Nguyễn Đăng Hải HUF04
I think your explanation of when to use a paired samples t-test vs. an independent samples t-test is really clear and logical. You did a good job showing how the choice ...

좀 더...

I think your explanation of when to use a paired samples t-test vs. an independent samples t-test is really clear and logical. You did a good job showing how the choice depends on whether the data come from the same group or different groups.

I do have one question though—have you considered whether there might be other factors influencing the improvement besides the app itself? For example, since you’re only using one group, things like students becoming more familiar with the test format or general improvement over time could also affect the post-test scores. How would you control for that?

Another idea is that, if possible, adding a control group (like you mentioned) could strengthen your study design and make your results more convincing. What do you think about combining both approaches to get more reliable findings?