F test vs T test. What is the real diference?
up vote
6
down vote
favorite
As I've learnt, a T - test is used to compare 2 populations’ means, whereas an F-test (ANOVA) is used to compare 2/> populations’ variances.
At the end is this doing the same thing?
My background is from biology and no strong math/stat background. I wonder because whenever I used ANOVA (comparing >2 groups) followed by postHOC Tukey and not observing sig. differences, supervisor asking to use multiple t-test every time. Is this acceptable way of doing statistics.
I see there are many publications in biology where they do not follow statistics taught in the Textbooks.
statistics normal-distribution statistical-inference variance
New contributor
add a comment |
up vote
6
down vote
favorite
As I've learnt, a T - test is used to compare 2 populations’ means, whereas an F-test (ANOVA) is used to compare 2/> populations’ variances.
At the end is this doing the same thing?
My background is from biology and no strong math/stat background. I wonder because whenever I used ANOVA (comparing >2 groups) followed by postHOC Tukey and not observing sig. differences, supervisor asking to use multiple t-test every time. Is this acceptable way of doing statistics.
I see there are many publications in biology where they do not follow statistics taught in the Textbooks.
statistics normal-distribution statistical-inference variance
New contributor
1
Not necessarily, to use a t-test you need an assumption of equal variances, so you may use an F-test to determine if the equal variance assumption holds. So in this case an F-test is a precursor to a t-test.
– gd1035
yesterday
add a comment |
up vote
6
down vote
favorite
up vote
6
down vote
favorite
As I've learnt, a T - test is used to compare 2 populations’ means, whereas an F-test (ANOVA) is used to compare 2/> populations’ variances.
At the end is this doing the same thing?
My background is from biology and no strong math/stat background. I wonder because whenever I used ANOVA (comparing >2 groups) followed by postHOC Tukey and not observing sig. differences, supervisor asking to use multiple t-test every time. Is this acceptable way of doing statistics.
I see there are many publications in biology where they do not follow statistics taught in the Textbooks.
statistics normal-distribution statistical-inference variance
New contributor
As I've learnt, a T - test is used to compare 2 populations’ means, whereas an F-test (ANOVA) is used to compare 2/> populations’ variances.
At the end is this doing the same thing?
My background is from biology and no strong math/stat background. I wonder because whenever I used ANOVA (comparing >2 groups) followed by postHOC Tukey and not observing sig. differences, supervisor asking to use multiple t-test every time. Is this acceptable way of doing statistics.
I see there are many publications in biology where they do not follow statistics taught in the Textbooks.
statistics normal-distribution statistical-inference variance
statistics normal-distribution statistical-inference variance
New contributor
New contributor
edited yesterday
New contributor
asked yesterday
Oncidium
313
313
New contributor
New contributor
1
Not necessarily, to use a t-test you need an assumption of equal variances, so you may use an F-test to determine if the equal variance assumption holds. So in this case an F-test is a precursor to a t-test.
– gd1035
yesterday
add a comment |
1
Not necessarily, to use a t-test you need an assumption of equal variances, so you may use an F-test to determine if the equal variance assumption holds. So in this case an F-test is a precursor to a t-test.
– gd1035
yesterday
1
1
Not necessarily, to use a t-test you need an assumption of equal variances, so you may use an F-test to determine if the equal variance assumption holds. So in this case an F-test is a precursor to a t-test.
– gd1035
yesterday
Not necessarily, to use a t-test you need an assumption of equal variances, so you may use an F-test to determine if the equal variance assumption holds. So in this case an F-test is a precursor to a t-test.
– gd1035
yesterday
add a comment |
2 Answers
2
active
oldest
votes
up vote
3
down vote
The appropriateness of the statistical test depends on the research hypothesis. If, as you suggest in your question, the research hypothesis is that there is a difference in means between at least two groups when there are strictly more than two groups to be compared, then the $F$-test arising from ANOVA is an appropriate test under additional assumptions, because the null hypothesis would be $$H_0 : mu_1 = mu_2 = ldots = mu_k$$ where $k > 2$ represents the number of groups, and $mu_i$ is the true mean of group $i$. A level $alpha$ test would control Type I error for the alternative (research) hypothesis. But the result of such a test would not formally tell you which groups differ from each other in a pairwise sense; thus the need for the Tukey post hoc test, or you could use pairwise $t$ tests with multiplicity correction.
As an illustration of the importance of the research hypothesis, if you have a control group against which different treatments are compared, you could use Dunnett's test instead of ANOVA, as the only comparisons of interest are the treatments against control, not treatments against each other.
The central issue underlying the subsequent identification of statistically significant pairwise differences after an omnibus test is that of multiple comparisons--e.g., even with as few as $4$ groups, you would have $binom{4}{2} = 6$ pairwise comparisons and the Type I error would be inflated without multiplicity correction such as the Bonferroni adjustment.
To simply do pairwise tests before ANOVA would, in my opinion, be ill-advised from the perspective of statistical rigor, although as I have implied, it is not the more serious methodological flaw. It may be useful for exploratory purposes, but adjustment for multiple comparisons is absolutely necessary in order to make inferential claims that could withstand scrutiny.
One final note: a "$t$ test" does not require an assumption of equal variances; the Welch $t$ test (using the Satterthwaite estimate of the degrees of freedom) is one way to address the issue of unequal group variances, and the test statistic is compared to a Student $t$ distribution, so I would consider that a $t$ test.
add a comment |
up vote
2
down vote
A T-test is a univariate hypothesis test that is applied when standard deviation is not known and the sample size is small. The T-statistic follows Student t-distribution under null hypothesis. You use this test for comparing the means of two populations. As @gd1035 mentioned, the t-test assumes equal variances, which you could first check by using an F-test.
The F-test, on the other hand, is statistical test that determines the equality of the variances of the two normal populations. The F-statistic follows the f-distribution under null hypothesis. You use this test for comparing two population variances.
add a comment |
2 Answers
2
active
oldest
votes
2 Answers
2
active
oldest
votes
active
oldest
votes
active
oldest
votes
up vote
3
down vote
The appropriateness of the statistical test depends on the research hypothesis. If, as you suggest in your question, the research hypothesis is that there is a difference in means between at least two groups when there are strictly more than two groups to be compared, then the $F$-test arising from ANOVA is an appropriate test under additional assumptions, because the null hypothesis would be $$H_0 : mu_1 = mu_2 = ldots = mu_k$$ where $k > 2$ represents the number of groups, and $mu_i$ is the true mean of group $i$. A level $alpha$ test would control Type I error for the alternative (research) hypothesis. But the result of such a test would not formally tell you which groups differ from each other in a pairwise sense; thus the need for the Tukey post hoc test, or you could use pairwise $t$ tests with multiplicity correction.
As an illustration of the importance of the research hypothesis, if you have a control group against which different treatments are compared, you could use Dunnett's test instead of ANOVA, as the only comparisons of interest are the treatments against control, not treatments against each other.
The central issue underlying the subsequent identification of statistically significant pairwise differences after an omnibus test is that of multiple comparisons--e.g., even with as few as $4$ groups, you would have $binom{4}{2} = 6$ pairwise comparisons and the Type I error would be inflated without multiplicity correction such as the Bonferroni adjustment.
To simply do pairwise tests before ANOVA would, in my opinion, be ill-advised from the perspective of statistical rigor, although as I have implied, it is not the more serious methodological flaw. It may be useful for exploratory purposes, but adjustment for multiple comparisons is absolutely necessary in order to make inferential claims that could withstand scrutiny.
One final note: a "$t$ test" does not require an assumption of equal variances; the Welch $t$ test (using the Satterthwaite estimate of the degrees of freedom) is one way to address the issue of unequal group variances, and the test statistic is compared to a Student $t$ distribution, so I would consider that a $t$ test.
add a comment |
up vote
3
down vote
The appropriateness of the statistical test depends on the research hypothesis. If, as you suggest in your question, the research hypothesis is that there is a difference in means between at least two groups when there are strictly more than two groups to be compared, then the $F$-test arising from ANOVA is an appropriate test under additional assumptions, because the null hypothesis would be $$H_0 : mu_1 = mu_2 = ldots = mu_k$$ where $k > 2$ represents the number of groups, and $mu_i$ is the true mean of group $i$. A level $alpha$ test would control Type I error for the alternative (research) hypothesis. But the result of such a test would not formally tell you which groups differ from each other in a pairwise sense; thus the need for the Tukey post hoc test, or you could use pairwise $t$ tests with multiplicity correction.
As an illustration of the importance of the research hypothesis, if you have a control group against which different treatments are compared, you could use Dunnett's test instead of ANOVA, as the only comparisons of interest are the treatments against control, not treatments against each other.
The central issue underlying the subsequent identification of statistically significant pairwise differences after an omnibus test is that of multiple comparisons--e.g., even with as few as $4$ groups, you would have $binom{4}{2} = 6$ pairwise comparisons and the Type I error would be inflated without multiplicity correction such as the Bonferroni adjustment.
To simply do pairwise tests before ANOVA would, in my opinion, be ill-advised from the perspective of statistical rigor, although as I have implied, it is not the more serious methodological flaw. It may be useful for exploratory purposes, but adjustment for multiple comparisons is absolutely necessary in order to make inferential claims that could withstand scrutiny.
One final note: a "$t$ test" does not require an assumption of equal variances; the Welch $t$ test (using the Satterthwaite estimate of the degrees of freedom) is one way to address the issue of unequal group variances, and the test statistic is compared to a Student $t$ distribution, so I would consider that a $t$ test.
add a comment |
up vote
3
down vote
up vote
3
down vote
The appropriateness of the statistical test depends on the research hypothesis. If, as you suggest in your question, the research hypothesis is that there is a difference in means between at least two groups when there are strictly more than two groups to be compared, then the $F$-test arising from ANOVA is an appropriate test under additional assumptions, because the null hypothesis would be $$H_0 : mu_1 = mu_2 = ldots = mu_k$$ where $k > 2$ represents the number of groups, and $mu_i$ is the true mean of group $i$. A level $alpha$ test would control Type I error for the alternative (research) hypothesis. But the result of such a test would not formally tell you which groups differ from each other in a pairwise sense; thus the need for the Tukey post hoc test, or you could use pairwise $t$ tests with multiplicity correction.
As an illustration of the importance of the research hypothesis, if you have a control group against which different treatments are compared, you could use Dunnett's test instead of ANOVA, as the only comparisons of interest are the treatments against control, not treatments against each other.
The central issue underlying the subsequent identification of statistically significant pairwise differences after an omnibus test is that of multiple comparisons--e.g., even with as few as $4$ groups, you would have $binom{4}{2} = 6$ pairwise comparisons and the Type I error would be inflated without multiplicity correction such as the Bonferroni adjustment.
To simply do pairwise tests before ANOVA would, in my opinion, be ill-advised from the perspective of statistical rigor, although as I have implied, it is not the more serious methodological flaw. It may be useful for exploratory purposes, but adjustment for multiple comparisons is absolutely necessary in order to make inferential claims that could withstand scrutiny.
One final note: a "$t$ test" does not require an assumption of equal variances; the Welch $t$ test (using the Satterthwaite estimate of the degrees of freedom) is one way to address the issue of unequal group variances, and the test statistic is compared to a Student $t$ distribution, so I would consider that a $t$ test.
The appropriateness of the statistical test depends on the research hypothesis. If, as you suggest in your question, the research hypothesis is that there is a difference in means between at least two groups when there are strictly more than two groups to be compared, then the $F$-test arising from ANOVA is an appropriate test under additional assumptions, because the null hypothesis would be $$H_0 : mu_1 = mu_2 = ldots = mu_k$$ where $k > 2$ represents the number of groups, and $mu_i$ is the true mean of group $i$. A level $alpha$ test would control Type I error for the alternative (research) hypothesis. But the result of such a test would not formally tell you which groups differ from each other in a pairwise sense; thus the need for the Tukey post hoc test, or you could use pairwise $t$ tests with multiplicity correction.
As an illustration of the importance of the research hypothesis, if you have a control group against which different treatments are compared, you could use Dunnett's test instead of ANOVA, as the only comparisons of interest are the treatments against control, not treatments against each other.
The central issue underlying the subsequent identification of statistically significant pairwise differences after an omnibus test is that of multiple comparisons--e.g., even with as few as $4$ groups, you would have $binom{4}{2} = 6$ pairwise comparisons and the Type I error would be inflated without multiplicity correction such as the Bonferroni adjustment.
To simply do pairwise tests before ANOVA would, in my opinion, be ill-advised from the perspective of statistical rigor, although as I have implied, it is not the more serious methodological flaw. It may be useful for exploratory purposes, but adjustment for multiple comparisons is absolutely necessary in order to make inferential claims that could withstand scrutiny.
One final note: a "$t$ test" does not require an assumption of equal variances; the Welch $t$ test (using the Satterthwaite estimate of the degrees of freedom) is one way to address the issue of unequal group variances, and the test statistic is compared to a Student $t$ distribution, so I would consider that a $t$ test.
answered yesterday
heropup
62k65997
62k65997
add a comment |
add a comment |
up vote
2
down vote
A T-test is a univariate hypothesis test that is applied when standard deviation is not known and the sample size is small. The T-statistic follows Student t-distribution under null hypothesis. You use this test for comparing the means of two populations. As @gd1035 mentioned, the t-test assumes equal variances, which you could first check by using an F-test.
The F-test, on the other hand, is statistical test that determines the equality of the variances of the two normal populations. The F-statistic follows the f-distribution under null hypothesis. You use this test for comparing two population variances.
add a comment |
up vote
2
down vote
A T-test is a univariate hypothesis test that is applied when standard deviation is not known and the sample size is small. The T-statistic follows Student t-distribution under null hypothesis. You use this test for comparing the means of two populations. As @gd1035 mentioned, the t-test assumes equal variances, which you could first check by using an F-test.
The F-test, on the other hand, is statistical test that determines the equality of the variances of the two normal populations. The F-statistic follows the f-distribution under null hypothesis. You use this test for comparing two population variances.
add a comment |
up vote
2
down vote
up vote
2
down vote
A T-test is a univariate hypothesis test that is applied when standard deviation is not known and the sample size is small. The T-statistic follows Student t-distribution under null hypothesis. You use this test for comparing the means of two populations. As @gd1035 mentioned, the t-test assumes equal variances, which you could first check by using an F-test.
The F-test, on the other hand, is statistical test that determines the equality of the variances of the two normal populations. The F-statistic follows the f-distribution under null hypothesis. You use this test for comparing two population variances.
A T-test is a univariate hypothesis test that is applied when standard deviation is not known and the sample size is small. The T-statistic follows Student t-distribution under null hypothesis. You use this test for comparing the means of two populations. As @gd1035 mentioned, the t-test assumes equal variances, which you could first check by using an F-test.
The F-test, on the other hand, is statistical test that determines the equality of the variances of the two normal populations. The F-statistic follows the f-distribution under null hypothesis. You use this test for comparing two population variances.
answered yesterday
bob
828
828
add a comment |
add a comment |
Oncidium is a new contributor. Be nice, and check out our Code of Conduct.
Oncidium is a new contributor. Be nice, and check out our Code of Conduct.
Oncidium is a new contributor. Be nice, and check out our Code of Conduct.
Oncidium is a new contributor. Be nice, and check out our Code of Conduct.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3012298%2ff-test-vs-t-test-what-is-the-real-diference%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
1
Not necessarily, to use a t-test you need an assumption of equal variances, so you may use an F-test to determine if the equal variance assumption holds. So in this case an F-test is a precursor to a t-test.
– gd1035
yesterday