<?xml version="1.0"?>
<feed xmlns="http://www.w3.org/2005/Atom" xml:lang="en">
	<id>http://practicalstats.labanca.net/index.php?action=history&amp;feed=atom&amp;title=Selecting_a_Post_Hoc_test</id>
	<title>Selecting a Post Hoc test - Revision history</title>
	<link rel="self" type="application/atom+xml" href="http://practicalstats.labanca.net/index.php?action=history&amp;feed=atom&amp;title=Selecting_a_Post_Hoc_test"/>
	<link rel="alternate" type="text/html" href="http://practicalstats.labanca.net/index.php?title=Selecting_a_Post_Hoc_test&amp;action=history"/>
	<updated>2026-09-25T00:18:35Z</updated>
	<subtitle>Revision history for this page on the wiki</subtitle>
	<generator>MediaWiki 1.31.16</generator>
	<entry>
		<id>http://practicalstats.labanca.net/index.php?title=Selecting_a_Post_Hoc_test&amp;diff=481&amp;oldid=prev</id>
		<title>Admin at 21:21, 11 May 2022</title>
		<link rel="alternate" type="text/html" href="http://practicalstats.labanca.net/index.php?title=Selecting_a_Post_Hoc_test&amp;diff=481&amp;oldid=prev"/>
		<updated>2022-05-11T21:21:25Z</updated>

		<summary type="html">&lt;p&gt;&lt;/p&gt;
&lt;table class=&quot;diff diff-contentalign-left&quot; data-mw=&quot;interface&quot;&gt;
				&lt;col class=&quot;diff-marker&quot; /&gt;
				&lt;col class=&quot;diff-content&quot; /&gt;
				&lt;col class=&quot;diff-marker&quot; /&gt;
				&lt;col class=&quot;diff-content&quot; /&gt;
				&lt;tr class=&quot;diff-title&quot; lang=&quot;en&quot;&gt;
				&lt;td colspan=&quot;2&quot; style=&quot;background-color: #fff; color: #222; text-align: center;&quot;&gt;← Older revision&lt;/td&gt;
				&lt;td colspan=&quot;2&quot; style=&quot;background-color: #fff; color: #222; text-align: center;&quot;&gt;Revision as of 21:21, 11 May 2022&lt;/td&gt;
				&lt;/tr&gt;&lt;tr&gt;&lt;td colspan=&quot;2&quot; class=&quot;diff-lineno&quot; id=&quot;mw-diff-left-l88&quot; &gt;Line 88:&lt;/td&gt;
&lt;td colspan=&quot;2&quot; class=&quot;diff-lineno&quot;&gt;Line 88:&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&#039;diff-marker&#039;&gt;&amp;#160;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;== Post Hoc Tests SPSS Directions ==&lt;/div&gt;&lt;/td&gt;&lt;td class=&#039;diff-marker&#039;&gt;&amp;#160;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;== Post Hoc Tests SPSS Directions ==&lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&#039;diff-marker&#039;&gt;&amp;#160;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;/td&gt;&lt;td class=&#039;diff-marker&#039;&gt;&amp;#160;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&#039;diff-marker&#039;&gt;−&lt;/td&gt;&lt;td style=&quot;color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt; On SPSS, find analyze and select &lt;del class=&quot;diffchange diffchange-inline&quot;&gt;univariant&lt;/del&gt;. Then, choose post hoc and move over your independent variable into the box. Finally, select the post hoc test that you want to run.&lt;/div&gt;&lt;/td&gt;&lt;td class=&#039;diff-marker&#039;&gt;+&lt;/td&gt;&lt;td style=&quot;color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt; On SPSS, find analyze and select &lt;ins class=&quot;diffchange diffchange-inline&quot;&gt;univariate&lt;/ins&gt;. Then, choose post hoc and move over your independent variable into the box. Finally, select the post hoc test that you want to run.&lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&#039;diff-marker&#039;&gt;&amp;#160;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;/td&gt;&lt;td class=&#039;diff-marker&#039;&gt;&amp;#160;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&#039;diff-marker&#039;&gt;&amp;#160;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;&amp;#039;&amp;#039;Contributed by Lisa Daigle&amp;#039;&amp;#039;&lt;/div&gt;&lt;/td&gt;&lt;td class=&#039;diff-marker&#039;&gt;&amp;#160;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;&amp;#039;&amp;#039;Contributed by Lisa Daigle&amp;#039;&amp;#039;&lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;/table&gt;</summary>
		<author><name>Admin</name></author>
		
	</entry>
	<entry>
		<id>http://practicalstats.labanca.net/index.php?title=Selecting_a_Post_Hoc_test&amp;diff=405&amp;oldid=prev</id>
		<title>Ldaigle at 20:52, 21 April 2022</title>
		<link rel="alternate" type="text/html" href="http://practicalstats.labanca.net/index.php?title=Selecting_a_Post_Hoc_test&amp;diff=405&amp;oldid=prev"/>
		<updated>2022-04-21T20:52:11Z</updated>

		<summary type="html">&lt;p&gt;&lt;/p&gt;
&lt;table class=&quot;diff diff-contentalign-left&quot; data-mw=&quot;interface&quot;&gt;
				&lt;col class=&quot;diff-marker&quot; /&gt;
				&lt;col class=&quot;diff-content&quot; /&gt;
				&lt;col class=&quot;diff-marker&quot; /&gt;
				&lt;col class=&quot;diff-content&quot; /&gt;
				&lt;tr class=&quot;diff-title&quot; lang=&quot;en&quot;&gt;
				&lt;td colspan=&quot;2&quot; style=&quot;background-color: #fff; color: #222; text-align: center;&quot;&gt;← Older revision&lt;/td&gt;
				&lt;td colspan=&quot;2&quot; style=&quot;background-color: #fff; color: #222; text-align: center;&quot;&gt;Revision as of 20:52, 21 April 2022&lt;/td&gt;
				&lt;/tr&gt;&lt;tr&gt;&lt;td colspan=&quot;2&quot; class=&quot;diff-lineno&quot; id=&quot;mw-diff-left-l85&quot; &gt;Line 85:&lt;/td&gt;
&lt;td colspan=&quot;2&quot; class=&quot;diff-lineno&quot;&gt;Line 85:&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&#039;diff-marker&#039;&gt;&amp;#160;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;/td&gt;&lt;td class=&#039;diff-marker&#039;&gt;&amp;#160;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&#039;diff-marker&#039;&gt;&amp;#160;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;This test is the most conservative of all post hoc tests.&amp;#160; Compared to Tukey&amp;#039;s HSD, Scheffe has less Power when making pairwise (simple) comparisons, but more Power when making complex comparisons.&amp;#160; It is appropriate to use Scheffe test only when making many post hoc complex comparisons (e.g. more than k-1).&lt;/div&gt;&lt;/td&gt;&lt;td class=&#039;diff-marker&#039;&gt;&amp;#160;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;This test is the most conservative of all post hoc tests.&amp;#160; Compared to Tukey&amp;#039;s HSD, Scheffe has less Power when making pairwise (simple) comparisons, but more Power when making complex comparisons.&amp;#160; It is appropriate to use Scheffe test only when making many post hoc complex comparisons (e.g. more than k-1).&lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&#039;diff-marker&#039;&gt;−&lt;/td&gt;&lt;td style=&quot;color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;&lt;del class=&quot;diffchange diffchange-inline&quot;&gt; &lt;/del&gt;&lt;/div&gt;&lt;/td&gt;&lt;td class=&#039;diff-marker&#039;&gt;+&lt;/td&gt;&lt;td style=&quot;color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;&amp;#160;&lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td colspan=&quot;2&quot;&gt;&amp;#160;&lt;/td&gt;&lt;td class=&#039;diff-marker&#039;&gt;+&lt;/td&gt;&lt;td style=&quot;color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;&lt;ins class=&quot;diffchange diffchange-inline&quot;&gt;== Post Hoc Tests SPSS Directions ==&lt;/ins&gt;&lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td colspan=&quot;2&quot;&gt;&amp;#160;&lt;/td&gt;&lt;td class=&#039;diff-marker&#039;&gt;+&lt;/td&gt;&lt;td style=&quot;color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;&amp;#160;&lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td colspan=&quot;2&quot;&gt;&amp;#160;&lt;/td&gt;&lt;td class=&#039;diff-marker&#039;&gt;+&lt;/td&gt;&lt;td style=&quot;color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;&lt;ins class=&quot;diffchange diffchange-inline&quot;&gt; On SPSS, find analyze and select univariant. Then, choose post hoc and move over your independent variable into the box. Finally, select the post hoc test that you want to run.&lt;/ins&gt;&lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td colspan=&quot;2&quot;&gt;&amp;#160;&lt;/td&gt;&lt;td class=&#039;diff-marker&#039;&gt;+&lt;/td&gt;&lt;td style=&quot;color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;&amp;#160;&lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td colspan=&quot;2&quot;&gt;&amp;#160;&lt;/td&gt;&lt;td class=&#039;diff-marker&#039;&gt;+&lt;/td&gt;&lt;td style=&quot;color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;&lt;ins class=&quot;diffchange diffchange-inline&quot;&gt;&amp;#039;&amp;#039;Contributed by Lisa Daigle&amp;#039;&amp;#039;&lt;/ins&gt;&lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;/table&gt;</summary>
		<author><name>Ldaigle</name></author>
		
	</entry>
	<entry>
		<id>http://practicalstats.labanca.net/index.php?title=Selecting_a_Post_Hoc_test&amp;diff=58&amp;oldid=prev</id>
		<title>Admin: Created page with &quot;&#039;&#039;Note:  The editor is unsure of the source of this material.  A citation would be greatly appreciated!&#039;&#039;   ----    “Once you have determined that differences exist among th...&quot;</title>
		<link rel="alternate" type="text/html" href="http://practicalstats.labanca.net/index.php?title=Selecting_a_Post_Hoc_test&amp;diff=58&amp;oldid=prev"/>
		<updated>2019-08-29T00:26:40Z</updated>

		<summary type="html">&lt;p&gt;Created page with &amp;quot;&amp;#039;&amp;#039;Note:  The editor is unsure of the source of this material.  A citation would be greatly appreciated!&amp;#039;&amp;#039;   ----    “Once you have determined that differences exist among th...&amp;quot;&lt;/p&gt;
&lt;p&gt;&lt;b&gt;New page&lt;/b&gt;&lt;/p&gt;&lt;div&gt;&amp;#039;&amp;#039;Note:  The editor is unsure of the source of this material.  A citation would be greatly appreciated!&amp;#039;&amp;#039;&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
----&lt;br /&gt;
 &lt;br /&gt;
&lt;br /&gt;
“Once you have determined that differences exist among the means, post hoc range tests and pairwise multiple comparisons can determine which means differ. Range tests identify homogeneous subsets of means that are not different from each other.  Pairwise multiple comparisons test the difference between each pair of means, and yield a matrix where asterisks indicate significantly different group means at an alpha level of 0.05” (SPSS, Inc.). &lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== Post Hoc tests that assume equal variance ==&lt;br /&gt;
&lt;br /&gt;
{| class=&amp;quot;wikitable&amp;quot;&lt;br /&gt;
|-&lt;br /&gt;
! Multiple Comparison Tests AND Range Tests&lt;br /&gt;
! Range Tests Only &lt;br /&gt;
! Multiple Comparison Tests Only&lt;br /&gt;
|-&lt;br /&gt;
| Tukey’s HSD (honestly significant difference) test &lt;br /&gt;
| Tukey’s b (AKA, Tukey’s WSD (Wholly Significant Difference)) &lt;br /&gt;
| Bonferroni (don&amp;#039;t use with 5 groups or greater) &lt;br /&gt;
|-&lt;br /&gt;
| Hochberg’s GT2  &lt;br /&gt;
| S-N-K (Student-Newman-Keuls)  &lt;br /&gt;
| Sidak &lt;br /&gt;
|-&lt;br /&gt;
| Gabriel &lt;br /&gt;
| Duncan &lt;br /&gt;
| Dunnett (compares a control group to the other groups without comparing the other groups to each other)&lt;br /&gt;
|-&lt;br /&gt;
| Scheffe (confidence intervals that are fairly wide) &lt;br /&gt;
| R-E-G-W F (Ryan-Einot-Gabriel-Welsch F test)  &lt;br /&gt;
| LSD (least significant difference)&lt;br /&gt;
|-&lt;br /&gt;
| &lt;br /&gt;
| R-E-G-W Q (Ryan-Einot-Gabriel-Welsch range test)  &lt;br /&gt;
| &lt;br /&gt;
|-&lt;br /&gt;
|&lt;br /&gt;
| Waller-Duncan  &lt;br /&gt;
| &lt;br /&gt;
|}&lt;br /&gt;
&lt;br /&gt;
== Post Hoc tests that do not assume equal variances ==&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
Tamhane’s T2 &lt;br /&gt;
&lt;br /&gt;
Dunnett’s T3 &lt;br /&gt;
&lt;br /&gt;
Games-Howell &lt;br /&gt;
&lt;br /&gt;
Dunnett’s C&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== About the more popular Post Hoc tests ==&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&amp;#039;&amp;#039;Fisher&amp;#039;s LSD (Least Significant Different)&amp;#039;&amp;#039;&lt;br /&gt;
 &lt;br /&gt;
This test is the most liberal of all Post Hoc tests and its critical t for significance is not affected by the number of groups.  This test is appropriate when you have 3 means to compare. It is not appropriate for additional means. &lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&amp;#039;&amp;#039;Bonferroni (AKA, Dunn’s Bonferroni)&amp;#039;&amp;#039; &lt;br /&gt;
&lt;br /&gt;
This test does not require the overall ANOVA to be significant. It is appropriate when the number of comparisons (c = number of comparisons = k(k-1))/2) exceeds the number of degrees of freedom (df) between groups (df = k-1).  This test is very conservative and its power quickly declines as the c increases.  A good rule of thumb is that the number of comparisons (c) be no larger than the degrees of freedom (df). &lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&amp;#039;&amp;#039;Newman-Keuls&amp;#039;&amp;#039; &lt;br /&gt;
&lt;br /&gt;
If there is more than one true null hypothesis in a set of means, this test will overestimate they familywise error rate.  It is appropriate to use this test when the number of comparisons exceeds the number of degrees of freedom (df) between groups (df = k-1) and one does not wish to be as conservative as the Bonferroni. &lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&amp;#039;&amp;#039;Tukey&amp;#039;s HSD (Honestly Significant Difference)&amp;#039;&amp;#039;&lt;br /&gt;
&lt;br /&gt;
This test is perhaps the most popular post hoc.  It reduces Type I error at the expense of Power.  It is appropriate to use this test when one desires all the possible comparisons between a large set of means (6 or more means). &lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&amp;#039;&amp;#039;Tukey&amp;#039;s b (AKA, Tukey’s WSD (Wholly Significant Difference))&amp;#039;&amp;#039; &lt;br /&gt;
&lt;br /&gt;
This test strikes a balance between the Newman-Keuls and Tukey&amp;#039;s more conservative HSD regarding Type I error and Power.  Tukey&amp;#039;s b is appropriate to use when one is making more than k-1 comparisons, yet fewer than (k(k-1))/2 comparisons, and needs more control of Type I error than Newman-Kuels. &lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&amp;#039;&amp;#039;Scheffe&amp;#039;&amp;#039;&lt;br /&gt;
&lt;br /&gt;
This test is the most conservative of all post hoc tests.  Compared to Tukey&amp;#039;s HSD, Scheffe has less Power when making pairwise (simple) comparisons, but more Power when making complex comparisons.  It is appropriate to use Scheffe test only when making many post hoc complex comparisons (e.g. more than k-1).&lt;br /&gt;
 &lt;/div&gt;</summary>
		<author><name>Admin</name></author>
		
	</entry>
</feed>