<?xml version="1.0"?>
<feed xmlns="http://www.w3.org/2005/Atom" xml:lang="en">
	<id>http://practicalstats.labanca.net/index.php?action=history&amp;feed=atom&amp;title=Limitations</id>
	<title>Limitations - Revision history</title>
	<link rel="self" type="application/atom+xml" href="http://practicalstats.labanca.net/index.php?action=history&amp;feed=atom&amp;title=Limitations"/>
	<link rel="alternate" type="text/html" href="http://practicalstats.labanca.net/index.php?title=Limitations&amp;action=history"/>
	<updated>2026-09-25T00:15:15Z</updated>
	<subtitle>Revision history for this page on the wiki</subtitle>
	<generator>MediaWiki 1.31.16</generator>
	<entry>
		<id>http://practicalstats.labanca.net/index.php?title=Limitations&amp;diff=70&amp;oldid=prev</id>
		<title>Admin at 00:36, 29 August 2019</title>
		<link rel="alternate" type="text/html" href="http://practicalstats.labanca.net/index.php?title=Limitations&amp;diff=70&amp;oldid=prev"/>
		<updated>2019-08-29T00:36:46Z</updated>

		<summary type="html">&lt;p&gt;&lt;/p&gt;
&lt;table class=&quot;diff diff-contentalign-left&quot; data-mw=&quot;interface&quot;&gt;
				&lt;col class=&quot;diff-marker&quot; /&gt;
				&lt;col class=&quot;diff-content&quot; /&gt;
				&lt;col class=&quot;diff-marker&quot; /&gt;
				&lt;col class=&quot;diff-content&quot; /&gt;
				&lt;tr class=&quot;diff-title&quot; lang=&quot;en&quot;&gt;
				&lt;td colspan=&quot;2&quot; style=&quot;background-color: #fff; color: #222; text-align: center;&quot;&gt;← Older revision&lt;/td&gt;
				&lt;td colspan=&quot;2&quot; style=&quot;background-color: #fff; color: #222; text-align: center;&quot;&gt;Revision as of 00:36, 29 August 2019&lt;/td&gt;
				&lt;/tr&gt;&lt;tr&gt;&lt;td colspan=&quot;2&quot; class=&quot;diff-lineno&quot; id=&quot;mw-diff-left-l5&quot; &gt;Line 5:&lt;/td&gt;
&lt;td colspan=&quot;2&quot; class=&quot;diff-lineno&quot;&gt;Line 5:&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&#039;diff-marker&#039;&gt;&amp;#160;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;/td&gt;&lt;td class=&#039;diff-marker&#039;&gt;&amp;#160;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&#039;diff-marker&#039;&gt;&amp;#160;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;/td&gt;&lt;td class=&#039;diff-marker&#039;&gt;&amp;#160;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&#039;diff-marker&#039;&gt;−&lt;/td&gt;&lt;td style=&quot;color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;Truth value: &lt;del class=&quot;diffchange diffchange-inline&quot;&gt; 	internal &lt;/del&gt;validity &lt;del class=&quot;diffchange diffchange-inline&quot;&gt;– &lt;/del&gt;Can potential observed changes be attributed to the program or intervention (i.e., the cause) and not to other possible causes (sometimes described as &amp;quot;alternative explanations&amp;quot; for the outcome)?&amp;#160; Threats to internal validity can be grouped in three general categories. The first involve the single group threats – criticisms that apply when there is only a single group that receives the treatment or program. Avoid it by using a comparison group.&amp;#160; The second consists of the multiple group threats – criticisms that are likely to be raised when there are several groups in a study (e.g., a program and a comparison group). It is important to know if they are similar at the start.&amp;#160;  Avoid it by having a pretest/covariate.&amp;#160; Finally, there are social threats to internal validity -- threats that arise because social research is conducted in real-world human contexts where people will react to not only what affects them, but also to what is happening to others around them.&amp;#160; Possible social threats include: diffusion or imitation of treatment, compensatory rivalry, resentful demoralization, and compensatory equalization of treatment.&amp;#160; Teachers implementing the treatment and/or comparison need to be familiar with the research process and can be offered training on the treatment and implementation of the treatment after the data for the study is collected.&lt;/div&gt;&lt;/td&gt;&lt;td class=&#039;diff-marker&#039;&gt;+&lt;/td&gt;&lt;td style=&quot;color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;&lt;ins class=&quot;diffchange diffchange-inline&quot;&gt;==&lt;/ins&gt;Truth value: &lt;ins class=&quot;diffchange diffchange-inline&quot;&gt;Internal &lt;/ins&gt;validity&lt;ins class=&quot;diffchange diffchange-inline&quot;&gt;== &lt;/ins&gt;&lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td colspan=&quot;2&quot;&gt;&amp;#160;&lt;/td&gt;&lt;td class=&#039;diff-marker&#039;&gt;+&lt;/td&gt;&lt;td style=&quot;color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;Can potential observed changes be attributed to the program or intervention (i.e., the cause) and not to other possible causes (sometimes described as &amp;quot;alternative explanations&amp;quot; for the outcome)?&amp;#160; Threats to internal validity can be grouped in three general categories. The first involve the single group threats – criticisms that apply when there is only a single group that receives the treatment or program. Avoid it by using a comparison group.&amp;#160; The second consists of the multiple group threats – criticisms that are likely to be raised when there are several groups in a study (e.g., a program and a comparison group). It is important to know if they are similar at the start.&amp;#160;  Avoid it by having a pretest/covariate.&amp;#160; Finally, there are social threats to internal validity -- threats that arise because social research is conducted in real-world human contexts where people will react to not only what affects them, but also to what is happening to others around them.&amp;#160; Possible social threats include: diffusion or imitation of treatment, compensatory rivalry, resentful demoralization, and compensatory equalization of treatment.&amp;#160; Teachers implementing the treatment and/or comparison need to be familiar with the research process and can be offered training on the treatment and implementation of the treatment after the data for the study is collected.&lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&#039;diff-marker&#039;&gt;&amp;#160;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;/td&gt;&lt;td class=&#039;diff-marker&#039;&gt;&amp;#160;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&#039;diff-marker&#039;&gt;−&lt;/td&gt;&lt;td style=&quot;color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;Applicability: &lt;del class=&quot;diffchange diffchange-inline&quot;&gt; 	external &lt;/del&gt;validity &lt;del class=&quot;diffchange diffchange-inline&quot;&gt;– &lt;/del&gt;Is there any generalizability, or how is the study limited by the confines of a convenience sample?&amp;#160; External validity is increased when more than one site is used.&lt;/div&gt;&lt;/td&gt;&lt;td class=&#039;diff-marker&#039;&gt;+&lt;/td&gt;&lt;td style=&quot;color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;&lt;ins class=&quot;diffchange diffchange-inline&quot;&gt;==&lt;/ins&gt;Applicability: &lt;ins class=&quot;diffchange diffchange-inline&quot;&gt;External &lt;/ins&gt;validity&lt;ins class=&quot;diffchange diffchange-inline&quot;&gt;== &lt;/ins&gt;&lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td colspan=&quot;2&quot;&gt;&amp;#160;&lt;/td&gt;&lt;td class=&#039;diff-marker&#039;&gt;+&lt;/td&gt;&lt;td style=&quot;color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;Is there any generalizability, or how is the study limited by the confines of a convenience sample?&amp;#160; External validity is increased when more than one site is used.&lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&#039;diff-marker&#039;&gt;&amp;#160;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;/td&gt;&lt;td class=&#039;diff-marker&#039;&gt;&amp;#160;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&#039;diff-marker&#039;&gt;−&lt;/td&gt;&lt;td style=&quot;color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;Consistency:	reliability &lt;del class=&quot;diffchange diffchange-inline&quot;&gt;– &lt;/del&gt;Are the instruments for collecting data and analyses appropriate and verified for repeated use?&lt;/div&gt;&lt;/td&gt;&lt;td class=&#039;diff-marker&#039;&gt;+&lt;/td&gt;&lt;td style=&quot;color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;&lt;ins class=&quot;diffchange diffchange-inline&quot;&gt;==&lt;/ins&gt;Consistency: reliability&lt;ins class=&quot;diffchange diffchange-inline&quot;&gt;== &lt;/ins&gt;&lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td colspan=&quot;2&quot;&gt;&amp;#160;&lt;/td&gt;&lt;td class=&#039;diff-marker&#039;&gt;+&lt;/td&gt;&lt;td style=&quot;color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;Are the instruments for collecting data and analyses appropriate and verified for repeated use?&lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&#039;diff-marker&#039;&gt;&amp;#160;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;/td&gt;&lt;td class=&#039;diff-marker&#039;&gt;&amp;#160;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&#039;diff-marker&#039;&gt;−&lt;/td&gt;&lt;td style=&quot;color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;Neutrality:	objectivity &lt;del class=&quot;diffchange diffchange-inline&quot;&gt;– &lt;/del&gt;Does the research design take the greatest advantage of the distribution of treatment and comparison groups and a wide variety of subjects?&amp;#160; Is the treatment being implemented fairly and not likely to cause an unnecessary bias? Is the  value for the study set a priori and appropriate, based on either literature or standards of the field?&lt;/div&gt;&lt;/td&gt;&lt;td class=&#039;diff-marker&#039;&gt;+&lt;/td&gt;&lt;td style=&quot;color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;&lt;ins class=&quot;diffchange diffchange-inline&quot;&gt;==&lt;/ins&gt;Neutrality: objectivity&lt;ins class=&quot;diffchange diffchange-inline&quot;&gt;==&lt;/ins&gt;&lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td colspan=&quot;2&quot;&gt;&amp;#160;&lt;/td&gt;&lt;td class=&#039;diff-marker&#039;&gt;+&lt;/td&gt;&lt;td style=&quot;color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt;Does the research design take the greatest advantage of the distribution of treatment and comparison groups and a wide variety of subjects?&amp;#160; Is the treatment being implemented fairly and not likely to cause an unnecessary bias? Is the  value for the study set a priori and appropriate, based on either literature or standards of the field?&lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;tr&gt;&lt;td class=&#039;diff-marker&#039;&gt;&amp;#160;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt; &lt;/div&gt;&lt;/td&gt;&lt;td class=&#039;diff-marker&#039;&gt;&amp;#160;&lt;/td&gt;&lt;td style=&quot;background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;&quot;&gt;&lt;div&gt; &lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;
&lt;/table&gt;</summary>
		<author><name>Admin</name></author>
		
	</entry>
	<entry>
		<id>http://practicalstats.labanca.net/index.php?title=Limitations&amp;diff=69&amp;oldid=prev</id>
		<title>Admin: Created page with &quot;There are four criteria applicable to the assessment of any research:  truth value, applicability, consistency, and neutrality.     == How do we achieve these criteria in a qu...&quot;</title>
		<link rel="alternate" type="text/html" href="http://practicalstats.labanca.net/index.php?title=Limitations&amp;diff=69&amp;oldid=prev"/>
		<updated>2019-08-29T00:34:48Z</updated>

		<summary type="html">&lt;p&gt;Created page with &amp;quot;There are four criteria applicable to the assessment of any research:  truth value, applicability, consistency, and neutrality.     == How do we achieve these criteria in a qu...&amp;quot;&lt;/p&gt;
&lt;p&gt;&lt;b&gt;New page&lt;/b&gt;&lt;/p&gt;&lt;div&gt;There are four criteria applicable to the assessment of any research:  truth value, applicability, consistency, and neutrality.  &lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== How do we achieve these criteria in a quantitative study? ==&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
Truth value:  	internal validity – Can potential observed changes be attributed to the program or intervention (i.e., the cause) and not to other possible causes (sometimes described as &amp;quot;alternative explanations&amp;quot; for the outcome)?  Threats to internal validity can be grouped in three general categories. The first involve the single group threats – criticisms that apply when there is only a single group that receives the treatment or program. Avoid it by using a comparison group.  The second consists of the multiple group threats – criticisms that are likely to be raised when there are several groups in a study (e.g., a program and a comparison group). It is important to know if they are similar at the start.   Avoid it by having a pretest/covariate.  Finally, there are social threats to internal validity -- threats that arise because social research is conducted in real-world human contexts where people will react to not only what affects them, but also to what is happening to others around them.  Possible social threats include: diffusion or imitation of treatment, compensatory rivalry, resentful demoralization, and compensatory equalization of treatment.  Teachers implementing the treatment and/or comparison need to be familiar with the research process and can be offered training on the treatment and implementation of the treatment after the data for the study is collected.&lt;br /&gt;
&lt;br /&gt;
Applicability:  	external validity – Is there any generalizability, or how is the study limited by the confines of a convenience sample?  External validity is increased when more than one site is used.&lt;br /&gt;
&lt;br /&gt;
Consistency:	reliability – Are the instruments for collecting data and analyses appropriate and verified for repeated use?&lt;br /&gt;
&lt;br /&gt;
Neutrality:	objectivity – Does the research design take the greatest advantage of the distribution of treatment and comparison groups and a wide variety of subjects?  Is the treatment being implemented fairly and not likely to cause an unnecessary bias? Is the  value for the study set a priori and appropriate, based on either literature or standards of the field?&lt;br /&gt;
 &lt;/div&gt;</summary>
		<author><name>Admin</name></author>
		
	</entry>
</feed>