Controlling for a variable

<h2 id="experiments">Experiments</h2>

<p>Experiments attempt to assess the effect of manipulating one or more <a href="/facts/Dependent_and_independent_variables/dINfzIF2">independent variables</a> on one or more <a href="/facts/Dependent_and_independent_variables/dINfzIF2">dependent variables</a>.  To ensure the measured effect is not influenced by external factors, other variables must be held constant. The variables made to remain constant during an experiment are referred to as <a href="/facts/Control_variable/5G6PK5Jw">control variables</a>.
</p><p>For example, if an outdoor experiment were to be conducted to compare how different wing designs of a <a href="/facts/Paper_airplane/0elXzyYx">paper airplane</a> (the independent variable) affect how far it can fly (the dependent variable), one would want to ensure that the experiment is conducted at times when the weather is the same, because one would not want weather to affect the experiment. In this case, the control variables may be wind speed, direction and precipitation. If the experiment were conducted when it was sunny with no wind, but the weather changed, one would want to postpone the completion of the experiment until the control variables (the wind and precipitation level) were the same as when the experiment began.
</p><p>In <a href="/facts/Scientific_control/FXHfQwHx">controlled experiments</a> of medical treatment options on humans, researchers randomly assign individuals to a <a href="/facts/Treatment_and_control_groups/zeT4uJ2S">treatment group</a> or <a href="/facts/Treatment_and_control_groups/zeT4uJ2S">control group</a>. This is done to reduce the <a href="/facts/Confounding/G4TVx1dt">confounding</a> effect of irrelevant variables that are not being studied, such as the <a href="/facts/Placebo/3fw50t53">placebo effect</a>.
</p>
<h2 id="observational-studies">Observational studies</h2>
<p>In an <a href="/facts/Observational_study/zEhxI4eh">observational study</a>, researchers have no control over the values of the independent variables, such as who receives the treatment. Instead, they must control for variables using <a href="/facts/Statistics/DNPsKGYU">statistics</a>.
</p><p>Observational studies are used when controlled experiments may be unethical or impractical. For instance, if a researcher wished to study the effect of unemployment (<a href="/facts/Independent_variable/dINfzIF2">the independent variable</a>) on health (<a href="/facts/Independent_variable/dINfzIF2">the dependent variable</a>), it would be considered unethical by <a href="/facts/Institutional_review_board/kfgmngkI">institutional review boards</a> to randomly assign some participants to have jobs and some not to. Instead, the researcher will have to create a <a href="/facts/Sample_(statistics)/URCwKNge">sample</a> which includes some employed people and some unemployed people. However, there could be factors that affect both whether someone is employed and how healthy he or she is. Part of any observed association between the independent variable (employment status) and the dependent variable (health) could be due to these outside, <a href="/facts/Confounding/G4TVx1dt">spurious</a> factors rather than indicating a true link between them. This can be problematic even in a <a href="/facts/Sampling_(statistics)/kIb01xdL">true random sample</a>. By controlling for the extraneous variables, the researcher can come closer to understanding the true effect of the independent variable on the dependent variable.
</p><p>In this context the extraneous variables can be controlled for by using <a href="/facts/Multiple_regression/n6z5Tf7K">multiple regression</a>. The regression uses as independent variables not only the one or ones whose effects on the dependent variable are being studied, but also any potential confounding variables, thus avoiding <a href="/facts/Omitted_variable_bias/eoDm4AJX">omitted variable bias</a>. "Confounding variables" in this context means other factors that not only influence the <i>dependent variable</i> (the outcome) but also influence the main <i>independent</i> variable.<a class="footnote-ref" id="fnref:5" href="#fn:5"><sup>5</sup></a>
</p>
<h3>OLS Regressions and control variables</h3>
<p>The simplest examples of control variables in regression analysis comes from <a href="/facts/Ordinary_least_squares/q7H9k5vM">Ordinary Least Squares</a> (OLS) estimators. The OLS framework assumes the following:
</p>
<ul><li>Linear relationship - OLS statistical models are linear. Hence the relationship between explanatory variables and the mean of Y must be linear.</li>
<li>Homoscedasticity - This requires <a href="/facts/Homogeneity_and_heterogeneity_(statistics)/gok3LHv3">homogeneity</a> of variances, that is equal or similar variances across these data.</li>
<li>Independence/No <a href="/facts/Autocorrelation/dm4MqK0A">Autocorrelation</a> - Error terms from one (or more) observation  can not be influenced by error terms of other observations.</li>
<li><a href="/facts/Normal_distribution/UapjjPyQ">Normality</a> of Errors - The errors are jointly normal and uncorrelated, this implies that 
  
    
      
        (
        
          ϵ
          
            i
          
        
        
          )
          
            i
            ∈
            N
          
        
      
    
    {\displaystyle (\epsilon _{i})_{i\in N}}
  
  i.e. that the error terms are an independently and identically distributed set (iid). This implies that the unobservables between different groups or observations are independent.</li>
<li>No multicollinearity -  Independent variables must not be highly correlated with each other. For regressions using matrix notation, the matrix must be full rank i.e.
  
    
      
        
          X
          
            
              
              ′
            
          
        
        X
      
    
    {\displaystyle X^{'}X}
  
 is invertible.</li></ul>
<p>Accordingly, a control variable can be interpreted as a linear explanatory variable that affects the mean value of Y (Assumption 1), but which does not present the primary variable of investigation, and which also satisfies the other assumptions above.<a class="footnote-ref" id="fnref:6" href="#fn:6"><sup>6</sup></a>
</p>
<h3>Example</h3>
<p>Consider a study about whether getting older affects someone's <a href="/facts/Life_satisfaction/ord3Dm4T">life satisfaction</a>.  (Some researchers perceive a "u-shape": life satisfaction appears to decline first and then rise after middle age.<a class="footnote-ref" id="fnref:7" href="#fn:7"><sup>7</sup></a>) To identify the control variables needed here, one could ask what other variables determine not only someone's life satisfaction but also their age. Many other variables determine life satisfaction. But <i>no other variable</i> determines how old someone is (as long as they remain alive).  (All people keep getting older, at the same rate, no matter what their other characteristics.)  So, no control variables are needed here.<a class="footnote-ref" id="fnref:8" href="#fn:8"><sup>8</sup></a>
</p><p>To determine the needed control variables, it can be useful to construct a <a href="/facts/Directed_acyclic_graph/k6zq1os9">directed acyclic graph</a>.<a class="footnote-ref" id="fnref:9" href="#fn:9"><sup>9</sup></a>
</p>
<h2 id="see-also">See also</h2>
<ul><li><a href="/facts/Scientific_control/FXHfQwHx">Scientific control</a></li>
<li><a href="/facts/Mixed_model/PovxPrAy">Mixed model</a></li>
<li><a href="/facts/Age_adjustment/Kqg0n7pC">Age adjustment</a></li></ul>

<h2 id="further-reading">Further reading</h2>
<ul><li>Freedman, David; Pisani, Robert; Purves, Roger (2007). <a href="https://books.google.com/books?id=mviJQgAACAAJ"><i>Statistics</i></a>. W. W. Norton & Company. <a href="/facts/ISBN_(identifier)/15AdSPa9">ISBN</a> 978-0393929720.</li></ul>

<h2 id="references">References</h2>

<ol>
<li id="fn:1"><p>Frost, Jim. "A Tribute to Regression Analysis | Minitab". Retrieved 2015-08-04. <a href="http://blog.minitab.com/blog/adventures-in-statistics/a-tribute-to-regression-analysis" target="_blank">http://blog.minitab.com/blog/adventures-in-statistics/a-tribute-to-regression-analysis</a> <a href="#fnref:1" class="footnote-back-ref">↩</a></p></li>
<li id="fn:2"><p>Streiner, David L (February 2016). "Control or overcontrol for covariates?". Evid Based Ment Health. 19 (1): 4–5. doi:10.1136/eb-2015-102294. PMC 10699339. PMID 26755716. S2CID 11155639. <a href="https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10699339" target="_blank">https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10699339</a> <a href="#fnref:2" class="footnote-back-ref">↩</a></p></li>
<li id="fn:3"><p>Pearl, Judea; Mackenzie, Dana (2018). The Book of Why: The New Science of Cause and Effect. London: Allen Lane. ISBN 978-0-241-24263-6. <a href="978-0-241-24263-6" target="_blank">978-0-241-24263-6</a> <a href="#fnref:3" class="footnote-back-ref">↩</a></p></li>
<li id="fn:4"><p>Pearl, Judea; Mackenzie, Dana (2018). The Book of Why: The New Science of Cause and Effect. London: Allen Lane. ISBN 978-0-241-24263-6. <a href="978-0-241-24263-6" target="_blank">978-0-241-24263-6</a> <a href="#fnref:4" class="footnote-back-ref">↩</a></p></li>
<li id="fn:5"><p>Pearl, Judea; Mackenzie, Dana (2018). The Book of Why: The New Science of Cause and Effect. London: Allen Lane. ISBN 978-0-241-24263-6. <a href="978-0-241-24263-6" target="_blank">978-0-241-24263-6</a> <a href="#fnref:5" class="footnote-back-ref">↩</a></p></li>
<li id="fn:6"><p>WEISBERG, SANFORD (2021). APPLIED LINEAR REGRESSION. JOHN WILEY. ISBN 978-1-119-58014-0. OCLC 1225621417. <a href="978-1-119-58014-0" target="_blank">978-1-119-58014-0</a> <a href="#fnref:6" class="footnote-back-ref">↩</a></p></li>
<li id="fn:7"><p>Blanchflower, D.; Oswald, A. (2008). "Is well-being U-shaped over the life cycle?" (PDF). Social Science & Medicine. 66 (8): 1733–1749. doi:10.1016/j.socscimed.2008.01.030. PMID 18316146. <a href="http://www.nber.org/papers/w12935.pdf" target="_blank">http://www.nber.org/papers/w12935.pdf</a> <a href="#fnref:7" class="footnote-back-ref">↩</a></p></li>
<li id="fn:8"><p>Bartram, D. (2020). "Age and Life Satisfaction: Getting Control Variables under Control". Sociology. 55 (2): 421–437. doi:10.1177/0038038520926871. <a href="https://doi.org/10.1177%2F0038038520926871" target="_blank">https://doi.org/10.1177%2F0038038520926871</a> <a href="#fnref:8" class="footnote-back-ref">↩</a></p></li>
<li id="fn:9"><p>Pearl, Judea; Mackenzie, Dana (2018). The Book of Why: The New Science of Cause and Effect. London: Allen Lane. ISBN 978-0-241-24263-6. <a href="978-0-241-24263-6" target="_blank">978-0-241-24263-6</a> <a href="#fnref:9" class="footnote-back-ref">↩</a></p></li>
</ol>

Controlling for a variable open-in-new

Controlling for a variable