AUTHOR=Keck Caroline , Mayer Axel , Rosseel Yves 

TITLE=Overview and evaluation of various frequentist test statistics using constrained statistical inference in the context of linear regression

JOURNAL=Frontiers in Psychology

VOLUME=13

YEAR=2022

URL=https://www.frontiersin.org/journals/psychology/articles/10.3389/fpsyg.2022.899165

DOI=10.3389/fpsyg.2022.899165

ISSN=1664-1078

ABSTRACT=<p>Within the framework of constrained statistical inference, we can test informative hypotheses, in which, for example, regression coefficients are constrained to have a certain direction or be in a specific order. A large amount of frequentist informative test statistics exist that each come with different versions, strengths and weaknesses. This paper gives an overview about these statistics, including the Wald, the LRT, the Score, the <inline-formula><mml:math id="M1" xmlns:mml="http://www.w3.org/1998/Math/MathML"><mml:mover accent="true"><mml:mrow><mml:mi>F</mml:mi></mml:mrow><mml:mo>¯</mml:mo></mml:mover></mml:math></inline-formula>- and the <italic>D</italic>-statistic. Simulation studies are presented that clarify their performance in terms of type I and type II error rates under different conditions. Based on the results, it is recommended to use the Wald and <inline-formula><mml:math id="M2" xmlns:mml="http://www.w3.org/1998/Math/MathML"><mml:mover accent="true"><mml:mrow><mml:mi>F</mml:mi></mml:mrow><mml:mo>¯</mml:mo></mml:mover></mml:math></inline-formula>-test rather than the LRT and Score test as the former need less computing time. Furthermore, it is favorable to use the degrees of freedom corrected rather than the naive mean squared error when calculating the test statistics as well as using the <inline-formula><mml:math id="M3" xmlns:mml="http://www.w3.org/1998/Math/MathML"><mml:mover accent="true"><mml:mrow><mml:mi>F</mml:mi></mml:mrow><mml:mo>¯</mml:mo></mml:mover></mml:math></inline-formula>- rather than the <inline-formula><mml:math id="M4" xmlns:mml="http://www.w3.org/1998/Math/MathML"><mml:msup><mml:mrow><mml:mover accent="true"><mml:mrow><mml:mi>χ</mml:mi></mml:mrow><mml:mo>¯</mml:mo></mml:mover></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msup></mml:math></inline-formula>-distribution when calculating the <italic>p</italic>-values.</p>