AUTHOR=Ronda-Pupo Guillermo Armando 

TITLE=A Framework to Assess the Citation Performance of Complex Innovation Systems

JOURNAL=Frontiers in Research Metrics and Analytics

VOLUME=6

YEAR=2021

URL=https://www.frontiersin.org/journals/research-metrics-and-analytics/articles/10.3389/frma.2021.622006

DOI=10.3389/frma.2021.622006

ISSN=2504-0537

ABSTRACT=<p>Scientometric indicators are useful to evaluate the relevance of scientific research, to prepare rankings, and to evaluate and inform research policies. That is why the choice of appropriate indicators is a matter of primary concern. This article aims to introduce a framework to decide the appropriate type of indicator for assessing the citation-based performance of complex innovation systems. The framework is two-fold: First, it brings the methodology to decide when the use of standard average based indicators is granted, and when scale-invariant indicators are mandatory. Second, it provides the procedures to build scale-invariant indicators to assess the relative impact of complex innovation systems. The framework is validated empirically through the evaluation of the relative impact of the Chilean science system in 2017. The result suggests that the Chilean science system has characteristics of a complex innovation system such as the distribution of citations fits to a power law with an exponential cutoff <inline-formula id="inf1"><mml:math id="minf1" xmlns:mml="http://www.w3.org/1998/Math/MathML"><mml:mrow><mml:mo>−</mml:mo><mml:mn>2.77</mml:mn><mml:mo>±</mml:mo><mml:mn>0.09</mml:mn></mml:mrow></mml:math></inline-formula> and a power-law correlation between the size of the system and its impact <inline-formula id="inf2"><mml:math id="minf2" xmlns:mml="http://www.w3.org/1998/Math/MathML"><mml:mrow><mml:mn>1.29</mml:mn><mml:mo>±</mml:mo><mml:mn>0.11</mml:mn></mml:mrow></mml:math></inline-formula>. Furthermore, the framework shows to be efficient to compare fields of vastly different sizes.</p>