Factors affecting expert performance in bid evaluation: An integrated approach

Experts play a crucial role in underpinning decision-making in most management situations. While recent studies have disclosed the impacts of individuals’ inherent cognition and the external environment on expert performance, these two-dimensional mechanisms remain poorly understood. In this study, we identified 14 factors that influence expert performance in a bid evaluation and applied cross-impact matrix multiplication to examine the interdependence of the factors. The results indicate that the two dimension-related factors affect each other within a person–environment system, and a poor situation perception gives rise to the deviation of expert performance. Expert performance can be improved if external supervision and expertise are strengthened through deliberate practices. The study proposes a new expert performance research tool, elucidates its mechanism in bid evaluation from a cognitive psychology perspective, and provides guidelines for its improvement in workplace contexts.

Introduction

One of the most heated research issues in management science is decision-making, which is strongly associated with experts’ scientific and accurate judgment (Bolger, 1996). Prior research has affirmed that the advice and judgment of experts are prominent in situations with limited data, enormous uncertainty, timely solutions, and unpredictable trends (Burgman et al., 2011). For example, there is a need for expert-aided decision-making in natural resource management to assess hazards (Victoria et al., 2018). In this sense, expert performance is highlighted to describe the process of providing quality services to meet societal demands. An expert’s satisfactory performance depends on whether the expert has sufficient expertise, qualifications, professional morality, and experience. For simplicity, Mcpherson and Kernodle (2007) called these factors “inherent cognition.”

However, given inherent cognition, experts may not provide quality judgments. Havers et al. (2019) suggested that the reason could be the conflicts of stakeholders’ interests and relationships. As a result, the expert is intended to make a biased decision and causes poor performance. Recent studies have further argued that personal reputation and fatigue deserve closer attention as they misguide experts to make incomplete decisions in the peer review process (Rodriguez et al., 2007; Burgman et al., 2011). Experts advocate balancing motivational and external constraints (e.g., external pressure, scenario perception, institutional systems; Ericsson et al., 1993). Thereby, expert performance can be improved. According to Araújo et al. (2006), such factors are external and related to material and social environments.

The synthesis of inherent cognition and external environmental factors suggests that expert performance is dynamic, systematic, interactive, and characterized by multiple feedbacks. As ecological cognition theory elaborates, experts prefer to build their decisions on the interaction between inherent cognition and external environmental factors (Vanda et al., 2013). Victoria et al. (2018) argued the protocol for structured expert elicitation is more conducive to coping with external impacts on inherent cognition than randomly capturing changes in dynamic environments. Therefore, attempts to promote expert performance should consider the interaction between inherent cognition and the external environment.

The enhancement of expert performance is fueled by an increase in inherent cognition and the ability to adapt to the external environment. However, there is scant research on the interaction between inherent cognition and the external environment (Ericsson, 2007; Baker et al., 2010; Li et al., 2014; Helfrich et al., 2018). It is also unsure about how inherent cognition and external environmental factors advance expert performance and how these factors drive one another in an industrial setting. This study aims to bridge this knowledge gap by examining expert performance-related factors. The research objectives are to identify the key factors of expert performance in bid evaluation and evaluate the interrelationships between the identified factors using a driving/dependence power graph. Our findings shed some light on a shift of expert performance concepts from cognitive to management science. Furthermore, we laid a foundation for future studies to generalize expert performance determinants, considering the uncertainty of environmental factors rather than merely psychological representations and cognitive scientific calculations.

Literature review

Rethinking expert performance definitions

Expert performance was coined as a key construct for theorizing expert performance (Ericsson, 2007; Debarnot et al., 2014; Hashimoto et al., 2015). Experts are engaged in providing knowledge-intensive professional services for complex questions. Traditionally, a closed system perspective is adopted to interpret experts’ long-time superior performance (Ericsson, 2008; Ericsson and Harwell, 2019). The long-time superior performance is tied to the accumulation of deliberate practices and feedback that they encode and the refinery of inherent representations memorized for effective use in a determinate world (Ericsson and Kintsch, 1995). Similarly, novices may be likely to produce opinions and judgments as experts do for the same matters if they have enough knowledge and experience (Spence, 1993). As revealed in scientific judgment and the improvement of learning patterns (Krueger et al., 2012; Campitelli et al., 2015; Friedman and Korman, 2019), inherent cognition, including knowledge and experience, pertains to the generation of expert performance. In a closed system, experts’ performances are evaluated without considering the fluctuations in situations they are working with. Unexpected emergencies are precluded in the determination of expert performance.

However, the “closed system” perspective is subject to considerable flaws, as indicated by quantum physics and social and psychological science (Glimcher, 2005). Researchers have thus claimed to advance the closed system to embrace indeterminacy in the research area of brain and behavior (Gigerenzer et al., 2000; Hastie, 2001; Schall, 2004). An open system is consequently framed. Based on the tenet of the open-system philosophy, the determinants of expert performance are beyond the boundary of inherent cognition. For example, an expert’s performance does not necessarily exceed that of a novice, regardless of whether the problem is relatively simple or complicated. Chi (2006) and Spence (1993) indicated that inherent cognition might not realize better performance in judgment and decision making as experts must adapt to a new environment. Over the years, with the development of ecological cognitive science, Araújo et al. (2006) proposed an effective way to obtain superior expert performance by capturing specific environmental and perceptual information. Therefore, improving perceptions about environmental factors and owning privileged access to refined inherent representations are crucial to expert performance (Ericsson and Kintsch, 1995).

Expert performance in bid evaluation

When decision-making time and support resources are stretched, the external environment becomes a predominant factor in the formation of expert performance. This is the case in competitive bidding in the construction sector, where experts are highly involved in evaluating submitted bids. As a result, experts must produce professional services to underpin the determination of winners in competitive bid evaluations. To address the issue, previous studies have proposed approaches and models to aid experts in evaluating bids (Liu et al., 2017; Semaan and Salem, 2017). However, they often face inadequate information and uncertain circumstances (Zhen-Song et al., 2021), suggesting that the interaction between inherent cognition and the external environment is not monotonic.

Previous studies have offered a few approaches to examining the links between inherent cognition and the external environment, such as measuring eye movements and verbal reports (Macmahon and McPherson, 2009; Afonso et al., 2012). The approaches address bid evaluation task constraints and behavior settings in experimental. However, laboratory-based simulations represent a real-life situation where experts are vulnerable to biases in decision-making (Araújo et al., 2006). Notwithstanding the complex factors of bid evaluation, expert performance has been paid extensive attention, Kardes (2006), Burgman et al. (2011), and Connor et al. (2020) proposed that it was better to redefine expert performance to account for those contextual and relational factors of expert performance.

A conceptual framework

Person–environment system

According to the open-system concept, we outlined two dimensions of expert performance: inherent cognition and the external environment. A conceptual framework is proposed below to describe the mechanism of expert performance (Figure 1).

FIGURE 1

Figure 1. The formation mechanism model of expert performance in bid evaluation.

As Figure 1 tells, the formation mechanism of expert performance contains two parts: memory and ecological psychology. Inherent cognition is grounded on theories of memory, of which the main components are knowledge, experience, and qualifications (Ericsson, 2003). The formation of inherent cognition contains a loop in which knowledge, experience, and qualifications give a stimulus to memory. A changed memory enlarges the packet of knowledge, experience, and qualifications. This loop mirrors the formation of inherent cognition (Ericsson, 2007). To align with the enlargement, deliberate practice, encoding, and transformation transform external stimuli into meaningful representations (Kording and Wolpert, 2006). Meanwhile, ecological psychology is referred to explain the impacts of the external environment on expert performance, assuming a person–environment system (PES; Araújo et al., 2006). As Turvey et al. (1981) pointed out, actions, judgment, and performance are based on the lawful connections between individuals and the environment in which they act. Therefore, experts are engaged in social culture, rules, and regulations belonging to the external environment.

Experts utilize external environmental factors to avoid biased decisions (Fischhoff et al., 1982; Ludger and Erik, 2016; Contreras-Pacheco et al., 2020). However, the factors also pose physical, goal-related, and task-related constraints to expert performance (Araújo et al., 2006). These constraints cause experts to feel physical discomfort (Liu et al., 2015), peer pressure (Bohannon, 2013), motivation deviation (Ericsson et al., 2009), loose supervision (Gonsalvez et al., 2017), and weak feedback (Kardes, 2006). Furthermore, given a specific external environment, expert performance may combine inherent cognition with the external environment to present a holistic “person–environment system.” Expert performance results from dynamic, continuous interaction within the PES, which is influenced by inherent cognition and external environmental perceptions.

Interaction between PES and expert performance in bid evaluation

According to ecological psychology theory, bid-evaluation experts’ inherent cognition and perception of the external environment are embedded in each other, emphasizing that the interaction between experts and the environment is an important motivation for expert performance. In the PES, bid-evaluation experts have many opportunities to address the opportunities or possibilities for actions, known as affordances, and seize a set of objective and physical external environmental factors to improve their performance (Costall, 1984). Regarding bid-evaluation experts, perceiving an “affordance” means perceiving how one can make decisions under specific bid evaluation conditions (Araújo et al., 2019).

In the bid evaluation process, experts are supposed to integrate multiple attributes into the overall description of bidders. This is a perceptual process in which bidders’ redundant and irrelevant attributes are removed, and their core attributes are framed. Finally, the experts form inherent cognitive “representations” of the bidders. Interweaving in the environment and perceptual processes (from reactions to relevant external objects and events), this cognitive process is dynamic. Therefore, a bid evaluation task is one in which “affordance” captures the interaction between experts and the environment (e.g., peer pressure, time pressure, supervision system, and opportunity cost) with a concatenation of interdependent decisions over time. At the end of bid evaluations, experts provide feedback by reflecting on or summarizing the results from the external environment to change inherent cognition. For example, whether a bid award decision is passable is determined not by its absolute attribution representation (whether measured in performance, qualification, or scale) but rather by how it relates to the substantive responses of an individual bidder to the rules, including technical requirements, economic indicators, and commitments.

Research methods

Expert performance impacts have been examined by exploratory research, including conceptual research (Ericsson and Ward, 2007) and case analysis (Araújo et al., 2006), with a focus on the influence of inherent cognitive or external environmental factors. However, based on experimental research methods, most quantitative research designs lead to the emergence of artificial decisions and behaviors (Sozzo, 2020). Therefore, we adopted a new perspective by investigating the determinants of on-the-job performance of experts within specialist domains in the workplace. First, two-dimensional factors: inherent cognition and the external environment, were identified. Second, we detected expert performance factors through a literature review. Third, in-depth interviews with experts were implemented to confirm the reliability of the factors. Fourth, factors were refined based on the experts’ evaluations of the similarity and necessity of the factors. Finally, we compiled a list of bid-evaluation expert performance factors. Consequently, the applicability and usefulness of the factors to attain a hierarchical structural framework were confirmed.

Interpretative structural modeling

We detected these factors’ dependency/driving power using cross-impact matrix multiplication, which is often applied to classification and interpretative structural modeling (MICMAC-ISM). Warfield (1974) established a computer-assisted learning process called interpretive structural modeling (ISM) to transform unclear and poorly articulated mental models into well-defined multi-level structural models through experts’ practical experience and knowledge. As many interrelated factors affect expert performance in bid evaluation, we selected ISM for our research methodology. The reason not only goes to a well-established methodology for identifying relationships among specific items but also to providing a fundamental understanding of complex situations. Therefore, this study established an ISM-based hierarchical structure model to clarify the dynamics of relationships among expert performance factors encountered in the bid evaluation practices. The technical route of the ISM is shown in Figure 2.

FIGURE 2

Figure 2. The technical route of interpretive structural modeling.

Expert performance factors in bid evaluation

Following the literature review, we categorized expert performance dimensions into 16 factors. A questionnaire was designed, and 34 experts (from construction, design, cost consulting enterprises, research institutions, and government departments) were interviewed to test the reliability of these dimensions and factors. The interviewees were selected based on their bid-evaluation qualifications and experience, and a deep understanding of construction contracts. The profiles of the interviewees are given in Table 1. To allow them to understand the relationships among the factors, we conducted face-to-face interviews with all the experts. As a result, three factors were removed, and a new one was added. Finally, the remaining 14 bid-evaluation expert performance factors were compiled. A summary of these factors is presented in Table 2.

TABLE 1

Table 1. Identification of expert performance factors per dimension.

TABLE 2

Table 2. Background profiles of interviewed experts.

Generation of the adjacency matrix A

The relationships among the 14 factors were confirmed via interviews with 34 experts. Using ISM, a “leads to” (one factor leading to another) contextual-type relationship was chosen to identify the interacting position of each factor for analysis. An adjacency 14*14 matrices of the identified impact factor elements (1 = Yes; 0 = No) was developed as an option for paired comparison between elements. The presence or absence of a relationship directed from element i to j was indicated by placing “1” or “0,” respectively, in the corresponding intersection of row i and column j. After that, information was sent to experts for comments. Based on their responses, we used the Delphi technique to obtain common views from the participants. When 80% of the interviewees agreed upon the relation, it was thought to have a consensus. The threshold value for the reliability of factors was 0.80. Adjacency reachability matrix A, indicating the relationship between elements, is presented in Table 3.

TABLE 3

Table 3. Adjacency reachability matrix A of expert performance factors.

Reachability matrix calculation

From the adjacency reachability matrix A, redundant relationships between elements were eliminated through an iterative process. A diagram established the final relationship level between elements in a hierarchical form. As the adjacency reachability matrix A is a Boolean matrix, we calculated it by applying the following Boolean algorithm:

$\mathrm{let}I\left(n\times n\right)=\left[\begin{array}{cccc}1& 0& \cdots & 0\\ 0& 1& \cdots & 0\\ ⋮& ⋮& \ddots & ⋮\\ 0& 0& \cdots & 1.\end{array}\right]$

$\begin{array}{ll}R={\left(A+I\right)}^{\left(n+1\right)}={\left(A+I\right)}^n\ne \cdots \ne {\left(A+I\right)}^2\ne \left(A+I\right)& (1)\end{array}$

where $R={\left(A+I\right)}^n$ is the reachability matrix R of matrix A.

According to adjacency reachability matrix I of the bid-evaluation expert performance, the calculation process was implemented in MATLAB (Lindfield and Penny, 2012). When $n=5$ , the equation $M={\left(A+I\right)}^{\left(n+1\right)}={\left(A+I\right)}^n\ne \cdots \ne {\left(A+I\right)}^2\ne \left(A+I\right)$ held. The derived result and the reachability matrix are shown in Table 4.

TABLE 4

Table 4. Reachability matrix of expert performance factors.

Reachability matrix R analysis

The reachability matrix obtained above was partitioned by deriving the reachability set and the antecedent set to establish the hierarchy model of the ISM. The reachability set for each element represented a set of elements (i.e., several risk elements, including itself) upon which the current element had an impact. For example, in the ith horizontal row Si of reachability matrix R, if $S_{ij}=1\left(j=1,2,\cdots ,n\right)$ , the element Sij is placed in the reachability set, expressed as Si. The antecedent set reflects a set of elements that affected the current element. Along the same lines, in the jth column Sj of reachability matrix R, if $R_{ij}=1\left(i=1,2,⥂\cdots ,n\right)$ , the element Rij is placed in the antecedent set, expressed as Aj. The intersection of these sets $S_i\cap A_j$ was derived for all elements. If Si is a complete subset of Aj, the element or elements were moved from the reachability matrix and assigned a specific level.

After the iteration, the reachability set for the elements Expertise (S1) and Number of bid evaluations (S5) was a complete subset of the antecedent set; therefore, it was considered the highest level of the elements removed from the reachability matrix. On the other hand, the elements Stress situations (S10), Natural Environment (S11), and Distance (S12) occupied the reachability sets and the antecedent sets on their own, which implies that these factors were isolated from other elements. They were, therefore, removed from the reachability matrix and placed on the first level. The iterative processes were continued in this manner to identify the different levels. Consequently, the hierarchy model of the ISM consisted of all these levels. The results of the final iteration are given in Table 5.

TABLE 5

Table 5. Level partition of reachability matrix.

Development of a diagram

A diagram explains the contextual relationship between an impact factor element and its hierarchy. First, as shown in Table 5, the elements taken from the reachability matrix in the previous step were placed at the highest level of the hierarchy. Thus, Expertise (S1), Number of bid evaluations (S5), Stress situations (S10), Natural environment (S11), and Distance (S12) appeared at the top. Next, the elements of Academic ability (S2), Motivation preference (S3), Years qualified as an expert (S4), and Rewards (S14) were removed before the next partition at the second level and placed below the top level. This process was repeated until all the elements were rearranged, creating a four-layer hierarchical structural diagram of the expert performance factors in bid evaluation (Figure 3).

FIGURE 3

Figure 3. Diagram of expert performance factors in bid evaluation.

Using MICMAC analysis, it is necessary to prove the relationships among impact factor elements based on the attained diagram. We used this approach to analyze a factor’s dependency and driving power. The analysis complements experienced users’ impressions drawn from the visual analysis of influence structures. To better understand the significance of certain elements and their influence on others, we used the MICMAC to classify the factors into four clusters (autonomous, dependent, linkage, and independent) according to their driving and dependence power. The driving-and-dependence power of an element was computed via the summation of the corresponding rows. Similarly, the dependence power was computed via the summation of the corresponding rows and columns, respectively. Finally, each element was plotted on the driving-dependence power matrix (Figure 4).

FIGURE 4

Figure 4. Classification of factors.

The first cluster represents “autonomous factors” (weak driving and dependence power). It includes Stress situations (S10), Natural environment (S11), Distance (S12), Strength (S13), Rewards (S14), Academic ability (S2), Motivation preference (S3), Years qualified as an expert (S4), Morality (S6), and Objective (S7). This set of factors reflects complicated situations. The “dependent factors” belonged to the second cluster (weak driving, strong dependence power) and ranked highest in the importance levels of the ISM-based hierarchical model. Two factors were assigned: Expertise (S1) and the number of bid evaluations (S5). Their dependence indicates that they depended on other factors to be resolved during the bid-evaluation expert performance. Therefore, bid-evaluation experts should consider all other factors to achieve the dependent factors and retain superior expert performance. The third cluster specifies the “linkage factors” (strong driving and dependence power). Any change occurring to these factors would significantly impact other factors in return. No factors correlated with this category in our study, implying that none of them had strong driving and dependence power. The “independent factors” (strong driving, weak dependence power) in the fourth cluster formed the foundation of the ISM hierarchical model and should be given priority. The two factors in this set, Situation perception (S8) and Supervision system (S9), are vital, and bid-evaluation experts and policymakers should focus on them for superior bid-evaluation expert performance.

Findings and discussion

It is important to enhance expert performance in bid evaluation. The derived model reflects the relationships among expert performance factors in bid evaluation practices.

A holistic picture of expert performance factors

The two dimensions of internal cognition and the external environment were independent through theoretical deduction. In the PES, the interaction between the “perceptions” and “affordance” of experts is manifested as expert performance, which feeds back or verifies internal cognition and external environment, forming a “closed system” (Figure 1). However, in the context of engineering, 14 factors affect expert performance, seven of which are from the internal cognitive dimension and seven from the external environmental dimension. We could observe that the two-dimensional factors were scattered on four levels (Figure 3). Inherent cognitive factors influenced each other and were scattered at the 1–3 level. Most of them had strong dependence and were driven and influenced by external environmental dimension factors. Level 2–4 was PES, with perception (e.g., body perception) and supply (e.g., the regulatory system) at the lowest end, the most important driving force in the structural system that influences other factors to work together.

The three factors under the heading of the external environment, namely pressure, natural environment, and working distance, together with expertise and bid evaluation times (internal cognitive dimensions), were at the first level of the hierarchical structure system and were the most direct influencing factors. However, the three factors of the environmental dimension existed independently of any other factors, leaving the structure in an open form. These phenomena reflect the organic integration of memory and ecological cognition theories and completely describe the factors affecting expert performance in engineering. These influencing factors differ from the characteristic cognitive ability mentioned in the ecological dynamics theory of sports decision-making with the help of regularity and universality (Araújo et al., 2006). For expert-performance factors with engineering characteristics, inherent cognition has a dynamic influence on expert performance under the constraint of a unique external environment. In contrast, the external environmental factors are more strongly driven or have a direct and independent influence.

Hierarchy of expert performance factors

In the bid evaluation, considering independent factors (strong driving and weak dependence power from cluster four), situation perception reflects the experts’ feelings regarding the environmental properties, including seating, air humidity, and physical comfort. Negative feelings will hinder expert performance as perception, cognition, and behavior are integrated processes. The nature and type of cognition are influenced by the interaction between the body and the external environment. For example, situation perception, relating to concepts such as fatigue (Orazbayev, 2017), is a hidden expert-performance-influencing factor that few researchers focus on. The perception of “affordance” has a dynamic quality and can change (Fajen et al., 2009). Improved working conditions can maintain enhanced situation perceptions and effectively obtain sustainable and superior expert performance. The other independent factor with strong driving power, a sustainable supervision system rather than self-restriction, is also confirmed to improve expert performance. Environmental properties directly inform experts about what they can and cannot do in a performance context (Michaels, 2000). In essence, the confluence of constraints and perception determines the stability and instability of expert performance.

At level III of the ISM, the factors of morality, objective, and strength precede motivation preference (Figure 3, Level II), while motivation preference, academic ability, and years qualified as an expert (all level II) affect each other bilaterally. Regarding the level II factor, rewards are influenced by the factor of strength. Therefore, these factors with higher driving power in the autonomous cluster (such as Strength) can impact each other. Therefore, their promotion should be given priority in attaining superior expert performance. In contrast, the factors with higher dependence on power are influenced by other factors. Consistent with current studies, academic ability, motivation preference, and years qualified as an expert (Figure 3, Level III) are key factors determining expert performance as acquired skills and experience in bid evaluation.

More factors from inherent cognition and the external environment are plotted at the top of the four-level diagram (Figure 3, Level IV), indicating that factors from the two dimensions collectively determine expert performance. These factors include the inherent cognition dimension (expertise, number of bid evaluations) and the external environment dimension (stress situations, natural environment, and distance).

Previous studies have demonstrated that expertise and exceptional performance are highly reproducible regarding inherent cognition. There is no doubt that unfailed successful learning is necessary for experts to achieve an improved or higher level of performance (Ericsson and Lehmann, 1996). In this regard, of all the factors at the top level, expertise and the number of bid evaluations, both belonging to the inherent cognition dimension, are viewed as the most natural elements influencing expert performance. The other factors: stress situations, natural environment, and distance, which belong to the external environment, are isolated and have no relationship with other factors. This phenomenon shows that the factors affecting experts’ performance are in an open system, and some external environmental factors will directly impact them in some situations. Especially in the bid evaluation process, the pressure from peers or the physical impact of the natural environment on experts (e.g., fatigue caused by long-distance travel to the workplace or bad weather) will make expert performances deviate.

Key expert performance factors

The situation perception and supervision system factors (Figure 3, Level IV) may forego morality, objective, and strength (Figure 3, Level III), determining expert performance in the bid evaluation. These are key issues to be addressed to realize superior expert performance. Moreover, Ericsson and Lehmann (1996) showed that situation perception affects labor intensity, whereas a strict supervision system initiates moral restraint. Thus, morality and some other factors (including procedural fairness, technical competence, and general reputation) impact and interact with expert performance. Still, illegalities often occur despite the vital importance of limiting moral deviation during expert behavior. For instance, bid-evaluation experts and bidders collude to manipulate the bidding of private customers (forcing the client to pay high prices). In addition, they colluded on certain municipal contracts, causing huge economic losses to New York taxpayers (TargetedNewsService, 2018). It has been reported that experts’ antagonistic feelings may hinder objectivity and obscure experts’ fairness (Lindfield and Penny, 2012).

In particular, three environmental constraint factors (stress situation, natural environment, and distance), located in the top layer, are mainly manifested as physical perception in the natural environment. They do not participate in the PES due to no correlation with any factor in internal cognition and other factors in the external environmental dimension. They make the system open, and these factors show that they directly, solely, and openly affect expert performance in engineering. This contrasts with the traditional information processing methods for decision-making in the “open system.” When decision-makers calculate and select options in the psychological or neural model, the influence of more uncertain external environment factors should be considered to maximize performance effectiveness.

Implications

Our results show that inherent cognitive and external environmental factors are characterized by high dependence and strong driving power, respectively (Figure 4). For example, Figure 3 Level IV shows that situation perception and supervision system (external environment dimension) are antecedent variables driving expert performance factors and should not be precluded first. However, the classification of factors (Figure 4) shows that morality and objective (internal cognitive dimension) also have higher driving and lower dependence power. This finding suggests that these two special factors bridge the inherent cognitive and external environmental dimensions. Moreover, morality and objectivity (Figure 3, Level III), controlled by the supervision mechanism (Figure 3, Level IV), influence inherent cognition dimension factors.

We confirmed the relationship and hierarchical structure of the two dimensions, suggesting that environmental constraint factors other than inherent cognition contribute to individual expert performance differences in bid evaluation. Furthermore, they show that external environmental factors strongly influence the externalization of inherent cognition. At a practical level, our findings on the two dimensions affirm existing research, supporting the notion that expert performance depends on professional knowledge and the environment in engineering. Furthermore, the findings also provide a basis for exploring ecological cognition based on the idea that the “brain–body-environment system is embedded and embodied.”

Conclusion

Several uncertainties and factors of expert performance in bid evaluation make its improvement to be a complicated matter. An individual’s performance in a domain is determined by multiple interactions between experience, training, and biological factors. This study produced a comprehensive list of expert performance factors. It identified and examined two dimensions of factors occurring in bid evaluation, and the results indicated that external environmental factors are prominent for expert performance. Furthermore, we also found evidence of cognition-environment interactions, which revealed environmental effects as the most important driving factors of expert performance in bid evaluation. The suggestion is that external environmental factors drive expert performance to change through the role of practice. Thus, poor expert performance can be resolved by fostering a friendly work environment for bid evaluation experts.

Morality and objective can be ranked as factors of ensuring expert performance in bid evaluation. Expert performance should be promoted by driving power factors such as academic ability, motivation preference, and years of qualification. Meanwhile, situation perception and supervision systems are deemed to form the hierarchical foundation, suggesting the need for an eco-friendly environment and enhancement of supervision intensity for good situation perception to support expert performance. In summary, the study sheds some light on the influence relationship and driving relationship among the factors of expert performance to reveal the interaction mechanism between inherent cognition and the external environment. It also extends the concept of expert performance from cognitive science to management science.

Although the study obtained findings on expert performance in bid evaluation, more factors related to the bid evaluation context should be detected to prevent deviations. Furthermore, our research was based on the experience and opinions of interviewees, of which bias and prejudice are unavoidable. Besides, the factors’ interactive relationships have not been quantitatively examined and can be further investigated in future research. Finally, expert performance involves many cognitive–psychological activities. Therefore, it is expected to investigate these activities in future studies to promote expert performance in the engineering context.

Data availability statement

The original contributions presented in the study are included in the article/supplementary material, further inquiries can be directed to the corresponding author.

Author contributions

KY and LW: conceptualization. WW: supervision. LW: writing–original draft preparation. KY and YL: writing–review and editing. All authors contributed to the article and approved the submitted version.

Funding

This work has been supported by National Natural Science Foundation of China (71871033) and Chunhui Project of National Ministry of Education (RZ1900011238).

Acknowledgments

The authors are grateful to the panelists in this research, and thank all the experts who participated in our research and Y.E. Yanling for assistance in the initial stages of the study. We especially thank the reviewers for their insightful suggestions to improve the final paper.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

References

Afonso, J., Garganta, J., Mcrobert, A., Williams, A. M., and Mesquita, I. (2012). The perceptual cognitive processes underpinning skilled performance in volleyball: evidence from eye-movements and verbal reports of thinking involving an in situ representative task. J. Sports Sci. Med. 11:339.

PubMed Abstract | Google Scholar

Araújo, D., Davids, K., and Hristovski, R. (2006). The ecological dynamics of decision making in sport. Psychol. Sport Exerc. 7, 653–676. doi: 10.1016/j.psychsport.2006.07.002

CrossRef Full Text | Google Scholar

Araújo, D., Hristovski, R., Seifert, L., Carvalho, J., and Davids, K. (2019). Ecological cognition: expert decision-making behaviour in sport. Int. Rev. Sport Exerc. Psychol. 12, 1–25. doi: 10.1080/1750984X.2017.1349826

CrossRef Full Text | Google Scholar

Baker, J., Cobley, S., Montelpare, W. J., Wattie, N., and Faught, B. P. (2010). Exploring proposed mechanisms of the relative age effect in Canadian minor hockey. Int. J. Sport 41, 148–159. doi: 10.1016/j.ijhcs.2009.12.003

CrossRef Full Text | Google Scholar

Bohannon, J. (2013). Who's afraid of peer review? Science 342, 60–65. doi: 10.1126/science.342.6154.60

PubMed Abstract | CrossRef Full Text | Google Scholar

Bolger, F. (1996). "Book Review: Uncertainty: A Guide to Dealing with Uncertainty in Quantitative Risk and Policy Analysis, M. Granger Morgan and Max Henrion, Cambridge: Cambridge University Press, 1990, 332 pp., ISBN 0–521–36542-2 (hc), ISBN 0–521–42744-4 (pb) ". (Chichester: John Wiley & Sons, Ltd), 147–148.

Google Scholar

Burgman, M. A., Mcbride, M., Ashton, R., Speirs-Bridge, A., Flander, L., Wintle, B., et al. (2011). Expert status and performance. Plos One 6:e22998. doi: 10.1371/journal.pone.0022998

PubMed Abstract | CrossRef Full Text | Google Scholar

Campitelli, G., Connors, M. H., Bilalic, M., and Hambrick, D. Z. (2015). Psychological perspectives on expertise. Front. Psychol. 6:258. doi: 10.3389/fpsyg.2015.00258

PubMed Abstract | CrossRef Full Text | Google Scholar

Caset, F., Wenner, F., and Wit, B. D. (2019). Conference locations and sustainability aspirations. Towards an integrative framework? J. DISP 55, 34–51. doi: 10.1080/02513625.2019.1598106

CrossRef Full Text | Google Scholar

Chi, M. (2006). “Two approaches to the study of Experts’ characteristics,” in The Cambridge Handbook of Expertise & Expert Performance. eds. K. A. Ericsson, N. Charness, P. J. Feltovich, and R. R. Hoffman (Cambridge: Cambridge University Press), 21–30.

Google Scholar

Connor, J. D., Renshaw, I., and Farrow, D. (2020). Defining cricket batting expertise from the perspective of elite coaches. PLoS One 15:e0234802. doi: 10.1371/journal.pone.0234802

CrossRef Full Text | Google Scholar

Contreras-Pacheco, O. E., Talero-Sarmiento, L. H., and Escobar-Rodríguez, L. Y. (2020). Sostenibilidad, stakeholders y crisis de empresa: un análisis estructurado de percepciones. Suma de Negocios 11, 64–72. doi: 10.14349/sumneg/2020.V11.N24.A7

CrossRef Full Text | Google Scholar

Costall, A. P. (1984). Are theories of perception necessary? A review of Gibson's The ecological approach to visual perception. J. Exp. Anal. Behav. 41, 109–115. doi: 10.1901/jeab.1984.41-109

PubMed Abstract | CrossRef Full Text | Google Scholar

Debarnot, U., Sperduti, M., Di Rienzo, F., and Guillot, A. (2014). Experts bodies, experts minds: How physical and mental training shape the brain. Front. Hum. Neurosci. 8:280. doi: 10.3389/fnhum.2014.00280

PubMed Abstract | CrossRef Full Text | Google Scholar

Ericsson, K. A. (2003). Exceptional memorizers: made, not born. Trends Cogn. Sci. 7, 233–235. doi: 10.1016/S1364-6613(03)00103-7

CrossRef Full Text | Google Scholar

Ericsson, K. A. (2007). An expert-performance perspective of research on medical expertise: the study of clinical performance. Med. Educ. 41, 1124–1130. doi: 10.1111/j.1365-2923.2007.02946.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Ericsson, K. A. (2008). Deliberate practice and acquisition of expert performance: a general overview. Acad. Emerg. Med. 15, 988–994. doi: 10.1111/j.1553-2712.2008.00227.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Ericsson, K. A. (2014). Why expert performance is special and cannot be extrapolated from studies of performance in the general population: a response to criticisms. Intelligence 45, 81–103. doi: 10.1016/j.intell.2013.12.001

CrossRef Full Text | Google Scholar

Ericsson, K. A., and Harwell, K. W. (2019). Deliberate practice and proposed limits on the effects of practice on the acquisition of expert performance: why the original definition matters and recommendations for future research. Front. Psychol. 10:2396. doi: 10.3389/fpsyg.2019.02396

PubMed Abstract | CrossRef Full Text | Google Scholar

Ericsson, K. A., and Kintsch, W. (1995). Long-term working-memory. Psychol. Rev. 102, 211–245. doi: 10.1037/0033-295x.102.2.211

CrossRef Full Text | Google Scholar

Ericsson, K. A., Kiruthiga, N., and Roring, R. W. (2009). Toward a science of exceptional achievement: attaining superior performance through deliberate practice. Annal N Y Acad. Sci. 1172, 199–217. doi: 10.1196/annals.1393.001

CrossRef Full Text | Google Scholar

Ericsson, K. A., Krampe, T., Tesch-Romer, R., and Clemens, T. (1993). The role of deliberate practice in the acquisition of expert performance. Psychol. Rev. 100, 363–406. doi: 10.1098/rsos.190327

CrossRef Full Text | Google Scholar

Ericsson, K. A., and Lehmann, A. C. (1996). Expert and exceptional performance: evidence of maximal adaptation to task constraints. Annu. Rev. Psychol. 47, 273–305. doi: 10.1146/annurev.psych.47.1.273

PubMed Abstract | CrossRef Full Text | Google Scholar

Ericsson, K. A., and Ward, P. (2007). Capturing the naturally occurring superior performance of experts in the laboratory: toward a science of expert and exceptional performance. Curr. Dir. Psychol. Sci. 16, 346–350. doi: 10.1111/j.1467-8721.2007.00533.x

CrossRef Full Text | Google Scholar

Erturan, G., Alvand, A., Judge, A., Pollard, T., Glyn-Jones, S., and Rees, J. L. (2018). Prior generic arthroscopic volume correlates with hip arthroscopic proficiency: a simulator study. J. Bone Joint Surg. Am. 100:e3. doi: 10.2106/JBJS.17.00352

PubMed Abstract | CrossRef Full Text | Google Scholar

Fabian, H., Mathias, R., and Jörn, M. (2016). Domain-specific and unspecific reaction times in experienced team handball goalkeepers and novices. Front. Psychol. 7:882. doi: 10.3389/fpsyg.2016.00882

PubMed Abstract | CrossRef Full Text | Google Scholar

Fajen, B. R., Riley, M. A., and Turvey, M. T. (2009). Information, affordances, and the control of action in sport. Int. J. Sport Psychol. 40, 79–107. doi: 10.1161/hh0202.103615

CrossRef Full Text | Google Scholar

Fischhoff, B., Slovic, P., and Lichtenstein, S. (1982). Lay foibles and expert fables in judgments about risk. Am. Stat. 36, 240–255. doi: 10.2307/2683835

CrossRef Full Text | Google Scholar

Foglia, L., and Wilson, R. A. (2013). Embodied cognition. Wiley Interdiscip. Rev. Cogn. Sci. 4, 319–325. doi: 10.1002/wcs.1226

CrossRef Full Text | Google Scholar

Friedman, J., and Korman, M. (2019). Observation of an expert model induces a skilled movement coordination pattern in a single session of intermittent practice. Sci. Rep. 9:4609. doi: 10.1038/s41598-019-40924-9

PubMed Abstract | CrossRef Full Text | Google Scholar

Fuller, C., Goodwyn, A., and Francis-Brophy, E. (2013). Advanced skills teachers: professional identity and status. Teach. Teach. Theory Pract. 19, 463–474. doi: 10.1080/13540602.2013.770228

CrossRef Full Text | Google Scholar

Gigerenzer, G., and Todd, P. M., The ABC Research Group (2000). Simple heuristics that make us smart. OUP Catalog. 23, 727–741. doi: 10.1017/S0140525X00003447

CrossRef Full Text | Google Scholar

Glimcher, P. W. (2005). Indeterminacy in brain and behavior. Annu. Rev. Psychol. 56, 25–56. doi: 10.1146/annurev.psych.55.090902.141429

PubMed Abstract | CrossRef Full Text | Google Scholar

Gonsalvez, C. J., Wahnon, T., and Deane, F. P. (2017). Goal-setting, feedback, and assessment practices reported by Australian clinical supervisors. Aust. Psychol. 52, 21–30. doi: 10.1111/ap.12175

CrossRef Full Text | Google Scholar

Hambrick, D. Z., Oswald, F. L., Altmann, E. M., Meinz, E. J., Gobet, F., and Campitelli, G. (2014). Deliberate practice: is that all it takes to become an expert? Intelligence 45, 34–45. doi: 10.1016/j.intell.2013.04.001

CrossRef Full Text | Google Scholar

Hambrick, D. Z., and Tucker-Drob, E. M. (2015). The genetics of music accomplishment: evidence for gene-environment correlation and interaction. Psychon. Bull. Rev. 22, 112–120. doi: 10.3758/s13423-014-0671-9

PubMed Abstract | CrossRef Full Text | Google Scholar

Hamdi, H., Laure, L.-P., and Corinne, M. (2017). Realistic stimuli reveal selective effects of motor expertise During a mental body rotation task. Am. J. Psychol. 45, 81–103. doi: 10.1016/j.intell.2013.12.001

CrossRef Full Text | Google Scholar

Hannele, F., Arto, G., Minna, B., Keith, D., Jarmo, L., and Niilo, K. (2016). Development of perceived competence, tactical skills, motivation, technical skills, and speed and agility in young soccer players. J. Sports Sci. 34, 1311–1318. doi: 10.1080/02640414.2015.1127401

PubMed Abstract | CrossRef Full Text | Google Scholar

Hashimoto, D. A., Sirimanna, P., Gomez, E. D., Beyer-Berjot, L., Ericsson, K. A., Williams, N. N., et al. (2015). Deliberate practice enhances quality of laparoscopic surgical performance in a randomized controlled trial: from arrested development to expert performance. Surg. Endosc. 29, 3154–3162. doi: 10.1007/s00464-014-4042-4

CrossRef Full Text | Google Scholar

Hastie, R. (2001). Problems for judgment and decision making. Annu. Rev. Psychol. 52, 653–683. doi: 10.1146/annurev.psych.52.1.653

CrossRef Full Text | Google Scholar

Havers, S. M., Martin, E., Wilson, A., and Hall, L. (2019). Implementation of government-directed policy in the hospital setting: a modified Delphi study. Health Res. Policy Syst. 17:91. doi: 10.1186/s12961-019-0500-8

PubMed Abstract | CrossRef Full Text | Google Scholar

Helfrich, C. D., Rose, A. J., Hartmann, C. W., Bodegom-Vos, L. V., Graham, I. D., Wood, S. J., et al. (2018). How the dual-process model of human cognition can inform efforts to de-implement ineffective and harmful clinical practices: a preliminary model of unlearning and substitution. J. Eval. Clin. Pract. 24, 198–205. doi: 10.1111/jep.12855

CrossRef Full Text | Google Scholar

Heyden, M. L. M. (2013). Perceived environmental dynamism, relative competitive performance, and top management team heterogeneity: examining correlates of upper echelons’ advice-seeking. Organ. Stud. 34, 1327–1356. doi: 10.1177/0170840612470229

CrossRef Full Text | Google Scholar

Jo, D., Park, H. Y., Choe, Y., and Kim, D. K. (2019). Destination-selection attributes for international association meetings: a mixed-methods study. J. Destin. Mark. Manag. 13, 61–72. doi: 10.1016/j.jdmm.2019.05.005

CrossRef Full Text | Google Scholar

Kardes, F. R. (2006). When should consumers and managers trust their intuition? J. Consum. Psychol. 16, 20–24. doi: 10.1207/s15327663jcp1601_4

CrossRef Full Text | Google Scholar

Kording, K. P., and Wolpert, D. M. (2006). Bayesian decision theory in sensorimotor control. Trends Cogn. Sci. 10, 319–326. doi: 10.1016/j.tics.2006.05.003

PubMed Abstract | CrossRef Full Text | Google Scholar

Korhonen-Sande, S., and Sande, J. B. (2016). Improving customer knowledge transfer in industrial firms: how does previous work experience influence the effect of reward systems? J. Bus. Industr. Market. 31, 232–246. doi: 10.1108/JBIM-03-2014-0048

CrossRef Full Text | Google Scholar

Krueger, T., Page, T., Hubacek, K., Smith, L., and Hiscock, K. (2012). The role of expert opinion in environmental modelling. Environ Model Softw. 36, 4–18. doi: 10.1016/j.envsoft.2012.01.011

CrossRef Full Text | Google Scholar

Lee, D., and Ryzin, G. G. V. (2019). Measuring bureaucratic reputation: scale development and validation. Governance 32, 177–192. doi: 10.1111/gove.12371

CrossRef Full Text | Google Scholar

Li, C., Wang, C. K. J., and Pyun, D. Y. (2014). Talent development environmental factors in sport: A review and taxonomic classification. Quest 66, 433–447. doi: 10.1080/00336297.2014.944715

CrossRef Full Text | Google Scholar

Lindfield, G. R., and Penny, J. E. T. (2012). Numerical Methods Using MATLAB. Amsterdam: Elsevier/Academic Press.

Google Scholar

Liu, X., Wang, D., and Jiang, Z. (2015). Simulation and analysis of bid evaluation behaviors for multiattribute reverse auction. IEEE Syst. J. 9, 165–176. doi: 10.1109/JSYST.2013.2258737

CrossRef Full Text | Google Scholar

Liu, B., Yang, X., Huo, T., Shen, G. Q., and Wang, X. (2017). A linguistic group decision-making framework for bid evaluation in mega public projects considering carbon dioxide emissions reduction. J. Clean. Prod. 148, 811–825. doi: 10.1016/j.jclepro.2017.02.044

CrossRef Full Text | Google Scholar

Ludger, V. D., and Erik, R. (2016). Foregrounding sociomaterial practice in our understanding of affordances: the skilled intentionality framework. Front. Psychol. 7:1969. doi: 10.3389/fpsyg.2016.01969

PubMed Abstract | CrossRef Full Text | Google Scholar

Lund, F., Schultz, J.-H., Maatouk, I., Krautter, M., Möltner, A., Werner, A., et al. (2017). Effectiveness of IV cannulation skills laboratory training and its transfer into clinical practice: a randomized, controlled trial. PLoS One 7:e32831. doi: 10.1371/journal.pone.0032831

PubMed Abstract | CrossRef Full Text | Google Scholar

Macmahon, C., and Mcpherson, S. (2009). Knowledge base as a mechanism for perceptual-cognitive tasks: Skill is in the details! Int. J. Sport Psychol. 40, 565–579. doi: 10.1016/j.humov.2008.08.003

CrossRef Full Text | Google Scholar

Mcpherson, S. L., and Kernodle, M. (2007). Mapping two new points on the tennis expertise continuum: tactical skills of adult advanced beginners and entry-level professionals during competition. J. Sports Sci. 25, 945–959. doi: 10.1080/02640410600908035

PubMed Abstract | CrossRef Full Text | Google Scholar

Michaels, C. F. (2000). Information, perception, and action: what should ecological psychologists learn From Milner and Goodale (1995)? Ecol. Psychol. 12, 241–258. doi: 10.1207/S15326969ECO1203_4

CrossRef Full Text | Google Scholar

Orazbayev, S. (2017). Sequential order as an extraneous factor in editorial decision. Scientometrics 113, 1573–1592. doi: 10.1007/s11192-017-2531-7

CrossRef Full Text | Google Scholar

Rodriguez, M. A., Bollen, J., and Van de Sompel, H. (2007). Mapping the bid behavior of conference referees. J. Informet. 1, 68–82. doi: 10.1016/j.joi.2006.09.006

CrossRef Full Text | Google Scholar

Schall, J. D. (2004). On building a Bridge Between brain and behavior. Annu. Rev. Psychol. 55, 23–50. doi: 10.1146/annurev.psych.55.090902.141907

CrossRef Full Text | Google Scholar

Semaan, N., and Salem, M. (2017). A deterministic contractor selection decision support system for competitive bidding. Eng. Constr. Archit. Manag. 24, 61–77. doi: 10.1108/ECAM-06-2015-0094

CrossRef Full Text | Google Scholar

Sozzo, S. (2020). Explaining versus describing human decisions: Hilbert space structures in decision theory. Soft Comput. 24, 10219–10229. doi: 10.1007/s00500-019-04140-x

CrossRef Full Text | Google Scholar

Spence, M. T. (1993). The moderating effect of problem characteristics on the expertise-decision-making link. Appl. Surf. Sci. 255, 8145–8152. doi: 10.1016/j.apsusc.2009.05.032

CrossRef Full Text | Google Scholar

TargetedNewsService. (2018). A.G. Schneiderman Announces Bust of Broome County Waste Management Cartel for Colluding to Rig Bids, Fix Prices [Online]. Available at: https://search.proquest.com/docview/2023386303?accountid=26785 (Accessed 9 April 2018).

Google Scholar

Thompson, J. J., Blair, M. R., Chen, L., and Henrey, A. J. (2013). Video game telemetry as a critical tool in the study of complex skill learning. PLoS One 8:e75129. doi: 10.1371/journal.pone.0075129

PubMed Abstract | CrossRef Full Text | Google Scholar

Turvey, M. T., Shaw, R. E., Reed, E. S., and Mace, W. M. (1981). Ecological laws of perceiving and acting: in reply to Fodor and Pylyshyn. Cognition 9, 237–304. doi: 10.1016/0010-0277(81)90002-0

PubMed Abstract | CrossRef Full Text | Google Scholar

Vanda, C., Duarte, A., Luís, V., and Keith, D. (2013). From recording discrete actions to studying continuous goal-directed behaviours in team sports. J. Sports Sci. 31, 546–553. doi: 10.1016/j.psychsport.2006.07.002

PubMed Abstract | CrossRef Full Text | Google Scholar

Victoria, H., Walshe, T. V., Hanea, A. M., Fiona, F., Burgman, M. A., and Judi, H. (2018). Eliciting improved quantitative judgements using the IDEA protocol: a case study in natural resource management. PLoS One 13:e0198468. doi: 10.1371/journal.pone.0198468

PubMed Abstract | CrossRef Full Text | Google Scholar

Wang, D., Liu, X., and Liu, L. (2013). Bid evaluation behavior in online procurement auctions involving technical and business experts. Electron. Commer. Res. Appl. 12, 328–336. doi: 10.1016/j.elerap.2012.10.001

CrossRef Full Text | Google Scholar

Warfield, J. N. (1974). Developing subsystem matrices in structural modeling. IEEE Trans. Syst. Man Cybernet. SMC-4, 74–80. doi: 10.1109/tsmc.1974.5408523

CrossRef Full Text | Google Scholar

Wei, J., Chen, Y., Zhang, J., and Gong, Y. (2019). Research on factors affecting the entrepreneurial learning From failure: an interpretive structure model. Front. Psychol. 10:1304. doi: 10.3389/fpsyg.2019.01304

PubMed Abstract | CrossRef Full Text | Google Scholar

Whitehead, A. E., Taylor, J. A., Polman, R. C. J., and Polman, R. C. J. (2016). Evidence for skill level differences in the thought processes of golfers during high and low pressure situations. Front. Psychol. 6:1974. doi: 10.3389/fpsyg.2015.01974

PubMed Abstract | CrossRef Full Text | Google Scholar

Zhen-Song, C., Xuan, Z., Rodríguez, M. R., Witold, P., and Luis, M. (2021). Expertise-based bid evaluation for construction-contractor selection with generalized comparative linguistic ELECTRE III. Autom. Constr. 125:103578. doi: 10.1016/j.autcon.2021.103578

CrossRef Full Text | Google Scholar