As a significant part of outdoor built-environment, public open spaces are closely associated with people's daily lives. Studies of outdoor behavior in these spaces can shed light on users' environmental perceptions and contribute to the promotion of physiological and psychological health. Many recent studies are case studies focused where observations, surveys and interviews have been conducted to understand the factors influencing people's behavior on one or few sites or city environments. There have been few reviews related to this topic, and none have been based on the systematic understanding of influencing factors. This paper presents a systematic review of interactions between behavior and the built environment in public open spaces, and highlights the impacts of diverse and objective influencing factors. Followed the rules of PRISMA method (Preferred Reporting Items for Systematic Reviews and Meta-Analyses), 109 papers published in 2000–2021 were selected and reviewed. The distribution of the studied interactions is analyzed, and the impacts of four distinct factors: personal background, location and context, environmental component, and climate stimuli, are extracted, categorized, and specified. Moreover, outdoor health benefits are discussed based on which, crucial factors that require emphasis after the outbreak of COVID-19 are identified. Throughout this paper, behavioral influencing processes, including objective influencing factors, subjective feedback, and the relationships involved, are considered to provide a comprehensive picture. With the robust classification of existing factors, architects, urban designers, policy makers and fellow researches could be easier to get a more comprehensive trend from the past. This paper also provides guidance for future research, especially given that COVID-19 has created huge changes to outdoor needs and customary behavior.