A long and winding road: research impact evaluation over public policies

Abstract

This study evaluates the extent to which the impacts of scientific publications funded by the São Paulo Research Foundation (FAPESP) on public policies can be assessed using the Overton database. Utilizing the Overton database, we integrate DOI data with bibliometric analyses to track how FAPESP’s funding influences policymaking in Brazil and worldwide. Results show significant citations across diverse fields, notably in health, environmental sustainability, and food security, reflecting the global relevance of FAPESP-funded research. Analyses reveal the geographical and thematic influence on policy documents, even considering potential biases due to the Overton database’s limitations. In this direction, the study highlights some limitations of this database, pointing out methodological challenges that need to be addressed for measuring the impact of scientific publications on policy documents to become more comprehensive and in depth. Overcoming these challenges is essential for effectively understanding the impacts of research on policy and for enabling better communication about the impact of science on society.