STEMskiller: Skill Set Map for Mentors of Early Career Researchers

RESEARCH AND SCHOLARSHIP: Perspectives on "open" movements

Open Evaluation: definition, why important, current trends, examples

Definition:

In terms of the evaluation of scholarly outputs (journal articles, proposals), “open evaluation” can refer to the judging of an output not just by a jury of experts (“classic expert evaluation”; for scholarly journals, this often means blind peer review) but rather by a jury of anyone interested in the output. Such evaluation mechanisms are, at the time of writing this entry, controversial and part of evergreen discussions about how scholarly peer review is performed.

Useful resources on Open Evaluation:

Open Science MOOC. (n.d.). Open evalution. https://opensciencemooc.eu/modules/open-evaluation/

Describes rationale behind open evaluation as defined as open peer review. Lists competencies researchers should possess and includes links to helpful tools, research articles and report, and other materials on this topic.

Teixeira da Silva, J.A., & S. Nazarovets. (2022). The Role of Publons in the Context of Open Peer Review. Publishing Research Quarterlyhttps://doi.org/10.1007/s12109-022-09914-0

Discusses open peer review using the case of Publons and Clarivate in the context of transparency and improving the quality and reputation of published scientific outputs.

Velamuri, V.K., Schneckenberg, D., Haller, J.B.A., & Moeslein, K.M. (2017). Open evaluation of new product concepts at the front end of innovation: Objectives and contingency factors. R&D Management Journal. Preprint for R&D Management Journal. https://www.researchgate.net/profile/Vivek_Velamuri/publication/279777177_Open_evaluation
_of_new_product_concepts_at_the_front_end_of_innovation_Objectives_and_contingency_factors/
links/5dcdf3a392851c382f3dffca/Open-evaluation-of-new-product-concepts-at-the-front-
end-of-innovation-Objectives-and-contingency-factors.pdf

Describes, in detail, the concept of open evaluation and its role in innovation competitions. Helpful definitions and list of more reading.

Tags: IPSCritT; IPS IA; PSR GL; CompS

Peer Review: None

Table of contents:

1.9.2. Open Evaluation: definition, why important, current trends, examples

 

Author: Stephanie Krueger

Peer Reviewer(s): None

Last Updated: November 4, 2022

 

Editor: Stephanie Krueger Last modified: 4.11. 2022 12:11