Bulletin of the Belgian Mathematical Society - Simon Stevin

Versatile weighting strategies for a citation-based research evaluation model

Gianna M. Del Corso and F. Romani

Full-text: Open access

Abstract

After a quick review of the most used numerical indicators for evaluating research, we present an integrated model for ranking scientific publications together with authors and journals. Our model relies on certain adjacentcy matrices obtained from the relationship between papers, authors, and journals. These matrices are first normalized to obtain stochastic matrices and then are combined together using appropriate weights to form a suitable irreducible stochastic matrix whose dominant eigenvector provides the desired ranking. Our main contribution is a in-depth analysis of various strategies for choosing the weights, showing their probabilistic interpretation and showing how they affect the outcome of the ranking process. We also prove that, by solving an inverse eigenvector problem, we can determine a weighting strategy in which the relative importance of papers, authors, and journals is chosen by the final user of the ranking algorithm. The impact of the different weighting strategies is analyzed also by means of extensive experiments on large synthetic datasets.

Article information

Source
Bull. Belg. Math. Soc. Simon Stevin, Volume 16, Number 4 (2009), 723-743.

Dates
First available in Project Euclid: 9 November 2009

Permanent link to this document
https://projecteuclid.org/euclid.bbms/1257776244

Digital Object Identifier
doi:10.36045/bbms/1257776244

Mathematical Reviews number (MathSciNet)
MR2583556

Zentralblatt MATH identifier
1192.68234

Subjects
Primary: 65C20: Models, numerical methods [See also 68U20] 65F15: Eigenvalues, eigenvectors

Keywords
PageRank Perron vector perturbation results impact factor

Citation

Del Corso, Gianna M.; Romani, F. Versatile weighting strategies for a citation-based research evaluation model. Bull. Belg. Math. Soc. Simon Stevin 16 (2009), no. 4, 723--743. doi:10.36045/bbms/1257776244. https://projecteuclid.org/euclid.bbms/1257776244


Export citation