SIG/MET presented its third Workshop on Informetric and Scientometric Research at the ASIS&T November 2013 Annual Meeting. Established in 2010, the group brings together those interested in all aspects of informetrics, including bibliometrics, scientometrics and webometrics, as well as metrics related to citation network analysis, visualization and scholarly communication. The meeting featured posters on measuring research in the context of academic monitoring and on the transition of meeting abstracts to peer-reviewed journal articles. Thirteen papers were presented in sessions addressing the application of metrics and new indicators. A session on topics beyond the journal article included discussions on Twitter hashtag use, motivations for blog posts and advisees’ career success relative to advisers’ scholarly activity. SIG/MET recognized students for outstanding contributions on statistical analysis of citation rates, cognitive aspects of peer review and indicators for research evaluation. The symposium concluded with discussion of the availability of a Scopus dataset for arts and humanities journals for research use.
research data sets
Bulletin, February/March 2014
Full Room for the Third SIG/MET Workshop
by Vincent Larivière
Founded in 2010 in order to regroup the increasingly important community of information scientists working on metrics, SIG/MET is the Association for Information Science & Technology (ASIS&T) Special Interest Group for the measurement of information production and use. It encourages the development and networking of all those interested in the measurement of information and, thus, encompasses not only bibliometrics, scientometrics and informetrics, but also measurement of the web and the Internet, applications running on these platforms and metrics related to network analysis, visualization and scholarly communication.
On November 2, 2013, SIG/MET held its third annual Workshop on Informetric and Scientometric Research, during the ASIS&T Annual Meeting in Montreal, Quebec, Canada. The full-day event, sponsored by both Elsevier and Thomson Reuters, attracted 30 attendees. The symposium consisted of two poster and 13 paper presentations by authors from nine countries (Canada, Finland, Germany, Israel, Japan, South Korea, Sweden, United Kingdom and United States).
The meeting opened with the two poster presentations. The first, by Jongwook Lee, a doctoral student at Florida State University, was on the measurement of the research dimension of academic mentoring. The other was by Burak Özkösem, a Ph.D. candidate in experimental surgery at McGill University, on the conversion of meeting abstracts to articles in peer-reviewed journal articles in the field of reproductive biology.
The first paper session, “Application of Metrics,” started with a presentation by Katherine McCain from Drexel University, who analyzed the first 25 years of research on the Zebrafish, an increasingly important model organism for research in the biomedical sciences. Her finding provided evidence of an increased internationalization of the field and of the number of research groups working on the model. Next up was Bradford Demarest, Ph.D. candidate at Indiana University, presenting a novel machine-learning-based metric applied to politically partisan subreddits on the website Reddit. The session ended with a talk by librarians Kimberly Powell and Shenita Peterson, who compared the citation counts, journal quality metrics and h-indexes obtained from Scopus and the Web of Science for faculty in the discipline of nursing.
The second paper session, “New Indicators,” started with Dietmar Wolfram, Feifei Wang and Yuehua Zhao, from the University of Wisconsin and Beijing University of Technology, who presented the results from two investigations of journal similarity based on citation journal topicality. Dangzhi Zhao, University of Alberta, and Andreas Strotmann, GESIS, Germany, showed how the combination of author co-citation and bibliographic coupling could help predict future trends in research. The last presentation of the session, by Masaki Eto of Keio University, Japan, demonstrated a novel graph-based method for retrieval of documents based on co-citation networks, which increased the number of retrieved documents without reducing precision.
As in previous years, the SIG recognized outstanding student contributions. The third session was devoted to presenting these awards and presentations by the recipients. This year’s winner was Fereshteh Didegah from the University of Wolverhampton, United Kingdom, for her paper, co-authored with her advisor Mike Thelwall, on the modelling of the factors affecting articles’ citation rates using an integrated statistical method. Two additional student submissions were also recognized for high merit: Ehsan Mohammadi’s paper, in collaboration with Mike Thelwall, on new indicators for research evaluation in the social sciences and humanities based on Mendeley readership, and Qi Wang of the KTH-Royal Institute of Technology in Sweden, in collaboration with Ulf Sandstrom, for their analysis of the relationship between cognitive distance and peer review in infection biology.
The last session, “Beyond the Journal Article,” started with Tim Bowman, Indiana University, and colleagues from Kiel University, Germany; Université de Montréal, Canada; and Åbo Akademi, Finland, on the use of hashtags by a sample of astrophysicists active on Twitter. It was followed by Chaoqun Ni and Cassidy R. Sugimoto’s investigation of the relationship between the advisers’ scholarly behavior and advisees’ career success based on large-scaled data for sociology. Hadas Shema, Judit Bar-Ilan, Bar-Ilan University, and Mike Thelwall then provided preliminary results of a classification of motivations for research blog posts in health research. The session ended with a talk by Staša Milojević and colleagues from Indiana University, Université de Montréal and University of Wolverhampton on the role of handbooks on knowledge creation and diffusion, based on five handbooks from the discipline of science studies.
The 3rd symposium concluded with a teleconference by Gali Halevi, senior research analyst and program director of the Informetics Research Group of Elsevier, Inc., who outlined the availability of a Scopus dataset consisting of bibliographic content and download information of all papers published in 56 arts and humanities journals. The dataset is being made available freely to participants for scholarly investigation.
More information about SIG/MET and this year’s symposium may be found on the SIG’s website at www.asis.org/SIG/SIGMET/.
Jongwook Lee, Measuring a Research Dimension of Academic Mentoring
Burak Özkösem, Conversion of Reproductive Biology Meeting Abstracts to Publications
APPLICATION OF METRICS
Katherine McCain, Charting the Rise of the Zebrafish as a Model Organism: Persistent Co-author Networks, 1980-2004
Bradford Demarest, Measuring Identities and Differences in Epistemic Communities in Political Sub-reddits: A Novel Machine-Learning-based Metric
Kimberly Powell and Shenita Peterson, Measuring Nursing Publication Impact and Faculty Metrics: Web of Science vs. Scopus
Dietmar Wolfram, Feifei Wang and Yuehua Zhao, The Assessment of Journal Similarity Using Citation Journal Topicality: Results from Two Investigations
Dangzhi Zhao and Andreas Strotmann, Combining Author Co-citation and Bibliographic Coupling Analyses for the Study of Research Trends
Masaki Eto, Document Retrieval Method Using Random Walk with Restart on Co-citation Network
BEYOND THE JOURNAL ARTICLE
Timothy Bowman, Isabella Peters, Stefanie Haustein and Kim Holmberg, #twinkletweet: Hashtag Use of Astrophysicists on Twitter
Chaoqun Ni and Cassidy R. Sugimoto, Doctoral Mentoring and Protégé Scholarly Performance: A Preliminary Examination in Sociology
Hadas Shema, Judit Bar-Ilan and Mike Thelwall, Classifying Motivations for Research Blog Posts – Preliminary Results
Staša Milojević, Cassidy Sugimoto, Vincent Larivière, Mike Thelwall and Ying Ding, The Role of Handbooks in Knowledge Creation and Diffusion: A Case of Science Studies
STUDENT PAPER AWARD WINNERS
Fereshteh Didegah and Mike Thelwall, Modelling Article Citation Impact Factors Using an Integrated Statistical Method
Ehsan Mohammadi and Mike Thelwall, Mendeley Readership Altmetrics for the Social Sciences and Humanities: Research Evaluation and Knowledge Flows
Qi Wang and Ulf Sandstrom, Cognitive Distance and Peer Review: A Study of a Grant Scheme in Infection Biology
Vincent Larivière is 2014 chair of ASIS&T Special Interest Group/Metrics (SIG/MET). He is an assistant professor in the School of Library and Information Science, Université de Montréal, a regular member of the Centre interuniversitaire de recherche sur la science et la technologie, Université du Québec à Montréal, and associate researcher at the Observatoire des sciences et des technologies, Université du Québec à Montréal. He can be reached at vincent.lariviere<at>umontreal.ca
Articles in this Issue
Full Room for the Third SIG/MET Workshop