An item-by-item subject classification of papers published in multidisciplinary and general journals using reference analysis

W. Glänzel, A. Schubert, H. J. Czerwon

Research output: Contribution to journalArticle

57 Citations (Scopus)

Abstract

A serious shortcoming of bibliometric studies based on the (Social) Science(s) Citation Index is the lack of an universally applicable subject classification scheme as individual papers are concerned. Subject classification of papers on the basis of assigning journals to subject categories (like those found in the various supplements of ISI databases) works well in case of highly specialised journals, but fails for multidisciplinary journals such as Nature, Science and PNAS -and so far as subfields are taken into consideration - also for "general" journals (e.g. JACS or Angewandte Chemie). This study presents the results of a pilot project attempting to overcome this shortcoming by delimiting the subject of papers published in multidisciplinary and general journals by an item-by-item subject classification scheme, where assignment is based on the analysis of the subject classification of reference literature. The results clearly confirmed the conclusions of earlier studies by the authors in the field of reference analysis. For the really important journals (sufficiently high number of annual publications and high impact with respect to the field), the share of classifiable papers was surprisingly high, and the assignment proved reliable as well. Since papers in the leading general and multidisciplinary journals are frequently citing general and multidisciplinary journals, an iterated application of the procedure is expected to increase the number of classifiable publications. The results of the new methodology may improve the validity of bibliometric studies for research evaluation purposes.

Original languageEnglish
Pages (from-to)427-439
Number of pages13
JournalScientometrics
Volume44
Issue number3
Publication statusPublished - 1999

Fingerprint

evaluation research
Social sciences
pilot project
supplement
social science
lack
methodology
science
literature

ASJC Scopus subject areas

  • Computational Theory and Mathematics
  • Computer Science Applications
  • Library and Information Sciences

Cite this

An item-by-item subject classification of papers published in multidisciplinary and general journals using reference analysis. / Glänzel, W.; Schubert, A.; Czerwon, H. J.

In: Scientometrics, Vol. 44, No. 3, 1999, p. 427-439.

Research output: Contribution to journalArticle

@article{bf3799814df14e06b576e40e8423a773,
title = "An item-by-item subject classification of papers published in multidisciplinary and general journals using reference analysis",
abstract = "A serious shortcoming of bibliometric studies based on the (Social) Science(s) Citation Index is the lack of an universally applicable subject classification scheme as individual papers are concerned. Subject classification of papers on the basis of assigning journals to subject categories (like those found in the various supplements of ISI databases) works well in case of highly specialised journals, but fails for multidisciplinary journals such as Nature, Science and PNAS -and so far as subfields are taken into consideration - also for {"}general{"} journals (e.g. JACS or Angewandte Chemie). This study presents the results of a pilot project attempting to overcome this shortcoming by delimiting the subject of papers published in multidisciplinary and general journals by an item-by-item subject classification scheme, where assignment is based on the analysis of the subject classification of reference literature. The results clearly confirmed the conclusions of earlier studies by the authors in the field of reference analysis. For the really important journals (sufficiently high number of annual publications and high impact with respect to the field), the share of classifiable papers was surprisingly high, and the assignment proved reliable as well. Since papers in the leading general and multidisciplinary journals are frequently citing general and multidisciplinary journals, an iterated application of the procedure is expected to increase the number of classifiable publications. The results of the new methodology may improve the validity of bibliometric studies for research evaluation purposes.",
author = "W. Gl{\"a}nzel and A. Schubert and Czerwon, {H. J.}",
year = "1999",
language = "English",
volume = "44",
pages = "427--439",
journal = "Scientometrics",
issn = "0138-9130",
publisher = "Springer Netherlands",
number = "3",

}

TY - JOUR

T1 - An item-by-item subject classification of papers published in multidisciplinary and general journals using reference analysis

AU - Glänzel, W.

AU - Schubert, A.

AU - Czerwon, H. J.

PY - 1999

Y1 - 1999

N2 - A serious shortcoming of bibliometric studies based on the (Social) Science(s) Citation Index is the lack of an universally applicable subject classification scheme as individual papers are concerned. Subject classification of papers on the basis of assigning journals to subject categories (like those found in the various supplements of ISI databases) works well in case of highly specialised journals, but fails for multidisciplinary journals such as Nature, Science and PNAS -and so far as subfields are taken into consideration - also for "general" journals (e.g. JACS or Angewandte Chemie). This study presents the results of a pilot project attempting to overcome this shortcoming by delimiting the subject of papers published in multidisciplinary and general journals by an item-by-item subject classification scheme, where assignment is based on the analysis of the subject classification of reference literature. The results clearly confirmed the conclusions of earlier studies by the authors in the field of reference analysis. For the really important journals (sufficiently high number of annual publications and high impact with respect to the field), the share of classifiable papers was surprisingly high, and the assignment proved reliable as well. Since papers in the leading general and multidisciplinary journals are frequently citing general and multidisciplinary journals, an iterated application of the procedure is expected to increase the number of classifiable publications. The results of the new methodology may improve the validity of bibliometric studies for research evaluation purposes.

AB - A serious shortcoming of bibliometric studies based on the (Social) Science(s) Citation Index is the lack of an universally applicable subject classification scheme as individual papers are concerned. Subject classification of papers on the basis of assigning journals to subject categories (like those found in the various supplements of ISI databases) works well in case of highly specialised journals, but fails for multidisciplinary journals such as Nature, Science and PNAS -and so far as subfields are taken into consideration - also for "general" journals (e.g. JACS or Angewandte Chemie). This study presents the results of a pilot project attempting to overcome this shortcoming by delimiting the subject of papers published in multidisciplinary and general journals by an item-by-item subject classification scheme, where assignment is based on the analysis of the subject classification of reference literature. The results clearly confirmed the conclusions of earlier studies by the authors in the field of reference analysis. For the really important journals (sufficiently high number of annual publications and high impact with respect to the field), the share of classifiable papers was surprisingly high, and the assignment proved reliable as well. Since papers in the leading general and multidisciplinary journals are frequently citing general and multidisciplinary journals, an iterated application of the procedure is expected to increase the number of classifiable publications. The results of the new methodology may improve the validity of bibliometric studies for research evaluation purposes.

UR - http://www.scopus.com/inward/record.url?scp=0009231197&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0009231197&partnerID=8YFLogxK

M3 - Article

VL - 44

SP - 427

EP - 439

JO - Scientometrics

JF - Scientometrics

SN - 0138-9130

IS - 3

ER -