The granularity of disciplinary structures for benchmarking citation impact. The case of CSS profiles

W. Glänzel, Bart Thijs

Research output: Contribution to conferencePaper

1 Citation (Scopus)

Abstract

In this paper we study the effect of granularity on Characteristic Scores and Scales (CSS). Unlike the traditional indicators that are mostly based on means and quantiles, CSS require the reduction of the citation distributions collaboration of the underlying reference population to four states (classes) and thus higher a different level of granularity. While the question of the choice of granularity is at higher levels of aggregation usually not critical since countries and university have rather multidisciplinary profiles, at lower aggregation levels specialisation becomes more typical. Inappropriate granularity might not warrant the depiction of the publication profiles at these levels in a correct and adequate manner and thus not add accurate citation profiles either. In order to be able to process one complete annual volume of the Web of Science, we decided to calculate CSS thresholds and classes for two levels of granularity, namely sub-fields and WoS Subject Categories. With about 5% deviation, we did not find a real significance. However, we identified journals with similar impact measures but different citation profiles, independently of the granularity. Finally, we have pointed to the limitations in the choice of granularity - in terms of both too broad and too narrow subjects.

Original languageEnglish
Pages1190-1200
Number of pages11
Publication statusPublished - Jan 1 2017
Event16th International Conference on Scientometrics and Informetrics, ISSI 2017 - Wuhan, China
Duration: Oct 16 2017Oct 20 2017

Other

Other16th International Conference on Scientometrics and Informetrics, ISSI 2017
CountryChina
CityWuhan
Period10/16/1710/20/17

Fingerprint

Citations
Benchmarking
Granularity
Agglomeration
Aggregation
Subfield
Specialization
Profile
Quantile
Annual
Deviation
Calculate

Keywords

  • Citation and co-citation analysis
  • Indicators
  • The application of informetrics on evaluation

ASJC Scopus subject areas

  • Computer Science Applications
  • Applied Mathematics
  • Modelling and Simulation
  • Statistics and Probability
  • Management Science and Operations Research

Cite this

Glänzel, W., & Thijs, B. (2017). The granularity of disciplinary structures for benchmarking citation impact. The case of CSS profiles. 1190-1200. Paper presented at 16th International Conference on Scientometrics and Informetrics, ISSI 2017, Wuhan, China.

The granularity of disciplinary structures for benchmarking citation impact. The case of CSS profiles. / Glänzel, W.; Thijs, Bart.

2017. 1190-1200 Paper presented at 16th International Conference on Scientometrics and Informetrics, ISSI 2017, Wuhan, China.

Research output: Contribution to conferencePaper

Glänzel, W & Thijs, B 2017, 'The granularity of disciplinary structures for benchmarking citation impact. The case of CSS profiles' Paper presented at 16th International Conference on Scientometrics and Informetrics, ISSI 2017, Wuhan, China, 10/16/17 - 10/20/17, pp. 1190-1200.
Glänzel W, Thijs B. The granularity of disciplinary structures for benchmarking citation impact. The case of CSS profiles. 2017. Paper presented at 16th International Conference on Scientometrics and Informetrics, ISSI 2017, Wuhan, China.
Glänzel, W. ; Thijs, Bart. / The granularity of disciplinary structures for benchmarking citation impact. The case of CSS profiles. Paper presented at 16th International Conference on Scientometrics and Informetrics, ISSI 2017, Wuhan, China.11 p.
@conference{2ad2f583c69947369e966e9e603d1f2d,
title = "The granularity of disciplinary structures for benchmarking citation impact. The case of CSS profiles",
abstract = "In this paper we study the effect of granularity on Characteristic Scores and Scales (CSS). Unlike the traditional indicators that are mostly based on means and quantiles, CSS require the reduction of the citation distributions collaboration of the underlying reference population to four states (classes) and thus higher a different level of granularity. While the question of the choice of granularity is at higher levels of aggregation usually not critical since countries and university have rather multidisciplinary profiles, at lower aggregation levels specialisation becomes more typical. Inappropriate granularity might not warrant the depiction of the publication profiles at these levels in a correct and adequate manner and thus not add accurate citation profiles either. In order to be able to process one complete annual volume of the Web of Science, we decided to calculate CSS thresholds and classes for two levels of granularity, namely sub-fields and WoS Subject Categories. With about 5{\%} deviation, we did not find a real significance. However, we identified journals with similar impact measures but different citation profiles, independently of the granularity. Finally, we have pointed to the limitations in the choice of granularity - in terms of both too broad and too narrow subjects.",
keywords = "Citation and co-citation analysis, Indicators, The application of informetrics on evaluation",
author = "W. Gl{\"a}nzel and Bart Thijs",
year = "2017",
month = "1",
day = "1",
language = "English",
pages = "1190--1200",
note = "16th International Conference on Scientometrics and Informetrics, ISSI 2017 ; Conference date: 16-10-2017 Through 20-10-2017",

}

TY - CONF

T1 - The granularity of disciplinary structures for benchmarking citation impact. The case of CSS profiles

AU - Glänzel, W.

AU - Thijs, Bart

PY - 2017/1/1

Y1 - 2017/1/1

N2 - In this paper we study the effect of granularity on Characteristic Scores and Scales (CSS). Unlike the traditional indicators that are mostly based on means and quantiles, CSS require the reduction of the citation distributions collaboration of the underlying reference population to four states (classes) and thus higher a different level of granularity. While the question of the choice of granularity is at higher levels of aggregation usually not critical since countries and university have rather multidisciplinary profiles, at lower aggregation levels specialisation becomes more typical. Inappropriate granularity might not warrant the depiction of the publication profiles at these levels in a correct and adequate manner and thus not add accurate citation profiles either. In order to be able to process one complete annual volume of the Web of Science, we decided to calculate CSS thresholds and classes for two levels of granularity, namely sub-fields and WoS Subject Categories. With about 5% deviation, we did not find a real significance. However, we identified journals with similar impact measures but different citation profiles, independently of the granularity. Finally, we have pointed to the limitations in the choice of granularity - in terms of both too broad and too narrow subjects.

AB - In this paper we study the effect of granularity on Characteristic Scores and Scales (CSS). Unlike the traditional indicators that are mostly based on means and quantiles, CSS require the reduction of the citation distributions collaboration of the underlying reference population to four states (classes) and thus higher a different level of granularity. While the question of the choice of granularity is at higher levels of aggregation usually not critical since countries and university have rather multidisciplinary profiles, at lower aggregation levels specialisation becomes more typical. Inappropriate granularity might not warrant the depiction of the publication profiles at these levels in a correct and adequate manner and thus not add accurate citation profiles either. In order to be able to process one complete annual volume of the Web of Science, we decided to calculate CSS thresholds and classes for two levels of granularity, namely sub-fields and WoS Subject Categories. With about 5% deviation, we did not find a real significance. However, we identified journals with similar impact measures but different citation profiles, independently of the granularity. Finally, we have pointed to the limitations in the choice of granularity - in terms of both too broad and too narrow subjects.

KW - Citation and co-citation analysis

KW - Indicators

KW - The application of informetrics on evaluation

UR - http://www.scopus.com/inward/record.url?scp=85036646631&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85036646631&partnerID=8YFLogxK

M3 - Paper

AN - SCOPUS:85036646631

SP - 1190

EP - 1200

ER -