Attempt to increase the transparency of fourth hurdle implementation in Central-Eastern European middle income countries

Publication of the critical appraisal methodology

András Inotai, Márta Pékli, Gabriella Jóna, Orsolya Nagy, Edit Remák, Z. Kaló

Research output: Contribution to journalArticle

14 Citations (Scopus)

Abstract

Background: In middle income countries the number of trained health technology assessment specialists is limited and the public budget for health technology assessment is considerably lower compared to developed countries. These countries therefore must develop their own solutions to improve the quality and efficiency of health technology assessment implementation in reimbursement decisions. Our study aimed to develop a scientifically rigorous and detailed appraisal checklist for economic evaluations of pharmaceuticals in the single health technology assessment process. Methods. The research design entailed a review of economic evaluations, submitted for reimbursement of pharmaceuticals, by two independent academic reviewers to identify the most common methodological problems. Fifty economic evaluations submitted in 2007-2008, randomly selected by the Health Technology Assessment Office served as data sources. The new checklist was developed by an iterative working process: first by assessing ten economic evaluations, then improving the checklist by generating new question items, then employing the improved checklist to assess the next ten economic evaluations. After appraising 25 documents, the reviewers reconciled their opinions and improved the checklist with the researchers of the Health Technology Assessment Office during an expert panel discussion. The reviewers scrutinized the second 25 economic evaluations, after which the expert panel finalized the checklist with consensus. Results: The final checklist consists of 91 yes or no questions in 11 main topics concerning comparator selection, efficacy, effectiveness, costs, sensitivity analysis, methodological approach, transparency, and interpretation of results. The new checklist is based on current Hungarian evaluation practice. As the published checklist will be part of the official single health technology assessment process of pharmaceuticals, submitters will be able to assure the quality of their economic evaluation. Conclusions: The transparent critical appraisal method should improve the consistency of pharmaceutical reimbursement decisions and facilitate the utilization of economic evaluations in other fields of health care decision-making in other Central-Eastern European countries.

Original languageEnglish
Article number332
JournalBMC Health Services Research
Volume12
Issue number1
DOIs
Publication statusPublished - 2012

Fingerprint

Checklist
Biomedical Technology Assessment
Cost-Benefit Analysis
Publications
Pharmaceutical Preparations
Information Storage and Retrieval
Budgets
Developed Countries
Consensus
Decision Making
Research Design
Public Health
Research Personnel
Delivery of Health Care

ASJC Scopus subject areas

  • Health Policy

Cite this

Attempt to increase the transparency of fourth hurdle implementation in Central-Eastern European middle income countries : Publication of the critical appraisal methodology. / Inotai, András; Pékli, Márta; Jóna, Gabriella; Nagy, Orsolya; Remák, Edit; Kaló, Z.

In: BMC Health Services Research, Vol. 12, No. 1, 332, 2012.

Research output: Contribution to journalArticle

@article{2a17df916c7841d699f6f8dcfe7aa7da,
title = "Attempt to increase the transparency of fourth hurdle implementation in Central-Eastern European middle income countries: Publication of the critical appraisal methodology",
abstract = "Background: In middle income countries the number of trained health technology assessment specialists is limited and the public budget for health technology assessment is considerably lower compared to developed countries. These countries therefore must develop their own solutions to improve the quality and efficiency of health technology assessment implementation in reimbursement decisions. Our study aimed to develop a scientifically rigorous and detailed appraisal checklist for economic evaluations of pharmaceuticals in the single health technology assessment process. Methods. The research design entailed a review of economic evaluations, submitted for reimbursement of pharmaceuticals, by two independent academic reviewers to identify the most common methodological problems. Fifty economic evaluations submitted in 2007-2008, randomly selected by the Health Technology Assessment Office served as data sources. The new checklist was developed by an iterative working process: first by assessing ten economic evaluations, then improving the checklist by generating new question items, then employing the improved checklist to assess the next ten economic evaluations. After appraising 25 documents, the reviewers reconciled their opinions and improved the checklist with the researchers of the Health Technology Assessment Office during an expert panel discussion. The reviewers scrutinized the second 25 economic evaluations, after which the expert panel finalized the checklist with consensus. Results: The final checklist consists of 91 yes or no questions in 11 main topics concerning comparator selection, efficacy, effectiveness, costs, sensitivity analysis, methodological approach, transparency, and interpretation of results. The new checklist is based on current Hungarian evaluation practice. As the published checklist will be part of the official single health technology assessment process of pharmaceuticals, submitters will be able to assure the quality of their economic evaluation. Conclusions: The transparent critical appraisal method should improve the consistency of pharmaceutical reimbursement decisions and facilitate the utilization of economic evaluations in other fields of health care decision-making in other Central-Eastern European countries.",
author = "Andr{\'a}s Inotai and M{\'a}rta P{\'e}kli and Gabriella J{\'o}na and Orsolya Nagy and Edit Rem{\'a}k and Z. Kal{\'o}",
year = "2012",
doi = "10.1186/1472-6963-12-332",
language = "English",
volume = "12",
journal = "BMC Health Services Research",
issn = "1472-6963",
publisher = "BioMed Central",
number = "1",

}

TY - JOUR

T1 - Attempt to increase the transparency of fourth hurdle implementation in Central-Eastern European middle income countries

T2 - Publication of the critical appraisal methodology

AU - Inotai, András

AU - Pékli, Márta

AU - Jóna, Gabriella

AU - Nagy, Orsolya

AU - Remák, Edit

AU - Kaló, Z.

PY - 2012

Y1 - 2012

N2 - Background: In middle income countries the number of trained health technology assessment specialists is limited and the public budget for health technology assessment is considerably lower compared to developed countries. These countries therefore must develop their own solutions to improve the quality and efficiency of health technology assessment implementation in reimbursement decisions. Our study aimed to develop a scientifically rigorous and detailed appraisal checklist for economic evaluations of pharmaceuticals in the single health technology assessment process. Methods. The research design entailed a review of economic evaluations, submitted for reimbursement of pharmaceuticals, by two independent academic reviewers to identify the most common methodological problems. Fifty economic evaluations submitted in 2007-2008, randomly selected by the Health Technology Assessment Office served as data sources. The new checklist was developed by an iterative working process: first by assessing ten economic evaluations, then improving the checklist by generating new question items, then employing the improved checklist to assess the next ten economic evaluations. After appraising 25 documents, the reviewers reconciled their opinions and improved the checklist with the researchers of the Health Technology Assessment Office during an expert panel discussion. The reviewers scrutinized the second 25 economic evaluations, after which the expert panel finalized the checklist with consensus. Results: The final checklist consists of 91 yes or no questions in 11 main topics concerning comparator selection, efficacy, effectiveness, costs, sensitivity analysis, methodological approach, transparency, and interpretation of results. The new checklist is based on current Hungarian evaluation practice. As the published checklist will be part of the official single health technology assessment process of pharmaceuticals, submitters will be able to assure the quality of their economic evaluation. Conclusions: The transparent critical appraisal method should improve the consistency of pharmaceutical reimbursement decisions and facilitate the utilization of economic evaluations in other fields of health care decision-making in other Central-Eastern European countries.

AB - Background: In middle income countries the number of trained health technology assessment specialists is limited and the public budget for health technology assessment is considerably lower compared to developed countries. These countries therefore must develop their own solutions to improve the quality and efficiency of health technology assessment implementation in reimbursement decisions. Our study aimed to develop a scientifically rigorous and detailed appraisal checklist for economic evaluations of pharmaceuticals in the single health technology assessment process. Methods. The research design entailed a review of economic evaluations, submitted for reimbursement of pharmaceuticals, by two independent academic reviewers to identify the most common methodological problems. Fifty economic evaluations submitted in 2007-2008, randomly selected by the Health Technology Assessment Office served as data sources. The new checklist was developed by an iterative working process: first by assessing ten economic evaluations, then improving the checklist by generating new question items, then employing the improved checklist to assess the next ten economic evaluations. After appraising 25 documents, the reviewers reconciled their opinions and improved the checklist with the researchers of the Health Technology Assessment Office during an expert panel discussion. The reviewers scrutinized the second 25 economic evaluations, after which the expert panel finalized the checklist with consensus. Results: The final checklist consists of 91 yes or no questions in 11 main topics concerning comparator selection, efficacy, effectiveness, costs, sensitivity analysis, methodological approach, transparency, and interpretation of results. The new checklist is based on current Hungarian evaluation practice. As the published checklist will be part of the official single health technology assessment process of pharmaceuticals, submitters will be able to assure the quality of their economic evaluation. Conclusions: The transparent critical appraisal method should improve the consistency of pharmaceutical reimbursement decisions and facilitate the utilization of economic evaluations in other fields of health care decision-making in other Central-Eastern European countries.

UR - http://www.scopus.com/inward/record.url?scp=84866518415&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84866518415&partnerID=8YFLogxK

U2 - 10.1186/1472-6963-12-332

DO - 10.1186/1472-6963-12-332

M3 - Article

VL - 12

JO - BMC Health Services Research

JF - BMC Health Services Research

SN - 1472-6963

IS - 1

M1 - 332

ER -