Zimovetz E, Wolowacz S. Reviewer's checklist for assessing the quality of decision models. Poster presented at the 2009 ISPOR 12th Annual European Congress; October 28, 2009. [abstract] Value Health. 2009 Oct; 12(7):A395.

OBJECTIVES: The NICE Single Technology Appraisal process requires a systematic review of existing economic evaluations to be submitted. A critical appraisal of the identified studies is an important component of this review. Numerous quality assessment tools have been devised to critically appraise the quality of decision models. However, none of these accurately reflect the quality criteria specified by the NICE Reference Case published in the updated 2008 Guide to the Methods of Technology Appraisal. We aimed to develop a checklist for assessing the quality of decision-analytic models that may be used in the context of STA submissions, and which reflects the requirements of the NICE reference case, and incorporates important elements of existing highly regarded tools.

METHODS: A systematic review was undertaken to identify existing good practice guidelines and checklists for critical appraisal of health economics studies. We searched MEDLINE, EconLit and Health Economic Evaluations Database (HEED) for published guidelines and checklists, and the Internet for relevant grey literature, discussion papers and conference abstracts.

RESULTS: We identified 17 relevant publications. These were summarised and synthesised to determine the most important appraisal criteria. Based on these findings and the NICE 2008 Methods Guide, we propose a simple checklist which provides a means to assess the quality of models and the evidence underpinning them according to the Reference Case and evidence hierarchy specified by NICE, including identification of evidence by systematic review, and selection and synthesis of outcomes data and measuring and valuing health effects.

CONCLUSIONS: We believe the proposed checklist will provide a useful means for assessing the quality of health economics evaluations reflecting the most up-to-date Reference Case requirements. The checklist may be used alongside recognized guidelines for critical appraisal of health economics evaluations.