Performance of the trim and fill method in adjusting for the publication bias in meta-analysis of continuous data

Publication bias in meta-analysis is a serious issue as it may lead to biased estimates which appear to be precise. A popular method for detecting and adjusting the publication bias is the trim and fill method. This study uses simulated meta-analysis to quantify the effects of publication bias on th...

Full description

Bibliographic Details
Main Author: Nik Idris, Nik Ruzni
Format: Article
Language:English
Published: Science Publications 2012
Subjects:
Online Access:http://irep.iium.edu.my/25536/
http://irep.iium.edu.my/25536/
http://irep.iium.edu.my/25536/
http://irep.iium.edu.my/25536/1/Performance_of_the_trim_and_fill_method_in_adjusting_for_the_publication_bias.pdf
id iium-25536
recordtype eprints
spelling iium-255362012-11-12T01:54:33Z http://irep.iium.edu.my/25536/ Performance of the trim and fill method in adjusting for the publication bias in meta-analysis of continuous data Nik Idris, Nik Ruzni Q Science (General) Publication bias in meta-analysis is a serious issue as it may lead to biased estimates which appear to be precise. A popular method for detecting and adjusting the publication bias is the trim and fill method. This study uses simulated meta-analysis to quantify the effects of publication bias on the overall meta-analysis estimates of continuous data where the absolute mean difference was utilized as the measure of effect. It additionally evaluates the performance of the trim and fills method for adjusting the publication bias in terms of statistical bias, the standard errors and the coverage probability. The results demonstrate that if the publication bias is not adjusted it could lead to up to 40% biased in treatment effect estimates. Utilization of the trim and fill method has reduced the bias in the overall effect estimate by more than half. It is optimum in presence of moderate underlying bias but has minimal effects in presence of low and severe bias. Additionally, the trim and fill method improves the coverage probability by more than half when subjected to the same level of publication bias as those of the unadjusted data. However, the method tends to produce false positive results. A sensitivity analysis suggests that the trim and fill method will incorrectly adjust the data for publication bias between 10-45% of the time (for the 5% nominal level). Although the data was incorrectly adjusted, it was found that the Percentage Relative Bias (PRB) introduced into the estimates due to this adjustment is minimal (min: 0.007%, max: 0.109%) and coverage probability for estimates based on this incorrectly adjusted data is not significantly different from those of which is correctly not adjusted. Therefore the trim and fill method is recommended be routinely used when conducting meta-analysis. Science Publications 2012 Article PeerReviewed application/pdf en http://irep.iium.edu.my/25536/1/Performance_of_the_trim_and_fill_method_in_adjusting_for_the_publication_bias.pdf Nik Idris, Nik Ruzni (2012) Performance of the trim and fill method in adjusting for the publication bias in meta-analysis of continuous data. American Journal of Applied Sciences , 9 (9). pp. 1512-1517. ISSN 1554-3641(O), 1546-9239 (P) http://thescipub.com/html/10.3844/ajassp.2012.1512.1517 10.3844/ajassp.2012.1512.1517
repository_type Digital Repository
institution_category Local University
institution International Islamic University Malaysia
building IIUM Repository
collection Online Access
language English
topic Q Science (General)
spellingShingle Q Science (General)
Nik Idris, Nik Ruzni
Performance of the trim and fill method in adjusting for the publication bias in meta-analysis of continuous data
description Publication bias in meta-analysis is a serious issue as it may lead to biased estimates which appear to be precise. A popular method for detecting and adjusting the publication bias is the trim and fill method. This study uses simulated meta-analysis to quantify the effects of publication bias on the overall meta-analysis estimates of continuous data where the absolute mean difference was utilized as the measure of effect. It additionally evaluates the performance of the trim and fills method for adjusting the publication bias in terms of statistical bias, the standard errors and the coverage probability. The results demonstrate that if the publication bias is not adjusted it could lead to up to 40% biased in treatment effect estimates. Utilization of the trim and fill method has reduced the bias in the overall effect estimate by more than half. It is optimum in presence of moderate underlying bias but has minimal effects in presence of low and severe bias. Additionally, the trim and fill method improves the coverage probability by more than half when subjected to the same level of publication bias as those of the unadjusted data. However, the method tends to produce false positive results. A sensitivity analysis suggests that the trim and fill method will incorrectly adjust the data for publication bias between 10-45% of the time (for the 5% nominal level). Although the data was incorrectly adjusted, it was found that the Percentage Relative Bias (PRB) introduced into the estimates due to this adjustment is minimal (min: 0.007%, max: 0.109%) and coverage probability for estimates based on this incorrectly adjusted data is not significantly different from those of which is correctly not adjusted. Therefore the trim and fill method is recommended be routinely used when conducting meta-analysis.
format Article
author Nik Idris, Nik Ruzni
author_facet Nik Idris, Nik Ruzni
author_sort Nik Idris, Nik Ruzni
title Performance of the trim and fill method in adjusting for the publication bias in meta-analysis of continuous data
title_short Performance of the trim and fill method in adjusting for the publication bias in meta-analysis of continuous data
title_full Performance of the trim and fill method in adjusting for the publication bias in meta-analysis of continuous data
title_fullStr Performance of the trim and fill method in adjusting for the publication bias in meta-analysis of continuous data
title_full_unstemmed Performance of the trim and fill method in adjusting for the publication bias in meta-analysis of continuous data
title_sort performance of the trim and fill method in adjusting for the publication bias in meta-analysis of continuous data
publisher Science Publications
publishDate 2012
url http://irep.iium.edu.my/25536/
http://irep.iium.edu.my/25536/
http://irep.iium.edu.my/25536/
http://irep.iium.edu.my/25536/1/Performance_of_the_trim_and_fill_method_in_adjusting_for_the_publication_bias.pdf
first_indexed 2023-09-18T20:38:02Z
last_indexed 2023-09-18T20:38:02Z
_version_ 1777409177946161152