Performance of the trim and fill method in adjusting for the publication bias in meta-analysis of continuous data
Publication bias in meta-analysis is a serious issue as it may lead to biased estimates which appear to be precise. A popular method for detecting and adjusting the publication bias is the trim and fill method. This study uses simulated meta-analysis to quantify the effects of publication bias on th...
Main Author: | |
---|---|
Format: | Article |
Language: | English |
Published: |
Science Publications
2012
|
Subjects: | |
Online Access: | http://irep.iium.edu.my/25536/ http://irep.iium.edu.my/25536/ http://irep.iium.edu.my/25536/ http://irep.iium.edu.my/25536/1/Performance_of_the_trim_and_fill_method_in_adjusting_for_the_publication_bias.pdf |
id |
iium-25536 |
---|---|
recordtype |
eprints |
spelling |
iium-255362012-11-12T01:54:33Z http://irep.iium.edu.my/25536/ Performance of the trim and fill method in adjusting for the publication bias in meta-analysis of continuous data Nik Idris, Nik Ruzni Q Science (General) Publication bias in meta-analysis is a serious issue as it may lead to biased estimates which appear to be precise. A popular method for detecting and adjusting the publication bias is the trim and fill method. This study uses simulated meta-analysis to quantify the effects of publication bias on the overall meta-analysis estimates of continuous data where the absolute mean difference was utilized as the measure of effect. It additionally evaluates the performance of the trim and fills method for adjusting the publication bias in terms of statistical bias, the standard errors and the coverage probability. The results demonstrate that if the publication bias is not adjusted it could lead to up to 40% biased in treatment effect estimates. Utilization of the trim and fill method has reduced the bias in the overall effect estimate by more than half. It is optimum in presence of moderate underlying bias but has minimal effects in presence of low and severe bias. Additionally, the trim and fill method improves the coverage probability by more than half when subjected to the same level of publication bias as those of the unadjusted data. However, the method tends to produce false positive results. A sensitivity analysis suggests that the trim and fill method will incorrectly adjust the data for publication bias between 10-45% of the time (for the 5% nominal level). Although the data was incorrectly adjusted, it was found that the Percentage Relative Bias (PRB) introduced into the estimates due to this adjustment is minimal (min: 0.007%, max: 0.109%) and coverage probability for estimates based on this incorrectly adjusted data is not significantly different from those of which is correctly not adjusted. Therefore the trim and fill method is recommended be routinely used when conducting meta-analysis. Science Publications 2012 Article PeerReviewed application/pdf en http://irep.iium.edu.my/25536/1/Performance_of_the_trim_and_fill_method_in_adjusting_for_the_publication_bias.pdf Nik Idris, Nik Ruzni (2012) Performance of the trim and fill method in adjusting for the publication bias in meta-analysis of continuous data. American Journal of Applied Sciences , 9 (9). pp. 1512-1517. ISSN 1554-3641(O), 1546-9239 (P) http://thescipub.com/html/10.3844/ajassp.2012.1512.1517 10.3844/ajassp.2012.1512.1517 |
repository_type |
Digital Repository |
institution_category |
Local University |
institution |
International Islamic University Malaysia |
building |
IIUM Repository |
collection |
Online Access |
language |
English |
topic |
Q Science (General) |
spellingShingle |
Q Science (General) Nik Idris, Nik Ruzni Performance of the trim and fill method in adjusting for the publication bias in meta-analysis of continuous data |
description |
Publication bias in meta-analysis is a serious issue as it may lead to biased estimates which appear to be precise. A popular method for detecting and adjusting the publication bias is the trim and fill method. This study uses simulated meta-analysis to quantify the effects of publication bias on the overall meta-analysis estimates of continuous data where the absolute mean difference was utilized as the measure of effect. It additionally evaluates the performance of the trim and fills method for adjusting the publication bias in terms of statistical bias, the standard errors and the coverage probability. The results demonstrate that if the publication bias is not adjusted it could lead to up to 40% biased in treatment effect estimates. Utilization of the trim and fill method has reduced the bias in the overall effect estimate by more than half. It is optimum in presence of moderate underlying bias but has minimal effects in presence of low and severe bias. Additionally, the trim and fill method improves the coverage probability by more than half when subjected to the same level of publication bias as those of the unadjusted data. However, the method tends to produce false positive results. A sensitivity analysis suggests that the trim and fill method will incorrectly adjust the data for publication bias between 10-45% of the time (for the 5% nominal level). Although the data was incorrectly adjusted, it was found that the Percentage Relative Bias (PRB) introduced into the estimates due to this adjustment is minimal (min: 0.007%, max: 0.109%) and coverage probability for estimates based on this incorrectly adjusted data is not significantly different from those of which is correctly not adjusted. Therefore the trim and fill method is recommended be routinely used when conducting meta-analysis. |
format |
Article |
author |
Nik Idris, Nik Ruzni |
author_facet |
Nik Idris, Nik Ruzni |
author_sort |
Nik Idris, Nik Ruzni |
title |
Performance of the trim and fill method in adjusting for the publication bias in meta-analysis of continuous data |
title_short |
Performance of the trim and fill method in adjusting for the publication bias in meta-analysis of continuous data |
title_full |
Performance of the trim and fill method in adjusting for the publication bias in meta-analysis of continuous data |
title_fullStr |
Performance of the trim and fill method in adjusting for the publication bias in meta-analysis of continuous data |
title_full_unstemmed |
Performance of the trim and fill method in adjusting for the publication bias in meta-analysis of continuous data |
title_sort |
performance of the trim and fill method in adjusting for the publication bias in meta-analysis of continuous data |
publisher |
Science Publications |
publishDate |
2012 |
url |
http://irep.iium.edu.my/25536/ http://irep.iium.edu.my/25536/ http://irep.iium.edu.my/25536/ http://irep.iium.edu.my/25536/1/Performance_of_the_trim_and_fill_method_in_adjusting_for_the_publication_bias.pdf |
first_indexed |
2023-09-18T20:38:02Z |
last_indexed |
2023-09-18T20:38:02Z |
_version_ |
1777409177946161152 |