Call Me Maybe : Experimental Evidence on Frequency and Medium Effects in Microenterprise Surveys

This study analyzes the effects of differences in survey frequency and medium on microenterprise survey data. A sample of enterprises were randomly assigned to monthly in-person, weekly in-person, or weekly phone surveys for a 12-week panel. The results show few differences across the groups in meas...

Full description

Bibliographic Details
Main Authors: Garlick, Robert, Orkin, Kate, Quinn, Simon
Format: Journal Article
Published: Published by Oxford University Press on behalf of the World Bank 2021
Subjects:
Online Access:http://hdl.handle.net/10986/36717
id okr-10986-36717
recordtype oai_dc
spelling okr-10986-367172021-12-11T05:10:38Z Call Me Maybe : Experimental Evidence on Frequency and Medium Effects in Microenterprise Surveys Garlick, Robert Orkin, Kate Quinn, Simon MICROENTERPRISE SURVEY METHODS DATA COLLECTION This study analyzes the effects of differences in survey frequency and medium on microenterprise survey data. A sample of enterprises were randomly assigned to monthly in-person, weekly in-person, or weekly phone surveys for a 12-week panel. The results show few differences across the groups in measured means, distributions, and deviations of measured data from an objective data-quality standard provided by Benford’s Law. However, phone interviews generated higher within-enterprise variation through time in several variables and may be more sensitive to social desirability bias. Higher-frequency interviews did not lead to persistent changes in reporting or increase permanent attrition from the panel but did increase the share of missed interviews. These findings show that collecting high-frequency survey data by phone does not substantially affect data quality. However, researchers who are particularly interested in within-enterprise dynamics should exercise caution when choosing survey medium. 2021-12-10T15:18:19Z 2021-12-10T15:18:19Z 2020-06 Journal Article World Bank Economic Review 1564-698X http://hdl.handle.net/10986/36717 CC BY-NC-ND 3.0 IGO http://creativecommons.org/licenses/by-nc-nd/3.0/igo World Bank Published by Oxford University Press on behalf of the World Bank Publications & Research Publications & Research :: Journal Article
repository_type Digital Repository
institution_category Foreign Institution
institution Digital Repositories
building World Bank Open Knowledge Repository
collection World Bank
topic MICROENTERPRISE
SURVEY METHODS
DATA COLLECTION
spellingShingle MICROENTERPRISE
SURVEY METHODS
DATA COLLECTION
Garlick, Robert
Orkin, Kate
Quinn, Simon
Call Me Maybe : Experimental Evidence on Frequency and Medium Effects in Microenterprise Surveys
description This study analyzes the effects of differences in survey frequency and medium on microenterprise survey data. A sample of enterprises were randomly assigned to monthly in-person, weekly in-person, or weekly phone surveys for a 12-week panel. The results show few differences across the groups in measured means, distributions, and deviations of measured data from an objective data-quality standard provided by Benford’s Law. However, phone interviews generated higher within-enterprise variation through time in several variables and may be more sensitive to social desirability bias. Higher-frequency interviews did not lead to persistent changes in reporting or increase permanent attrition from the panel but did increase the share of missed interviews. These findings show that collecting high-frequency survey data by phone does not substantially affect data quality. However, researchers who are particularly interested in within-enterprise dynamics should exercise caution when choosing survey medium.
format Journal Article
author Garlick, Robert
Orkin, Kate
Quinn, Simon
author_facet Garlick, Robert
Orkin, Kate
Quinn, Simon
author_sort Garlick, Robert
title Call Me Maybe : Experimental Evidence on Frequency and Medium Effects in Microenterprise Surveys
title_short Call Me Maybe : Experimental Evidence on Frequency and Medium Effects in Microenterprise Surveys
title_full Call Me Maybe : Experimental Evidence on Frequency and Medium Effects in Microenterprise Surveys
title_fullStr Call Me Maybe : Experimental Evidence on Frequency and Medium Effects in Microenterprise Surveys
title_full_unstemmed Call Me Maybe : Experimental Evidence on Frequency and Medium Effects in Microenterprise Surveys
title_sort call me maybe : experimental evidence on frequency and medium effects in microenterprise surveys
publisher Published by Oxford University Press on behalf of the World Bank
publishDate 2021
url http://hdl.handle.net/10986/36717
_version_ 1764485760839319552