The effects of response stimulating factors on response rates and data quality in mail surveys. A test of Dillman's Total design Method

Abstract

Dillman's Total Design Method (TDM) for mail surveys has proved effectual in attaining high response rates in the U.S.A. The TDM, however, has two drawbacks: its relatively high costs of a mail survey and its susceptibility to response errors. We tested the ability of the TDM techniques to increase response rates. Furthermore, the influence of the TDM on the response error was investigated. In this experiment, the effects of personalization of the cover letter and a final reminder by certified mail were tested on a sample of the Dutch population. If the TDM is followed completely the response rate in the Netherlands is comparable to the response rate in the U.S.A (70%). Omission of personalizing the cover letter or sending a reminder by certified mail results in a significantly lower response rate. Using the TDM in toto does not lead to responses of inferior quality. We find that a reminder by certified mail in combination with a personalized cover letter does not result in more socially desirable answers, more item non-response, or a more deviating response pattern. However, the use of only a personalized cover letter, i.e., without a certified mailing, did result in more socially desirable answers.