Skip to main content
Search
Search
    Quick Search anywhere
    Quick search in Citations
Advanced Search
Skip main navigationClose Drawer MenuOpen Drawer Menu
Previous article
Original Article

Reflections on the Cognitive Interviewing Reporting Framework

Efficacy, Expectations, and Promise for the Future

Published Online:January 01, 2013https://doi.org/10.1027/1614-2241/a000074

Abstract

Based on the experiences of three research groups using and evaluating the Cognitive Interviewing Reporting Framework (CIRF), we draw conclusions about the utility of the CIRF as a guide to creating cognitive testing reports. Authors generally found the CIRF checklist to be usable, and that it led to a more complete description of key steps involved. However, despite the explicit direction by the CIRF to include a full explanation of major steps and features (e.g., research objectives and research design), the three cognitive testing reports tended to simply state what was done, without further justification. Authors varied in their judgments concerning whether the CIRF requires the appropriate level of detail. Overall, we believe that current cognitive interviewing practice will benefit from including, within cognitive testing reports, the 10 categories of information specified by the CIRF. Future use of the CIRF may serve to direct the overall research project from the start, and to further the goal of evaluation of specific cognitive interviewing procedures.

References

  • Bode, C. , Jansen, H. (2013). Examining the Personal Experience of Aging Scale with the Three Step Test Interview. Methodology: European Journal of Research Methods for the Behavioral and Social Sciences, 9, 96–103. doi: 10.1027/1614-2241/a000071 First citation in articleLink, Google Scholar

  • Boeije, H. R. (2010). Analysis in qualitative research. London, UK: Sage. First citation in articleGoogle Scholar

  • Boeije, H. , Willis, G. (2013). The Cognitive Interviewing Reporting Framework (CIRF): Towards the harmonization of cognitive testing reports. Methodology: European Journal of Research Methods for the Behavioral and Social Sciences, 9, 87–95. doi: 10.1027/1614-2241/a000075 First citation in articleGoogle Scholar

  • Conrad, F. , Blair, J. , Tracy, E. (2000). Verbal reports are data! A theoretical approach to cognitive interviews. Proceedings of the 1999 Federal Committee on Statistical Methodology Research Conference (pp. 317–326). Washington, DC: Office of Management and Budget Retrieved from www.bls.gov./osmr/pdf/st990240.pdf First citation in articleGoogle Scholar

  • Padilla, J. L. , Benitez, I. , Castillo, M. (2013). Obtaining validity evidence by cognitive interviewing to interpret psychometric results. Methodology: European Journal of Research Methods for the Behavioral and Social Sciences, 9, 113–122. doi: 10.1027/1614-2241/a000073 First citation in articleLink, Google Scholar

  • Tourangeau, R. (1984). Cognitive science and survey methods: A cognitive perspective. In T. Jabine, M. Straf, J. Tanur, R. Tourangeau, (Eds.), Cognitive aspects of survey design: Building a bridge between disciplines (pp. 73–100). Washington, DC: National Academy Press. First citation in articleGoogle Scholar

  • Vis-Visschers, R. , Meertens, V. (2013). Evaluating the CIRF by re-writing a Dutch pretesting report of a European health survey questionnaire. Methodology: European Journal of Research Methods for the Behavioral and Social Sciences, 9, 104–112. doi: 10.1027/1614-2241/a000072 First citation in articleLink, Google Scholar

  • Willis, G. B. (2005). Cognitive interviewing: A tool for improving questionnaire design. Thousand Oaks, CA: Sage. First citation in articleCrossref, Google Scholar