|
FrontPage
This version was saved 11 years ago
View current version Page history
Saved by Pierre PLUYE
on November 13, 2013 at 6:36:09 pm
Welcome to the public wiki 'Mixed Methods Appraisal Tool'
Please invite others to use this workspace. Comments and suggestions can be added at the bottom of each page (free comment box).
Aim of this WIKI: To enable collaborative work for developing a Mixed Methods Appraisal Tool (MMAT).
The MMAT is intended to be used as a checklist for concomitantly appraising and/or describing studies included in systematic mixed studies reviews (reviews including original qualitative, quantitative and mixed methods studies). You will find additional information and references in our new complementary wikitoolkit for designing, conducting, and reporting systematic mixed studies reviews: http://toolkit4mixedstudiesreviews.pbworks.com.
The MMAT is a tool in development, and must be used with caution. The development of the MMAT is supported by a project called ‘Content Validity, Usability and Reliability of a Mixed Methods Appraisal Tool (MMAT)’ (including workshops, presentations and fellowship/prize/grant from the Canadian Institutes of Health Research - CIHR).
For instance, you may state that the Mixed Methods Appraisal Tool is:
- Designed for systematic reviews that include qualitative, quantitative and mixed methods studies;
- Efficient as it allows to use one tool for concomitantly appraising the most common types of empirical studies;
- Addressing the quality of mixed methods studies (appraisal of qualitative, quantitative and mixed methods components);
- Based on a constructionist theory and a literature review;
- Content validated using feedback from experts and workshops;
- Pilot tested for reliability;
- Already used worldwide for at least 25 systematic mixed studies reviews (to our knowledge).
Pluye, P., Robert, E., Cargo, M., Bartlett, G., O’Cathain, A., Griffiths, F., Boardman, F., Gagnon, M.P., & Rousseau, M.C. (2011). Proposal: A mixed methods appraisal tool for systematic mixed studies reviews. Retrieved on [date] from http://mixedmethodsappraisaltoolpublic.pbworks.com. Archived by WebCite® at http://www.webcitation.org/5tTRTc9yJ
Your feedback is important for us. If you are using the MMAT for a systematic mixed studies review, please let us know : pierre.pluye@mcgill.ca or quan.nha.hong@mail.mcgill.ca
Pilot version (reliability testing)
- Pace R, Pluye P, Bartlett G, Macaulay AC, Salsberg J, Jagosh J, et al. Testing the reliability and efficiency of the pilot Mixed Methods Appraisal Tool (MMAT) for systematic mixed studies review. International Journal of Nursing Studies. 2012;49(1):47-53.
- Pace, R., Pluye, P., Bartlett, G., Macaulay, A., Salsberg, J., Jagosh, J., & Seller, R. (2010). Reliability of a tool for concomitantly appraising the methodological quality of qualitative, quantitative and mixed methods research: a pilot study. 38th Annual Meeting of the North American Primary Care Research Group (NAPCRG), Seattle, USA.
Initial version (content validation)
Pluye P, Gagnon MP, Griffiths F & Johnson-Lafleur J (2009). A scoring system for appraising mixed methods research, and concomitantly appraising qualitative, quantitative and mixed methods primary studies in mixed studies reviews. International Journal of Nursing Studies, 46(4):529-546.
Limitations & strenghts
- The MMAT is not a guidance for writing and reporting mixed methods studies such as GRAMMS 'Good Reporting of a Mixed Methods Study' (O'Cathain et al., 2008), and does not permit a comprehensive evaluation of mixed methods studies such as the conceptual framework proposed by O'Cathain (2010).
- Crowe and Sheppard (2011) reviewed critical appraisal tools, and found only one tool that addresses the quality of mixed methods studies: the MMAT. They suggest the MMAT is in the top-five tools with respect to the explanation of the development of the items, and the presence of a tutorial. They mentioned the content validation of the MMAT, but were not aware (at the time of the publication) that the pilot version of the MMAT was being tested for reliability.
References
- Crowe, M., & Sheppard, L. (2011). A review of critical appraisal tools show they lack rigor: Alternative tool structure is proposed. Journal of Clinical Epidemiology, 64(1), 79-89.
- O'Cathain, A., Murphy, E., & Nicholl, J. (2008). The quality of mixed methods studies in health services research. Journal of Health Services Research and Policy, 13(2), 92-98.
-
O'Cathain, A. (2010). Assessing the quality of mixed methods research: towards a comprehensive framework. In A. Tashakkori & C. Teddlie (Eds.), Handbook of mixed methods in social and behavioral research (pp. 531-555). Thousand Oaks: Sage.
-
Pluye, P., Bush, P., Macaulay, A., Khanassov, V., Queiroga, R., Loignon, C., et al. (September 2013). The Mixed Methods Appraisal Tool for assessing studies with diverse designs: Example from a systematic mixed studies review on the key processes and outcomes of Participatory Research with Health Organizations. Annual International Cochrane Colloquium, Quebec City.
-
Pluye, P. & Hong, Q.N. (2014). Combining the power of stories and the power of numbers: Mixed Methods Research and Mixed Studies Reviews. Annual Review of Public Health, 35:2.1–2.17 (advanced online publication).
Visitors (since March 12, 2013):
FrontPage
|
Tip: To turn text into a link, highlight the text, then click on a page or file from the list above.
|
|
|
|
|
Comments (0)
You don't have permission to comment on this page.