This article is part of a series on African primary care research and gives practical guidance on qualitative data analysis and the presentation of qualitative findings. After an overview of qualitative methods and analytical approaches, the article focuses particularly on content analysis, using the framework method as an example. The steps of familiarisation, creating a thematic index, indexing, charting, interpretation and confirmation are described. Key concepts with regard to establishing the quality and trustworthiness of data analysis are described. Finally, an approach to the presentation of qualitative findings is given.
Recherche en Soins primaires africains: analyse de données qualitatives et rédaction des résultats. Cet article fait partie d’une série sur la recherche en soins primaires africains et offre des conseils pratiques pour l’analyse des données qualitatives et la présentation des résultats qualitatifs. Après un survol des méthodes qualitatives et des approches analytiques, l’article se penche particulièrement sur l’analyse du contenu, en utilisant comme exemple la méthode du cadre logique. On y décrit les étapes de familiarisation, la création d’un index thématique, l’indexage, le répertoriage, l’interprétation et la confirmation. Les concepts clés concernant la détermination de la qualité et de la fiabilité de l’analyse des données sont définis. Finalement, on y donne une méthode de présentation des résultats qualitatifs.
This article is part of a series on African primary care research and addresses the topics of qualitative data analysis and writing results. Over the last few decades there have been several improvements in the scientific rigour of qualitative research methods, which had previously been regarded as being less scientific than more established quantitative approaches.1,2In the discipline of family medicine and primary care, most researchers have been using focus group or in-depth interviews to collect qualitative data. Few researchers engage with participant or non-participant observation or immerse themselves for prolonged periods in other social groups or cultures. Research questions often focus on the need to gain a better understanding of the experiences of people regarding health-related topics or the experiences of patients regarding health services. The need to explore or understand people’s perceptions, attitudes, beliefs, concerns, feelings or expectations are often mentioned in the aim and objectives. Whilst the qualitative research field is a broad one (see Table 1), this article will focus mainly on the analysis and reporting of qualitative data derived from interviews. This article complements the other article in this series on qualitative interviewing and methods.
TABLE 1: Range of qualitative methodological approaches and analysis.
|
Qualitative data is usually text that has been derived from interviews, observations or already-existing documents. Interviews are usually audio- or video-recorded and must be transcribed verbatim in order to create data that can be analysed further.3,4,5,6,7,8,9,10The transcript should therefore be
a word-by-word account and not paraphrased. Transcripts should include page and line numbers and should have sufficiently large margins to allow for
coding.11,12 Before analysing the data the transcript should be checked for accuracy and any mistakes in the transcription corrected against the original recording. If the interview must be translated, then the accuracy of the translation must also be verified. These steps in preparing the data for analysis must be described in the research proposal.
Approach to qualitative data analysis
|
|
Most primary care researchers use content analysis to make sense of their data and most approaches to content analysis follow the same basic stages of familiarisation, coding and formation of categories, interpretation of themes, confirmation of the interpretation and presentation of the results.13 Attention must also be given throughout to the trustworthiness of the data and data analysis process, as is discussed below. In order to provide a practical approach to qualitative data analysis, the Framework Method is described in some detail below as one commonly-used example.14 In your research proposal, you should outline the steps that you will follow in your analysis.
Familiarisation
If you are performing your own data collection, this process may start in the field when you collected your data and made field notes. Once the data is available, however, the researcher(s) will make themselves familiar with the qualitative data as a whole by reading the transcripts and observation notes or listening to the tapes. During this process they should take note of key ideas and recurrent themes as they emerge, their own reactions to the data (see ‘Reflexivity’ below) and any remarks on the quality of the data or methodological issues. If there is a large amount of data then it may be necessary to select a representative sample of the data for this stage.15
Development of a thematic index
A list of codes is created based on the familiarisation process mentioned above and organised into categories. Codes and categories should be developed from the data (an inductive process),16 but with the aim and objectives of the study in mind, as sometimes the data contains material that is irrelevant. Sometimes the objectives also provide an overall structure for the categories. The final list of codes and categories is called a ‘thematic index’14,17 and an example is given in Box 1 from a study looking at how people experienced the use of anti-retroviral medication. The thematic index can then be tested and refined on a small number of the transcripts or data sources.Your codes should enable you to organise your data into manageable ‘bites’ that can be interpreted with ease in the next step. The range of opinions, for example, can be captured during interpretation, so you do not need a code for every viewpoint. However, once coding is completed it is easy to join codes together, but very difficult to divide up a code without re-analysing all the coded text. Codes, therefore, should be close to the data and not too broadly defined. The researcher should give the code a short descriptive label and be clear as to what data belong to this code and what is excluded. This can be defined with examples in the thematic index. Codes should be mutually exclusive,18 although the same passage of text can have multiple codes attached.
BOX 1: Example of a thematic index.
|
Indexing
In this step, the codes in the thematic index are applied systematically to all the qualitative data. Text is annotated with all the codes that are being applied to it, usually by highlighting the passage and noting the code used in the margin.14 This is not a mechanical process and often requires the use of judgement to decide on the most appropriate code.
Charting
In this step, the data are re-arranged into a series of charts that bring all the data with the same code together in one place from all the data sources.14,17 Charts are often constructed using the framework of the thematic index (i.e. one chart per major category) or can be aligned with another conceptual framework that makes sense of the study aim and objectives. Each chart will usually be a matrix in which each column is a particular code and each row a particular data source. The cells of the chart may contain the highlighted quotation or a summary of the point being made. Each cell should be traceable back to the original data source, page and line number. One can use tables in a Word document, cells in an Excel spreadsheet or specially designed software to create charts.
Interpretation
The researcher will now read each chart and interpret the data. As the charts bring all the data related to a particular category or concept together in one place, it is easy to establish the range and nature of the phenomenon of interest.16 Depending on the research aim and objectives, the following interpretations may also be necessary: how respondents defined the characteristics of key concepts, how emerging themes can be organised into a typology (a range of types of cases), or how patterns in the data suggest associations or explanations. In interpreting the data, it may be useful to pay particular attention to ‘deviant cases’ that contradict or negate the main findings.15 Contradictory and deviant experiences may be a rich source of information allowing for a further understanding of the phenomenon and should not be discarded just because they are a minority view.
Confirmation
It can be helpful to confirm your interpretation of the findings with your respondents – so-called ‘respondent validation’.19 This is, however, not feasible or even desirable in all studies. Triangulation (see below) of findings with data from different sources and methods can help confirm the validity of the interpretation. Having several researchers independently analyse and confirm their interpretation with each other can also assist.15
Checking for trustworthiness
|
|
Qualitative research should be written up with enough clarity regarding the processes that were employed so as to enable the reader to evaluate the scientific rigour of the study, hence enabling acceptance or refutation of the findings.20 The concepts and terminology used to describe the trustworthiness of qualitative research findings are different from quantitative research. The criteria for trustworthiness (verification) are credibility (for internal validity), transferability (external validity), dependability (reliability) and confirmability (objectivity).21 Table 2 displays the various strategies employed to achieve each criterion.
TABLE 2: Criteria for trustworthiness of qualitative research.
|
Credibility
Credibility is concerned with the validity of the conclusions that are drawn from the data and how these conclusions match the reality being reported on. There are many aspects of the study design and reporting that affect the credibility of the work: recognised research methods, sufficient engagement with the phenomenon of interest, checking the transcriptions and emerging themes with the informants (so called ‘member checking’ and ‘respondent validation’), debriefing of the researcher with their mentor or supervisor, peer scrutiny of the process and triangulation. Triangulation has been described as ‘the process of corroborating evidence from different individuals, types of data, or methods of data collection’.20 For example, data sources could be interviews, observations of events in the field (including the informants’ non-verbal expressions), information obtained from semi-structured questionnaires or other relevant documents. Triangulation could also refer to obtaining information from various different types of informants on the same phenomenon.20,22 The effect of triangulation is to render a more holistic picture of the phenomenon under study and to prevent undue reliance on a single data collection method or source.23
Transferability
Transferability refers to how well the study conclusions can be applied to other similar settings. The ability of others to judge whether the findings can be transferred depends on a detailed description of the study setting, the selection of participants and the findings. This is often referred to as a ‘thick description’.
Dependability
Dependability refers to the extent to which similar findings would be obtained if the study were repeated.24 However, variability should be expected in qualitative studies as the focus is on ‘the range of experience rather than the average experience’.25 The best way of supporting the dependability of the research is to ensure that the methods are described in sufficient detail that they could be replicated by someone else (a step-by-step ‘audit trail’) and any limitations are discussed. Triangulation of methods will also improve the dependability of the findings.
Confirmability
Confirmability refers to the degree of objectivity of the researcher in data collection and reporting. The reader wants to ensure that the results are truly based on the data and not the characteristics or preferences of the researcher. Triangulation of the findings with other researchers and methods can help with this, but all qualitative researchers must also account for their own reflexivity.Reflexivity refers to the researcher’s awareness of the self as a research instrument.26 The quality of the data obtained through interviewing or observation will, to some extent, depend on the nature of the interviewer. The extent to which they are open, detached, curious and unprejudiced will affect the responses that they receive and/or what they observe. Issues such as power, hierarchy, class, culture and language may also influence the responses.27 The researchers should be aware of their own reactions
(thoughts, feelings, judgements etc.) and pet theories that may influence how they interpret the data during the analytical process. Qualitative research does not
claim to be free of subjectivity, but should strive to be conscious thereof and to describe how the researchers have accounted for the subjectivity as part of the
research process.27 Describing the researcher’s credentials, training, occupation and prior relationship to the subjects of the research helps to
demonstrate in the proposal that you are thinking about reflexivity.
Computer-assisted qualitative data analysis
|
|
These enhance the analytical process by making it easier and quicker to code, collate, interpret your data and select quotations for the final report.28 The most popular programmes are HyperRESEARCH (ResearchWare, Inc.), NVivo (QSR International) and ATLAS.ti (ATLAS.ti Scientific Software Development GmbH). It should be noted that these programmes do not interpret the data for you, but simply speed up the process and make the handling of large amounts of data both manageable and systematic.15,29
A checklist for explicit and comprehensive reporting of qualitative studies has been suggested by Tong, Sainsburg and Craig in order to promote complete and transparent reporting amongst researchers of interview and focus group studies.30 The checklist is based on three domains: research team and reflexivity, study design and reporting on findings. The study design has been described in another article in this series and reflexivity has been described above.You should start writing up your findings as soon as you have completed the interpretation of your data. It is customary to start the results section of your thesis with an overview or profile of your research subjects or respondents. Sometimes this can be narrative, but a table may also help to clarify who they were along with their key characteristics. It is important to remember to collect this information (e.g. sex, age, qualifications or whatever is relevant to your study) when you interview or observe them. The presentation of results will depend on the level of analysis. For example, a simple narrative may be presented chronologically or according to key topics, subheadings may be used to present a series of emergent themes or results may be presented to establish a new theory. In primary care research it is common to present a series of themes. In this example, the main theme may be given as a subheading and then the subthemes and main points are described in your own words according to your interpretation of the data. It is important to remember that these are not quantitative data and should not usually be reported in terms of the number of people who expressed a particular viewpoint.15 Each main point is usually supported by a quotation from the raw data that speaks to the trustworthiness of your analysis. Quotations also help to connect the reader to the phenomenon that you
are describing and to bring it alive.16 The voice behind
each quotation can be identified in brackets, as long as this does not clash with the need for confidentiality. It is, however, helpful to the reader to know in
general terms whose voice the quote represents (e.g. patients or health workers). It is also helpful to number or code the different sources so that the reader can see
you have used a wide variety of sources in supporting your findings. An example of presentation of results from a study by Ifebuzor et al., conducted on the perceptions of parents about the skin conditions of their children in Francistown, Botswana, is given in Box 2.31 At the end of the results section, it can be helpful to try and summarise the key findings for the reader using a conceptual framework. For example, this could be in the form of a picture, a diagram such as a fishbone (e.g. for factors influencing an adverse event), a table (e.g. a strengths–weaknesses–opportunities–threats [SWOT] matrix) or a theoretical framework taken from the literature (see Figure 1 for an example from a study exploring the factors that influence teenage pregnancy, where social cognitive theory was used for the conceptual framework).32
BOX 2: Example of how to present qualitative results.31
|
This article has described the broad range of qualitative methods and types of analysis and then focused on a stepwise approach to content analysis using the framework method as a specific example. It has described the factors involved in determining the trustworthiness of qualitative data analysis and, finally, has outlined how to present your findings in a thesis or scientific article.
The authors gratefully acknowledge funding received from the U.S. President’s Emergency Plan for AIDS Relief (PEPFAR), through HRSA under the terms of T84HA21652 and via the Stellenbosch University Rural Medical Education Partnership Initiative (SURMEPI).
Competing interests
The authors declare that they have no financial or personal relationship(s) which may have inappropriately influenced them in writing this article.
Authors’ contributions
LM (University of Limpopo) wrote the original manuscript with assistance from IG (University of Limpopo) and GO (University of Limpopo). The manuscript was revised with feedback and contributions from BM (Stellenbosch University). All authors approved the final manuscript.
1. Patton MQ. Enhancing the quality and credibility of qualitative analysis. Health Serv Res. 1999;34(5 Pt 2):1189–1208.2. Meyer J. Using qualitative methods in health related action research. BMJ. 2000;320:178.1. 3. Van Maanen J (editor). Representation in ethnography. Thousand Oaks, CA: Sage Publications; 1995. 4. Rybas N, Gajjala R. Developing cyberethnographic research methods for understanding digitally mediated identities. Forum Qual Soc Res. 2007;8(3):Art. 35. 5. Garfinkel H. Studies in ethnomethodology. Englewood Cliffs, NJ: Prentice-Hall; 1967.Antaki C. Discourse analysis and conversation analysis. In: Alasuutari P, Bickman L, Brannan J (editors). The SAGE Handbook of Social Research Methods. London: Sage Publications Ltd 2008; p.431–446.
http://dx.doi.org/10.4135/9781446212165.n25
6. Griffin C. Narrative analysis [document on the Internet]. No date [cited 2013 Oct 23]. Available from: staff.bath.ac.uk/psscg/QM-Nar-lec.htm 7. Shutt RK. Investigating the social world: the process and practice of research. 7th ed. Thousand Oaks, CA: Sage Publications; 2012. 8. Sbaraini A, Carter SM, Evans RW, et al. How to do a grounded theory study: a worked example of a study of dental practices. BMC Med Res Methodol. 2011;11:128.
http://dx.doi.org/10.1186/1471-2288-11-128
9. DiCicco-Bloom B, Crabtree BF. Making sense of qualitative research: the qualitative research interview. Medical Education. 2006;40:314–321.
http://dx.doi.org/10.1111/j.1365-2929.2006.02418.x
10. Denzin NK, Lincoln YS. The SAGE Handbook of qualitative research. 4th ed. Los Angeles: Sage Publications; 2011. 11. Gläser J, Laudel G. Life with and without coding: two methods for early-stage data analysis in qualitative research aiming at causal explanations. Forum Qual Soc Res. 2013;14(2):Art 5. 12. Mayring P. Qualitative content analysis. Forum Qual Soc Res. 2000;1(2): Art 20. 13. Ritchie J, Spencer L. Qualitative data analysis for applied policy research. In: Bryman A, Burgess R (editors). Qualitative data analysis. London: Routledge, 1994; p.173–194. 14. Pope C, Ziebland S, Mays N. Qualitative research in health care: analysing qualitative data. BMJ. 2000;320(7227):114–116.
http://dx.doi.org/10.1136/bmj.320.7227.114
15. Elo S, Kynga SH. The qualitative content analysis process. J Adv Nurs. 2008;62(1):107–115.
http://dx.doi.org/10.1111/j.1365-2648.2007.04569.x
16. Attride-Stirling J. Thematic networks: an analytic tool for qualitative research. Qualitative Research. 2001;1(3):385–405.
http://dx.doi.org/10.1177/146879410100100307
17. Glaser BG, Strauss AL. The discovery of grounded theory: strategies for qualitative research. Chicago: Aldine; 1967. 18. Riessman CK. Narrative methods for the human sciences. Thousand Oaks, CA: Sage Publications, Inc; 2008. 19. Creswell J. Educational research: planning, conducting, and evaluating quantitative and qualitative research. Upper Saddle River, NJ: Merrill Prentice Hall; 2002. 20. Anfara VA, Brown KM, Mangione TL. Qualitative analysis on stage: making the research process more public. Educ Res. 2002;31(7):28–38.
http://dx.doi.org/10.3102/0013189X031007028
21. Huberman AM, Miles MB. Data management and analysis methods. In: Denzin NK, Lincoln YS (editors). Collecting and interpreting qualitative materials. Thousand Oaks, CA: Sage Publications, Inc, 2000; p.179–210. 22. Miles MB, Huberman AM. Qualitative data analysis: an expanded source book. 2nd ed. London: Sage Publications, Inc; 1994. 23. Shenton AK. Strategies for ensuring trustworthiness in qualitative research projects. Education for Information. 2004;22:63–75. 24. Guba EG. Criteria for assessing the trustworthiness of naturalistic inquiries. ECTJ. 1981;29(2):75-91. 25. Jootun D, McGhee G, Marland GR. Reflexivity: promoting rigour in qualitative research. Nurs Stand. 2009;23(23):42–46.
http://dx.doi.org/10.7748/ns2009.02.23.23.42.c6800
26. Seale C, Silverman D. Ensuring rigour in qualitative research. Eur J Public Health. 1997;7(4):379–384.
http://dx.doi.org/10.1093/eurpub/7.4.379
27. Richards L, Richards T. From filing cabinet to computer. In: Bryman A, Burgess RG (editors). Analysing qualitative data. London: Routledge, 1994; p.146–172.
http://dx.doi.org/10.4324/9780203413081_chapter_8
28. Rambaree K. Bringing rigour in qualitative social research: the use of a CAQDAS. UoM Research Journal. 2007;13A (Special ed.):1–16. 29. Tong A, Sainsbury P, Craig J. Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups. Int J Qual Health Care. 2007;19 (6):349–357.
http://dx.doi.org/10.1093/intqhc/mzm042
30. Ifebuzor DC, Mabuza LH, Malete NH, et al. The perceptions of parents about the skin conditions of their children presenting with comorbid fungal skin infections in Francistown, Botswana. Afr J Prm Health Care Fam Med. 2013;5(1), Art. #459, 6 pages.
http://dx.doi.org/10.4102/phcfm.v5i1.459
31. Kanku T, Mash R. Attitudes, perceptions and understanding amongst teenagers regarding teenage pregnancy, sexuality and contraception in Taung. SA Fam Pract.
2010;52(6):563–572.
|