<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.1d1 20130915//EN" "http://jats.nlm.nih.gov/publishing/1.1d1/JATS-journalpublishing1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:mml="http://www.w3.org/1998/Math/MathML" article-type="research-article" xml:lang="en">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">PHCFM</journal-id>
<journal-title-group>
<journal-title>African Journal of Primary Health Care &#x0026; Family Medicine</journal-title>
</journal-title-group>
<issn pub-type="ppub">2071-2928</issn>
<issn pub-type="epub">2071-2936</issn>
<publisher>
<publisher-name>AOSIS</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="publisher-id">PHCFM-10-1722</article-id>
<article-id pub-id-type="doi">10.4102/phcfm.v10i1.1722</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Original Research</subject>
</subj-group>
</article-categories>
<title-group>
<article-title>The validation of the visual screening tool for anxiety disorders and depression in hypertension and/or diabetes</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<contrib-id contrib-id-type="orcid">https://orcid.org/0000-0001-5711-3960</contrib-id>
<name>
<surname>Ogle</surname>
<given-names>Zimbini</given-names>
</name>
<xref ref-type="aff" rid="AF0001">1</xref>
</contrib>
<contrib contrib-type="author">
<contrib-id contrib-id-type="orcid">https://orcid.org/0000-0003-1009-7160</contrib-id>
<name>
<surname>Koen</surname>
<given-names>Liezl</given-names>
</name>
<xref ref-type="aff" rid="AF0001">1</xref>
<xref ref-type="aff" rid="AF0002">2</xref>
</contrib>
<contrib contrib-type="author">
<contrib-id contrib-id-type="orcid">https://orcid.org/0000-0001-9696-5605</contrib-id>
<name>
<surname>Niehaus</surname>
<given-names>Dana J.H.</given-names>
</name>
<xref ref-type="aff" rid="AF0001">1</xref>
<xref ref-type="aff" rid="AF0002">2</xref>
</contrib>
<aff id="AF0001"><label>1</label>Department of Psychiatry, Stellenbosch University, South Africa</aff>
<aff id="AF0002"><label>2</label>Stikland Psychiatric Hospital, Bellville, South Africa</aff>
</contrib-group>
<author-notes>
<corresp id="cor1"><bold>Corresponding author:</bold> Zimbini Ogle, <email xlink:href="zimbinio@gmail.com">zimbinio@gmail.com</email></corresp>
</author-notes>
<pub-date pub-type="epub"><day>14</day><month>11</month><year>2018</year></pub-date>
<pub-date pub-type="collection"><year>2018</year></pub-date>
<volume>10</volume>
<issue>1</issue>
<elocation-id>1722</elocation-id>
<history>
<date date-type="received"><day>14</day><month>12</month><year>2017</year></date>
<date date-type="accepted"><day>03</day><month>07</month><year>2018</year></date>
</history>
<permissions>
<copyright-statement>&#x00A9; 2018. The Authors</copyright-statement>
<copyright-year>2018</copyright-year>
<license license-type="open-access" xlink:href="https://creativecommons.org/licenses/by/4.0/">
<license-p>Licensee: AOSIS. This work is licensed under the Creative Commons Attribution License.</license-p>
</license>
</permissions>
<abstract>
<sec id="st1">
<title>Background</title>
<p>Depression and anxiety disorders remain poorly detected at primary health care, particularly in patients with hypertension and/or diabetes. A visual screening tool for anxiety disorders and depression (VISTAD) has been developed, but not validated.</p>
</sec>
<sec id="st2">
<title>Aim</title>
<p>To validate the VISTAD in primary health care participants diagnosed with hypertension and/or diabetes.</p>
</sec>
<sec id="st3">
<title>Setting</title>
<p>Participants were recruited from five primary health care centres in the Eastern Cape, South Africa (urban, peri-urban and rural).</p>
</sec>
<sec id="st4">
<title>Methods</title>
<p>The study used a cross-sectional study design to validate the VISTAD. The VISTAD was validated against the International Neuropsychiatric Interview (M.I.N.I) using field testing. A demographic questionnaire was used to collect data on socio-economic variables.</p>
</sec>
<sec id="st5">
<title>Results</title>
<p>Sixty-nine (87&#x0025;) females and 10 (13&#x0025;) males with a mean age of 49 (SD 8.6844) participated in the study. Fifty black people (63&#x0025;), 16 mixed race people (20&#x0025;) and 13 white people (16&#x0025;) participated in the study. The majority of the participants (77&#x0025;) did not complete high school. The area under curve score (AUC) for the VISTAD in screening for depression was 0.91, and for anxiety disorders, 0.87 post-traumatic stress disorder, 0.87 panic disorder, 0.85 social phobia, 0.88 agoraphobia, and 0.83 generalised anxiety disorder revealing acceptable psychometric properties.</p>
</sec>
<sec id="st6">
<title>Conclusion</title>
<p>The use of the VISTAD as a screening tool at primary health care in people living with hypertension and/or diabetes is recommended. The VISTAD could, therefore, play a key role in the prevention and early treatment of individuals diagnosed with hypertension and/or diabetes across cultures and levels of education. The VISTAD needs to be validated in a large population representative of primary care patients diagnosed with hypertension and/or diabetes.</p>
</sec>
</abstract>
</article-meta>
</front>
<body>
<sec id="s0001">
<title>Background</title>
<p>Current literature demonstrates that hypertension and diabetes have emerged as a major medical and public burden globally.<sup><xref ref-type="bibr" rid="CIT0001">1</xref>,<xref ref-type="bibr" rid="CIT0002">2</xref>,<xref ref-type="bibr" rid="CIT0003">3</xref>,<xref ref-type="bibr" rid="CIT0004">4</xref></sup> South Africa is burdened with a high prevalence of hypertension and diabetes. There are 2.3 million people living with diabetes in South Africa,<sup><xref ref-type="bibr" rid="CIT0005">5</xref></sup> and 30&#x0025; of the adult population is living with hypertension.<sup><xref ref-type="bibr" rid="CIT0006">6</xref></sup> Furthermore, hypertension and diabetes account for 17 million visits to health facilities in South Africa every year.<sup><xref ref-type="bibr" rid="CIT0001">1</xref></sup></p>
<p>The diabetes and hypertension burden is further complicated by the increasingly high co-morbidity with depression and anxiety disorders. Kumar and Clark<sup><xref ref-type="bibr" rid="CIT0007">7</xref></sup> argue that chronic diseases have psychological sequelae; however, these remain largely undetected and untreated at primary health care.<sup><xref ref-type="bibr" rid="CIT0008">8</xref>,<xref ref-type="bibr" rid="CIT0009">9</xref>,<xref ref-type="bibr" rid="CIT0010">10</xref></sup> Patients may be aware of their emotional state; however, they may be unable to describe accurately their subjective experience, according to Aitken.<sup><xref ref-type="bibr" rid="CIT0011">11</xref></sup> In addition, inadequate levels of mental health literacy, for both health care workers<sup><xref ref-type="bibr" rid="CIT0012">12</xref></sup> and patients, have been well established in research.<sup><xref ref-type="bibr" rid="CIT0013">13</xref></sup></p>
<p>When clinicians do attempt to screen for mental disorders in patients with hypertension and/or diabetes, primary health care facilities are faced with barriers such as insufficient human and material resources, lack of assessment instruments that can be appropriately applied to the diverse range of cultural and language groupings in South Africa, and communication difficulties which lead to misunderstandings, misdiagnosis and/or inappropriate treatment. In addition to the above-mentioned barriers, pencil and paper tests are often not available or have to be read aloud to illiterate patients.<sup><xref ref-type="bibr" rid="CIT0014">14</xref></sup> Availability of appropriate tools at primary health care could therefore contribute to the quality of detection and management of mental disorders, particularly in developing countries. Visual screening tools for depression and anxiety disorders could possibly circumvent the challenges posed by cultural, language, educational and time factors. This has been shown by Akena et al.<sup><xref ref-type="bibr" rid="CIT0015">15</xref></sup> who developed a visual screening tool for depression in patients living with HIV and/or AIDS in Uganda. However, the screening tool developed by Akena et al.<sup><xref ref-type="bibr" rid="CIT0015">15</xref></sup> does not screen for anxiety disorders. Screening for depression, according to Katon et al.,<sup><xref ref-type="bibr" rid="CIT0016">16</xref></sup> should also include anxiety disorders as these often coexist in patients living with chronic physical conditions.</p>
<p>The use of pictures in aiding patients to describe emotions and thoughts has been well established in psychology. Psychological tests, referred to as projectives, such as the thematic apperception test (TAT),<sup><xref ref-type="bibr" rid="CIT0017">17</xref></sup> make use of drawings in order to allow access to unconscious thoughts, emotional life and internal dynamics &#x2013; revealing hidden materials that clients are unable to disclose or unwilling to disclose. Ogle, Koen and Niehaus developed a visual screening tool for anxiety disorders and depression (VISTAD) using drawings based on the hospital anxiety and depression scale (HADS). The visual screening tool is referred to as the VISTAD. It includes depression items such as sleep disturbance, feeling miserable and sad, appetite and feeling life is not worth living, as well as anxiety items such as feeling frightened or having panic feelings for no reason, feeling frightened when going out of the house alone, getting palpitations or sensations &#x2018;butterflies&#x2019; in stomach or chest, more irritable than usual and worrying thoughts. The VISTAD, however, has not been validated for use in primary health care.</p>
<p>The aim of the study was to validate the VISTAD as a screening tool for use in primary health care in individuals diagnosed with hypertension and/or diabetes and as a tool that can be used effectively in a time- and resource-constrained environment and with people with low levels of education.</p>
</sec>
<sec id="s0002">
<title>Methods</title>
<sec id="s20003">
<title>Study design</title>
<p>The study used a cross-sectional study design for validating the newly developed VISTAD.</p>
</sec>
<sec id="s20004">
<title>Setting</title>
<p>The study was conducted in five primary health care centres in the Eastern Cape, South Africa. These primary health care centres provide health care services to two urban areas, KwaMagxaki, a predominantly black suburb, and Algoa Park, a mixed suburb, mixed race and white population, in Port Elizabeth; one peri-urban area in Uitenhage, predominantly black population; and two rural communities, KwaNonqubela, a black community, and Wentzel Park, a mixed race community in Alexandria, Eastern Cape.</p>
</sec>
<sec id="s20005">
<title>Sampling strategy</title>
<p>Purposive sampling was utilised to recruit participants who were able to provide informed consent. Individuals were recruited while they were at the settings for their routine scheduled visit. Individuals between the ages of 18 and 60, diagnosed with diabetes and/or hypertension, were eligible for the study. Individuals known to have visual and hearing impairments, and intellectual disability were excluded from the study.</p>
<p>The principal researcher explained the purpose of the study and requested individuals who were interested in participating in the study to indicate their interest. Those who indicated an interest or wanted to get more information were interviewed in a private setting and provided with more details on the study.</p>
</sec>
<sec id="s20006">
<title>Data collection</title>
<p>A demographic questionnaire was utilised to gather information about gender, age, race, marital status, level of education, employment status, family income and medical conditions. A short structured diagnostic interview, the International Neuropsychiatric Interview (M.I.N.I),<sup><xref ref-type="bibr" rid="CIT0018">18</xref></sup> was used as a gold standard in the validation of the VISTAD. It covers 17 Axis I disorders that include mood, anxiety, substance use, psychotic and eating disorders, and it also has a suicidality module and one Axis-II disorder, antisocial personality disorder.<sup><xref ref-type="bibr" rid="CIT0018">18</xref></sup> Sheehan et al.<sup><xref ref-type="bibr" rid="CIT0018">18</xref></sup> found the M.I.N.I to be a reliable and valid diagnostic tool, and it has been used in South African studies.<sup><xref ref-type="bibr" rid="CIT0019">19</xref>,<xref ref-type="bibr" rid="CIT0020">20</xref>,<xref ref-type="bibr" rid="CIT0021">21</xref>,<xref ref-type="bibr" rid="CIT0022">22</xref></sup> The development of the VISTAD is discussed in detail in Ogle, Koen and Niehaus.<sup><xref ref-type="bibr" rid="CIT0023">23</xref></sup> In the VISTAD, a score of 1 is allocated when a participant endorses an abnormal state drawing and 0 when none of the abnormal state symptoms are endorsed. The maximum score that could be obtained on the VISTAD is 10.</p>
</sec>
<sec id="s20007">
<title>Data analysis</title>
<p>Descriptive statistics were used to describe demographic data. The M.I.N.I was used to categorise cases and non-cases of depression (major depressive episode) and anxiety disorders, that is, agoraphobia, generalised anxiety disorder (GAD), panic disorder, post-traumatic stress disorder (PTSD) and social phobia, excluding obsessive&#x2013;compulsive disorder. The impact of education, employment and gender on the performance of VISTAD was investigated. Coefficient of correlation (coef.) indicated the correlation between the above-mentioned variables. The sensitivity and specificity and likelihood ratios (LR) were estimated. Sensitivity and specificity was calculated based on leave-one-out cross validation. Cut-off scores were informed by high specificity scores and moderate sensitivity scores. With a high specificity, the truly positives represent the mental disorder being screened for and not another condition, such as diabetes or hypertension.</p>
<p>The plot of sensitivity versus specificity is referred to as the receiver operating characteristics (ROC).<sup><xref ref-type="bibr" rid="CIT0024">24</xref></sup> The area under the curve (AUC) which is an effective measure of diagnostic test accuracy<sup><xref ref-type="bibr" rid="CIT0024">24</xref></sup> was used for interpretations of the data. An AUC value of 0.50&#x2013;0.70 is considered low accuracy, 0.70&#x2013;0.90 is considered moderate accuracy and 0.90 is considered high accuracy.<sup><xref ref-type="bibr" rid="CIT0025">25</xref></sup> Linear discriminant analysis was used to predict the disorder outcomes with the VISTAD drawing outcomes as predictors. All data analyses were done with STATA, version 14.</p>
</sec>
<sec id="s20008">
<title>Ethical considerations</title>
<p>Ethical approval was granted by the University of Stellenbosch&#x2019;s Faculty of Medicine and Health Sciences Human Research Ethics Committee (Reference number: S14/11/262). Permission to conduct the study at the primary care centres was obtained from the Eastern Cape Department of Health, South Africa</p>
</sec>
</sec>
<sec id="s0009">
<title>Results</title>
<sec id="s20010">
<title>Demographics</title>
<p>Eighty-one participants from primary health care participated in the validation of the VISTAD. All the participants consented and participated in this study. However, out of the 81 participants, one declined to continue with completing the interview reporting that the VISTAD depicted his life, and it was painful to look at the images.</p>
<p>In this study, we used demographic data of 79 participants as there was missing information from two participants. The majority of the participants were females, 69 (87&#x0025;), with 10 (13&#x0025;) males. Race distribution on the basis of gender showed that there were 43 black females, 15 mixed race females and 11 white females, and seven black males, two white males and one mixed race male. The mean age of the participants was 49, with standard deviation 8.6844 and minimum age 22 and maximum 60. Socio-demographic variables and related factors are set out in <xref ref-type="table" rid="T0001">Table 1</xref>.</p>
<table-wrap id="T0001">
<label>TABLE 1</label>
<caption><p>Demographic and clinical characteristics of participants (<italic>N</italic> = 79).</p></caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th valign="top" align="left">Variables</th>
<th valign="top" align="center"><italic>n</italic></th>
<th valign="top" align="center">(&#x0025;)</th>
</tr>
</thead>
<tbody valign="top">
<tr>
<td align="left" colspan="3"><bold>Gender</bold></td>
</tr>
<tr>
<td align="left">Female</td>
<td align="center">69</td>
<td align="center">87</td>
</tr>
<tr>
<td align="left">Male</td>
<td align="center">10</td>
<td align="center">13</td>
</tr>
<tr>
<td align="left" colspan="3"><bold>Language</bold></td>
</tr>
<tr>
<td align="left">isiXhosa</td>
<td align="center">48</td>
<td align="center">61</td>
</tr>
<tr>
<td align="left">Afrikaans</td>
<td align="center">29</td>
<td align="center">37</td>
</tr>
<tr>
<td align="left">English</td>
<td align="center">1</td>
<td align="center">1</td>
</tr>
<tr>
<td align="left">Shona</td>
<td align="center">1</td>
<td align="center">1</td>
</tr>
<tr>
<td align="left" colspan="3"><bold>Race</bold></td>
</tr>
<tr>
<td align="left">Black people</td>
<td align="center">50</td>
<td align="center">63</td>
</tr>
<tr>
<td align="left">Mixed race</td>
<td align="center">16</td>
<td align="center">20</td>
</tr>
<tr>
<td align="left">White people</td>
<td align="center">13</td>
<td align="center">17</td>
</tr>
<tr>
<td align="left" colspan="3"><bold>Education</bold></td>
</tr>
<tr>
<td align="left">No education</td>
<td align="center">2</td>
<td align="center">3</td>
</tr>
<tr>
<td align="left">Primary level of education (Grades 1&#x2013;6)</td>
<td align="center">25</td>
<td align="center">32</td>
</tr>
<tr>
<td align="left">Senior level of education (Grades 7&#x2013;11)</td>
<td align="center">33</td>
<td align="center">42</td>
</tr>
<tr>
<td align="left">Matric (Grade 12)</td>
<td align="center">15</td>
<td align="center">19</td>
</tr>
<tr>
<td align="left">Post-matric qualification</td>
<td align="center">4</td>
<td align="center">5</td>
</tr>
<tr>
<td align="left" colspan="3"><bold>Employment</bold></td>
</tr>
<tr>
<td align="left">Yes</td>
<td align="center">21</td>
<td align="center">27</td>
</tr>
<tr>
<td align="left">No</td>
<td align="center">58</td>
<td align="center">73</td>
</tr>
<tr>
<td align="left" colspan="3"><bold>Hypertension or diabetes</bold></td>
</tr>
<tr>
<td align="left">Hypertension only</td>
<td align="center">47</td>
<td align="center">59</td>
</tr>
<tr>
<td align="left">Diabetes only</td>
<td align="center">1</td>
<td align="center">1</td>
</tr>
<tr>
<td align="left">Hypertension and diabetes</td>
<td align="center">31</td>
<td align="center">39</td>
</tr>
<tr>
<td align="left" colspan="3"><bold>Other medical conditions</bold></td>
</tr>
<tr>
<td align="left">Yes</td>
<td align="center">43</td>
<td align="center">54</td>
</tr>
<tr>
<td align="left">No</td>
<td align="center">36</td>
<td align="center">46</td>
</tr>
<tr>
<td align="left" colspan="3"><bold>Existing mental disorder</bold></td>
</tr>
<tr>
<td align="left">Yes</td>
<td align="center">10</td>
<td align="center">13</td>
</tr>
<tr>
<td align="left">No</td>
<td align="center">69</td>
<td align="center">87</td>
</tr>
<tr>
<td align="left" colspan="3"><bold>M.I.N.I. diagnosis</bold></td>
</tr>
<tr>
<td align="left">Depression</td>
<td align="center">26</td>
<td align="center">32</td>
</tr>
<tr>
<td align="left">Panic disorder</td>
<td align="center">32</td>
<td align="center">40</td>
</tr>
<tr>
<td align="left">Agoraphobia</td>
<td align="center">8</td>
<td align="center">10</td>
</tr>
<tr>
<td align="left">Social phobia</td>
<td align="center">8</td>
<td align="center">10</td>
</tr>
<tr>
<td align="left">Post-traumatic stress disorder</td>
<td align="center">27</td>
<td align="center">33</td>
</tr>
<tr>
<td align="left">Generalised anxiety disorder</td>
<td align="center">14</td>
<td align="center">17</td>
</tr>
</tbody>
</table>
</table-wrap>
</sec>
<sec id="s20011">
<title>Accuracy of the visual screening tool for anxiety disorders and depression</title>
<p>The AUC determined the accuracy of the VISTAD. The AUC in screening for depression is shown in <xref ref-type="fig" rid="F0001">Figure 1</xref>, PTSD in <xref ref-type="fig" rid="F0002">Figure 2</xref>, panic disorder in <xref ref-type="fig" rid="F0003">Figure 3</xref>, GAD in <xref ref-type="fig" rid="F0004">Figure 4</xref>, social phobia in <xref ref-type="fig" rid="F0005">Figure 5</xref> and agoraphobia in <xref ref-type="fig" rid="F0006">Figure 6</xref>. The AUC score for depression shows a high accuracy of 0.91.</p>
<fig id="F0001">
<label>FIGURE 1</label>
<caption><p>Receiver operating curves of the visual screening tool for anxiety disorders and depression for depression.</p></caption>
<graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="PHCFM-10-1722-g001.tif"/>
</fig>
<fig id="F0002">
<label>FIGURE 2</label>
<caption><p>Receiver operating curves of the visual screening tool for anxiety disorders and depression for post-traumatic stress disorder.</p></caption>
<graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="PHCFM-10-1722-g002.tif"/>
</fig>
<fig id="F0003">
<label>FIGURE 3</label>
<caption><p>Receiver operating curves of the visual screening tool for anxiety disorders and depression for panic disorder.</p></caption>
<graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="PHCFM-10-1722-g003.tif"/>
</fig>
<fig id="F0004">
<label>FIGURE 4</label>
<caption><p>Receiver operating curves of the visual screening tool for anxiety disorders and depression for generalised anxiety disorder.</p></caption>
<graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="PHCFM-10-1722-g004.tif"/>
</fig>
<fig id="F0005">
<label>FIGURE 5</label>
<caption><p>Receiver operating curves of the visual screening tool for anxiety disorders and depression for social phobia.</p></caption>
<graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="PHCFM-10-1722-g005.tif"/>
</fig>
<fig id="F0006">
<label>FIGURE 6</label>
<caption><p>Receiver operating curves of the visual screening tool for anxiety disorders and depression for agoraphobia.</p></caption>
<graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="PHCFM-10-1722-g006.tif"/>
</fig>
<p>The best cut-off scores were based on high specificity and moderate sensitivity. At a cut-off score of 6, the specificity was 90.91, and sensitivity was 72.00&#x0025;, with 85&#x0025; correctly classified cases. The specificity was 90.91 and sensitivity was 60.00&#x0025;, with 81.25&#x0025; correctly classified cases at a cut-off score of 7.</p>
<p>The area under curve for PTSD was 0.87. At a cut-off point of 6 for PTSD, there were 68&#x0025; correctly classified cases with a specificity of 72.22&#x0025; and a sensitivity of 37&#x0025;. Similar to PTSD, the area under curve for panic disorder was 0.87, which indicated moderate accuracy. The specificity of the VISTAD at a cut-off point of 6 was 81.25&#x0025;, with a sensitivity of 43.75&#x0025;.</p>
<p>Agoraphobia had a specificity of 73.61&#x0025;. Social phobia had a specificity of 72.22&#x0025; at a cut-off score of 6. Generalised anxiety disorder had a specificity of 74.63&#x0025;, with 70&#x0025; correctly classified cases.</p>
<p>Fundamental to the validation of the VISTAD is the investigation of whether education levels, socio-economic status and gender have an impact on the performance of the VISTAD. <xref ref-type="table" rid="T0002">Table 2</xref> presents the impact of level of education, gender and employment status on the performance of the VISTAD.</p>
<table-wrap id="T0002">
<label>TABLE 2</label>
<caption><p>Impact of education, gender and employment status on the performance of the visual screening tool for anxiety disorders and depression.</p></caption>
<table frame="hsides" rules="groups">
<thead>
<tr>
<th valign="top" align="left">Variable</th>
<th valign="top" align="left">Coef.</th>
<th valign="top" align="left">SE</th>
<th valign="top" align="left"><italic>T</italic></th>
<th valign="top" align="left"><italic>p</italic> &#x003E; |<italic>t</italic>|</th>
<th valign="top" align="left">95&#x0025; CI</th>
</tr>
</thead>
<tbody valign="top">
<tr>
<td align="left" colspan="6"><bold>Level of education</bold></td>
</tr>
<tr>
<td align="left">Primary</td>
<td align="left">&#x2212;0.7505694</td>
<td align="left">3.557147</td>
<td align="left">&#x2212;0.21</td>
<td align="left">0.833</td>
<td align="left">&#x2212;7.841612&#x2013;6.340473</td>
</tr>
<tr>
<td align="left">Senior</td>
<td align="left">&#x2212;0.6239653</td>
<td align="left">3.507459</td>
<td align="left">&#x2212;0.18</td>
<td align="left">0.859</td>
<td align="left">&#x2212;7.615957&#x2013;6.368026</td>
</tr>
<tr>
<td align="left">Matric</td>
<td align="left">&#x2212;2.326809</td>
<td align="left">3.619307</td>
<td align="left">&#x2212;0.64</td>
<td align="left">0.522</td>
<td align="left">&#x2212;9.541764&#x2013;4.888147</td>
</tr>
<tr>
<td align="left">Post-matric</td>
<td align="left">0.0663401</td>
<td align="left">4.089943</td>
<td align="left">0.02</td>
<td align="left">0.987</td>
<td align="left">&#x2212;8.086812&#x2013;8.219493</td>
</tr>
<tr>
<td align="left" colspan="6"><bold>Gender</bold></td>
</tr>
<tr>
<td align="left">Male</td>
<td align="left">&#x2212;3.715155</td>
<td align="left">1.795807</td>
<td align="left">&#x2212;2.07</td>
<td align="left">0.042</td>
<td align="left">&#x2212;7.295031&#x2013; -0.1352794</td>
</tr>
<tr>
<td align="left" colspan="6"><bold>Employment</bold></td>
</tr>
<tr>
<td align="left">Yes</td>
<td align="left">0.4993359</td>
<td align="left">1.26012</td>
<td align="left">0.40</td>
<td align="left">0.693</td>
<td align="left">&#x2212;2.012668 &#x2013;3.01134</td>
</tr>
<tr>
<td align="left">_cons</td>
<td align="left">4.808826</td>
<td align="left">3.425357</td>
<td align="left">1.40</td>
<td align="left">0.165</td>
<td align="left">&#x2212;2.019499&#x2013;11.63715</td>
</tr>
<tr>
<td align="left">/sigma</td>
<td align="left">4.344278</td>
<td align="left">0.4488455</td>
<td align="left"></td>
<td align="left"></td>
<td align="left">3.449521&#x2013;5.239035</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn><p>CI, confidence interval; SE, standard error; coef., coefficient of correlation; cons, coefficient estimate; sigma, standard deviation.</p></fn>
</table-wrap-foot>
</table-wrap>
</sec>
</sec>
<sec id="s0012">
<title>Discussion</title>
<sec id="s20013">
<title>Findings</title>
<p>In this study, we validated the VISTAD against the M.I.N.I. at primary health care in participants diagnosed with hypertension and/or diabetes. The VISTAD demonstrated high accuracy in detecting depression in participants with hypertension and/or diabetes. The AUC of the VSTAD was 0.91 in screening for depression. At a cut-off score of 6, the VISTAD had satisfactory accuracy in classifying cases. This is similar to that of the HADS which the VISTAD is based on. At a cut-off score of 7, the HADS depression subscale provided the best balance between a sensitivity of 0.86 and a specificity of 0.81 in cancer patients.<sup><xref ref-type="bibr" rid="CIT0026">26</xref></sup> In our study, the best balance was at a cut-off score of 6 with a sensitivity of 0.72 and a specificity of 0.91, with 85&#x0025; of the cases classified correctly. The accuracy of the VISTAD is also similar to that of other widely used traditional screening tools, such as the Patient Health Questionnaire (PHQ), with an AUC of 0.88 at a higher cut-off score in patients with type II diabetes and/or coronary heart disease in primary care,<sup><xref ref-type="bibr" rid="CIT0027">27</xref></sup> and the Kessler Scale (K10) for either anxiety or depression<sup><xref ref-type="bibr" rid="CIT0028">28</xref></sup> and CES-D, K-10 and PHQ-9 and with AUC ranging from 0.82 to 0.96<sup><xref ref-type="bibr" rid="CIT0015">15</xref></sup> in people living with HIV.</p>
<p>The VISTAD had a higher AUC score compared to the recently validated WHO-5 for use in screening for depression in adults with diabetes. The AUC scores for WHO-5 in the validation study by Halliday et al.<sup><xref ref-type="bibr" rid="CIT0029">29</xref></sup> ranged between 0.85 and 0.88, which demonstrated that the WHO-5 has moderate accuracy in screening for depression. This demonstrates that the VISTAD is a valuable tool for detecting depression. The optimal cut-off score chosen for depression was 6 in this study. This is in line with the current practice of selecting higher cut-off scores to indicate the presence of depression.<sup><xref ref-type="bibr" rid="CIT0028">28</xref>,<xref ref-type="bibr" rid="CIT0029">29</xref></sup> Similar to screening for depression, the optimal cut-off score chosen for anxiety disorders was 6. The AUC for anxiety disorders was in the moderate range. This indicates that the accuracy of the VISTAD was better for depression than for anxiety. This is consistent with findings made in the meta-analysis conducted by Vodemaier and Millman<sup><xref ref-type="bibr" rid="CIT0026">26</xref></sup> on other screening tools. Previous research has also established a similar pattern. For example, GAD 7 showed lower sensitivity and specificity levels when compared to screening tools for depression.<sup><xref ref-type="bibr" rid="CIT0028">28</xref></sup> Makanjuola et al.<sup><xref ref-type="bibr" rid="CIT0030">30</xref></sup> also reported lower AUC values in Nigeria for K-6 and the General Health Questionnaire (GHQ-12). K-6 and GHQ-12 are sensitive and specific screening tools widely used and recommended for use in the screening for depression and/or anxiety disorders in primary health care and community samples.</p>
<p>Newly developed screening tools have also been recommended for use in patients with chronic medical conditions. A Ugandan study recommended the use of a visual screening tool for depression.<sup><xref ref-type="bibr" rid="CIT0015">15</xref></sup> This was based on its accuracy in detecting depression in people living with HIV. However, a study by Puertas<sup><xref ref-type="bibr" rid="CIT0031">31</xref></sup> did not recommend the use of visual screening tools as it found the FACES test to have low accuracy. The FACES test, according to Puertas, is a visual analogue scale representation of mood, consisting of seven graded faces from happiest mood to saddest mood. Akena<sup><xref ref-type="bibr" rid="CIT0015">15</xref></sup> argues that screening tools, such as the FACES test, have often depended on a single facial picture depicting emotions ranging from a happy face to an extremely sad face. Participants with lower literacy levels struggle to comprehend the FACES screening tool according to Puertas<sup><xref ref-type="bibr" rid="CIT0031">31</xref></sup> Previous research has established that education has an impact on people&#x2019;s ability to comprehend and complete screening tools.<sup><xref ref-type="bibr" rid="CIT0032">32</xref>,<xref ref-type="bibr" rid="CIT0033">33</xref></sup> Some, according to Snaith,<sup><xref ref-type="bibr" rid="CIT0034">34</xref></sup> are ashamed and pretend to answer questions and respond in a haphazard manner. This study demonstrated that education had no impact on the participants&#x2019; ability to comprehend and complete the VISTAD. The findings on the education and performance of the VISTAD are consistent with previous research by Akena et al.<sup><xref ref-type="bibr" rid="CIT0015">15</xref></sup> Furthermore, the socio-economic status had no impact on the participants&#x2019; ability to understand and complete the VISTAD. The majority of participants in this study were of low socio-economic status.</p>
<p>Based on the M.I.N.I, we noted a high prevalence of common mental disorders in this study. For example, depression had a prevalence of 32&#x0025;. This is consistent with the findings of Jacob and Kostev&#x2019;s study,<sup><xref ref-type="bibr" rid="CIT0035">35</xref></sup> which reported a prevalence of 33.7&#x0025; in women and 26.8&#x0025; in men diagnosed with diabetes. Cols-Sagarra et al.<sup><xref ref-type="bibr" rid="CIT0036">36</xref></sup> reported a higher prevalence of 43.4&#x0025; in women with diabetes at primary health care. A prevalence of 31.4&#x0025; was reported in a study conducted in rural and urban parts of the Eastern Cape, South Africa,<sup><xref ref-type="bibr" rid="CIT0037">37</xref></sup> and this finding is consistent with the prevalence observed in our study.</p>
<p>Anxiety disorders such as panic disorder and PTSD had a high prevalence, with panic disorder at 40&#x0025; and PTSD at 33&#x0025;. Other studies have found a significantly higher prevalence of panic disorder in hypertensive patients.<sup><xref ref-type="bibr" rid="CIT0038">38</xref></sup> Also, in primary care, studies have observed a prevalence of PTSD ranging from 2.0&#x0025; to 39.1&#x0025; in hypertensive patients.<sup><xref ref-type="bibr" rid="CIT0039">39</xref></sup> Post-traumatic stress disorder, according to Seedat<sup><xref ref-type="bibr" rid="CIT0040">40</xref></sup> is among the most prevalent compared to other anxiety disorders in terms of lifetime and 12-month prevalence rates documented in epidemiological studies. The number of participants who had a positive diagnosis of a common mental disorder was high. This observation is consistent with previous research findings.<sup><xref ref-type="bibr" rid="CIT0039">39</xref>,<xref ref-type="bibr" rid="CIT0041">41</xref>,<xref ref-type="bibr" rid="CIT0042">42</xref></sup> Data on larger samples are needed to determine the prevalence of depression and anxiety disorders in primary care patients with hypertension and/or diabetes.</p>
</sec>
<sec id="s20014">
<title>Strengths and limitations</title>
<p>This is the first study to develop and validate a visual screening tool for both depression and anxiety disorders in primary health care participants diagnosed with hypertension and/or diabetes in South Africa. Furthermore, the use of the M.I.N.I in the study was not limited to the depression module, and the anxiety disorder module was also administered, except for obsessive&#x2013;compulsive disorder module. The administration of the M.I.N.I depression module only might artificially inflate the extent of the correlations as some participants with depression might have been better diagnosed with another disorder, such as anxiety disorders.<sup><xref ref-type="bibr" rid="CIT0015">15</xref></sup> Also, this could lead to a false accuracy of the visual screening tool. The strength of the study was enhanced by the inclusion of five different primary health care sites, which serve urban, peri-urban and rural population.</p>
<p>Because of the small size of the sample, we cannot generalise the findings of the study to all individuals attending primary health care. Thus, future research is needed to validate the VISTAD in a large primary health care population. Furthermore, the use of the VISTAD in primary health care with speech impairments and intellectual impairments needs further investigation. A further limitation is that this study was informed by the DSM-IV nosology. For example, PTSD is no longer described as an anxiety disorder in the current DSM-V, but as a trauma- and stressor-related disorder.</p>
</sec>
</sec>
<sec id="s0015">
<title>Conclusion</title>
<p>The visual screening tool is referred to as the VISTAD. The VISTAD is accurate in detecting depression and anxiety disorders in primary health care participants diagnosed with diabetes and/or hypertension. The use of the VISTAD is recommended as a screening tool for depression and anxiety disorders at primary care level in patients with hypertension and/or diabetes. However, the VISTAD needs to be validated in a large population of primary care patients diagnosed with hypertension and/or diabetes.</p>
</sec>
</body>
<back>
<ack>
<title>Acknowledgements</title>
<p>The authors would like to thank Prof. Martin Kidd for doing data analysis and Mrs Jane Metelo-Liquito for doing the drawings.</p>
<sec id="s20016" sec-type="COI-statement">
<title>Competing interests</title>
<p>The authors declare that they have no conflicts of interest to disclose. Neither personal nor financial relationship may have inappropriately influenced them in writing this article.</p>
</sec>
<sec id="s20017">
<title>Authors&#x2019; contributions</title>
<p>This article is produced from research that will be submitted for a PhD in Psychiatry. Z.O. is the principal researcher. Z.O. collected data and produced the first draft of the article. L.K. is the research supervisor and contributed to the article review. D.J.H.N. is the co-supervisor and contributed to the article review.</p>
</sec>
</ack>
<ref-list id="references">
<title>References</title>
<ref id="CIT0001"><label>1.</label><mixed-citation publication-type="web"><person-group person-group-type="author"><collab>Department of Health Republic of South Africa</collab></person-group>. <source>Strategic plan for prevention and control of non-communicable diseases 2013&#x2013;17</source>. <year>2013</year> <comment>[cited 2017 Sep] Available from: <ext-link ext-link-type="uri" xlink:href="http://www.hsrc.ac.za/uploads/pageContent/3893/NCDs&#x0025;20STRAT&#x0025;20PLAN&#x0025;20&#x0025;20CONTENT&#x0025;208&#x0025;20april&#x0025;20proof.pdf">http://www.hsrc.ac.za/uploads/pageContent/3893/NCDs&#x0025;20STRAT&#x0025;20PLAN&#x0025;20&#x0025;20CONTENT&#x0025;208&#x0025;20april&#x0025;20proof.pdf</ext-link></comment></mixed-citation></ref>
<ref id="CIT0002"><label>2.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Mohan</surname> <given-names>V</given-names></string-name>, <string-name><surname>Seedat</surname> <given-names>YK</given-names></string-name>, <string-name><surname>Pradeepa</surname> <given-names>R</given-names></string-name></person-group>. <article-title>The rising burden of diabetes and hypertension in Southeast Asian and African regions: Need for effective strategies for prevention and control in primary health care settings</article-title>. <source>Int J Hypertens</source>. <year>2013</year>;<volume>2013</volume>:<fpage>1</fpage>&#x2013;<lpage>14</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1155/2013/409083">https://doi.org/10.1155/2013/409083</ext-link></comment></mixed-citation></ref>
<ref id="CIT0003"><label>3.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Mutowo</surname> <given-names>MP</given-names></string-name>, <string-name><surname>Lorgelly</surname> <given-names>PK</given-names></string-name>, <string-name><surname>Laxy</surname> <given-names>M</given-names></string-name>, <etal>et al</etal></person-group>. <article-title>The hospitalization costs of diabetes and hypertension complications in Zimbabwe: Estimations and correlations</article-title>. <source>J Diabetes Res</source>. <year>2016</year>;<volume>2016</volume>:<fpage>1</fpage>&#x2013;<lpage>9</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1155/2016/9754230">https://doi.org/10.1155/2016/9754230</ext-link></comment></mixed-citation></ref>
<ref id="CIT0004"><label>4.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Tripathy</surname> <given-names>JP</given-names></string-name>, <string-name><surname>Thakur</surname> <given-names>JS</given-names></string-name>, <string-name><surname>Jeet</surname> <given-names>G</given-names></string-name>, <string-name><surname>Jain</surname> <given-names>S</given-names></string-name></person-group>. <article-title>Prevalence and determinants of comorbid diabetes and hypertension: Evidence from non communicable disease risk factor STEPS survey, India</article-title>. <source>Diabetes Metab Syndr</source>. <year>2017</year>;<volume>11</volume>:<fpage>S459</fpage>&#x2013;<lpage>S465</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1016-/j.dsx.2017.03.036">https://doi.org/10.1016-/j.dsx.2017.03.036</ext-link></comment>.</mixed-citation></ref>
<ref id="CIT0005"><label>5.</label><mixed-citation publication-type="book"><person-group person-group-type="author"><collab>International Diabetes Federation</collab></person-group>. <source>IDF Diabetes Atlas</source>. <edition>7th ed.</edition> <publisher-loc>Brussels, Belgium</publisher-loc>: <publisher-name>IDF</publisher-name>; <year>2015</year>.</mixed-citation></ref>
<ref id="CIT0006"><label>6.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Kandala</surname> <given-names>NB</given-names></string-name>, <string-name><surname>Tigbe</surname> <given-names>W</given-names></string-name>, <string-name><surname>Manda</surname> <given-names>SOM</given-names></string-name>, <string-name><surname>Stranges</surname> <given-names>S</given-names></string-name></person-group>. <article-title>Geographic variation of hypertension in sub-Saharan Africa: A case study of South Africa</article-title>. <source>Am J Hypertens</source>. <year>2013</year>;<volume>26</volume>(<issue>3</issue>):<fpage>382</fpage>&#x2013;<lpage>391</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1093/ajh/hps063">https://doi.org/10.1093/ajh/hps063</ext-link></comment></mixed-citation></ref>
<ref id="CIT0007"><label>7.</label><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Kumar</surname> <given-names>P</given-names></string-name>, <string-name><surname>Clark</surname> <given-names>ML</given-names></string-name></person-group>. <source>Kumar and Clark&#x2019;s clinical medicine</source>. <edition>9th ed.</edition> <publisher-loc>Edinburgh</publisher-loc>: <publisher-name>Saunders</publisher-name>; <year>2017</year>.</mixed-citation></ref>
<ref id="CIT0008"><label>8.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Chou</surname> <given-names>SP</given-names></string-name>, <string-name><surname>Huang</surname> <given-names>B</given-names></string-name>, <string-name><surname>Goldstein</surname> <given-names>R</given-names></string-name>, <string-name><surname>Grant</surname> <given-names>BF</given-names></string-name></person-group>. <article-title>Temporal associations between physical illnesses and mental disorders--results from the Wave 2 National Epidemiologic Survey on Alcohol and Related Conditions (NESARC)</article-title>. <source>Compr Psychiatry</source>. <year>2013</year>;<volume>54</volume>(<issue>6</issue>):<fpage>627</fpage>&#x2013;<lpage>638</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1016/j.comppsych.2012.12.020">https://doi.org/10.1016/j.comppsych.2012.12.020</ext-link></comment></mixed-citation></ref>
<ref id="CIT0009"><label>9.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Lotfi</surname> <given-names>L</given-names></string-name>, <string-name><surname>Flyckt</surname> <given-names>L</given-names></string-name>, <string-name><surname>Krakau</surname> <given-names>I</given-names></string-name>, <string-name><surname>M&#x00E5;rtensson</surname> <given-names>B</given-names></string-name>, <string-name><surname>Nilsson</surname> <given-names>GH</given-names></string-name></person-group>. <article-title>Undetected depression in primary healthcare: Occurrence, severity and co-morbidity in a two-stage procedure of opportunistic screening</article-title>. <source>Nord J Psychiatry</source>. <year>2010</year>;<volume>64</volume>(<issue>6</issue>):<fpage>421</fpage>&#x2013;<lpage>427</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3109/08039481003786378">https://doi.org/10.3109/08039481003786378</ext-link></comment></mixed-citation></ref>
<ref id="CIT0010"><label>10.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Petersen</surname> <given-names>I</given-names></string-name>, <string-name><surname>Lund</surname> <given-names>C</given-names></string-name></person-group>. <article-title>Mental health service delivery in South Africa from 2000 to 2010: One step forward, one step back</article-title>. <source>S Afr Med J</source>. <year>2011</year>;<volume>101</volume>(<issue>10</issue>):<fpage>751</fpage>&#x2013;<lpage>757</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.7196/samj.4841">https://doi.org/10.7196/samj.4841</ext-link></comment></mixed-citation></ref>
<ref id="CIT0011"><label>11.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Aitken</surname> <given-names>RCB</given-names></string-name></person-group>. <article-title>Measurement of feelings using visual analogue scales</article-title>. <source>Proc R Soc Med</source>. <year>1969</year>;<volume>62</volume>:<fpage>989</fpage>&#x2013;<lpage>993</lpage>.</mixed-citation></ref>
<ref id="CIT0012"><label>12.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Ganasen</surname> <given-names>KA</given-names></string-name>, <string-name><surname>Parker</surname> <given-names>S</given-names></string-name>, <string-name><surname>Hugo</surname> <given-names>CJ</given-names></string-name>, <string-name><surname>Stein</surname> <given-names>DJ</given-names></string-name>, <string-name><surname>Emsley</surname> <given-names>RA</given-names></string-name>, <string-name><surname>Seedat</surname> <given-names>S</given-names></string-name></person-group>. <article-title>Mental health literacy: Focus on developing countries</article-title>. <source>Afr J Psychiatry</source>. <year>2008</year>;<volume>11</volume>:<fpage>23</fpage>&#x2013;<lpage>28</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.4314/ajpsy.v11i1.30251">https://doi.org/10.4314/ajpsy.v11i1.30251</ext-link></comment></mixed-citation></ref>
<ref id="CIT0013"><label>13.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Cheung</surname> <given-names>YT</given-names></string-name>, <string-name><surname>Ong</surname> <given-names>YY</given-names></string-name>, <string-name><surname>Ng</surname> <given-names>T</given-names></string-name>, <etal>et al</etal></person-group>. <article-title>Assessment of mental health literacy in patients with breast cancer</article-title>. <source>J Oncol Pharm Pract</source>. <year>2016</year>;<volume>22</volume>(<issue>3</issue>):<fpage>437</fpage>&#x2013;<lpage>447</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1177/1078155215587541">https://doi.org/10.1177/1078155215587541</ext-link></comment></mixed-citation></ref>
<ref id="CIT0014"><label>14.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Goldberg</surname> <given-names>DP</given-names></string-name>, <string-name><surname>Prisciandaro</surname> <given-names>JJ</given-names></string-name>, <string-name><surname>Williams</surname> <given-names>P</given-names></string-name></person-group>. <article-title>The primary health care version of ICD-11: The detection of common mental disorders in general medical settings</article-title>. <source>Gen Hosp Psychiatry</source>. <year>2012</year>;<volume>34</volume>:<fpage>665</fpage>&#x2013;<lpage>670</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1016/j.genhosppsych.2012.06.006">https://doi.org/10.1016/j.genhosppsych.2012.06.006</ext-link></comment></mixed-citation></ref>
<ref id="CIT0015"><label>15.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Akena</surname> <given-names>D</given-names></string-name>, <string-name><surname>Joska</surname> <given-names>J</given-names></string-name>, <string-name><surname>Obuku</surname> <given-names>E</given-names></string-name>, <string-name><surname>Stein</surname> <given-names>DJ</given-names></string-name></person-group>. <article-title>Sensitivity and specificity of clinician administered screening instruments in detecting depression among HIV-positive individuals in Uganda</article-title>. <source>AIDS Care</source>. <year>2013</year>;<volume>25</volume>(<issue>10</issue>):<fpage>1245</fpage>&#x2013;<lpage>52</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1080/09540121.2013.764385">https://doi.org/10.1080/09540121.2013.764385</ext-link></comment></mixed-citation></ref>
<ref id="CIT0016"><label>16.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Katon</surname> <given-names>W</given-names></string-name>, <string-name><surname>Lin</surname> <given-names>EH</given-names></string-name>, <string-name><surname>Kroenke</surname> <given-names>K</given-names></string-name></person-group>. <article-title>The association of depression and anxiety with medical symptom burden in patients with chronic medical illness</article-title>. <source>Gen Hosp Psychiatry</source>. <year>2007</year>;<volume>29</volume>:<fpage>147</fpage>&#x2013;<lpage>155</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1016/j.genhosppsych.2006.11.005">https://doi.org/10.1016/j.genhosppsych.2006.11.005</ext-link></comment></mixed-citation></ref>
<ref id="CIT0017"><label>17.</label><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Murray</surname> <given-names>H</given-names></string-name></person-group>. <source>Thematic apperception test manual</source>. <publisher-loc>Cambridge, MA</publisher-loc>: <publisher-name>Harvard University</publisher-name>; <year>1943</year>.</mixed-citation></ref>
<ref id="CIT0018"><label>18.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Sheehan</surname> <given-names>DV</given-names></string-name>, <string-name><surname>Lecrubier</surname> <given-names>Y</given-names></string-name>, <string-name><surname>Sheehan</surname> <given-names>KH</given-names></string-name>, <etal>et al</etal></person-group>. <article-title>The MINI-International Neuropsychiatric Interview (M.I.N.I.): The development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10</article-title>. <source>J Clin Psychiatry</source>. <year>1998</year>;<volume>59</volume>(<issue>20</issue>):<fpage>20</fpage>&#x2013;<lpage>33</lpage>.</mixed-citation></ref>
<ref id="CIT0019"><label>19.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Andersen</surname> <given-names>L</given-names></string-name>, <string-name><surname>Kagee</surname> <given-names>A</given-names></string-name>, <string-name><surname>O&#x2019;Cleirigh</surname> <given-names>C</given-names></string-name>, <string-name><surname>Safren</surname> <given-names>S</given-names></string-name>, <string-name><surname>Joska</surname> <given-names>J</given-names></string-name></person-group>. <article-title>Understanding the experience and manifestation of depression in people living with HIV/AIDS in South Africa</article-title>. <source>AIDS Care</source>. <year>2015</year>;<volume>27</volume>(<issue>1</issue>):<fpage>59</fpage>&#x2013;<lpage>62</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1080/09540121.2014.951306">https://doi.org/10.1080/09540121.2014.951306</ext-link></comment></mixed-citation></ref>
<ref id="CIT0020"><label>20.</label><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Kader</surname> <given-names>R</given-names></string-name>, <string-name><surname>Seedat</surname> <given-names>S</given-names></string-name>, <string-name><surname>Parry</surname> <given-names>C</given-names></string-name>, <string-name><surname>Koch</surname> <given-names>R</given-names></string-name></person-group>. <chapter-title>The relationship between substance abuse, health status and health behaviours of patients attending HIV clinics</chapter-title>. <source>Department of Psychiatry</source>, <publisher-name>University of Stellenbosch</publisher-name>, <publisher-loc>Cape Town, South Africa</publisher-loc>; <year>2013</year>.</mixed-citation></ref>
<ref id="CIT0021"><label>21.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Myer</surname> <given-names>L</given-names></string-name>, <string-name><surname>Smit</surname> <given-names>J</given-names></string-name>, <string-name><surname>Roux</surname> <given-names>LL</given-names></string-name>, <string-name><surname>Parker</surname> <given-names>S</given-names></string-name>, <string-name><surname>Stein</surname> <given-names>DJ</given-names></string-name>, <string-name><surname>Seedat</surname> <given-names>S</given-names></string-name></person-group>. <article-title>Common mental disorders among HIV-infected individuals in South Africa: Prevalence, predictors, and validation of brief psychiatric rating scales</article-title>. <source>AIDS Patient Care STDs</source>. <year>2008</year>;<volume>22</volume>(<issue>2</issue>):<fpage>147</fpage>&#x2013;<lpage>158</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1089/apc.2007.0102">https://doi.org/10.1089/apc.2007.0102</ext-link></comment></mixed-citation></ref>
<ref id="CIT0022"><label>22.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Spies</surname> <given-names>S</given-names></string-name>, <string-name><surname>Kader</surname> <given-names>K</given-names></string-name>, <string-name><surname>Kidd</surname> <given-names>M</given-names></string-name>, <etal>et al</etal></person-group>. <article-title>Validity of the K-10 in detecting DSM-IV-defined depression and anxiety disorders among HIV infected individuals</article-title>. <source>AIDS Care</source>. <year>2009</year>;<volume>21</volume>(<issue>9</issue>):<fpage>1163</fpage>&#x2013;<lpage>1168</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1080/09540120902729965">https://doi.org/10.1080/09540120902729965</ext-link></comment></mixed-citation></ref>
<ref id="CIT0023"><label>23.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Ogle</surname> <given-names>Z</given-names></string-name>, <string-name><surname>Koen</surname> <given-names>L</given-names></string-name>, <string-name><surname>Niehaus</surname> <given-names>DJH</given-names></string-name></person-group>. <article-title>The development of the visual screening tool for anxiety disorders and depression: Addressing barriers to screening for depression and anxiety disorders in hypertension and/or diabetes</article-title>. <source>Afr J Prim Care Fam Med</source>. <year>2018</year>;<volume>10</volume>(<issue>1</issue>):<fpage>a1721</fpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.4102/phcfm.V10il.1721">https://doi.org/10.4102/phcfm.V10il.1721</ext-link></comment></mixed-citation></ref>
<ref id="CIT0024"><label>24.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Hanley</surname> <given-names>JA</given-names></string-name>, <string-name><surname>McNeil</surname> <given-names>BJ</given-names></string-name></person-group>. <article-title>The meaning and use of the area under curve operating characteristic (ROC) curve</article-title>. <source>Radiology</source>. <year>1982</year>;<volume>143</volume>(<issue>1</issue>):<fpage>29</fpage>&#x2013;<lpage>36</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1148/radiology.143.1.7063747">https://doi.org/10.1148/radiology.143.1.7063747</ext-link></comment></mixed-citation></ref>
<ref id="CIT0025"><label>25.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Fischer</surname> <given-names>JE</given-names></string-name>, <string-name><surname>Bachmann</surname> <given-names>LM</given-names></string-name>, <string-name><surname>Jaeschke</surname> <given-names>R</given-names></string-name></person-group>. <article-title>A readers&#x2019; guide to the interpretation of diagnostic test properties. Clinical example of sepsis</article-title>. <source>Intensive Care Med</source>. <year>2003</year>;<volume>29</volume>(<issue>7</issue>):<fpage>1043</fpage>&#x2013;<lpage>1051</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1007/s00134-003-1761-8">https://doi.org/10.1007/s00134-003-1761-8</ext-link></comment></mixed-citation></ref>
<ref id="CIT0026"><label>26.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Vodemaier</surname> <given-names>A</given-names></string-name>, <string-name><surname>Millman</surname> <given-names>RD</given-names></string-name></person-group>. <article-title>Accuracy of the Hospital Anxiety and Depression Scale as a screening tool in cancer patients: A systematic review and meta-analysis</article-title>. <source>Support Care Cancer</source>. <year>2011</year>;<volume>19</volume>:<fpage>1899</fpage>&#x2013;<lpage>1908</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1007/s00520-011-1251-4">https://doi.org/10.1007/s00520-011-1251-4</ext-link></comment></mixed-citation></ref>
<ref id="CIT0027"><label>27.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Van der Zwaan</surname>, <given-names>GL</given-names></string-name>, <string-name><surname>Dijk</surname> <given-names>SEM</given-names></string-name>, <string-name><surname>Adriaanse</surname> <given-names>MC</given-names></string-name>, <etal>et al</etal></person-group>. <article-title>Diagnostic accuracy of the Patient Health Questionnaire-9 for assessment of depression in type II diabetes mellitus and/or coronary heart disease in primary care</article-title>. <source>J Affect Disord</source>. <year>2016</year>;<volume>190</volume>:<fpage>68</fpage>&#x2013;<lpage>74</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1016/j.jad.2015.09.045">https://doi.org/10.1016/j.jad.2015.09.045</ext-link></comment></mixed-citation></ref>
<ref id="CIT0028"><label>28.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Conway</surname> <given-names>A</given-names></string-name>, <string-name><surname>Sheridan</surname> <given-names>J</given-names></string-name>, <string-name><surname>Maddicks-Law</surname> <given-names>J</given-names></string-name>, <etal>et al</etal></person-group>. <article-title>Accuracy of anxiety and depression screening tools in heart transplant recipients</article-title>. <source>Appl Nurs Res</source>. <year>2016</year>;<volume>32</volume>:<fpage>177</fpage>&#x2013;<lpage>181</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1016/j.apnr.2016.07.015">https://doi.org/10.1016/j.apnr.2016.07.015</ext-link></comment></mixed-citation></ref>
<ref id="CIT0029"><label>29.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Halliday</surname> <given-names>JA</given-names></string-name>, <string-name><surname>Hendrieck</surname> <given-names>C</given-names></string-name>, <string-name><surname>Busija</surname> <given-names>L</given-names></string-name>, <etal>et al</etal></person-group>. <article-title>Validation of the WHO-5 as a first-step screening instrument for depression in adults with diabetes: Results from Diabetes MILES &#x2013; Australia</article-title>. <source>Diabetes Res Clin Pract</source>. <year>2017</year>;<volume>132</volume>:<fpage>27</fpage>&#x2013;<lpage>35</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1016/j.diabres.2017.07.005">https://doi.org/10.1016/j.diabres.2017.07.005</ext-link></comment></mixed-citation></ref>
<ref id="CIT0030"><label>30.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Makanjuola</surname> <given-names>VA</given-names></string-name>, <string-name><surname>Onyeama</surname> <given-names>M</given-names></string-name>, <string-name><surname>Nuhu</surname> <given-names>FT</given-names></string-name>, <string-name><surname>Kola</surname> <given-names>L</given-names></string-name>, <string-name><surname>Gureje</surname> <given-names>O</given-names></string-name></person-group>. <article-title>Validation of short screening tools for common mental disorders in Nigerian general practices</article-title>. <source>Gen Hosp Psychiatry</source>. <year>2014</year>;<volume>36</volume>:<fpage>325</fpage>&#x2013;<lpage>329</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1016/j.genhosppsych.2013.12.010">https://doi.org/10.1016/j.genhosppsych.2013.12.010</ext-link></comment></mixed-citation></ref>
<ref id="CIT0031"><label>31.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Puertas</surname> <given-names>G</given-names></string-name>, <string-name><surname>Patel</surname> <given-names>V</given-names></string-name>, <string-name><surname>Marshall</surname> <given-names>T</given-names></string-name></person-group>. <article-title>Are visual measures of mood superior to questionnaire measures in non-Western settings?</article-title> <source>Soc Psychiatry Psychiatr Epidemiol</source>. <year>2004</year>;<volume>39</volume>:<fpage>662</fpage>&#x2013;<lpage>666</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1007/s00127-004-0800-2">https://doi.org/10.1007/s00127-004-0800-2</ext-link></comment></mixed-citation></ref>
<ref id="CIT0032"><label>32.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Reddy</surname> <given-names>P</given-names></string-name>, <string-name><surname>Philpot</surname> <given-names>B</given-names></string-name>, <string-name><surname>Ford</surname> <given-names>D</given-names></string-name>, <string-name><surname>Dunbar</surname> <given-names>JA</given-names></string-name></person-group>. <article-title>Identification of depression in diabetes: The efficacy of the PHQ-9 and the HADS-D</article-title>. <source>Br J Gen Pract</source> <year>2010</year>;<volume>60</volume>:<fpage>e239</fpage>&#x2013;<lpage>e245</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.3399/bjgp10X502128">https://doi.org/10.3399/bjgp10X502128</ext-link></comment></mixed-citation></ref>
<ref id="CIT0033"><label>33.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Hanlon</surname> <given-names>C</given-names></string-name>, <string-name><surname>Luitel</surname> <given-names>NP</given-names></string-name>, <string-name><surname>Kathree</surname> <given-names>T</given-names></string-name>, <etal>et al</etal></person-group>. <article-title>Challenges and opportunities for implementing integrated mental health care: A district level situation analysis from five low- and middle-income countries</article-title>. <source>PLoS One</source>. <year>2014</year>;<volume>9</volume>(<issue>2</issue>):<fpage>e88437</fpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1371/journal.pone.0088437">https://doi.org/10.1371/journal.pone.0088437</ext-link></comment></mixed-citation></ref>
<ref id="CIT0034"><label>34.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Snaith</surname> <given-names>RP</given-names></string-name></person-group>. <article-title>The Hospital Anxiety and Depression Scale</article-title>. <source>Health Qual Life Outcomes</source>. <year>2003</year>;<volume>1</volume>:<fpage>29</fpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1186/1477-7525-1-29">https://doi.org/10.1186/1477-7525-1-29</ext-link></comment></mixed-citation></ref>
<ref id="CIT0035"><label>35.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Jacob L, Kostev</surname>, <given-names>K</given-names></string-name></person-group>. <article-title>Prevalence of depression in type 2 diabetes patients in German primary care practices</article-title>. <source>J Diabetes Complications</source>. <year>2016</year>;<volume>30</volume>:<fpage>432</fpage>&#x2013;<lpage>437</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1016/j.jdiacomp.2015.12.013">https://doi.org/10.1016/j.jdiacomp.2015.12.013</ext-link></comment></mixed-citation></ref>
<ref id="CIT0036"><label>36.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Cols-Sagarra</surname> <given-names>C</given-names></string-name>, <string-name><surname>L&#x00F3;pez-Simarro</surname> <given-names>F</given-names></string-name>, <string-name><surname>Alonso-Fern&#x00E1;ndez</surname> <given-names>M</given-names></string-name>, <etal>et al</etal></person-group>. <article-title>Prevalence of depression in patients with type 2 diabetes attended in primary care in Spain</article-title>. <source>Prim Care Diabetes</source>. <year>2016</year>;<volume>10</volume>(<issue>5</issue>):<fpage>369</fpage>&#x2013;<lpage>375</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1016/j.pcd.2016.02.003">https://doi.org/10.1016/j.pcd.2016.02.003</ext-link></comment></mixed-citation></ref>
<ref id="CIT0037"><label>37.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Andersson</surname> <given-names>LMC</given-names></string-name>, <string-name><surname>Schierenbeck</surname> <given-names>I</given-names></string-name>, <string-name><surname>Strumpher</surname> <given-names>J</given-names></string-name>, <etal>et al</etal></person-group>. <article-title>Help-seeking behaviour, barriers to care and experiences of care among persons with depression in Eastern Cape, South Africa</article-title>. <source>J Affect Disord</source>. <year>2013</year>;<volume>151</volume>(<issue>2</issue>):<fpage>439</fpage>&#x2013;<lpage>448</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1016/j.jad.2013.06.022i">https://doi.org/10.1016/j.jad.2013.06.022i</ext-link></comment></mixed-citation></ref>
<ref id="CIT0038"><label>38.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Davies</surname> <given-names>SJC</given-names></string-name>, <string-name><surname>Ghahramani</surname> <given-names>P</given-names></string-name>, <string-name><surname>Jackson</surname> <given-names>PR</given-names></string-name>, <etal>et al</etal></person-group>. <article-title>Association of panic disorder and panic attacks with hypertension</article-title>. <source>Am J Med</source>. <year>1999</year>;<volume>107</volume>:<fpage>310</fpage>&#x2013;<lpage>316</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1016/S0002-9343(99)00237-5">https://doi.org/10.1016/S0002-9343(99)00237-5</ext-link></comment></mixed-citation></ref>
<ref id="CIT0039"><label>39.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Greene</surname> <given-names>T</given-names></string-name>, <string-name><surname>Neria</surname> <given-names>Y</given-names></string-name>, <string-name><surname>Gross</surname> <given-names>R</given-names></string-name></person-group>. <article-title>Prevalence, detection and correlates of PTSD in the primary care setting: A systematic review</article-title>. <source>J Clin Psychol Med Settings</source>. <year>2016</year>;<volume>23</volume>:<fpage>160</fpage>&#x2013;<lpage>180</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1007/s10880-016-9449-8">https://doi.org/10.1007/s10880-016-9449-8</ext-link></comment></mixed-citation></ref>
<ref id="CIT0040"><label>40.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Seedat</surname> <given-names>S</given-names></string-name></person-group>. <article-title>Guideline: Posttraumatic stress disorder</article-title>. <source>S Afr J Psychiatr</source>. <year>2013</year>;<volume>19</volume>(<issue>3</issue>):<fpage>187</fpage>&#x2013;<lpage>191</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.4102/sajpsychiatry.v19i3.952">https://doi.org/10.4102/sajpsychiatry.v19i3.952</ext-link></comment></mixed-citation></ref>
<ref id="CIT0041"><label>41.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Roy</surname> <given-names>T</given-names></string-name>, <string-name><surname>Llyod</surname> <given-names>CE</given-names></string-name></person-group>. <article-title>Epidemiology of depression and diabetes: A systematic review</article-title>. <source>J Affect Disord</source>. <year>2012</year>;<volume>142</volume>(<supplement>Suppl 1</supplement>):<fpage>S8</fpage>&#x2013;<lpage>S21</lpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1016/S0165-0327(12)70004-6">https://doi.org/10.1016/S0165-0327(12)70004-6</ext-link></comment></mixed-citation></ref>
<ref id="CIT0042"><label>42.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Rubio-Guerra</surname> <given-names>AF</given-names></string-name>, <string-name><surname>Rodriguez-Lopez</surname> <given-names>L</given-names></string-name>, <string-name><surname>Vargas-Ayala</surname> <given-names>G</given-names></string-name>, <string-name><surname>Huerta-Ramirez</surname> <given-names>S</given-names></string-name>, <string-name><surname>Serna</surname> <given-names>DC</given-names></string-name>, <string-name><surname>Lozano-Nuevo</surname> <given-names>JJ</given-names></string-name></person-group>. <article-title>Depression increases the risk for uncontrolled hypertension</article-title>. <source>Exp Clin Cardiol</source>. <year>2013</year>;<volume>18</volume>(<issue>1</issue>):<fpage>10</fpage>&#x2013;<lpage>12</lpage>.</mixed-citation></ref>
</ref-list>
<fn-group>
<fn><p><bold>How to cite this article:</bold> Ogle Z, Koen L, Niehaus D.J.H. The validation of the visual screening tool for anxiety disorders and depression in hypertension and/or diabetes. Afr J Prm Health Care Fam Med. 2018;10(1), a1722. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.4102/phcfm.v10i1.1722">https://doi.org/10.4102/phcfm.v10i1.1722</ext-link></p></fn>
</fn-group>
</back>
</article>