ALL Metrics
-
Views
-
Downloads
Get PDF
Get XML
Cite
Export
Track
Method Article
Revised

VISIT-TS: A multimedia tool for population studies on tic disorders

[version 2; peer review: 3 approved]
Previously titled: VISIT-TS version 2: A multimedia tool for population studies on tic disorders
PUBLISHED 07 Oct 2016
Author details Author details
OPEN PEER REVIEW
REVIEWER STATUS

This article is included in the Tics collection.

Abstract

Population-based assessment of Tourette syndrome (TS) and other tic disorders produces a paradox. On one hand, ideally diagnosis of tic disorders requires expert observation. In fact, diagnostic criteria for TS explicitly require expert assessment of tics for a definite diagnosis. On the other hand, large-scale population surveys with expert assessment of every subject are impracticable. True, several published studies have successfully used expert assessment to find tic prevalence in a representative population (e.g. all students in a school district). However, extending these studies to larger populations is daunting.

We created a multimedia tool to demonstrate tics to a lay audience, discuss their defining and common attributes, and address features that differentiate tics from other movements and vocalizations. A first version was modified to improve clarity and to include a more diverse group in terms of age and ethnicity. The result is a tool intended for epidemiological research. It may also provide additional benefits, such as more representative minority recruitment for other TS studies and increased community awareness of TS.

Keywords

Tourette syndrome, prevalence, epidemiology, method, video-audio media, video recording

Revised Amendments from Version 1

This revised manuscript simplifies the title and includes minor changes in response to reviewers’ suggestions. 
Our primary intent was to help lay people decide whether they (or their child) had any tics, not to distinguish which tics they had. We had chosen to present and ask about different tics separately in order to increase sensitivity, but the comments by Drs. Plessen and Hagstrøm suggest that this choice may have unnecessarily lengthened the video, and was not clearly explained in the text. We now acknowledge this point in the last two sentences of Discussion. We also add the omitted original reference for the YGTSS.
Dr. Malaty commented on the probably limited specificity of VISIT‑TS, since respondents may mistake other normal or abnormal movements for tics. We agree with these comments and acknowledge this point in the last paragraph of Discussion.

See the authors' detailed response to the review by Kerstin J. Plessen and Julie Hagstrøm
See the authors' detailed response to the review by David R. Shprecher

Introduction

Some important questions in Tourette Syndrome (TS) require large-scale epidemiological studies. To give one example, studies have not yet had the power to definitively establish whether TS is equally common in people of African versus European descent. In the U.S., although diagnosis and treatment are about twice as common in European Americans (CDC, 2009), three prior studies in the U.S., though limited in various ways, all found tics to be more common in minorities (Costello et al., 1996; Lapouse & Monk, 1964; [Table 4]; personal communication Costello EJ to KJB, 1999; personal communication Peterson BS to KJB, 2008; Peterson et al., 2001). The results may differ so dramatically because of true genetic or epigenetic differences between racial groups (Robertson et al., 2009), or because social determinants of health care create barriers to diagnosis or treatment that create an artifactual difference in apparent prevalence (American Psychiatric Association, 2013, under Tic Disorders/Culture-Related Diagnostic Issues; CDC, 2009; Olfson et al., 2011). Settling this question will require large-scale prevalence studies that recruit an adequate, representative sample of minority populations.

Cubo (2012) reviews several factors that complicate epidemiological research on TS. One is that such studies generally must rely on assessments by lay interviewers. Although that approach has been very useful for psychiatric epidemiology in general, the validity may reasonably be questioned in the case of TS. There can be difficulties in conveying adequate descriptions of movements by words alone; probable miscategorization or failure to recognize some abnormal movements by both subjects and lay interviewers; the broad differential diagnosis of tics, including other movement disorders and normal movements; and misinterpretation of typical tics due to their intermittent nature, suppressibility and fluctuating severity over time or in response to the environment.

We were especially concerned that some respondents with tics, or whose children had tics, might not correctly interpret written descriptions of tics but would recognize the tics if they saw them. Supporting the potential importance of this concern, epidemiological studies that included expert examination (Comings et al., 1990; Cubo et al., 2011; Hornsey et al., 2001; Jin et al., 2005; Khalifa & von Knorring, 2003; Khalifa & von Knorring, 2005; Kurlan et al., 1994; Lanzi et al., 2004; Mason et al., 1998; Wang & Kuo, 2003) generally report a several-fold higher prevalence of tic disorders than do other epidemiological studies (CDC, 2009; Scahill et al., 2014).

To address these issues, we developed a multimedia screening interview to enhance population-based ascertainment of tic disorders by lay interviewers (“VISIT-TS”, Gordon et al., 2010). A video presented and discussed typical tics, addressed a few difficulties in differential diagnosis, and then presented questions to gather the information required for diagnosis by DSM-IV-TR (American Psychiatric Association, 2000) and DSM-5 (American Psychiatric Association, 2013). After initial testing and application (unpublished report, Striley CW, Black KJ, Kelso N, and Vagelakos L), we revised the instrument. Here we describe the approach we took and the result: VISIT-TS v. 2.

Methods

We first reviewed previous methods including the Yale Child Study Center questionnaire (Findley et al., 1999; Jagger et al., 1982), the Kiddie SADS semi-structured interview (K-SADS-PL) (Kaufman et al., 1997) and the interviews used by Apter et al. (1993); Gillberg & Rasmussen (1982, Appendix); Hornsey et al. (2001) and Mason et al. (1998) who used the Apter questions and the National Hospital Interview Schedule for GTS (Rickards & Robertson, 2003; Robertson & Eapen, 1996); Appendix I in Khalifa & von Knorring (2003); and Table 1 in Linazasoro et al. (2006). We also reviewed the Diagnostic Confidence Index (Robertson et al., 1999), the YGTSS (Leckman et al., 1989; Storch et al., 2005), and the parent and child self-report forms used by the Tourette Syndrome Association International Consortium for Genetics (1999). An expert in psychiatric epidemiology (CWS) developed the questions that would be posed, in consultation with a movement-disorders-trained neuropsychiatrist (KJB). The interview was designed to address both current (past month) and lifetime symptoms and included information needed for TSSG, DSM-IV-TR and DSM-5 criteria for TS.

We wrote a script addressing the following aims: demonstrate tics, discuss their defining and common attributes, and address features that differentiate tics from other movements and vocalizations. We then selected video clips from patients and research volunteers who gave written permission to re-use their video separately from patient care or the research study they had participated in. We also obtained permission from people with tics to re-use selected video clips that they had already made publicly available on YouTube. The final video was produced by Ty Travis (San Tan Valley, Arizona, USA). We dubbed the final product VISIT-TS, for “Video-Integrated Screening Instrument for Tics and Tourette Syndrome” (Gordon et al., 2010).

The first version of VISIT-TS was used in an initial reliability and validity study that provided experience and initial feedback from interviewees and staff (unpublished report, Striley CW, Black KJ, Kelso N, and Vagelakos L). It was also shared with about a dozen other movement disorders experts and we reviewed their feedback. In response to this initial experience and feedback, we made many changes, including new video clips, thereby reducing the amount of time the narrator is shown and showing more diversity in ethnicity and age. We added and improved graphics, including written text while examples of tics appear in the background. To avoid confusion, we removed videos showing examples of non-tic movements, and we eliminated medical terms unfamiliar to the general public, such as chorea. Finally, we restored an unintentionally omitted question on lower facial tics. Here we describe the revised product, version 2 of VISIT-TS.

Results

The revised VISIT-TS multimedia tool includes almost 100 video clips defining and demonstrating tics including simple and complex motor tics as well as simple and complex vocal tics, edited to a length of 5 minutes. Following the clips, 16 questions are presented in written and spoken form, one at a time, accompanied in most cases by brief video of the phenomenon being ascertained (see Appendix 1; question 4 of the video, at about 6:09, is a good brief demonstration). The questions take another 5 minutes. The video clips demonstrate adults and children in similar numbers, both sexes (male:female ≈ 5:4), and include some ethnic diversity (about 1 in 8 clips are Hispanic or non-white). VISIT-TS v. 2 is freely available for noncommercial use at https://zenodo.org/collection/user-kjb or at http://dx.doi.org/10.5281/zenodo.55604.

Discussion

This approach is based on the premise that survey respondents will respond more accurately about tics in themselves (or their children) after the interviewer shows them a brief video about tics than they would if only asked about history by questionnaire or by cross-sectional lay observation. Because tics can come and go, can be suppressed, and often resemble intentional movement or vocalizations, diagnosis of tic disorders can be challenging (Black et al., 2016; Cubo, 2012).

Some data are available to judge the sensitivity of lay diagnostic instruments for tic disorders. In two studies, about half of the children who had previously been diagnosed with TS were missed by research screening: 1 of 2 in Landgren et al., 1996 and 8 of 15 in Snider et al., 2002. Conversely, routine clinical assessment for tics is also insensitive; Kadesjo & Gillberg (2000) report that a tic diagnosis had been considered during child psychiatric treatment in only 1 of 18 children with TS. Khalifa & von Knorring (2003) examined the sensitivity of their questionnaire but only by comparing questionnaire responses from parents to those from teachers. It appears Wang & Kuo (2003) collected physician examination data on questionnaire-negative children, but those data were not reported. Linazasoro et al. (2006) do not specify whether any of the tics diagnosed by a physician observing a classroom of students for 20 minutes were missed by parent or teacher questionnaires. Stefanoff et al. (2008) diagnosed a tic disorder in 6% of children whose parents and teachers noticed no tics; this is more remarkable given that the diagnosis rate in screen-positive children was only 18%. Cubo et al. (2011) found sensitivities of 36%–73% for questionnaires completed by teachers, observers or parents. In a recent study, a semistandardized diagnostic interview (the DISC) captured only about half the cases of TS, and there was little agreement between DISC results and expert clinician diagnosis (Lewin et al., 2014).

The most detailed data on the sensitivity of questionnaires for tic diagnosis come from the study of Mason et al. (1998). They gave questionnaires containing the 4 tic screening questions of Apter et al. (1993) to students, parents and teachers. They also screened for tics with direct classroom observation by Dr. Mason, a psychologist trained in tic detection at the Queen Square, London, TS center; she watched each classroom for an hour, 2 minutes per student. To confirm the diagnosis, Mason then directly examined all 16 consenting screen-positive students in a traditional clinical setting. Importantly, Mason also examined 8 students randomly chosen from screen negatives, i.e. those who had no tics reported by themselves, parents, or teachers, and no tics observed in the classroom. Remarkably, 3 of the 8 had at least one tic when examined directly, counted only if it had been present for at least a year by history! This very high rate of missed chronic tic disorders (37.5%) suggests that traditional questionnaires and interviews are insufficiently sensitive. VISIT-TS was designed to improve sensitivity by making sure subjects and parents have seen typical tics on video before answering questions about them.

Linazasoro & colleagues (2006) used a method somewhat similar to the VISIT-TS approach, i.e., they showed a videotape of tics as part of an initial lecture to parents and teachers, followed by a survey that included a short written description of tics. Independently, “all children were directly observed in the classroom by an expert clinician in the field of tics who diagnosed tics based exclusively on the characteristics of the movements”, with a limit of 20 minutes’ observation per classroom (p. 2107). However, the authors note limitations of their work including the fact that children were observed collectively, for a relatively brief period of time, and while engaged in school work, when tics may have been suppressed. The questionnaires actually identified more children (98) than the expert (57), suggesting either that parents and teachers overdiagnosed some movements as tics, or that they were describing tics present in the past but no longer present, or that the classroom observation was not an adequately sensitive clinical comparison. A videotape demonstrating tics was released (Tourette Syndrome Association, 1990), but it was intended for a professional audience rather than for epidemiological studies.

The VISIT-TS also has limitations. The DSM and TSSG criteria explicitly require application by properly trained experts, so VISIT-TS is primarily intended as a screening tool rather than as a substitute for clinical expertise. The sensitivity of VISIT-TS has not been reported. Furthermore, its specificity may be limited; the video includes only minimal information that could help distinguish tics from chorea, dystonia, stereotypies (sensu stricto) or other abnormal movements, and after all such differential diagnosis generally requires clinical expertise. Nevertheless, a 5- to 10-minute video-illustrated questionnaire is probably a reasonable compromise for epidemiological or other tic studies that require screening large population samples for tic disorders. Finally, the video inquires separately about tics in different body locations, in hopes of improving sensitivity. However, since our primary intent was to identify presence or absence of tics, not to distinguish tics by body part affected, further experience with VISIT TS may allow shortening the video further by reducing the number of questions.

Data availability

The video can be found here: http://dx.doi.org/10.5281/zenodo.55604 (Vachon et al., 2016).

Comments on this article Comments (5)

Version 2
VERSION 2 PUBLISHED 07 Oct 2016
Revised
  • Author Response (F1000Research Advisory Board Member) 04 Jan 2023
    Kevin J Black, Departments of Psychiatry, Neurology, Radiology, and Neuroscience, Washington University School of Medicine, St. Louis, USA
    04 Jan 2023
    Author Response F1000Research Advisory Board Member
    A survey of parents in three countries showed that reactions to tics differed among the countries, whereas severity of tics was similar (Stiede et al, 2021). This finding supports an ... Continue reading
  • Author Response (F1000Research Advisory Board Member) 03 Nov 2020
    Kevin J Black, Departments of Psychiatry, Neurology, Radiology, and Neuroscience, Washington University School of Medicine, St. Louis, USA
    03 Nov 2020
    Author Response F1000Research Advisory Board Member
    On re-reading the epidemological study by Gadow et al,1 "A significantly higher percentage of African–American than white children received tic ratings in preschool (35% versus 17%) and elementary school (11% versus 3%), but ... Continue reading
  • Author Response (F1000Research Advisory Board Member) 29 Aug 2017
    Kevin J Black, Departments of Psychiatry, Neurology, Radiology, and Neuroscience, Washington University School of Medicine, St. Louis, USA
    29 Aug 2017
    Author Response F1000Research Advisory Board Member
    Appendix 1 above omits explanatory text we added to 2 questions, intended to reduce false positives. Here is the missing text:
    • 3.  Have you ever had eyebrow tics?
    ... Continue reading
  • Author Response (F1000Research Advisory Board Member) 01 Feb 2017
    Kevin J Black, Departments of Psychiatry, Neurology, Radiology, and Neuroscience, Washington University School of Medicine, St. Louis, USA
    01 Feb 2017
    Author Response F1000Research Advisory Board Member
    Additional video resources on TS include:
    • Jankovic J. A Video Guide to the Diagnosis of Tourette Syndrome. Tourette Syndrome Association, www.tsa-usa.org, 2008.
    • Video atlas supplement to: Singer
    ... Continue reading
Version 1
VERSION 1 PUBLISHED 27 Jun 2016
Discussion is closed on this version, please comment on the latest version above.
  • Reader Comment 11 Aug 2016
    Irene Malaty, University of Flroida, USA
    11 Aug 2016
    Reader Comment
    The authors have attempted to address a longstanding problem in TS epidemiologic research, which is the challenge in capturing tic prevalence when recognition and trends in seeking healthcare are variable.  ... Continue reading
  • Discussion is closed on this version, please comment on the latest version above.
Author details Author details
Competing interests
Grant information
Copyright
Download
 
Export To
metrics
Views Downloads
F1000Research - -
PubMed Central
Data from PMC are received and updated monthly.
- -
Citations
CITE
how to cite this article
Vachon MJ, Striley CW, Gordon MR et al. VISIT-TS: A multimedia tool for population studies on tic disorders [version 2; peer review: 3 approved]. F1000Research 2016, 5:1518 (https://doi.org/10.12688/f1000research.7196.2)
NOTE: If applicable, it is important to ensure the information in square brackets after the title is included in all citations of this article.
track
receive updates on this article
Track an article to receive email alerts on any updates to this article.

Open Peer Review

Current Reviewer Status: ?
Key to Reviewer Statuses VIEW
ApprovedThe paper is scientifically sound in its current form and only minor, if any, improvements are suggested
Approved with reservations A number of small changes, sometimes more significant revisions are required to address specific details and improve the papers academic merit.
Not approvedFundamental flaws in the paper seriously undermine the findings and conclusions
Version 2
VERSION 2
PUBLISHED 07 Oct 2016
Revised
Views
14
Cite
Reviewer Report 07 Nov 2016
Shawn Smyth, Johns Hopkins School of Medicine, Baltimore, MD, USA;  Sinai Hospital, Baltimore, MD, USA 
James R. Brašić, The Russell H. Morgan Department of Radiology and Radiological Science, Johns Hopkins University, Baltimore, MD, USA 
Approved
VIEWS 14
Vachon and colleagues present a structured assessment designed to assist trained lay interviewers in assessing Tourette syndrome and other tic disorders in larger population studies. This tool is a well thought out instrument that will likely help fill a void ... Continue reading
CITE
CITE
HOW TO CITE THIS REPORT
Smyth S and Brašić JR. Reviewer Report For: VISIT-TS: A multimedia tool for population studies on tic disorders [version 2; peer review: 3 approved]. F1000Research 2016, 5:1518 (https://doi.org/10.5256/f1000research.10427.r16869)
NOTE: it is important to ensure the information in square brackets after the title is included in all citations of this article.
Views
13
Cite
Reviewer Report 31 Oct 2016
David R. Shprecher, Banner Sun Health Research Institute, Sun City, AZ, USA;  Department of Neurology, University of Utah, Salt Lake City, UT, USA 
Approved
VIEWS 13
The authors carefully reviewed the epidemiology of tics and Tourette syndrome and explained the need for more sensitive, broadly applicable screening tools. To address this need, they have developed a 10-minute video that shows nearly 100 tic examples and then ... Continue reading
CITE
CITE
HOW TO CITE THIS REPORT
Shprecher DR. Reviewer Report For: VISIT-TS: A multimedia tool for population studies on tic disorders [version 2; peer review: 3 approved]. F1000Research 2016, 5:1518 (https://doi.org/10.5256/f1000research.10427.r16867)
NOTE: it is important to ensure the information in square brackets after the title is included in all citations of this article.
  • Author Response (F1000Research Advisory Board Member) 01 Nov 2016
    Kevin J Black, Departments of Psychiatry, Neurology, Radiology, and Neuroscience, Washington University School of Medicine, St. Louis, USA
    01 Nov 2016
    Author Response F1000Research Advisory Board Member
    I am very appreciative of Dr. Shprecher's thoughtful comments.
    • We envisioned VISIT-TS being used primarily for screening, a setting in which sensitivity was more of a concern than
    ... Continue reading
COMMENTS ON THIS REPORT
  • Author Response (F1000Research Advisory Board Member) 01 Nov 2016
    Kevin J Black, Departments of Psychiatry, Neurology, Radiology, and Neuroscience, Washington University School of Medicine, St. Louis, USA
    01 Nov 2016
    Author Response F1000Research Advisory Board Member
    I am very appreciative of Dr. Shprecher's thoughtful comments.
    • We envisioned VISIT-TS being used primarily for screening, a setting in which sensitivity was more of a concern than
    ... Continue reading
Version 1
VERSION 1
PUBLISHED 27 Jun 2016
Views
20
Cite
Reviewer Report 12 Jul 2016
Kerstin J. Plessen, Department of Clinical Medicine, Faculty of Health and Medical Sciences, University of Copenhagen,  Copenhagen, Denmark;  Child and Adolescent Mental Health Centre, Mental Health Services - Capital Region of Denmark, Copenhagen, Denmark 
Julie Hagstrøm, Child and Adolescent Mental Health Centre, Mental Health Services - Capital Region of Denmark, Copenhagen, Denmark 
Approved
VIEWS 20
In the article “VISIT-TS version 2: A multimedia tool for population studies on tic disorders” by Vachon, MJ, Striley, CW, Gordon, MR, Schroeder, ML., Bihun, EC, Koller, JM, and Black, KJ, a new method of classifying tics by lay persons ... Continue reading
CITE
CITE
HOW TO CITE THIS REPORT
Plessen KJ and Hagstrøm J. Reviewer Report For: VISIT-TS: A multimedia tool for population studies on tic disorders [version 2; peer review: 3 approved]. F1000Research 2016, 5:1518 (https://doi.org/10.5256/f1000research.7752.r14613)
NOTE: it is important to ensure the information in square brackets after the title is included in all citations of this article.
  • Author Response (F1000Research Advisory Board Member) 13 Jul 2016
    Kevin J Black, Departments of Psychiatry, Neurology, Radiology, and Neuroscience, Washington University School of Medicine, St. Louis, USA
    13 Jul 2016
    Author Response F1000Research Advisory Board Member
    We appreciate the thoughtful suggestions from Drs. Plessen and Hagstrøm.

    Our primary intent was to help lay people decide whether they (or their child) had any tics, not to distinguish ... Continue reading
COMMENTS ON THIS REPORT
  • Author Response (F1000Research Advisory Board Member) 13 Jul 2016
    Kevin J Black, Departments of Psychiatry, Neurology, Radiology, and Neuroscience, Washington University School of Medicine, St. Louis, USA
    13 Jul 2016
    Author Response F1000Research Advisory Board Member
    We appreciate the thoughtful suggestions from Drs. Plessen and Hagstrøm.

    Our primary intent was to help lay people decide whether they (or their child) had any tics, not to distinguish ... Continue reading

Comments on this article Comments (5)

Version 2
VERSION 2 PUBLISHED 07 Oct 2016
Revised
  • Author Response (F1000Research Advisory Board Member) 04 Jan 2023
    Kevin J Black, Departments of Psychiatry, Neurology, Radiology, and Neuroscience, Washington University School of Medicine, St. Louis, USA
    04 Jan 2023
    Author Response F1000Research Advisory Board Member
    A survey of parents in three countries showed that reactions to tics differed among the countries, whereas severity of tics was similar (Stiede et al, 2021). This finding supports an ... Continue reading
  • Author Response (F1000Research Advisory Board Member) 03 Nov 2020
    Kevin J Black, Departments of Psychiatry, Neurology, Radiology, and Neuroscience, Washington University School of Medicine, St. Louis, USA
    03 Nov 2020
    Author Response F1000Research Advisory Board Member
    On re-reading the epidemological study by Gadow et al,1 "A significantly higher percentage of African–American than white children received tic ratings in preschool (35% versus 17%) and elementary school (11% versus 3%), but ... Continue reading
  • Author Response (F1000Research Advisory Board Member) 29 Aug 2017
    Kevin J Black, Departments of Psychiatry, Neurology, Radiology, and Neuroscience, Washington University School of Medicine, St. Louis, USA
    29 Aug 2017
    Author Response F1000Research Advisory Board Member
    Appendix 1 above omits explanatory text we added to 2 questions, intended to reduce false positives. Here is the missing text:
    • 3.  Have you ever had eyebrow tics?
    ... Continue reading
  • Author Response (F1000Research Advisory Board Member) 01 Feb 2017
    Kevin J Black, Departments of Psychiatry, Neurology, Radiology, and Neuroscience, Washington University School of Medicine, St. Louis, USA
    01 Feb 2017
    Author Response F1000Research Advisory Board Member
    Additional video resources on TS include:
    • Jankovic J. A Video Guide to the Diagnosis of Tourette Syndrome. Tourette Syndrome Association, www.tsa-usa.org, 2008.
    • Video atlas supplement to: Singer
    ... Continue reading
Version 1
VERSION 1 PUBLISHED 27 Jun 2016
Discussion is closed on this version, please comment on the latest version above.
  • Reader Comment 11 Aug 2016
    Irene Malaty, University of Flroida, USA
    11 Aug 2016
    Reader Comment
    The authors have attempted to address a longstanding problem in TS epidemiologic research, which is the challenge in capturing tic prevalence when recognition and trends in seeking healthcare are variable.  ... Continue reading
  • Discussion is closed on this version, please comment on the latest version above.
Alongside their report, reviewers assign a status to the article:
Approved - the paper is scientifically sound in its current form and only minor, if any, improvements are suggested
Approved with reservations - A number of small changes, sometimes more significant revisions are required to address specific details and improve the papers academic merit.
Not approved - fundamental flaws in the paper seriously undermine the findings and conclusions
Sign In
If you've forgotten your password, please enter your email address below and we'll send you instructions on how to reset your password.

The email address should be the one you originally registered with F1000.

Email address not valid, please try again

You registered with F1000 via Google, so we cannot reset your password.

To sign in, please click here.

If you still need help with your Google account password, please click here.

You registered with F1000 via Facebook, so we cannot reset your password.

To sign in, please click here.

If you still need help with your Facebook account password, please click here.

Code not correct, please try again
Email us for further assistance.
Server error, please try again.