Software for web-based tic suppression training

Jonathan K. Black; Kevin J. Black

doi:10.12688/f1000research.13460.1

Home Browse Software for web-based tic suppression training

ALL Metrics

Views

Downloads

Get PDF

Get XML

Export

▬

✚

Software Tool Article

Software for web-based tic suppression training

[version 1; peer review: 3 approved with reservations]

Jonathan K. Black¹, Kevin J. Black ²

PUBLISHED 19 Dec 2017

Author details Author details

¹ Ira A. Fulton College of Engineering and Technology, Brigham Young University, Provo, UT, 84602, USA
² Washington University School of Medicine, St. Louis, MO, 63110, USA

Jonathan K. Black
Roles: Software, Writing – Original Draft Preparation

Kevin J. Black
Roles: Conceptualization, Resources, Writing – Original Draft Preparation, Writing – Review & Editing

OPEN PEER REVIEW

REVIEWER STATUS

This article is included in the Tics collection.

Abstract

Exposure and response prevention (ERP) is a first-line behavior therapy for obsessive-compulsive disorder, and has also been tested in Tourette syndrome (TS). However, ERP for tic disorders requires intentional tic suppression, which for some patients is difficult even for brief periods. Additionally, practical access to behavior therapy is difficult for many patients, especially those in rural areas. The authors present a simple, working web platform (TicTrainer) that implements a strategy called reward-enhanced exposure and response prevention (RE–ERP). This strategy sacrifices most expert therapist components of ERP, focusing only on increasing the duration of time for which the user can suppress tics through automated differential reinforcement of tic-free periods (DRO). RE–ERP requires an external tic monitor, such as a parent, during training sessions. The user sees increasing digital rewards for longer and longer periods of successful tic suppression, similar to a video game score. TicTrainer is designed with security in mind, storing no personally identifiable health information, and has features to facilitate research, including optional masked comparison of tics during DRO vs. noncontingent reward conditions. A working instance of TicTrainer is available from https://tictrainer.com/

Keywords

behavior therapy, software, tic disorders, Tourette syndrome, reward

Corresponding author: Kevin J. Black

Competing interests: No competing interests were disclosed.

Grant information: The author(s) declared that no grants were involved in supporting this work.

Copyright: © 2017 Black JK and Black KJ. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

How to cite: Black JK and Black KJ. Software for web-based tic suppression training [version 1; peer review: 3 approved with reservations]. F1000Research 2017, 6:2150 (https://doi.org/10.12688/f1000research.13460.1) First published: 19 Dec 2017, 6:2150 (https://doi.org/10.12688/f1000research.13460.1) Latest published: 06 Aug 2018, 6:2150 (https://doi.org/10.12688/f1000research.13460.2)

Introduction

Recent years have seen increasing evidence for and acceptance of behavior therapies for tic disorders such as Tourette syndrome (Capriotti et al., 2014). Tic suppression plays a key role in these therapies (Specht et al., 2014). One of these is exposure and response prevention (ERP), a first-line treatment for obsessive-compulsive disorder. ERP also showed similar tic reduction efficacy to the most extensively studied behavior therapy for tics in a randomized, controlled trial (Verdellen et al., 2004). However, tic suppression, an essential component of ERP, is difficult or frustrating for some tic patients. Fortunately, we showed that even children with recent-onset tic disorders could suppress tics when brief tic-free periods were rewarded immediately by small tokens (Greene et al., 2015). Our experience with that study, and in an unrelated project, suggested to us that automating the process of immediate rewards for tic-free intervals might facilitate ERP, even in those who at first could suppress tics only for a few seconds at a time (Black et al., 2017; Miller et al., 2015).

Here we present a simple, web-based tool to facilitate training intended to allow increasing periods of tic suppression. Design goals included using this program to record tics, to provide rewards for tic suppression in a video-game-like format that many children would be familiar with, to gradually increase rewards for increasing periods of tic suppression, to respect confidentiality, to gather anonymous information that can be used to assess use patterns and initial information about efficacy and safety, and to provide features that facilitate research use, i.e. creation of research subject accounts that can be assigned to different reward schedules at different points in time.

Methods

Implementation

The TicTrainer server is written in JavaScript, using the Node.js runtime.

Account registration and anonymity

The system is designed to ensure security of users’ personally identifying information. Instead of recording a name, each user is assigned a simple account ID used to log on. To track the collective age of users and to allow potential individualized training dependent on age, the user is asked his or her birth month and year. However, the system saves only a randomly chosen birthdate within 45 days of the 15th day of the month supplied.

Administrative accounts also can be created. Admins can flag certain users as research participants and assign them to receive rewards differently from regular users. They can also view system and session log files, or create another admin account.

Storing data

Each user and trainer account has its own text-based account data file on the server. This is a simple way to store modest amounts of data without using a database, at the possible expense of keeping numerous files open simultaneously if traffic to a single site becomes very heavy. System design may need to change if the number of users increases very substantially.

Logging on

A user’s ID, password, and other account information are sent back and forth as needed between client and server. When a user types his ID and password into the “Manage Account” sign in page, for example, the server sends back a unique web page that includes the credentials, as he/she provided them, and some information loaded from his/her account data. If he/she edits something in his/her account, those same credentials are sent back to the server for authentication along with the new data.

Any page on the website that has information specific to a signed-in user is created dynamically by the server. These dynamic web pages are stored as .dynh files on the server. (“.dynh” is a custom extension which stands for DYNamic Html.) These files have designated locations for the server to inject the required unique fields (usually these include the user’s ID and password) before sending the edited page back to the client. Almost every page involved in a training session is stored and generated this way by the server, so as to preserve the user’s credentials as he/she typed them at the beginning of the session.

During a session, the server mediates between the user and trainer via a session log file. When the trainer records a user’s tic, the trainer’s page sends an XMLHttpRequest asking the server to write a line to the log file. On the other side, the user’s page continually checks the session log file on the server for changes, so it can reset the rewards when the user tics and end the session when the trainer leaves. At the end of a session, the log file is archived with the end time in the filename.

Operation

TicTrainer runs on a node.js server. Users need a web browser that supports javascript. The program may not function properly on browsers that do not support HTML5, and currently does not work with Microsoft browsers.

Setting up

A visitor to TicTrainer first registers an account. User and trainer accounts are created separately. Either one next goes to the “Manage Account” page and links to another account. Specifically, trainers specify the users they train, and users specify the trainers that can train them.

Training sessions

During a session, the trainer is presented with two buttons: “Tic Detected,” and “End Session.” When “Tic Detected” is pressed, the server logs a tic. Trainers also see a 1-minute timer progressing continuously next to an “I’m Here” button, which restarts that timer (as does the “Tic Detected” button). If the trainer presses “End Session,” closes the page, or lets the “I’m Here” timer elapse, the session ends. The timer helps ensure that the trainer stays engaged in watching and recording the user’s tics.

The user’s session page displays a large counter for their current point total, followed by a superscript number indicating the current point accrual rate. Each time the user refrains from ticcing for a number of seconds equal to his/her level, their point total increases by the current rate, and the rate then increases by the square of the current level (rate is capped at 10 × levels²). Finally, a user “levels up” when his/her points exceed 1000 × levels². He/she then also receives “coins” equal to the square of the previous level. The coins can be traded in for digital medals at an online store. Parents or clinicians may choose to provide tangible rewards for the digital coins or medals. The medals are displayed during training sessions and on the user’s “Manage Account” page. In total, this reward strategy is intended to provide users increasing incentives to suppress their tics for increasingly long intervals.

For potential use in controlled trials, research participant accounts can also be assigned to an alternative (control) reward strategy, noncontingent reward (Greene et al., 2015; Himle et al., 2008). In this case the admin user can set the initial mean frequency of rewards. This frequency may be set based on the participant’s previously recorded tic frequency, to better mask the treatment allocation. Thereafter the frequency of rewards increases automatically based on the subject’s achieved “level,” with the intention of approximately matching reward frequency with the two methods.

Use cases

Figure 1 shows a “user” window (for the person with tics) and a “trainer” window as they might appear during a session. Normally the two windows would appear on separate devices. This user is currently on level one, with 958 points, and is accruing 5 points for every second during which no tics are detected. This user has not yet earned any coins.

Figure 1. Screenshots from a TicTrainer.com session.

Left: the “user” window (person with tics). Right: the “trainer” window (clinician or other trained observer). Typically the two windows would appear on separate devices.

Supplementary File 1 is a session log file for a test session (no human subjects were observed). Admin users can view or download these session log files, from which they can compute for each session any of the following:

measures of tic frequency and tic suppression, e.g.
- ◦ mean frequency of tics
- ◦ longest tic-free interval
- ◦ number of 10-second tic-free intervals
number of rewards
other metrics, e.g.
- ◦ tests of whether inter-tic intervals fit a fractal pattern (Peterson & Leckman, 1998)
- ◦ tests of the timing of tics vis-à-vis timing of rewards

Conclusions

This simple web-based platform is available at TicTrainer.com, and provides features that allow prospective trials including with different reward schedules. Features that could yet be implemented include adding self-report (and/or trainer-report) measures of inter-session tic severity or of other symptoms, or measures of premonitory sensations/urge intensity before, during or after sessions (Himle et al., 2007; Specht et al., 2014; Verdellen et al., 2008).

Software availability

TicTrainer available from: https://tictrainer.com/

Source code available from https://github.com/jonkb/TicTrainer-node

Archived source code as at time of publication: http://doi.org/10.5281/zenodo.1098270 (Black, 2017).

License: MIT

Competing interests

No competing interests were disclosed.

Grant information

The author(s) declared that no grants were involved in supporting this work.

Acknowledgments

A preprint of this work was posted on Authorea.com.

Supplementary material

Supplementary File 1: Sample regular log file. The log file from a sample training session. This test user account was not flagged for research, so this log file demonstrates the typical reward strategy (differential reinforcement of other behavior, or DRO).

Click here to access the data.

Faculty Opinions recommended

References

Black JK: TicTrainer V.2. Zenodo. 2017. Data Source
Black JK, Koller JM, Black KJ: TicTimer software for measuring tic suppression [version 1; referees: 1 approved, 1 approved with reservations]. F1000Research. 2017; 6: 1560. Publisher Full Text
Capriotti MR, Himle MB, Woods DW: Behavioral Treatments for Tourette Syndrome. J Obsessive Compuls Relat Disord. Elsevier BV, 2014; 3(4): 415–20. Publisher Full Text
Greene DJ, Koller JM, Robichaux-Viehoever A, et al.: Reward enhances tic suppression in children within months of tic disorder onset. Dev Cogn Neurosci. 2015; 11: 65–74. PubMed Abstract | Publisher Full Text | Free Full Text
Himle MB, Woods DW, Conelea CA, et al.: Investigating the effects of tic suppression on premonitory urge ratings in children and adolescents with Tourette's syndrome. Behav Res Ther. 2007; 45(12): 2964–76. PubMed Abstract | Publisher Full Text
Himle MB, Woods DW, Bunaciu L: Evaluating the role of contingency in differentially reinforced tic suppression. J Appl Behav Anal. 2008; 41(2): 285–89. PubMed Abstract | Free Full Text
Peterson BS, Leckman JF: The Temporal Dynamics of Tics in Gilles De La Tourette Syndrome. Biol Psychiatry. 1998; 44(12): 1337–48. PubMed Abstract | Publisher Full Text
Miller B, Lim AN, Heidbreder AF, et al.: An Automated Motion Detection and Reward System for Animal Training. Cureus. 2015; 7(12): e397. PubMed Abstract | Publisher Full Text | Free Full Text
Specht MW, Nicotra CM, Kelly LM, et al.: A Comparison of Urge Intensity and the Probability of Tic Completion During Tic Freely and Tic Suppression Conditions. Behav Modif. 2014; 38(12): 297–318. PubMed Abstract | Publisher Full Text
Verdellen CW, Keijsers GP, Cath DC, et al.: Exposure with Response Prevention versus Habit Reversal in Tourettes’s Syndrome: a Controlled Study. Behav Res Ther. 2004; 42(5): 501–11. PubMed Abstract | Publisher Full Text
Verdellen CW, Hoogduin CA, Kato BS, et al.: Habituation of Premonitory Sensations during Exposure and Response Prevention Treatment in Tourette’s Syndrome. Behav Modif. 2008; 32(2): 215–27. PubMed Abstract | Publisher Full Text

Comments on this article Comments (0)

Version 2

VERSION 2 PUBLISHED 19 Dec 2017

Author details Author details

¹ Ira A. Fulton College of Engineering and Technology, Brigham Young University, Provo, UT, 84602, USA
² Washington University School of Medicine, St. Louis, MO, 63110, USA

Jonathan K. Black
Roles: Software, Writing – Original Draft Preparation

Kevin J. Black
Roles: Conceptualization, Resources, Writing – Original Draft Preparation, Writing – Review & Editing

Competing interests

No competing interests were disclosed.

Grant information

The author(s) declared that no grants were involved in supporting this work.

Article Versions (2)

version 2

Revised

Published: 06 Aug 2018, 6:2150

https://doi.org/10.12688/f1000research.13460.2

version 1

Published: 19 Dec 2017, 6:2150

https://doi.org/10.12688/f1000research.13460.1

© 2017 Black JK and Black KJ. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Download

Export To

metrics

	Views	Downloads
F1000Research	-	-
PubMed Central Data from PMC are received and updated monthly.	-	-

Citations

SEE MORE DETAILS

CITE

how to cite this article

Black JK and Black KJ. Software for web-based tic suppression training [version 1; peer review: 3 approved with reservations]. F1000Research 2017, 6:2150 (https://doi.org/10.12688/f1000research.13460.1)

NOTE: If applicable, it is important to ensure the information in square brackets after the title is included in all citations of this article.

track

receive updates on this article

Track an article to receive email alerts on any updates to this article.

Open Peer Review

Current Reviewer Status: ?

Key to Reviewer Statuses VIEW HIDE

ApprovedThe paper is scientifically sound in its current form and only minor, if any, improvements are suggested

Approved with reservations A number of small changes, sometimes more significant revisions are required to address specific details and improve the papers academic merit.

Not approvedFundamental flaws in the paper seriously undermine the findings and conclusions

Version 1

VERSION 1

PUBLISHED 19 Dec 2017

Views

Reviewer Report 15 Mar 2018

Cara W.J Verdellen, PsyQ Nijmegen, Nijmegen, The Netherlands

Approved with Reservations

https://doi.org/10.5256/f1000research.14616.r30608

Is the rationale for developing the new software tool clearly explained?

Yes
Is the description of the software tool technically sound?

Partly
Are sufficient details of the code, methods and analysis (if applicable) provided to allow replication of the software development and its use by others?

Partly
Is sufficient information provided to allow interpretation of the expected output datasets and any results generated using the tool?

Partly
Are the conclusions about the tool and its performance adequately supported by the findings presented in the article?

Partly

Competing Interests: No competing interests were disclosed.

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.

CITE

Report a concern

Author Response (F1000Research Advisory Board Member) 06 Aug 2018

Kevin J Black, Washington University School of Medicine, St. Louis, 63110, USA

06 Aug 2018

Author Response F1000Research Advisory Board Member

TicTrainer is developed to support exposure and response prevention (ERP) in the behavioral treatment of tics. ERP is considered a firstline intervention for tic disorders according to European Guidelines (Roessner ... Continue reading TicTrainer is developed to support exposure and response prevention (ERP) in the behavioral treatment of tics. ERP is considered a firstline intervention for tic disorders according to European Guidelines (Roessner et al; Verdellen et al, ESSTS, 2011). Patients are encouraged to suppress tics for prolonged periods of time allowing them to get used to unpleasant premonitory urges that often accompany tics. TicTrainer is a very valuable, nice and simple tool that supports the patient in practicing ERP at home, also in the absence of a therapist. It is also based on the finding that tic suppression is enhanced by reinforcement of tic-free periods. TicTrainer stores anonymous information to assess use patterns and information about efficacy and safety. This makes TicTrainer a promising software tool for both clinical and research ends.

Unfortunately, I was unable to evaluate the website itself because after creating an account I did not manage to make it work (‘Input Error: improper ID’). Therefore, my review is based only on the manuscript. I recommend the authors to pay attention to these ‘’technical problems’’, and also to get it supported by Microsoft browsers, as this may be a major limitation for usage.

The web site is working now. Steps for registering and starting the first session were originally quite complicated. We now provide careful, step-by-step instructions for both “users” and “trainers,” and we believe this also increases the likelihood of successful use.

TicTrainer can be used to enhance tic suppression ability (response prevention of tics), but in its present form, it does not include the element of exposure to premonitory urges. Since exposure is an important part of ERP (learning to tolerate the urge, not give in to it by performing tics), it is highly recommended to integrate this element, for example by adding a measure of sensations/urges.

In the edited introduction and conclusion, we now discuss this as a potential limitation, as a possible future improvement, and as an opportunity to test whether explicit exposure (focus on the urge) is essential to efficacy in ERP of tics (or whether by contrast tic suppression practice itself, if scheduled and repeated, can lead to benefit). This last possibility seems the more plausible given that habituation’s relevance to ERP efficacy is now in doubt.

The relevant portions of the revised text include: “There is substantial evidence that contingent reward enhances tic suppression without producing a rebound effect, at least for periods of time up to 30-40 minutes (Himle et al., 2007; Himle et al., 2008; Woods et al., 2008; Specht et al., 2013; Brabson et al., 2016; Conelea et al., 2018). Within a single session, contingently reinforced tic suppression produced decreases in tic frequency whether or not the participants were directed to attend to premonitory urges (Specht et al., 2013). However, whether repeated practice of tic suppression leads to sustained, clinically relevant improvement is not known, because unlike typical ERP, tic suppression alone does not explicitly encourage attention to the premonitory urge (the “exposure” part of ERP). … The software itself does not encourage attention to premonitory urges, a focus of traditional ERP. One can provide instructions to do so outside of the software, or use the software without explicit exposure instructions in order to test whether ERP’s efficacy depends on this component.”

More literature demonstrating the effect of direct reinforcement on tic suppression should be included in the introduction as it supports the rational for this tool in enhancing tic suppression ability.

Done: “There is substantial evidence that contingent reward enhances tic suppression without producing a rebound effect, at least for periods of time up to 30-40 minutes (Himle et al., 2007; Himle et al., 2008; Woods et al., 2008; Specht et al., 2013; Brabson et al., 2016; Conelea et al., 2018). Within a single session, contingently reinforced tic suppression produced decreases in tic frequency whether or not the participants were directed to attend to premonitory urges (Specht et al., 2013).”

It is described in this manuscript that ‘’preferably’’ two devices are needed; one for the patient and one for the trainer, who can be a parent/partner. It doesn’t say if it also works on one device (do you see 2 windows?). A disadvantage of two devices may be that a patient always needs another person to practice with, which is not always possible. It is suggested to consider integrating both tic detection and suppression/reinforcement in one tool/device (like the app BT-Coach, see bt-tics.com/bt-coach).

We now address this question in “Use cases”: “Figure 1 shows a “user” window (for the person with tics) and a “trainer” window as they might appear during a session. In typical use, the two windows would appear on two separate devices (but they can be opened on the same device, as shown here).”

We feel that BT-Coach is a wonderful (and more mature) application. However, the TicTrainer approach grew out of our recent study on children with recent onset of tics, who often are less likely to notice their own tics. We feel that tic monitoring by a third party may be a feature rather than a drawback in certain use cases.

For what age is this tool applicable?

We don’t know for certain but expect that anyone who could sit through a session of even 10 minutes or so may be able to use it.

Is it right that a patient doesn’t see his tic suppression (record) times on the window, only ‘’levels’’ and ‘’earned coins’’? It may be encouraging and reinforcing to also receive feedback on the exact tic suppression (record) times (as described in the protocol of ERP).

Correct, though the increasing reward rate with increasing duration of tic suppression (through 10 seconds initially, or 10 × level seconds later) is a weak proxy. We agree that the record times would be a potentially useful addition. We have added to conclusion the following: “Showing the user’s personal record times (maximum achieved tic-free duration) would be another feature of interest.”

Since the tool is based on receiving rewards for tic suppression, perhaps more details can be given about what kind of rewards can be used; an example of a rewarding system could be useful. Perhaps ‘’mini’’ games can be integrated in the tool that can be done directly after practicing, depending on the number of coins that are earned/levels achieved?

That is a great idea that at this time is beyond our skill. One benefit of our releasing this code is that others with time and skill beyond ours can add to it.

Overall I think this is a very promising tic suppression tool!

Thank you!
TicTrainer is developed to support exposure and response prevention (ERP) in the behavioral treatment of tics. ERP is considered a firstline intervention for tic disorders according to European Guidelines (Roessner et al; Verdellen et al, ESSTS, 2011). Patients are encouraged to suppress tics for prolonged periods of time allowing them to get used to unpleasant premonitory urges that often accompany tics. TicTrainer is a very valuable, nice and simple tool that supports the patient in practicing ERP at home, also in the absence of a therapist. It is also based on the finding that tic suppression is enhanced by reinforcement of tic-free periods. TicTrainer stores anonymous information to assess use patterns and information about efficacy and safety. This makes TicTrainer a promising software tool for both clinical and research ends.

Unfortunately, I was unable to evaluate the website itself because after creating an account I did not manage to make it work (‘Input Error: improper ID’). Therefore, my review is based only on the manuscript. I recommend the authors to pay attention to these ‘’technical problems’’, and also to get it supported by Microsoft browsers, as this may be a major limitation for usage.

The web site is working now. Steps for registering and starting the first session were originally quite complicated. We now provide careful, step-by-step instructions for both “users” and “trainers,” and we believe this also increases the likelihood of successful use.

TicTrainer can be used to enhance tic suppression ability (response prevention of tics), but in its present form, it does not include the element of exposure to premonitory urges. Since exposure is an important part of ERP (learning to tolerate the urge, not give in to it by performing tics), it is highly recommended to integrate this element, for example by adding a measure of sensations/urges.

In the edited introduction and conclusion, we now discuss this as a potential limitation, as a possible future improvement, and as an opportunity to test whether explicit exposure (focus on the urge) is essential to efficacy in ERP of tics (or whether by contrast tic suppression practice itself, if scheduled and repeated, can lead to benefit). This last possibility seems the more plausible given that habituation’s relevance to ERP efficacy is now in doubt.

The relevant portions of the revised text include: “There is substantial evidence that contingent reward enhances tic suppression without producing a rebound effect, at least for periods of time up to 30-40 minutes (Himle et al., 2007; Himle et al., 2008; Woods et al., 2008; Specht et al., 2013; Brabson et al., 2016; Conelea et al., 2018). Within a single session, contingently reinforced tic suppression produced decreases in tic frequency whether or not the participants were directed to attend to premonitory urges (Specht et al., 2013). However, whether repeated practice of tic suppression leads to sustained, clinically relevant improvement is not known, because unlike typical ERP, tic suppression alone does not explicitly encourage attention to the premonitory urge (the “exposure” part of ERP). … The software itself does not encourage attention to premonitory urges, a focus of traditional ERP. One can provide instructions to do so outside of the software, or use the software without explicit exposure instructions in order to test whether ERP’s efficacy depends on this component.”

More literature demonstrating the effect of direct reinforcement on tic suppression should be included in the introduction as it supports the rational for this tool in enhancing tic suppression ability.

Done: “There is substantial evidence that contingent reward enhances tic suppression without producing a rebound effect, at least for periods of time up to 30-40 minutes (Himle et al., 2007; Himle et al., 2008; Woods et al., 2008; Specht et al., 2013; Brabson et al., 2016; Conelea et al., 2018). Within a single session, contingently reinforced tic suppression produced decreases in tic frequency whether or not the participants were directed to attend to premonitory urges (Specht et al., 2013).”

It is described in this manuscript that ‘’preferably’’ two devices are needed; one for the patient and one for the trainer, who can be a parent/partner. It doesn’t say if it also works on one device (do you see 2 windows?). A disadvantage of two devices may be that a patient always needs another person to practice with, which is not always possible. It is suggested to consider integrating both tic detection and suppression/reinforcement in one tool/device (like the app BT-Coach, see bt-tics.com/bt-coach).

We now address this question in “Use cases”: “Figure 1 shows a “user” window (for the person with tics) and a “trainer” window as they might appear during a session. In typical use, the two windows would appear on two separate devices (but they can be opened on the same device, as shown here).”

We feel that BT-Coach is a wonderful (and more mature) application. However, the TicTrainer approach grew out of our recent study on children with recent onset of tics, who often are less likely to notice their own tics. We feel that tic monitoring by a third party may be a feature rather than a drawback in certain use cases.

For what age is this tool applicable?

We don’t know for certain but expect that anyone who could sit through a session of even 10 minutes or so may be able to use it.

Is it right that a patient doesn’t see his tic suppression (record) times on the window, only ‘’levels’’ and ‘’earned coins’’? It may be encouraging and reinforcing to also receive feedback on the exact tic suppression (record) times (as described in the protocol of ERP).

Correct, though the increasing reward rate with increasing duration of tic suppression (through 10 seconds initially, or 10 × level seconds later) is a weak proxy. We agree that the record times would be a potentially useful addition. We have added to conclusion the following: “Showing the user’s personal record times (maximum achieved tic-free duration) would be another feature of interest.”

Since the tool is based on receiving rewards for tic suppression, perhaps more details can be given about what kind of rewards can be used; an example of a rewarding system could be useful. Perhaps ‘’mini’’ games can be integrated in the tool that can be done directly after practicing, depending on the number of coins that are earned/levels achieved?

That is a great idea that at this time is beyond our skill. One benefit of our releasing this code is that others with time and skill beyond ours can add to it.

Overall I think this is a very promising tic suppression tool!

Thank you!
Competing Interests: No competing interests were disclosed. Close
Report a concern
Respond or Comment

COMMENTS ON THIS REPORT

Author Response (F1000Research Advisory Board Member) 06 Aug 2018

Kevin J Black, Washington University School of Medicine, St. Louis, 63110, USA

06 Aug 2018

Author Response F1000Research Advisory Board Member

TicTrainer is developed to support exposure and response prevention (ERP) in the behavioral treatment of tics. ERP is considered a firstline intervention for tic disorders according to European Guidelines (Roessner ... Continue reading TicTrainer is developed to support exposure and response prevention (ERP) in the behavioral treatment of tics. ERP is considered a firstline intervention for tic disorders according to European Guidelines (Roessner et al; Verdellen et al, ESSTS, 2011). Patients are encouraged to suppress tics for prolonged periods of time allowing them to get used to unpleasant premonitory urges that often accompany tics. TicTrainer is a very valuable, nice and simple tool that supports the patient in practicing ERP at home, also in the absence of a therapist. It is also based on the finding that tic suppression is enhanced by reinforcement of tic-free periods. TicTrainer stores anonymous information to assess use patterns and information about efficacy and safety. This makes TicTrainer a promising software tool for both clinical and research ends.

Unfortunately, I was unable to evaluate the website itself because after creating an account I did not manage to make it work (‘Input Error: improper ID’). Therefore, my review is based only on the manuscript. I recommend the authors to pay attention to these ‘’technical problems’’, and also to get it supported by Microsoft browsers, as this may be a major limitation for usage.

The web site is working now. Steps for registering and starting the first session were originally quite complicated. We now provide careful, step-by-step instructions for both “users” and “trainers,” and we believe this also increases the likelihood of successful use.

TicTrainer can be used to enhance tic suppression ability (response prevention of tics), but in its present form, it does not include the element of exposure to premonitory urges. Since exposure is an important part of ERP (learning to tolerate the urge, not give in to it by performing tics), it is highly recommended to integrate this element, for example by adding a measure of sensations/urges.

In the edited introduction and conclusion, we now discuss this as a potential limitation, as a possible future improvement, and as an opportunity to test whether explicit exposure (focus on the urge) is essential to efficacy in ERP of tics (or whether by contrast tic suppression practice itself, if scheduled and repeated, can lead to benefit). This last possibility seems the more plausible given that habituation’s relevance to ERP efficacy is now in doubt.

The relevant portions of the revised text include: “There is substantial evidence that contingent reward enhances tic suppression without producing a rebound effect, at least for periods of time up to 30-40 minutes (Himle et al., 2007; Himle et al., 2008; Woods et al., 2008; Specht et al., 2013; Brabson et al., 2016; Conelea et al., 2018). Within a single session, contingently reinforced tic suppression produced decreases in tic frequency whether or not the participants were directed to attend to premonitory urges (Specht et al., 2013). However, whether repeated practice of tic suppression leads to sustained, clinically relevant improvement is not known, because unlike typical ERP, tic suppression alone does not explicitly encourage attention to the premonitory urge (the “exposure” part of ERP). … The software itself does not encourage attention to premonitory urges, a focus of traditional ERP. One can provide instructions to do so outside of the software, or use the software without explicit exposure instructions in order to test whether ERP’s efficacy depends on this component.”

More literature demonstrating the effect of direct reinforcement on tic suppression should be included in the introduction as it supports the rational for this tool in enhancing tic suppression ability.

Done: “There is substantial evidence that contingent reward enhances tic suppression without producing a rebound effect, at least for periods of time up to 30-40 minutes (Himle et al., 2007; Himle et al., 2008; Woods et al., 2008; Specht et al., 2013; Brabson et al., 2016; Conelea et al., 2018). Within a single session, contingently reinforced tic suppression produced decreases in tic frequency whether or not the participants were directed to attend to premonitory urges (Specht et al., 2013).”

It is described in this manuscript that ‘’preferably’’ two devices are needed; one for the patient and one for the trainer, who can be a parent/partner. It doesn’t say if it also works on one device (do you see 2 windows?). A disadvantage of two devices may be that a patient always needs another person to practice with, which is not always possible. It is suggested to consider integrating both tic detection and suppression/reinforcement in one tool/device (like the app BT-Coach, see bt-tics.com/bt-coach).

We now address this question in “Use cases”: “Figure 1 shows a “user” window (for the person with tics) and a “trainer” window as they might appear during a session. In typical use, the two windows would appear on two separate devices (but they can be opened on the same device, as shown here).”

We feel that BT-Coach is a wonderful (and more mature) application. However, the TicTrainer approach grew out of our recent study on children with recent onset of tics, who often are less likely to notice their own tics. We feel that tic monitoring by a third party may be a feature rather than a drawback in certain use cases.

For what age is this tool applicable?

We don’t know for certain but expect that anyone who could sit through a session of even 10 minutes or so may be able to use it.

Is it right that a patient doesn’t see his tic suppression (record) times on the window, only ‘’levels’’ and ‘’earned coins’’? It may be encouraging and reinforcing to also receive feedback on the exact tic suppression (record) times (as described in the protocol of ERP).

Correct, though the increasing reward rate with increasing duration of tic suppression (through 10 seconds initially, or 10 × level seconds later) is a weak proxy. We agree that the record times would be a potentially useful addition. We have added to conclusion the following: “Showing the user’s personal record times (maximum achieved tic-free duration) would be another feature of interest.”

Since the tool is based on receiving rewards for tic suppression, perhaps more details can be given about what kind of rewards can be used; an example of a rewarding system could be useful. Perhaps ‘’mini’’ games can be integrated in the tool that can be done directly after practicing, depending on the number of coins that are earned/levels achieved?

That is a great idea that at this time is beyond our skill. One benefit of our releasing this code is that others with time and skill beyond ours can add to it.

Overall I think this is a very promising tic suppression tool!

Thank you!
TicTrainer is developed to support exposure and response prevention (ERP) in the behavioral treatment of tics. ERP is considered a firstline intervention for tic disorders according to European Guidelines (Roessner et al; Verdellen et al, ESSTS, 2011). Patients are encouraged to suppress tics for prolonged periods of time allowing them to get used to unpleasant premonitory urges that often accompany tics. TicTrainer is a very valuable, nice and simple tool that supports the patient in practicing ERP at home, also in the absence of a therapist. It is also based on the finding that tic suppression is enhanced by reinforcement of tic-free periods. TicTrainer stores anonymous information to assess use patterns and information about efficacy and safety. This makes TicTrainer a promising software tool for both clinical and research ends.

Unfortunately, I was unable to evaluate the website itself because after creating an account I did not manage to make it work (‘Input Error: improper ID’). Therefore, my review is based only on the manuscript. I recommend the authors to pay attention to these ‘’technical problems’’, and also to get it supported by Microsoft browsers, as this may be a major limitation for usage.

The web site is working now. Steps for registering and starting the first session were originally quite complicated. We now provide careful, step-by-step instructions for both “users” and “trainers,” and we believe this also increases the likelihood of successful use.

TicTrainer can be used to enhance tic suppression ability (response prevention of tics), but in its present form, it does not include the element of exposure to premonitory urges. Since exposure is an important part of ERP (learning to tolerate the urge, not give in to it by performing tics), it is highly recommended to integrate this element, for example by adding a measure of sensations/urges.

In the edited introduction and conclusion, we now discuss this as a potential limitation, as a possible future improvement, and as an opportunity to test whether explicit exposure (focus on the urge) is essential to efficacy in ERP of tics (or whether by contrast tic suppression practice itself, if scheduled and repeated, can lead to benefit). This last possibility seems the more plausible given that habituation’s relevance to ERP efficacy is now in doubt.

The relevant portions of the revised text include: “There is substantial evidence that contingent reward enhances tic suppression without producing a rebound effect, at least for periods of time up to 30-40 minutes (Himle et al., 2007; Himle et al., 2008; Woods et al., 2008; Specht et al., 2013; Brabson et al., 2016; Conelea et al., 2018). Within a single session, contingently reinforced tic suppression produced decreases in tic frequency whether or not the participants were directed to attend to premonitory urges (Specht et al., 2013). However, whether repeated practice of tic suppression leads to sustained, clinically relevant improvement is not known, because unlike typical ERP, tic suppression alone does not explicitly encourage attention to the premonitory urge (the “exposure” part of ERP). … The software itself does not encourage attention to premonitory urges, a focus of traditional ERP. One can provide instructions to do so outside of the software, or use the software without explicit exposure instructions in order to test whether ERP’s efficacy depends on this component.”

More literature demonstrating the effect of direct reinforcement on tic suppression should be included in the introduction as it supports the rational for this tool in enhancing tic suppression ability.

Done: “There is substantial evidence that contingent reward enhances tic suppression without producing a rebound effect, at least for periods of time up to 30-40 minutes (Himle et al., 2007; Himle et al., 2008; Woods et al., 2008; Specht et al., 2013; Brabson et al., 2016; Conelea et al., 2018). Within a single session, contingently reinforced tic suppression produced decreases in tic frequency whether or not the participants were directed to attend to premonitory urges (Specht et al., 2013).”

It is described in this manuscript that ‘’preferably’’ two devices are needed; one for the patient and one for the trainer, who can be a parent/partner. It doesn’t say if it also works on one device (do you see 2 windows?). A disadvantage of two devices may be that a patient always needs another person to practice with, which is not always possible. It is suggested to consider integrating both tic detection and suppression/reinforcement in one tool/device (like the app BT-Coach, see bt-tics.com/bt-coach).

We now address this question in “Use cases”: “Figure 1 shows a “user” window (for the person with tics) and a “trainer” window as they might appear during a session. In typical use, the two windows would appear on two separate devices (but they can be opened on the same device, as shown here).”

We feel that BT-Coach is a wonderful (and more mature) application. However, the TicTrainer approach grew out of our recent study on children with recent onset of tics, who often are less likely to notice their own tics. We feel that tic monitoring by a third party may be a feature rather than a drawback in certain use cases.

For what age is this tool applicable?

We don’t know for certain but expect that anyone who could sit through a session of even 10 minutes or so may be able to use it.

Is it right that a patient doesn’t see his tic suppression (record) times on the window, only ‘’levels’’ and ‘’earned coins’’? It may be encouraging and reinforcing to also receive feedback on the exact tic suppression (record) times (as described in the protocol of ERP).

Correct, though the increasing reward rate with increasing duration of tic suppression (through 10 seconds initially, or 10 × level seconds later) is a weak proxy. We agree that the record times would be a potentially useful addition. We have added to conclusion the following: “Showing the user’s personal record times (maximum achieved tic-free duration) would be another feature of interest.”

Since the tool is based on receiving rewards for tic suppression, perhaps more details can be given about what kind of rewards can be used; an example of a rewarding system could be useful. Perhaps ‘’mini’’ games can be integrated in the tool that can be done directly after practicing, depending on the number of coins that are earned/levels achieved?

That is a great idea that at this time is beyond our skill. One benefit of our releasing this code is that others with time and skill beyond ours can add to it.

Overall I think this is a very promising tic suppression tool!

Thank you!
Competing Interests: No competing interests were disclosed. Close
Report a concern

Views

Reviewer Report 05 Mar 2018

Davide Martino, Department of Clinical Neurosciences, Cumming School of Medicine, Hotchkiss Brain Institute, University of Calgary, Calgary, AB, Canada

Approved with Reservations

https://doi.org/10.5256/f1000research.14616.r30850

Like the other reviewer, I also think that the Introduction is too simplistic in comparing efficacy between ERP and CBIT, whereas in fact the quality of the evidence supporting these two behavioral treatments is different, and has been systematically reviewed and even meta-analysed. A short paragraph summarizing the evidence supporting the efficacy of ERP, also with respect to CBIT, would be useful.
Moreover, the Introduction should help a reader who is not fully acquainted with ERP understanding the technique of this behavioral approach, particularly the way in which trainer and patient interact during treatment sessions, and how this type of interaction is suitable to be operationalized using a software tool. All this is a bit given for well established in the paper, whereas in fact the literature on alternative modes of administering ERP is scant.
Perhaps I am missing some basic characteristic of the TicTrainer software, but from this manuscript it is not clear whether the “user” window and the “trainer” must appear on separate devices, or whether they could be opened on the same computer simultaneously. Can the authors comment on whether this is a specific choice of the authors of the software (and why), or a technical limitation that aims to be overcome in software upgrades?
Finally, I think that the lack of premonitory urge measures is an important limitation. On an individual patient basis, the lack of efficacy of contingent reward application to ERP might depend on the intensity of the premonitory urges and by an insufficient habituation to the urge. If the urges are not measured somehow, it would be difficult to monitor treatment response. A recent paper by Brandt et al., Cortex 2006 proposes a real time, computer-based urge monitoring technique; it would be interesting to integrate/implement something similar in this software.

Is the rationale for developing the new software tool clearly explained?

Partly
Is the description of the software tool technically sound?

Partly
Are sufficient details of the code, methods and analysis (if applicable) provided to allow replication of the software development and its use by others?

Partly
Is sufficient information provided to allow interpretation of the expected output datasets and any results generated using the tool?

Partly
Are the conclusions about the tool and its performance adequately supported by the findings presented in the article?

Partly

Competing Interests: No competing interests were disclosed.

CITE

Report a concern

Author Response (F1000Research Advisory Board Member) 06 Aug 2018

Kevin J Black, Washington University School of Medicine, St. Louis, 63110, USA

06 Aug 2018

Author Response F1000Research Advisory Board Member

The concept of the TicTrainer is highly valuable. Unfortunately I was unable to review the current version of the TicTrainer website directly due to issues with registration (it won’t accept ... Continue reading The concept of the TicTrainer is highly valuable. Unfortunately I was unable to review the current version of the TicTrainer website directly due to issues with registration (it won’t accept ID – if crucial for this peer review, please provide some guidance in a Supplementary file or in the reply).

The web site is working now. Steps for registering and starting the first session were originally quite complicated. We now provide careful, step-by-step instructions for both “users” and “trainers,” and we believe this also increases the likelihood of successful use.

In general, the authors should comment whether there is a plan in place to overcome the inability of Microsoft browsers to support the program, as this may be a major limitation for diffusion.

This is a quite reasonable concern, but we have not yet identified the specific problem. However, since other free browsers for MS Windows, Apple OS, Linux, Android and Chrome OS are in very common use, we suspect this will not constitute a real barrier to its use.

1. Like the other reviewer, I also think that the Introduction is too simplistic in comparing efficacy between ERP and CBIT, whereas in fact the quality of the evidence supporting these two behavioral treatments is different, and has been systematically reviewed and even meta-analysed. A short paragraph summarizing the evidence supporting the efficacy of ERP, also with respect to CBIT, would be useful.

I agree that the evidence for efficacy of ERP is less solid than for CBIT, but ERP advocates reasonably point to the Verdellen, 2004, trial comparing it to HRT, and their own experience. In any case, a long discussion seems out of place in a short paper introducing software. We added a citation in the introduction to the ESSTS review of behavior therapies for TS.

2. Moreover, the Introduction should help a reader who is not fully acquainted with ERP understanding the technique of this behavioral approach, particularly the way in which trainer and patient interact during treatment sessions, and how this type of interaction is suitable to be operationalized using a software tool. All this is a bit given for well established in the paper, whereas in fact the literature on alternative modes of administering ERP is scant.

The introduction now points out that exposure by focusing on premonitory urges is an important part of traditional ERP and we discuss in introduction and conclusion how this approach differs.

3. Perhaps I am missing some basic characteristic of the TicTrainer software, but from this manuscript it is not clear whether the “user” window and the “trainer” must appear on separate devices, or whether they could be opened on the same computer simultaneously. Can the authors comment on whether this is a specific choice of the authors of the software (and why), or a technical limitation that aims to be overcome in software upgrades?

The original idea was for Johnny with tics to be seated at a computer or tablet and Mom to be using her smart phone, but it can be done on a single screen. We now specify this in “Use cases”: “Figure 1 shows a “user” window (for the person with tics) and a “trainer” window as they might appear during a session. In typical use, the two windows would appear on two separate devices (but they can be opened on the same device, as shown here).”

4. Finally, I think that the lack of premonitory urge measures is an important limitation. On an individual patient basis, the lack of efficacy of contingent reward application to ERP might depend on the intensity of the premonitory urges and by an insufficient habituation to the urge. If the urges are not measured somehow, it would be difficult to monitor treatment response. A recent paper by Brandt et al., Cortex 2006 proposes a real time, computer-based urge monitoring technique; it would be interesting to integrate/implement something similar in this software.

We also are very interested in monitoring premonitory urge severity, though that likely would affect outcome. The conclusions now include the following: “Features that could yet be implemented include adding self-report (and/or trainer-report) measures of … premonitory sensations/urge intensity before, during or after sessions (Brandt et al., 2016; Himle et al., 2007; Specht et al., 2014; Verdellen et al., 2008).”
The concept of the TicTrainer is highly valuable. Unfortunately I was unable to review the current version of the TicTrainer website directly due to issues with registration (it won’t accept ID – if crucial for this peer review, please provide some guidance in a Supplementary file or in the reply).

The web site is working now. Steps for registering and starting the first session were originally quite complicated. We now provide careful, step-by-step instructions for both “users” and “trainers,” and we believe this also increases the likelihood of successful use.

In general, the authors should comment whether there is a plan in place to overcome the inability of Microsoft browsers to support the program, as this may be a major limitation for diffusion.

This is a quite reasonable concern, but we have not yet identified the specific problem. However, since other free browsers for MS Windows, Apple OS, Linux, Android and Chrome OS are in very common use, we suspect this will not constitute a real barrier to its use.

1. Like the other reviewer, I also think that the Introduction is too simplistic in comparing efficacy between ERP and CBIT, whereas in fact the quality of the evidence supporting these two behavioral treatments is different, and has been systematically reviewed and even meta-analysed. A short paragraph summarizing the evidence supporting the efficacy of ERP, also with respect to CBIT, would be useful.

I agree that the evidence for efficacy of ERP is less solid than for CBIT, but ERP advocates reasonably point to the Verdellen, 2004, trial comparing it to HRT, and their own experience. In any case, a long discussion seems out of place in a short paper introducing software. We added a citation in the introduction to the ESSTS review of behavior therapies for TS.

2. Moreover, the Introduction should help a reader who is not fully acquainted with ERP understanding the technique of this behavioral approach, particularly the way in which trainer and patient interact during treatment sessions, and how this type of interaction is suitable to be operationalized using a software tool. All this is a bit given for well established in the paper, whereas in fact the literature on alternative modes of administering ERP is scant.

The introduction now points out that exposure by focusing on premonitory urges is an important part of traditional ERP and we discuss in introduction and conclusion how this approach differs.

3. Perhaps I am missing some basic characteristic of the TicTrainer software, but from this manuscript it is not clear whether the “user” window and the “trainer” must appear on separate devices, or whether they could be opened on the same computer simultaneously. Can the authors comment on whether this is a specific choice of the authors of the software (and why), or a technical limitation that aims to be overcome in software upgrades?

The original idea was for Johnny with tics to be seated at a computer or tablet and Mom to be using her smart phone, but it can be done on a single screen. We now specify this in “Use cases”: “Figure 1 shows a “user” window (for the person with tics) and a “trainer” window as they might appear during a session. In typical use, the two windows would appear on two separate devices (but they can be opened on the same device, as shown here).”

4. Finally, I think that the lack of premonitory urge measures is an important limitation. On an individual patient basis, the lack of efficacy of contingent reward application to ERP might depend on the intensity of the premonitory urges and by an insufficient habituation to the urge. If the urges are not measured somehow, it would be difficult to monitor treatment response. A recent paper by Brandt et al., Cortex 2006 proposes a real time, computer-based urge monitoring technique; it would be interesting to integrate/implement something similar in this software.

We also are very interested in monitoring premonitory urge severity, though that likely would affect outcome. The conclusions now include the following: “Features that could yet be implemented include adding self-report (and/or trainer-report) measures of … premonitory sensations/urge intensity before, during or after sessions (Brandt et al., 2016; Himle et al., 2007; Specht et al., 2014; Verdellen et al., 2008).”
Competing Interests: No competing interests were disclosed. Close
Report a concern
Respond or Comment

COMMENTS ON THIS REPORT

Author Response (F1000Research Advisory Board Member) 06 Aug 2018

Kevin J Black, Washington University School of Medicine, St. Louis, 63110, USA

06 Aug 2018

Author Response F1000Research Advisory Board Member

The concept of the TicTrainer is highly valuable. Unfortunately I was unable to review the current version of the TicTrainer website directly due to issues with registration (it won’t accept ... Continue reading The concept of the TicTrainer is highly valuable. Unfortunately I was unable to review the current version of the TicTrainer website directly due to issues with registration (it won’t accept ID – if crucial for this peer review, please provide some guidance in a Supplementary file or in the reply).

The web site is working now. Steps for registering and starting the first session were originally quite complicated. We now provide careful, step-by-step instructions for both “users” and “trainers,” and we believe this also increases the likelihood of successful use.

In general, the authors should comment whether there is a plan in place to overcome the inability of Microsoft browsers to support the program, as this may be a major limitation for diffusion.

This is a quite reasonable concern, but we have not yet identified the specific problem. However, since other free browsers for MS Windows, Apple OS, Linux, Android and Chrome OS are in very common use, we suspect this will not constitute a real barrier to its use.

1. Like the other reviewer, I also think that the Introduction is too simplistic in comparing efficacy between ERP and CBIT, whereas in fact the quality of the evidence supporting these two behavioral treatments is different, and has been systematically reviewed and even meta-analysed. A short paragraph summarizing the evidence supporting the efficacy of ERP, also with respect to CBIT, would be useful.

I agree that the evidence for efficacy of ERP is less solid than for CBIT, but ERP advocates reasonably point to the Verdellen, 2004, trial comparing it to HRT, and their own experience. In any case, a long discussion seems out of place in a short paper introducing software. We added a citation in the introduction to the ESSTS review of behavior therapies for TS.

2. Moreover, the Introduction should help a reader who is not fully acquainted with ERP understanding the technique of this behavioral approach, particularly the way in which trainer and patient interact during treatment sessions, and how this type of interaction is suitable to be operationalized using a software tool. All this is a bit given for well established in the paper, whereas in fact the literature on alternative modes of administering ERP is scant.

The introduction now points out that exposure by focusing on premonitory urges is an important part of traditional ERP and we discuss in introduction and conclusion how this approach differs.

3. Perhaps I am missing some basic characteristic of the TicTrainer software, but from this manuscript it is not clear whether the “user” window and the “trainer” must appear on separate devices, or whether they could be opened on the same computer simultaneously. Can the authors comment on whether this is a specific choice of the authors of the software (and why), or a technical limitation that aims to be overcome in software upgrades?

The original idea was for Johnny with tics to be seated at a computer or tablet and Mom to be using her smart phone, but it can be done on a single screen. We now specify this in “Use cases”: “Figure 1 shows a “user” window (for the person with tics) and a “trainer” window as they might appear during a session. In typical use, the two windows would appear on two separate devices (but they can be opened on the same device, as shown here).”

4. Finally, I think that the lack of premonitory urge measures is an important limitation. On an individual patient basis, the lack of efficacy of contingent reward application to ERP might depend on the intensity of the premonitory urges and by an insufficient habituation to the urge. If the urges are not measured somehow, it would be difficult to monitor treatment response. A recent paper by Brandt et al., Cortex 2006 proposes a real time, computer-based urge monitoring technique; it would be interesting to integrate/implement something similar in this software.

We also are very interested in monitoring premonitory urge severity, though that likely would affect outcome. The conclusions now include the following: “Features that could yet be implemented include adding self-report (and/or trainer-report) measures of … premonitory sensations/urge intensity before, during or after sessions (Brandt et al., 2016; Himle et al., 2007; Specht et al., 2014; Verdellen et al., 2008).”
The concept of the TicTrainer is highly valuable. Unfortunately I was unable to review the current version of the TicTrainer website directly due to issues with registration (it won’t accept ID – if crucial for this peer review, please provide some guidance in a Supplementary file or in the reply).

The web site is working now. Steps for registering and starting the first session were originally quite complicated. We now provide careful, step-by-step instructions for both “users” and “trainers,” and we believe this also increases the likelihood of successful use.

In general, the authors should comment whether there is a plan in place to overcome the inability of Microsoft browsers to support the program, as this may be a major limitation for diffusion.

This is a quite reasonable concern, but we have not yet identified the specific problem. However, since other free browsers for MS Windows, Apple OS, Linux, Android and Chrome OS are in very common use, we suspect this will not constitute a real barrier to its use.

1. Like the other reviewer, I also think that the Introduction is too simplistic in comparing efficacy between ERP and CBIT, whereas in fact the quality of the evidence supporting these two behavioral treatments is different, and has been systematically reviewed and even meta-analysed. A short paragraph summarizing the evidence supporting the efficacy of ERP, also with respect to CBIT, would be useful.

I agree that the evidence for efficacy of ERP is less solid than for CBIT, but ERP advocates reasonably point to the Verdellen, 2004, trial comparing it to HRT, and their own experience. In any case, a long discussion seems out of place in a short paper introducing software. We added a citation in the introduction to the ESSTS review of behavior therapies for TS.

2. Moreover, the Introduction should help a reader who is not fully acquainted with ERP understanding the technique of this behavioral approach, particularly the way in which trainer and patient interact during treatment sessions, and how this type of interaction is suitable to be operationalized using a software tool. All this is a bit given for well established in the paper, whereas in fact the literature on alternative modes of administering ERP is scant.

The introduction now points out that exposure by focusing on premonitory urges is an important part of traditional ERP and we discuss in introduction and conclusion how this approach differs.

3. Perhaps I am missing some basic characteristic of the TicTrainer software, but from this manuscript it is not clear whether the “user” window and the “trainer” must appear on separate devices, or whether they could be opened on the same computer simultaneously. Can the authors comment on whether this is a specific choice of the authors of the software (and why), or a technical limitation that aims to be overcome in software upgrades?

The original idea was for Johnny with tics to be seated at a computer or tablet and Mom to be using her smart phone, but it can be done on a single screen. We now specify this in “Use cases”: “Figure 1 shows a “user” window (for the person with tics) and a “trainer” window as they might appear during a session. In typical use, the two windows would appear on two separate devices (but they can be opened on the same device, as shown here).”

4. Finally, I think that the lack of premonitory urge measures is an important limitation. On an individual patient basis, the lack of efficacy of contingent reward application to ERP might depend on the intensity of the premonitory urges and by an insufficient habituation to the urge. If the urges are not measured somehow, it would be difficult to monitor treatment response. A recent paper by Brandt et al., Cortex 2006 proposes a real time, computer-based urge monitoring technique; it would be interesting to integrate/implement something similar in this software.

We also are very interested in monitoring premonitory urge severity, though that likely would affect outcome. The conclusions now include the following: “Features that could yet be implemented include adding self-report (and/or trainer-report) measures of … premonitory sensations/urge intensity before, during or after sessions (Brandt et al., 2016; Himle et al., 2007; Specht et al., 2014; Verdellen et al., 2008).”
Competing Interests: No competing interests were disclosed. Close
Report a concern

Views

Reviewer Report 02 Feb 2018

Christine A. Conelea, Department of Psychiatry, University of Minnesota, Minneapolis, MN, USA

Approved with Reservations

https://doi.org/10.5256/f1000research.14616.r30166

Introduction: In the sentence, “ERP also showed similar tic reduction..” clarify if the other treatment being referred to is Habit Reversal Therapy/Comprehensive Behavioral Intervention for Tics. It would be helpful to the reader to summarize the outcomes reported for ERP for tics in terms of response rate and degree of change in tic severity reported in prior research.

A key feature of ERP is that it aims to train tic suppression in the presence of the premonitory urge so that one can habituate to those aversive sensations. This should be noted in the introduction, particularly since this program would train suppression in a manner that is de-linked from the urge.
A brief summary of the literature demonstrating the robust, acute enhancement effect of contingent reward on tic suppression should be included in the introduction. This is a consistently replicated finding, which further supports the rationale for creating a more automated reward delivery program.
The introduction suggests an intent to utilize data input into the software for research purposes; however, at present the tictimer.com site does not appear to inform users of this intent. It is unclear to me if this is meant as a research only tool at this time, or if anyone can access the site. Clarify whether other possibility identifying information can be collected (e.g., IP address).
It seems that each “level” corresponds to a particular reinforcement schedule. Specific details about these schedules and how they change as one progresses through the program would be helpful. I assuming the program is intended to shape longer tic suppression durations but am not clear if the program aims to do this with an increasing or decreasing reward density. It also sounds like the reward schedule can be manipulated in a research context, so clarification of what the default settings vs. customizable settings would be useful.
A section discussing limitations of the current iteration of the software would be useful, such as reliance on live observation by the trainer (as tic frequency can be impacted by observation, and real-time judgements about tic occurrences can be difficult). The program only codes tic occurrence dichotomously, which precludes analyses related to tic type (e.g., motor vs. vocal, simple vs. complex).
It would be beneficial to clarify whether this software has been tested in those with tics yet.

Is the rationale for developing the new software tool clearly explained?

Yes
Is the description of the software tool technically sound?

Yes
Are sufficient details of the code, methods and analysis (if applicable) provided to allow replication of the software development and its use by others?

Yes
Is sufficient information provided to allow interpretation of the expected output datasets and any results generated using the tool?

Partly
Are the conclusions about the tool and its performance adequately supported by the findings presented in the article?

Partly

Competing Interests: No competing interests were disclosed.

Reviewer Expertise: Tic disorders, behavioral paradigms

CITE

Report a concern

Author Response (F1000Research Advisory Board Member) 06 Aug 2018

Kevin J Black, Washington University School of Medicine, St. Louis, 63110, USA

06 Aug 2018

Author Response F1000Research Advisory Board Member
This paper describes TicTrainer, a newly created software program designed to track tic occurrences and deliver reward for successful suppression during live observation. Tic suppression contingent reward has reliably been ... Continue reading
This paper describes TicTrainer, a newly created software program designed to track tic occurrences and deliver reward for successful suppression during live observation. Tic suppression contingent reward has reliably been shown to acutely enhance tic suppression in laboratory settings, but little work has been done to date to translate this finding into the clinical context. TicTrainer is an important step in this direction, and appears to be a promising tool for both research and clinical applications. To note, I was unable to evaluate the website itself due to “time out” errors, so my review is based only on the manuscript.

The web site is working now. Steps for registering and starting the first session were originally quite complicated. We now provide careful, step-by-step instructions for both “users” and “trainers,” and we believe this also increases the likelihood of successful use.

Suggestions for enhancing the manuscript are as follows:
Introduction: In the sentence, “ERP also showed similar tic reduction..” clarify if the other treatment being referred to is Habit Reversal Therapy/Comprehensive Behavioral Intervention for Tics. It would be helpful to the reader to summarize the outcomes reported for ERP for tics in terms of response rate and degree of change in tic severity reported in prior research.

Yes, the comparison was HRT/CBIT, which had more robust published evidence for efficacy. Since this is a software paper, the introduction was light on detail about ERP. Still, we now provide somewhat more information, as requested.

A key feature of ERP is that it aims to train tic suppression in the presence of the premonitory urge so that one can habituate to those aversive sensations. This should be noted in the introduction, particularly since this program would train suppression in a manner that is de-linked from the urge.

We now discuss this potentially important difference in the next-to-last paragraph of the introduction, and briefly mention it again at the end of the conclusion.

A brief summary of the literature demonstrating the robust, acute enhancement effect of contingent reward on tic suppression should be included in the introduction. This is a consistently replicated finding, which further supports the rationale for creating a more automated reward delivery program.

Done (next-to-last paragraph of introduction).

The introduction suggests an intent to utilize data input into the software for research purposes; however, at present the tictimer.com site does not appear to inform users of this intent. It is unclear to me if this is meant as a research only tool at this time, or if anyone can access the site. Clarify whether other possibility identifying information can be collected (e.g., IP address).

Anyone can access the site and use the software as is (or create their own instantiation on their own server to change its details and control its use). The program is not intended to track IP address, but servers can do so.

It seems that each “level” corresponds to a particular reinforcement schedule. Specific details about these schedules and how they change as one progresses through the program would be helpful. I assuming the program is intended to shape longer tic suppression durations but am not clear if the program aims to do this with an increasing or decreasing reward density. It also sounds like the reward schedule can be manipulated in a research context, so clarification of what the default settings vs. customizable settings would be useful.

Higher levels give higher reward density but reward frequency is slower. We provide the details in the revised ms. (“For each session, the reward point rate starts at zero, and the rate resets to zero after each tic. Each time the user refrains from ticcing for a number of seconds equal to his/her level, their point total increases by the current rate, and the rate then increases by the square of the current level (rate is capped at 10 × levels ²).”
In other words, at level 1, the first second without a tic is rewarded with 0 points, the 2nd second without a tic is rewarded by 1 point, and so on until the eleventh (and beyond) consecutive second without a tic is rewarded with 10 points. Once a tic happens, the rate resets to 0 point per second. At level 2, two seconds must pass before the first reward, and the rate then increases to 4 points. After two additional seconds the rate increases to 8 points, and so on to a maximum of 40 points per 2 seconds. As for the question about research use, the current version of the software allows administrators to change a participant from the contingent reward schedule above to a noncontingent reward strategy in which rewards are given regardless of tics at a fixed initial rate that then increases with each subsequent level.

A section discussing limitations of the current iteration of the software would be useful, such as reliance on live observation by the trainer (as tic frequency can be impacted by observation, and real-time judgements about tic occurrences can be difficult). The program only codes tic occurrence dichotomously, which precludes analyses related to tic type (e.g., motor vs. vocal, simple vs. complex).

Done (last paragraph).

It would be beneficial to clarify whether this software has been tested in those with tics yet.

We’re just offering the software. We don’t yet know whether it will work or how well it is tolerated (though of course we want to find out). Added to last paragraph.
This paper describes TicTrainer, a newly created software program designed to track tic occurrences and deliver reward for successful suppression during live observation. Tic suppression contingent reward has reliably been shown to acutely enhance tic suppression in laboratory settings, but little work has been done to date to translate this finding into the clinical context. TicTrainer is an important step in this direction, and appears to be a promising tool for both research and clinical applications. To note, I was unable to evaluate the website itself due to “time out” errors, so my review is based only on the manuscript.

The web site is working now. Steps for registering and starting the first session were originally quite complicated. We now provide careful, step-by-step instructions for both “users” and “trainers,” and we believe this also increases the likelihood of successful use.

Suggestions for enhancing the manuscript are as follows:
Introduction: In the sentence, “ERP also showed similar tic reduction..” clarify if the other treatment being referred to is Habit Reversal Therapy/Comprehensive Behavioral Intervention for Tics. It would be helpful to the reader to summarize the outcomes reported for ERP for tics in terms of response rate and degree of change in tic severity reported in prior research.

Yes, the comparison was HRT/CBIT, which had more robust published evidence for efficacy. Since this is a software paper, the introduction was light on detail about ERP. Still, we now provide somewhat more information, as requested.

A key feature of ERP is that it aims to train tic suppression in the presence of the premonitory urge so that one can habituate to those aversive sensations. This should be noted in the introduction, particularly since this program would train suppression in a manner that is de-linked from the urge.

We now discuss this potentially important difference in the next-to-last paragraph of the introduction, and briefly mention it again at the end of the conclusion.

A brief summary of the literature demonstrating the robust, acute enhancement effect of contingent reward on tic suppression should be included in the introduction. This is a consistently replicated finding, which further supports the rationale for creating a more automated reward delivery program.

Done (next-to-last paragraph of introduction).

The introduction suggests an intent to utilize data input into the software for research purposes; however, at present the tictimer.com site does not appear to inform users of this intent. It is unclear to me if this is meant as a research only tool at this time, or if anyone can access the site. Clarify whether other possibility identifying information can be collected (e.g., IP address).

Anyone can access the site and use the software as is (or create their own instantiation on their own server to change its details and control its use). The program is not intended to track IP address, but servers can do so.

It seems that each “level” corresponds to a particular reinforcement schedule. Specific details about these schedules and how they change as one progresses through the program would be helpful. I assuming the program is intended to shape longer tic suppression durations but am not clear if the program aims to do this with an increasing or decreasing reward density. It also sounds like the reward schedule can be manipulated in a research context, so clarification of what the default settings vs. customizable settings would be useful.

Higher levels give higher reward density but reward frequency is slower. We provide the details in the revised ms. (“For each session, the reward point rate starts at zero, and the rate resets to zero after each tic. Each time the user refrains from ticcing for a number of seconds equal to his/her level, their point total increases by the current rate, and the rate then increases by the square of the current level (rate is capped at 10 × levels ²).”
In other words, at level 1, the first second without a tic is rewarded with 0 points, the 2nd second without a tic is rewarded by 1 point, and so on until the eleventh (and beyond) consecutive second without a tic is rewarded with 10 points. Once a tic happens, the rate resets to 0 point per second. At level 2, two seconds must pass before the first reward, and the rate then increases to 4 points. After two additional seconds the rate increases to 8 points, and so on to a maximum of 40 points per 2 seconds. As for the question about research use, the current version of the software allows administrators to change a participant from the contingent reward schedule above to a noncontingent reward strategy in which rewards are given regardless of tics at a fixed initial rate that then increases with each subsequent level.

A section discussing limitations of the current iteration of the software would be useful, such as reliance on live observation by the trainer (as tic frequency can be impacted by observation, and real-time judgements about tic occurrences can be difficult). The program only codes tic occurrence dichotomously, which precludes analyses related to tic type (e.g., motor vs. vocal, simple vs. complex).

Done (last paragraph).

It would be beneficial to clarify whether this software has been tested in those with tics yet.

We’re just offering the software. We don’t yet know whether it will work or how well it is tolerated (though of course we want to find out). Added to last paragraph.
Competing Interests: No competing interests were disclosed. Close
Report a concern
Author Response (F1000Research Advisory Board Member) 07 Aug 2018

Kevin J Black, Washington University School of Medicine, St. Louis, 63110, USA

07 Aug 2018

Author Response F1000Research Advisory Board Member

Oops, that sentence should have read:
"Higher levels give higher reward magnitude, but reward frequency is slower."
Competing Interests: No competing interests were disclosed.
Oops, that sentence should have read:
"Higher levels give higher reward magnitude, but reward frequency is slower."
Oops, that sentence should have read:
"Higher levels give higher reward magnitude, but reward frequency is slower."
Competing Interests: No competing interests were disclosed. Close
Report a concern
Respond or Comment

COMMENTS ON THIS REPORT

Author Response (F1000Research Advisory Board Member) 06 Aug 2018

Kevin J Black, Washington University School of Medicine, St. Louis, 63110, USA

06 Aug 2018

Author Response F1000Research Advisory Board Member
This paper describes TicTrainer, a newly created software program designed to track tic occurrences and deliver reward for successful suppression during live observation. Tic suppression contingent reward has reliably been ... Continue reading
This paper describes TicTrainer, a newly created software program designed to track tic occurrences and deliver reward for successful suppression during live observation. Tic suppression contingent reward has reliably been shown to acutely enhance tic suppression in laboratory settings, but little work has been done to date to translate this finding into the clinical context. TicTrainer is an important step in this direction, and appears to be a promising tool for both research and clinical applications. To note, I was unable to evaluate the website itself due to “time out” errors, so my review is based only on the manuscript.

The web site is working now. Steps for registering and starting the first session were originally quite complicated. We now provide careful, step-by-step instructions for both “users” and “trainers,” and we believe this also increases the likelihood of successful use.

Suggestions for enhancing the manuscript are as follows:
Introduction: In the sentence, “ERP also showed similar tic reduction..” clarify if the other treatment being referred to is Habit Reversal Therapy/Comprehensive Behavioral Intervention for Tics. It would be helpful to the reader to summarize the outcomes reported for ERP for tics in terms of response rate and degree of change in tic severity reported in prior research.

Yes, the comparison was HRT/CBIT, which had more robust published evidence for efficacy. Since this is a software paper, the introduction was light on detail about ERP. Still, we now provide somewhat more information, as requested.

A key feature of ERP is that it aims to train tic suppression in the presence of the premonitory urge so that one can habituate to those aversive sensations. This should be noted in the introduction, particularly since this program would train suppression in a manner that is de-linked from the urge.

We now discuss this potentially important difference in the next-to-last paragraph of the introduction, and briefly mention it again at the end of the conclusion.

A brief summary of the literature demonstrating the robust, acute enhancement effect of contingent reward on tic suppression should be included in the introduction. This is a consistently replicated finding, which further supports the rationale for creating a more automated reward delivery program.

Done (next-to-last paragraph of introduction).

The introduction suggests an intent to utilize data input into the software for research purposes; however, at present the tictimer.com site does not appear to inform users of this intent. It is unclear to me if this is meant as a research only tool at this time, or if anyone can access the site. Clarify whether other possibility identifying information can be collected (e.g., IP address).

Anyone can access the site and use the software as is (or create their own instantiation on their own server to change its details and control its use). The program is not intended to track IP address, but servers can do so.

It seems that each “level” corresponds to a particular reinforcement schedule. Specific details about these schedules and how they change as one progresses through the program would be helpful. I assuming the program is intended to shape longer tic suppression durations but am not clear if the program aims to do this with an increasing or decreasing reward density. It also sounds like the reward schedule can be manipulated in a research context, so clarification of what the default settings vs. customizable settings would be useful.

Higher levels give higher reward density but reward frequency is slower. We provide the details in the revised ms. (“For each session, the reward point rate starts at zero, and the rate resets to zero after each tic. Each time the user refrains from ticcing for a number of seconds equal to his/her level, their point total increases by the current rate, and the rate then increases by the square of the current level (rate is capped at 10 × levels ²).”
In other words, at level 1, the first second without a tic is rewarded with 0 points, the 2nd second without a tic is rewarded by 1 point, and so on until the eleventh (and beyond) consecutive second without a tic is rewarded with 10 points. Once a tic happens, the rate resets to 0 point per second. At level 2, two seconds must pass before the first reward, and the rate then increases to 4 points. After two additional seconds the rate increases to 8 points, and so on to a maximum of 40 points per 2 seconds. As for the question about research use, the current version of the software allows administrators to change a participant from the contingent reward schedule above to a noncontingent reward strategy in which rewards are given regardless of tics at a fixed initial rate that then increases with each subsequent level.

A section discussing limitations of the current iteration of the software would be useful, such as reliance on live observation by the trainer (as tic frequency can be impacted by observation, and real-time judgements about tic occurrences can be difficult). The program only codes tic occurrence dichotomously, which precludes analyses related to tic type (e.g., motor vs. vocal, simple vs. complex).

Done (last paragraph).

It would be beneficial to clarify whether this software has been tested in those with tics yet.

We’re just offering the software. We don’t yet know whether it will work or how well it is tolerated (though of course we want to find out). Added to last paragraph.
This paper describes TicTrainer, a newly created software program designed to track tic occurrences and deliver reward for successful suppression during live observation. Tic suppression contingent reward has reliably been shown to acutely enhance tic suppression in laboratory settings, but little work has been done to date to translate this finding into the clinical context. TicTrainer is an important step in this direction, and appears to be a promising tool for both research and clinical applications. To note, I was unable to evaluate the website itself due to “time out” errors, so my review is based only on the manuscript.

The web site is working now. Steps for registering and starting the first session were originally quite complicated. We now provide careful, step-by-step instructions for both “users” and “trainers,” and we believe this also increases the likelihood of successful use.

Suggestions for enhancing the manuscript are as follows:
Introduction: In the sentence, “ERP also showed similar tic reduction..” clarify if the other treatment being referred to is Habit Reversal Therapy/Comprehensive Behavioral Intervention for Tics. It would be helpful to the reader to summarize the outcomes reported for ERP for tics in terms of response rate and degree of change in tic severity reported in prior research.

Yes, the comparison was HRT/CBIT, which had more robust published evidence for efficacy. Since this is a software paper, the introduction was light on detail about ERP. Still, we now provide somewhat more information, as requested.

A key feature of ERP is that it aims to train tic suppression in the presence of the premonitory urge so that one can habituate to those aversive sensations. This should be noted in the introduction, particularly since this program would train suppression in a manner that is de-linked from the urge.

We now discuss this potentially important difference in the next-to-last paragraph of the introduction, and briefly mention it again at the end of the conclusion.

A brief summary of the literature demonstrating the robust, acute enhancement effect of contingent reward on tic suppression should be included in the introduction. This is a consistently replicated finding, which further supports the rationale for creating a more automated reward delivery program.

Done (next-to-last paragraph of introduction).

The introduction suggests an intent to utilize data input into the software for research purposes; however, at present the tictimer.com site does not appear to inform users of this intent. It is unclear to me if this is meant as a research only tool at this time, or if anyone can access the site. Clarify whether other possibility identifying information can be collected (e.g., IP address).

Anyone can access the site and use the software as is (or create their own instantiation on their own server to change its details and control its use). The program is not intended to track IP address, but servers can do so.

It seems that each “level” corresponds to a particular reinforcement schedule. Specific details about these schedules and how they change as one progresses through the program would be helpful. I assuming the program is intended to shape longer tic suppression durations but am not clear if the program aims to do this with an increasing or decreasing reward density. It also sounds like the reward schedule can be manipulated in a research context, so clarification of what the default settings vs. customizable settings would be useful.

Higher levels give higher reward density but reward frequency is slower. We provide the details in the revised ms. (“For each session, the reward point rate starts at zero, and the rate resets to zero after each tic. Each time the user refrains from ticcing for a number of seconds equal to his/her level, their point total increases by the current rate, and the rate then increases by the square of the current level (rate is capped at 10 × levels ²).”
In other words, at level 1, the first second without a tic is rewarded with 0 points, the 2nd second without a tic is rewarded by 1 point, and so on until the eleventh (and beyond) consecutive second without a tic is rewarded with 10 points. Once a tic happens, the rate resets to 0 point per second. At level 2, two seconds must pass before the first reward, and the rate then increases to 4 points. After two additional seconds the rate increases to 8 points, and so on to a maximum of 40 points per 2 seconds. As for the question about research use, the current version of the software allows administrators to change a participant from the contingent reward schedule above to a noncontingent reward strategy in which rewards are given regardless of tics at a fixed initial rate that then increases with each subsequent level.

A section discussing limitations of the current iteration of the software would be useful, such as reliance on live observation by the trainer (as tic frequency can be impacted by observation, and real-time judgements about tic occurrences can be difficult). The program only codes tic occurrence dichotomously, which precludes analyses related to tic type (e.g., motor vs. vocal, simple vs. complex).

Done (last paragraph).

It would be beneficial to clarify whether this software has been tested in those with tics yet.

We’re just offering the software. We don’t yet know whether it will work or how well it is tolerated (though of course we want to find out). Added to last paragraph.
Competing Interests: No competing interests were disclosed. Close
Report a concern
Author Response (F1000Research Advisory Board Member) 07 Aug 2018

Kevin J Black, Washington University School of Medicine, St. Louis, 63110, USA

07 Aug 2018

Author Response F1000Research Advisory Board Member

Oops, that sentence should have read:
"Higher levels give higher reward magnitude, but reward frequency is slower."
Competing Interests: No competing interests were disclosed.
Oops, that sentence should have read:
"Higher levels give higher reward magnitude, but reward frequency is slower."
Oops, that sentence should have read:
"Higher levels give higher reward magnitude, but reward frequency is slower."
Competing Interests: No competing interests were disclosed. Close
Report a concern

Comments on this article Comments (0)

Version 2

VERSION 2 PUBLISHED 19 Dec 2017

Open Peer Review

Reviewer Status

Reviewer Reports

	Invited Reviewers
	1	2	3
Version 2 (revision) 06 Aug 18	read	read	read
Version 1 19 Dec 17	read	read	read

Christine A. Conelea, University of Minnesota, Minneapolis, USA
Davide Martino, University of Calgary, Calgary, Canada
Cara W.J Verdellen, PsyQ Nijmegen, Nijmegen, The Netherlands

Comments on this article

All Comments(0)

Add a comment

Browse by related subjects

Back to all reports

Reviewer Report

4 Views

10 Sep 2018 | for Version 2

Davide Martino, Department of Clinical Neurosciences, Cumming School of Medicine, Hotchkiss Brain Institute, University of Calgary, Calgary, AB, Canada

4 Views Cite this report Responses(0)

Approved

The authors' revisions have substantially improved the article and addressed my initial comments. I don't have further suggestions for improvement.

Competing Interests

No competing interests were disclosed.

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

Respond to this report

Responses (0)

Back to all reports

Reviewer Report

5 Views

04 Sep 2018 | for Version 2

Cara W.J Verdellen, PsyQ Nijmegen, Nijmegen, The Netherlands

5 Views Cite this report Responses(0)

Approved

I have read the revisions with interest and noticed that the authors adequately addressed the questions raised.

Competing Interests

No competing interests were disclosed.

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

Respond to this report

Responses (0)

Back to all reports

Reviewer Report

9 Views

30 Aug 2018 | for Version 2

Christine A. Conelea, Department of Psychiatry, University of Minnesota, Minneapolis, MN, USA

9 Views Cite this report Responses(0)

Approved

The authors have been responsive to reviewer feedback and adequately addressed the questions raised.

Competing Interests

No competing interests were disclosed.

Reviewer Expertise

Tic disorders, behavioral paradigms

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

Respond to this report

Responses (0)

Back to all reports

Reviewer Report

15 Views

15 Mar 2018 | for Version 1

Cara W.J Verdellen, PsyQ Nijmegen, Nijmegen, The Netherlands

15 Views Cite this report Responses(1)

Approved With Reservations

Is the rationale for developing the new software tool clearly explained?

Yes
Is the description of the software tool technically sound?

Partly
Are sufficient details of the code, methods and analysis (if applicable) provided to allow replication of the software development and its use by others?

Partly
Is sufficient information provided to allow interpretation of the expected output datasets and any results generated using the tool?

Partly
Are the conclusions about the tool and its performance adequately supported by the findings presented in the article?

Partly

Competing Interests

No competing interests were disclosed.

Respond to this report

Responses (1)

Author Response F1000Research Advisory Board Member

06 Aug 2018

Kevin J Black, Washington University School of Medicine, St. Louis, 63110, USA

TicTrainer is developed to support exposure and response prevention (ERP) in the behavioral treatment of tics. ERP is considered a firstline intervention for tic disorders according to European Guidelines (Roessner et al; Verdellen et al, ESSTS, 2011). Patients are encouraged to suppress tics for prolonged periods of time allowing them to get used to unpleasant premonitory urges that often accompany tics. TicTrainer is a very valuable, nice and simple tool that supports the patient in practicing ERP at home, also in the absence of a therapist. It is also based on the finding that tic suppression is enhanced by reinforcement of tic-free periods. TicTrainer stores anonymous information to assess use patterns and information about efficacy and safety. This makes TicTrainer a promising software tool for both clinical and research ends.

Unfortunately, I was unable to evaluate the website itself because after creating an account I did not manage to make it work (‘Input Error: improper ID’). Therefore, my review is based only on the manuscript. I recommend the authors to pay attention to these ‘’technical problems’’, and also to get it supported by Microsoft browsers, as this may be a major limitation for usage.

The web site is working now. Steps for registering and starting the first session were originally quite complicated. We now provide careful, step-by-step instructions for both “users” and “trainers,” and we believe this also increases the likelihood of successful use.

TicTrainer can be used to enhance tic suppression ability (response prevention of tics), but in its present form, it does not include the element of exposure to premonitory urges. Since exposure is an important part of ERP (learning to tolerate the urge, not give in to it by performing tics), it is highly recommended to integrate this element, for example by adding a measure of sensations/urges.

In the edited introduction and conclusion, we now discuss this as a potential limitation, as a possible future improvement, and as an opportunity to test whether explicit exposure (focus on the urge) is essential to efficacy in ERP of tics (or whether by contrast tic suppression practice itself, if scheduled and repeated, can lead to benefit). This last possibility seems the more plausible given that habituation’s relevance to ERP efficacy is now in doubt.

The relevant portions of the revised text include: “There is substantial evidence that contingent reward enhances tic suppression without producing a rebound effect, at least for periods of time up to 30-40 minutes (Himle et al., 2007; Himle et al., 2008; Woods et al., 2008; Specht et al., 2013; Brabson et al., 2016; Conelea et al., 2018). Within a single session, contingently reinforced tic suppression produced decreases in tic frequency whether or not the participants were directed to attend to premonitory urges (Specht et al., 2013). However, whether repeated practice of tic suppression leads to sustained, clinically relevant improvement is not known, because unlike typical ERP, tic suppression alone does not explicitly encourage attention to the premonitory urge (the “exposure” part of ERP). … The software itself does not encourage attention to premonitory urges, a focus of traditional ERP. One can provide instructions to do so outside of the software, or use the software without explicit exposure instructions in order to test whether ERP’s efficacy depends on this component.”

More literature demonstrating the effect of direct reinforcement on tic suppression should be included in the introduction as it supports the rational for this tool in enhancing tic suppression ability.

Done: “There is substantial evidence that contingent reward enhances tic suppression without producing a rebound effect, at least for periods of time up to 30-40 minutes (Himle et al., 2007; Himle et al., 2008; Woods et al., 2008; Specht et al., 2013; Brabson et al., 2016; Conelea et al., 2018). Within a single session, contingently reinforced tic suppression produced decreases in tic frequency whether or not the participants were directed to attend to premonitory urges (Specht et al., 2013).”

It is described in this manuscript that ‘’preferably’’ two devices are needed; one for the patient and one for the trainer, who can be a parent/partner. It doesn’t say if it also works on one device (do you see 2 windows?). A disadvantage of two devices may be that a patient always needs another person to practice with, which is not always possible. It is suggested to consider integrating both tic detection and suppression/reinforcement in one tool/device (like the app BT-Coach, see bt-tics.com/bt-coach).

We now address this question in “Use cases”: “Figure 1 shows a “user” window (for the person with tics) and a “trainer” window as they might appear during a session. In typical use, the two windows would appear on two separate devices (but they can be opened on the same device, as shown here).”

We feel that BT-Coach is a wonderful (and more mature) application. However, the TicTrainer approach grew out of our recent study on children with recent onset of tics, who often are less likely to notice their own tics. We feel that tic monitoring by a third party may be a feature rather than a drawback in certain use cases.

For what age is this tool applicable?

We don’t know for certain but expect that anyone who could sit through a session of even 10 minutes or so may be able to use it.

Is it right that a patient doesn’t see his tic suppression (record) times on the window, only ‘’levels’’ and ‘’earned coins’’? It may be encouraging and reinforcing to also receive feedback on the exact tic suppression (record) times (as described in the protocol of ERP).

Correct, though the increasing reward rate with increasing duration of tic suppression (through 10 seconds initially, or 10 × level seconds later) is a weak proxy. We agree that the record times would be a potentially useful addition. We have added to conclusion the following: “Showing the user’s personal record times (maximum achieved tic-free duration) would be another feature of interest.”

Since the tool is based on receiving rewards for tic suppression, perhaps more details can be given about what kind of rewards can be used; an example of a rewarding system could be useful. Perhaps ‘’mini’’ games can be integrated in the tool that can be done directly after practicing, depending on the number of coins that are earned/levels achieved?

That is a great idea that at this time is beyond our skill. One benefit of our releasing this code is that others with time and skill beyond ours can add to it.

Overall I think this is a very promising tic suppression tool!

Thank you!

View more View less

Competing Interests

No competing interests were disclosed.

Back to all reports

Reviewer Report

14 Views

05 Mar 2018 | for Version 1

Davide Martino, Department of Clinical Neurosciences, Cumming School of Medicine, Hotchkiss Brain Institute, University of Calgary, Calgary, AB, Canada

14 Views Cite this report Responses(1)

Approved With Reservations

Like the other reviewer, I also think that the Introduction is too simplistic in comparing efficacy between ERP and CBIT, whereas in fact the quality of the evidence supporting these two behavioral treatments is different, and has been systematically reviewed and even meta-analysed. A short paragraph summarizing the evidence supporting the efficacy of ERP, also with respect to CBIT, would be useful.
Moreover, the Introduction should help a reader who is not fully acquainted with ERP understanding the technique of this behavioral approach, particularly the way in which trainer and patient interact during treatment sessions, and how this type of interaction is suitable to be operationalized using a software tool. All this is a bit given for well established in the paper, whereas in fact the literature on alternative modes of administering ERP is scant.
Perhaps I am missing some basic characteristic of the TicTrainer software, but from this manuscript it is not clear whether the “user” window and the “trainer” must appear on separate devices, or whether they could be opened on the same computer simultaneously. Can the authors comment on whether this is a specific choice of the authors of the software (and why), or a technical limitation that aims to be overcome in software upgrades?
Finally, I think that the lack of premonitory urge measures is an important limitation. On an individual patient basis, the lack of efficacy of contingent reward application to ERP might depend on the intensity of the premonitory urges and by an insufficient habituation to the urge. If the urges are not measured somehow, it would be difficult to monitor treatment response. A recent paper by Brandt et al., Cortex 2006 proposes a real time, computer-based urge monitoring technique; it would be interesting to integrate/implement something similar in this software.

Is the rationale for developing the new software tool clearly explained?

Partly
Is the description of the software tool technically sound?

Partly
Are sufficient details of the code, methods and analysis (if applicable) provided to allow replication of the software development and its use by others?

Partly
Is sufficient information provided to allow interpretation of the expected output datasets and any results generated using the tool?

Partly
Are the conclusions about the tool and its performance adequately supported by the findings presented in the article?

Partly

Competing Interests

No competing interests were disclosed.

Respond to this report

Responses (1)

Author Response F1000Research Advisory Board Member

06 Aug 2018

Kevin J Black, Washington University School of Medicine, St. Louis, 63110, USA

The concept of the TicTrainer is highly valuable. Unfortunately I was unable to review the current version of the TicTrainer website directly due to issues with registration (it won’t accept ID – if crucial for this peer review, please provide some guidance in a Supplementary file or in the reply).

The web site is working now. Steps for registering and starting the first session were originally quite complicated. We now provide careful, step-by-step instructions for both “users” and “trainers,” and we believe this also increases the likelihood of successful use.

In general, the authors should comment whether there is a plan in place to overcome the inability of Microsoft browsers to support the program, as this may be a major limitation for diffusion.

This is a quite reasonable concern, but we have not yet identified the specific problem. However, since other free browsers for MS Windows, Apple OS, Linux, Android and Chrome OS are in very common use, we suspect this will not constitute a real barrier to its use.

1. Like the other reviewer, I also think that the Introduction is too simplistic in comparing efficacy between ERP and CBIT, whereas in fact the quality of the evidence supporting these two behavioral treatments is different, and has been systematically reviewed and even meta-analysed. A short paragraph summarizing the evidence supporting the efficacy of ERP, also with respect to CBIT, would be useful.

I agree that the evidence for efficacy of ERP is less solid than for CBIT, but ERP advocates reasonably point to the Verdellen, 2004, trial comparing it to HRT, and their own experience. In any case, a long discussion seems out of place in a short paper introducing software. We added a citation in the introduction to the ESSTS review of behavior therapies for TS.

2. Moreover, the Introduction should help a reader who is not fully acquainted with ERP understanding the technique of this behavioral approach, particularly the way in which trainer and patient interact during treatment sessions, and how this type of interaction is suitable to be operationalized using a software tool. All this is a bit given for well established in the paper, whereas in fact the literature on alternative modes of administering ERP is scant.

The introduction now points out that exposure by focusing on premonitory urges is an important part of traditional ERP and we discuss in introduction and conclusion how this approach differs.

3. Perhaps I am missing some basic characteristic of the TicTrainer software, but from this manuscript it is not clear whether the “user” window and the “trainer” must appear on separate devices, or whether they could be opened on the same computer simultaneously. Can the authors comment on whether this is a specific choice of the authors of the software (and why), or a technical limitation that aims to be overcome in software upgrades?

The original idea was for Johnny with tics to be seated at a computer or tablet and Mom to be using her smart phone, but it can be done on a single screen. We now specify this in “Use cases”: “Figure 1 shows a “user” window (for the person with tics) and a “trainer” window as they might appear during a session. In typical use, the two windows would appear on two separate devices (but they can be opened on the same device, as shown here).”

4. Finally, I think that the lack of premonitory urge measures is an important limitation. On an individual patient basis, the lack of efficacy of contingent reward application to ERP might depend on the intensity of the premonitory urges and by an insufficient habituation to the urge. If the urges are not measured somehow, it would be difficult to monitor treatment response. A recent paper by Brandt et al., Cortex 2006 proposes a real time, computer-based urge monitoring technique; it would be interesting to integrate/implement something similar in this software.

We also are very interested in monitoring premonitory urge severity, though that likely would affect outcome. The conclusions now include the following: “Features that could yet be implemented include adding self-report (and/or trainer-report) measures of … premonitory sensations/urge intensity before, during or after sessions (Brandt et al., 2016; Himle et al., 2007; Specht et al., 2014; Verdellen et al., 2008).”

View more View less

Competing Interests

No competing interests were disclosed.

Back to all reports

Reviewer Report

17 Views

02 Feb 2018 | for Version 1

Christine A. Conelea, Department of Psychiatry, University of Minnesota, Minneapolis, MN, USA

17 Views Cite this report Responses(2)

Approved With Reservations

Introduction: In the sentence, “ERP also showed similar tic reduction..” clarify if the other treatment being referred to is Habit Reversal Therapy/Comprehensive Behavioral Intervention for Tics. It would be helpful to the reader to summarize the outcomes reported for ERP for tics in terms of response rate and degree of change in tic severity reported in prior research.

A key feature of ERP is that it aims to train tic suppression in the presence of the premonitory urge so that one can habituate to those aversive sensations. This should be noted in the introduction, particularly since this program would train suppression in a manner that is de-linked from the urge.
A brief summary of the literature demonstrating the robust, acute enhancement effect of contingent reward on tic suppression should be included in the introduction. This is a consistently replicated finding, which further supports the rationale for creating a more automated reward delivery program.
The introduction suggests an intent to utilize data input into the software for research purposes; however, at present the tictimer.com site does not appear to inform users of this intent. It is unclear to me if this is meant as a research only tool at this time, or if anyone can access the site. Clarify whether other possibility identifying information can be collected (e.g., IP address).
It seems that each “level” corresponds to a particular reinforcement schedule. Specific details about these schedules and how they change as one progresses through the program would be helpful. I assuming the program is intended to shape longer tic suppression durations but am not clear if the program aims to do this with an increasing or decreasing reward density. It also sounds like the reward schedule can be manipulated in a research context, so clarification of what the default settings vs. customizable settings would be useful.
A section discussing limitations of the current iteration of the software would be useful, such as reliance on live observation by the trainer (as tic frequency can be impacted by observation, and real-time judgements about tic occurrences can be difficult). The program only codes tic occurrence dichotomously, which precludes analyses related to tic type (e.g., motor vs. vocal, simple vs. complex).
It would be beneficial to clarify whether this software has been tested in those with tics yet.

Is the rationale for developing the new software tool clearly explained?

Yes
Is the description of the software tool technically sound?

Yes
Are sufficient details of the code, methods and analysis (if applicable) provided to allow replication of the software development and its use by others?

Yes
Is sufficient information provided to allow interpretation of the expected output datasets and any results generated using the tool?

Partly
Are the conclusions about the tool and its performance adequately supported by the findings presented in the article?

Partly

Competing Interests

No competing interests were disclosed.

Reviewer Expertise

Tic disorders, behavioral paradigms

Respond to this report

Responses (2)

Author Response F1000Research Advisory Board Member

06 Aug 2018

Kevin J Black, Washington University School of Medicine, St. Louis, 63110, USA

This paper describes TicTrainer, a newly created software program designed to track tic occurrences and deliver reward for successful suppression during live observation. Tic suppression contingent reward has reliably been shown to acutely enhance tic suppression in laboratory settings, but little work has been done to date to translate this finding into the clinical context. TicTrainer is an important step in this direction, and appears to be a promising tool for both research and clinical applications. To note, I was unable to evaluate the website itself due to “time out” errors, so my review is based only on the manuscript.

The web site is working now. Steps for registering and starting the first session were originally quite complicated. We now provide careful, step-by-step instructions for both “users” and “trainers,” and we believe this also increases the likelihood of successful use.

Suggestions for enhancing the manuscript are as follows:
Introduction: In the sentence, “ERP also showed similar tic reduction..” clarify if the other treatment being referred to is Habit Reversal Therapy/Comprehensive Behavioral Intervention for Tics. It would be helpful to the reader to summarize the outcomes reported for ERP for tics in terms of response rate and degree of change in tic severity reported in prior research.

Yes, the comparison was HRT/CBIT, which had more robust published evidence for efficacy. Since this is a software paper, the introduction was light on detail about ERP. Still, we now provide somewhat more information, as requested.

A key feature of ERP is that it aims to train tic suppression in the presence of the premonitory urge so that one can habituate to those aversive sensations. This should be noted in the introduction, particularly since this program would train suppression in a manner that is de-linked from the urge.

We now discuss this potentially important difference in the next-to-last paragraph of the introduction, and briefly mention it again at the end of the conclusion.

A brief summary of the literature demonstrating the robust, acute enhancement effect of contingent reward on tic suppression should be included in the introduction. This is a consistently replicated finding, which further supports the rationale for creating a more automated reward delivery program.

Done (next-to-last paragraph of introduction).

The introduction suggests an intent to utilize data input into the software for research purposes; however, at present the tictimer.com site does not appear to inform users of this intent. It is unclear to me if this is meant as a research only tool at this time, or if anyone can access the site. Clarify whether other possibility identifying information can be collected (e.g., IP address).

Anyone can access the site and use the software as is (or create their own instantiation on their own server to change its details and control its use). The program is not intended to track IP address, but servers can do so.
It seems that each “level” corresponds to a particular reinforcement schedule. Specific details about these schedules and how they change as one progresses through the program would be helpful. I assuming the program is intended to shape longer tic suppression durations but am not clear if the program aims to do this with an increasing or decreasing reward density. It also sounds like the reward schedule can be manipulated in a research context, so clarification of what the default settings vs. customizable settings would be useful.

Higher levels give higher reward density but reward frequency is slower. We provide the details in the revised ms. (“For each session, the reward point rate starts at zero, and the rate resets to zero after each tic. Each time the user refrains from ticcing for a number of seconds equal to his/her level, their point total increases by the current rate, and the rate then increases by the square of the current level (rate is capped at 10 × levels ²).”
In other words, at level 1, the first second without a tic is rewarded with 0 points, the 2nd second without a tic is rewarded by 1 point, and so on until the eleventh (and beyond) consecutive second without a tic is rewarded with 10 points. Once a tic happens, the rate resets to 0 point per second. At level 2, two seconds must pass before the first reward, and the rate then increases to 4 points. After two additional seconds the rate increases to 8 points, and so on to a maximum of 40 points per 2 seconds. As for the question about research use, the current version of the software allows administrators to change a participant from the contingent reward schedule above to a noncontingent reward strategy in which rewards are given regardless of tics at a fixed initial rate that then increases with each subsequent level.
A section discussing limitations of the current iteration of the software would be useful, such as reliance on live observation by the trainer (as tic frequency can be impacted by observation, and real-time judgements about tic occurrences can be difficult). The program only codes tic occurrence dichotomously, which precludes analyses related to tic type (e.g., motor vs. vocal, simple vs. complex).

Done (last paragraph).
It would be beneficial to clarify whether this software has been tested in those with tics yet.

We’re just offering the software. We don’t yet know whether it will work or how well it is tolerated (though of course we want to find out). Added to last paragraph.

View more View less

Competing Interests

No competing interests were disclosed.

Alongside their report, reviewers assign a status to the article:

Approved - the paper is scientifically sound in its current form and only minor, if any, improvements are suggested

Approved with reservations - A number of small changes, sometimes more significant revisions are required to address specific details and improve the papers academic merit.

Not approved - fundamental flaws in the paper seriously undermine the findings and conclusions

[1] Black JK: TicTrainer V.2. Zenodo. 2017. Data Source

[2] Black JK, Koller JM, Black KJ: TicTimer software for measuring tic suppression [version 1; referees: 1 approved, 1 approved with reservations]. F1000Research. 2017; 6: 1560. Publisher Full Text

[3] Capriotti MR, Himle MB, Woods DW: Behavioral Treatments for Tourette Syndrome. J Obsessive Compuls Relat Disord. Elsevier BV, 2014; 3(4): 415–20. Publisher Full Text

[4] Greene DJ, Koller JM, Robichaux-Viehoever A, et al.: Reward enhances tic suppression in children within months of tic disorder onset. Dev Cogn Neurosci. 2015; 11: 65–74. PubMed Abstract | Publisher Full Text | Free Full Text

[5] Himle MB, Woods DW, Conelea CA, et al.: Investigating the effects of tic suppression on premonitory urge ratings in children and adolescents with Tourette's syndrome. Behav Res Ther. 2007; 45(12): 2964–76. PubMed Abstract | Publisher Full Text

[6] Himle MB, Woods DW, Bunaciu L: Evaluating the role of contingency in differentially reinforced tic suppression. J Appl Behav Anal. 2008; 41(2): 285–89. PubMed Abstract | Free Full Text

[7] Peterson BS, Leckman JF: The Temporal Dynamics of Tics in Gilles De La Tourette Syndrome. Biol Psychiatry. 1998; 44(12): 1337–48. PubMed Abstract | Publisher Full Text

[8] Miller B, Lim AN, Heidbreder AF, et al.: An Automated Motion Detection and Reward System for Animal Training. Cureus. 2015; 7(12): e397. PubMed Abstract | Publisher Full Text | Free Full Text

[9] Specht MW, Nicotra CM, Kelly LM, et al.: A Comparison of Urge Intensity and the Probability of Tic Completion During Tic Freely and Tic Suppression Conditions. Behav Modif. 2014; 38(12): 297–318. PubMed Abstract | Publisher Full Text

[10] Verdellen CW, Keijsers GP, Cath DC, et al.: Exposure with Response Prevention versus Habit Reversal in Tourettes’s Syndrome: a Controlled Study. Behav Res Ther. 2004; 42(5): 501–11. PubMed Abstract | Publisher Full Text

[11] Verdellen CW, Hoogduin CA, Kato BS, et al.: Habituation of Premonitory Sensations during Exposure and Response Prevention Treatment in Tourette’s Syndrome. Behav Modif. 2008; 32(2): 215–27. PubMed Abstract | Publisher Full Text

Software for web-based tic suppression training

Abstract

Keywords

Introduction

Methods

Implementation

Account registration and anonymity

Storing data

Logging on

Operation

Setting up

Training sessions

Use cases

Figure 1. Screenshots from a TicTrainer.com session.

Conclusions

Software availability

Competing interests

Grant information

Acknowledgments

Supplementary material

References

Comments on this article Comments (0)

Open Peer Review

Comments on this article Comments (0)

Open Peer Review

Reviewer Status

Reviewer Reports

Comments on this article

Browse by related subjects

Competing Interests Policy

Stay Updated