ALL Metrics
-
Views
-
Downloads
Get PDF
Get XML
Cite
Export
Track
Software Tool Article
Revised

TicTimer Web: software for measuring tic suppression remotely

[version 2; peer review: 2 approved]
PUBLISHED 03 Mar 2021
Author details Author details
OPEN PEER REVIEW
REVIEWER STATUS

This article is included in the Tics collection.

Abstract

Woods and Himle developed a standardized tic suppression paradigm (TSP) for the experimental setting, to quantify the effects of intentional tic suppression in Tourette syndrome. We previously provided a computer program to facilitate recording tic occurrence and to automate reward delivery during the several experimental conditions of the TSP. The present article describes a web-based program that performs the same functions. Implementing this program on the web allows research sessions to be performed remotely, in tandem with a video calling program. Relevant data for each session, such as the timing of tics and dispensed rewards, are stored in plain text files for later analysis. Expected applications include research on Tourette syndrome and related disorders.

Keywords

tic disorders, Tourette syndrome, reward, reinforcement (psychology), software

Revised Amendments from Version 1

We respond to the suggestions of the reviewers by elaborating on the background of the tic suppression paradigm and the potential uses of this new software.

See the authors' detailed response to the review by Jennifer Schild and Matthew W. Specht
See the authors' detailed response to the review by Valerie Brandt

Introduction

One of the defining characteristics of tics, compared to some other abnormal movements, is that they can usually be suppressed with an effort of will for at least a brief interval1. Woods and Himle developed an experimental measure of tic suppression, the tic suppression paradigm (TSP)2,3. In this paradigm, each participant is observed during several experimental conditions: usually baseline and differential reinforcement of zero-rate ticcing (DRO), and sometimes also verbal instruction to suppress tics and/or noncontingent reinforcement (NCR). The DRO condition replicates a behavior therapy long in clinical use, providing frequent rewards for absence of a problematic behavior, such as a reward token delivered after every 10 seconds without a tic. In the NCR condition, rewards are provided at a similar overall frequency as in the DRO condition, but at times unrelated to the timing of tics during the NCR session; Himle and colleagues used this approach to clarify the mechanism of the DRO condition’s tic reduction benefit4.

The TSP has been used in a number of studies, producing several interesting results5,6. For instance, tic suppression measured early after the onset of a tic disorder predicts clinical outcome 6–12 months later7. Additional studies using the TSP are being conducted in various research centers. In the course of conducting a longitudinal study of children with Provisional Tic Disorder8, we found that the TSP required substantial investigator effort. That is, a tic expert must watch the session, “live” or on a video recording, and note the presence and timing of each tic. Furthermore, in the DRO and NCR conditions a second staff member must repeatedly signal a device to provide a reward for each predefined tic-free interval. To reduce this effort, we wrote a simple program to facilitate record keeping and reward delivery during research sessions9. The expert observer pressed a button to record each tic observed, and in the DRO and NCR conditions the program delivered reward tokens at the appropriate times by connecting to a relay module that signaled a token dispenser box. This software improved convenience for the investigator and accuracy of record-keeping.

Because of enforced social distancing during the COVID 19 pandemic, the need arose for sessions to be performed remotely. A video calling program allowed us to observe the subjects, but we still needed a way to deliver rewards during the DRO and NCR conditions of the TSP. Previously, we had created a web-based program called TicTrainer for behavioral therapy10, and we decided to expand the functionality of that program so it could be used for TSP research. The new program allows the same functionality as the previous, in-person TicTimer software, providing audiovisual rewards at appropriate intervals on a web browser viewed by the participant, based on the timing of tics recorded remotely by the investigator. We present the software here11 to facilitate its use by others.

Methods

Implementation

TicTimer Web11 uses the node.js server that was made for TicTrainer. It adopts that program’s structure, with user accounts for research subjects and an admin account for the rater. Details on account registration, data storage, and logging on were described previously10.

A new field was added to user accounts so that a research ID (different from the ID used to log on) can be set for research subjects.

Sessions for TicTimer Web use separate but simultaneous connections to a server from a “user” and from a rater. TSP DRO sessions deliver rewards after every 10-s tic-free interval. To deliver rewards at the appropriate times, the user page checks in with the server periodically to see if it has been 10 seconds since the last tic was signaled by the rater. If it has not, the server responds with the time remaining until the next reward is due, and the user page uses that number, adjusted for the lag time of the round trip, to schedule when to check back with the server. Using this method, reward timing is synchronized so that rewards are delivered usually within 50 ms of the target time. The previous, in-person version of TicTimer used a token dispenser box to automatically deliver rewards at the appropriate times. In an attempt to approximate the user experience of the physical token dispenser, TicTimer Web delivers rewards by displaying coin images on the subject’s screen along with a chime sound.

At the end of each session, a summary is generated and appended at the bottom of the session log file, which is then archived with the date and time of the session in the filename.

Operation

Setup. First, node.js is installed on the server. We used an Amazon EC2 instance, but the program can operate on any computer with node.js (e.g. a laptop).

The researcher and subject need only a modern web browser to interface with TicTimer Web once the server is running. The browser must support JavaScript and HTML5. We have tested TicTimer Web with current versions of Chrome and Edge.

To perform sessions with TicTimer Web, the researcher creates a user account if needed, then if desired uses the admin interface to assign the user a research ID number to identify the subject for later data analysis.

Use. The researcher and subject sign in on their respective TicTimer session pages and the rater begins the session by selecting one of the four experimental conditions.

During a session, the rater watches the subject. We have used a separate video calling program for this observation, but a video camera or one-way mirror could be used for in-person visits. The rater records any observed tics by immediately pressing the “Tic Detected” button, the spacebar, or the letter “T”. If the session type includes rewards (DRO and NCR), they are dispensed appropriately. The session ends after the predetermined duration, or when the rater presses “End Session,” or when either rater or subject closes their browser window early.

For the NCR condition, the rater first chooses a log file previously created with the current subject, and rewards are delivered to the user at the same times (relative to the session start) that they were delivered in the specified session.

Archived session log files can be downloaded from the admin interface, or they can be copied over directly from the server itself.

Use cases

The video file (Extended data, Supplementary File 1)12 demonstrates the operation of TicTimer Web11 from a researcher’s perspective. The sessions performed here were test sessions with no human subjects being observed. Extended data, Supplementary Files 2–412 are the session log files created in that video.

Conclusions

The TicTimer Web11 program allows for remote implementation of the TSP, while maintaining the benefits of earlier versions of the software9: ease and accuracy of record keeping and automated reward delivery. TicTimer Web also simplifies the TSP, replacing a physical token dispenser box with any web browser, say a wireless tablet. While designed for our purposes in tic disorder research, TicTimer Web may find other uses. The most obvious of these may be for research on traditional habit disorders; for instance, hair pulling and skin picking appear in the “Obsessive-compulsive and related disorders” section of DSM-513. TicTimer Web may also have clinical applications. These may include documenting suppression ability before and after treatment and investigations of the chaotic nature of tic timing14, in addition to the previously described behavior therapy10.

Future modifications may include adding machine detection of tics, e.g. by audio-visual observation, surface EMG or accelerometry. Artificial intelligence and machine learning techniques may be able to use these inputs to recognize and mark the occurrence of specific tics. Such improvements would be quite welcome, as they might speed tic research or even allow automated behavior therapy. However, these methods are thus far difficult to reduce to practice; separating tics from normal adventitious movements is not trivial, and the wide variety of observed tics defies a unitary definition in terms of elementary movement features and timing.

Data availability

Underlying data

All data underlying the results are available as part of the article and no additional source data are required.

Extended data

Zenodo: TicTimer Web: software for measuring tic suppression remotely: Supplementary Files. http://doi.org/10.5281/zenodo.402313412.

This project contains the following extended data:

  • ttw_demo.mp4. (Supplementary File 1: Video Demonstration of Operation. A video demonstrating how to operate TicTimer Web from the researcher’s perspective.)

  • au5_20200622-153043_baseline.ttsd. (Supplementary File 2: Sample Log, baseline. Log file for the baseline session performed during the video demonstration.)

  • au5_20200622-153125_DRZ.ttsd. (Supplementary File 3: Sample Log, DRO. Log file for the DRO session performed during the video demonstration.)

  • au5_20200622-153214_NCR.ttsd. (Supplementary File 4: Sample Log, NCR. Log file for the NCR session performed during the video demonstration.)

License: MIT License.

Software availability

The source code for TicTimer Web is available at: https://github.com/jonkb/TicTrainer-node.

Archived source code at time of publication: https://doi.org/10.5281/zenodo.399047411.

License: MIT License.

Comments on this article Comments (0)

Version 2
VERSION 2 PUBLISHED 22 Oct 2020
Comment
Author details Author details
Competing interests
Grant information
Copyright
Download
 
Export To
metrics
Views Downloads
F1000Research - -
PubMed Central
Data from PMC are received and updated monthly.
- -
Citations
CITE
how to cite this article
Black JK, Koller JM and Black KJ. TicTimer Web: software for measuring tic suppression remotely [version 2; peer review: 2 approved]. F1000Research 2021, 9:1264 (https://doi.org/10.12688/f1000research.26347.2)
NOTE: If applicable, it is important to ensure the information in square brackets after the title is included in all citations of this article.
track
receive updates on this article
Track an article to receive email alerts on any updates to this article.

Open Peer Review

Current Reviewer Status: ?
Key to Reviewer Statuses VIEW
ApprovedThe paper is scientifically sound in its current form and only minor, if any, improvements are suggested
Approved with reservations A number of small changes, sometimes more significant revisions are required to address specific details and improve the papers academic merit.
Not approvedFundamental flaws in the paper seriously undermine the findings and conclusions
Version 2
VERSION 2
PUBLISHED 03 Mar 2021
Revised
Views
6
Cite
Reviewer Report 23 Mar 2021
Matthew W. Specht, Weill Cornell Medicine, New York City, NY, USA 
Jennifer Schild, Suffolk University, Boston, MA, USA 
Approved
VIEWS 6
The authors appear to have responded to our prior suggested ... Continue reading
CITE
CITE
HOW TO CITE THIS REPORT
Specht MW and Schild J. Reviewer Report For: TicTimer Web: software for measuring tic suppression remotely [version 2; peer review: 2 approved]. F1000Research 2021, 9:1264 (https://doi.org/10.5256/f1000research.54969.r80760)
NOTE: it is important to ensure the information in square brackets after the title is included in all citations of this article.
Version 1
VERSION 1
PUBLISHED 22 Oct 2020
Views
11
Cite
Reviewer Report 17 Feb 2021
Valerie Brandt, Department of Psychology, Centre for Innovation in Mental Health, University of Southampton, Southampton, UK 
Approved
VIEWS 11
The report describes the development of TicTimer Web, a nifty software that can be used to record tics, tic timings, and distribute reinforcement tokens during online experiments are therapeutic sessions. The authors describe that they adapted the TicTrainer programme to ... Continue reading
CITE
CITE
HOW TO CITE THIS REPORT
Brandt V. Reviewer Report For: TicTimer Web: software for measuring tic suppression remotely [version 2; peer review: 2 approved]. F1000Research 2021, 9:1264 (https://doi.org/10.5256/f1000research.29084.r77056)
NOTE: it is important to ensure the information in square brackets after the title is included in all citations of this article.
  • Author Response (F1000Research Advisory Board Member) 23 Feb 2021
    Kevin J Black, Department of Psychiatry, Washington University in St. Louis, St. Louis, 63110, USA
    23 Feb 2021
    Author Response F1000Research Advisory Board Member
    We thank Prof. Brandt for her kind comments.
    Competing Interests: No competing interests were disclosed.
COMMENTS ON THIS REPORT
  • Author Response (F1000Research Advisory Board Member) 23 Feb 2021
    Kevin J Black, Department of Psychiatry, Washington University in St. Louis, St. Louis, 63110, USA
    23 Feb 2021
    Author Response F1000Research Advisory Board Member
    We thank Prof. Brandt for her kind comments.
    Competing Interests: No competing interests were disclosed.
Views
22
Cite
Reviewer Report 20 Jan 2021
Jennifer Schild, Suffolk University, Boston, MA, USA 
Matthew W. Specht, Weill Cornell Medicine, New York City, NY, USA 
Approved with Reservations
VIEWS 22
This paper describes a timely and valuable tool for assessing tic suppression remotely in clinical and research settings. This web-based program is based on Woods and Himle’s standardized tic suppression paradigm (TSP) and performs the same function as a computer ... Continue reading
CITE
CITE
HOW TO CITE THIS REPORT
Schild J and Specht MW. Reviewer Report For: TicTimer Web: software for measuring tic suppression remotely [version 2; peer review: 2 approved]. F1000Research 2021, 9:1264 (https://doi.org/10.5256/f1000research.29084.r73543)
NOTE: it is important to ensure the information in square brackets after the title is included in all citations of this article.
  • Author Response (F1000Research Advisory Board Member) 23 Feb 2021
    Kevin J Black, Department of Psychiatry, Washington University in St. Louis, St. Louis, 63110, USA
    23 Feb 2021
    Author Response F1000Research Advisory Board Member
    We thank Ms. Schild and Dr. Specht for their thoughtful review, and will edit the report as they suggest.
    Competing Interests: No competing interests were disclosed.
  • Author Response (F1000Research Advisory Board Member) 03 Mar 2021
    Kevin J Black, Department of Psychiatry, Washington University in St. Louis, St. Louis, 63110, USA
    03 Mar 2021
    Author Response F1000Research Advisory Board Member
    Author responses are below, marked by the > sign and bold face, intercalated between sections of the original review.

    APPROVED WITH RESERVATIONS
    This paper describes a timely and valuable ... Continue reading
COMMENTS ON THIS REPORT
  • Author Response (F1000Research Advisory Board Member) 23 Feb 2021
    Kevin J Black, Department of Psychiatry, Washington University in St. Louis, St. Louis, 63110, USA
    23 Feb 2021
    Author Response F1000Research Advisory Board Member
    We thank Ms. Schild and Dr. Specht for their thoughtful review, and will edit the report as they suggest.
    Competing Interests: No competing interests were disclosed.
  • Author Response (F1000Research Advisory Board Member) 03 Mar 2021
    Kevin J Black, Department of Psychiatry, Washington University in St. Louis, St. Louis, 63110, USA
    03 Mar 2021
    Author Response F1000Research Advisory Board Member
    Author responses are below, marked by the > sign and bold face, intercalated between sections of the original review.

    APPROVED WITH RESERVATIONS
    This paper describes a timely and valuable ... Continue reading

Comments on this article Comments (0)

Version 2
VERSION 2 PUBLISHED 22 Oct 2020
Comment
Alongside their report, reviewers assign a status to the article:
Approved - the paper is scientifically sound in its current form and only minor, if any, improvements are suggested
Approved with reservations - A number of small changes, sometimes more significant revisions are required to address specific details and improve the papers academic merit.
Not approved - fundamental flaws in the paper seriously undermine the findings and conclusions
Sign In
If you've forgotten your password, please enter your email address below and we'll send you instructions on how to reset your password.

The email address should be the one you originally registered with F1000.

Email address not valid, please try again

You registered with F1000 via Google, so we cannot reset your password.

To sign in, please click here.

If you still need help with your Google account password, please click here.

You registered with F1000 via Facebook, so we cannot reset your password.

To sign in, please click here.

If you still need help with your Facebook account password, please click here.

Code not correct, please try again
Email us for further assistance.
Server error, please try again.