ALL Metrics
-
Views
-
Downloads
Get PDF
Get XML
Cite
Export
Track
Correspondence
Revised

Ocular disconjugacy cannot be measured without establishing a solid spatial reference

[version 2; peer review: 1 approved, 2 approved with reservations]
(Previously Titled: 'Ocular disconjugacy cannot be measured without establishing a solid reference')
PUBLISHED 22 Apr 2015
Author details Author details
OPEN PEER REVIEW
REVIEWER STATUS

This article is included in the Eye Health gateway.

Abstract

This correspondence points out a need for clarification concerning the methodology utilized in the study “Eye tracking detects disconjugate eye movements associated with structural traumatic brain injury and concussion”, recently published in Journal of Neurotrauma. The authors of the paper state that binocular eye movements were recorded using a single-camera video-oculography technique and that binocular disconjugate characteristics were analyzed without calibration of eye orientation. It is claimed that a variance-based disconjugacy metric was found to be sensitive to the severity of a concussive brain injury and to the status of recovery after the original injury. However, the reproducibility of the paper’s findings may be challenged simply by the paucity of details in the methodological description. More importantly, from the information supplied or cited in the paper, it is difficult to evaluate the validity of the potentially interesting conclusions of the paper.

Keywords

Mild traumatic brain injury, mTBI screening, vergence

Revised Amendments from Version 1

The main goals of this revision were: 1) to emphasize that disconjugacy is spatial in nature, and thus a solid spatial reference is needed; and 2) to add details on the forms of asymmetries that may exist because of the geometries among the camera, the light source, and the eyes.

See the author's detailed response to the review by Marcus Nyström
See the author's detailed response to the review by Christopher Tyler

Correspondence

I wish to point out a need for clarification concerning the methodology utilized in the study “Eye tracking detects disconjugate eye movements associated with structural traumatic brain injury and concussion” by Samadani et al., 20151. The authors state that binocular eye movements were recorded using a single-camera infrared-based video-oculography technique (EyeLink 1000, SR Research, Ontario, Canada) and that binocular disconjugate characteristics were analyzed without calibration of eye orientation. The authors claim that their variance-based disconjugacy metric was sensitive to the severity of a concussive brain injury and to the status of recovery after the original injury.

The EyeLink 1000 system is an excellent eye tracker with a single high resolution camera and an infrared light source affixed to a side of the camera. This system uses a dark pupil-corneal reflection principle for tracking eye movements. A typical recording setup consists of a computer monitor with which the visual stimuli are presented to the subject and the camera unit (placed in front of the monitor base) with which the eye movement is recorded monocularly or binocularly. The system has an option of easily outputting image-based, uncalibrated eye coordinates with hundreds of units representing 1° of eye rotation.

The concern I would raise with the Samadani et al. paper is the unclearness of the relationship between their metric and binocular disconjugacy. Logically, for an identical amount of eye rotation, any asymmetry in the spatial relationship that the camera or the infrared light source has with the two fellow eyes would result in different extents of relocation of the images of the pupils or corneal reflections. Asymmetries exist because there is a physical separation between the two eyes as well as between the camera and the infrared light source. For instance, the camera may be centered in front of the subject to obtain a symmetric view of the pupils for a gaze along the midline, but the infrared light source cannot be centered simultaneously, the consequence of which is an asymmetric view of the corneal reflections.

The individually variable physical separation of the two eyes contributes to variations in the extent of asymmetry in the camera view of the landmark features of the eyes. It may be asserted that the group-wise comparisons utilized by Samadani et al. are robust to effects of subject-wise asymmetry and the equally constant lack of calibration. However, a systematic between-group bias may be created when the demographic composition of the subject groups are different. For example, having a larger male-to-female ratio in one group could increase the extent of binocular asymmetry in uncalibrated data since men tend to have a larger interocular distance2,3. Incidentally, Samadani et al. note a tendency toward the positive head CT group having more males than the non-injured control group, with the positive head CT group of 13 patients being 35.9% female and the control group of 64 subjects being 47.9% female. (Curiously, the percentage of female subjects times the group size does not yield a whole number in any of the four subject groups in the Samadani et al. paper.)

There are still other variables that confound the relationship between eye rotation and changes in pixel coordinates. Although the biometric characteristics of eyes are highly symmetrical within individuals, they are not perfectly symmetrical4 and a 1–2% non-conformity in corneal curvature or axial length is not uncommon. Each of the two fellow eyes has its own function that maps pixel movement to the eye rotation, and this mapping is not linear. Thus, the arithmetic difference between the uncalibrated coordinates of the two eyes is quite removed from a physical representation of gaze misalignment.

Beyond the factors associated with the raw data, the analytic methods in the paper also do not seem to be constructed with a clear intent. It is puzzling why the disconjugacy metric is represented by the variance of the left-right differences after independently averaging for each eye the uncalibrated coordinates over several cycles for a given stimulus position, as opposed to the straightforward variance of the left-right differences at all sample points. Furthermore, the ranges of outcome values presented in the series of figures run from 0 to at most 0.25, but how the value 0 could have been obtained is not clear. The question arises because in the two eyes’ uncalibrated coordinates there must be a constant bias related to the interocular distance. Lastly, what the high end of the outcome range represents is not clear. Since one unit in EyeLink’s uncalibrated data output is smaller than 0.01° of eye rotation, being able to report differences in 0.25 square units or less seems implausible. If the raw data were numerically centered or scaled, the procedure should have been noted in the text.

Since disconjugacy is spatial in nature, a solid reference is needed. The authors discuss some valid points regarding potential pitfalls associated with calibration and phoria. However, these points can be directly addressed by implementing a calibration procedure under monocular viewing5,6. A comparison between the results from thus calibrated and uncalibrated data, and a demonstration of test-retest reliability could have improved the paper.

In summary, the reproducibility of the paper’s findings may be challenged simply by the paucity of details in the methodological description. More importantly, however, from the information supplied or cited in the paper it is difficult to evaluate the validity of the potentially interesting conclusion that deficits in conjugacy of eye movements may quantitate physiologic impact of brain injury.

Comments on this article Comments (0)

Version 2
VERSION 2 PUBLISHED 17 Mar 2015
Comment
Author details Author details
Competing interests
Grant information
Copyright
Download
 
Export To
metrics
Views Downloads
F1000Research - -
PubMed Central
Data from PMC are received and updated monthly.
- -
Citations
CITE
how to cite this article
Maruta J. Ocular disconjugacy cannot be measured without establishing a solid spatial reference [version 2; peer review: 1 approved, 2 approved with reservations]. F1000Research 2015, 4:71 (https://doi.org/10.12688/f1000research.6162.2)
NOTE: If applicable, it is important to ensure the information in square brackets after the title is included in all citations of this article.
track
receive updates on this article
Track an article to receive email alerts on any updates to this article.

Open Peer Review

Current Reviewer Status: ?
Key to Reviewer Statuses VIEW
ApprovedThe paper is scientifically sound in its current form and only minor, if any, improvements are suggested
Approved with reservations A number of small changes, sometimes more significant revisions are required to address specific details and improve the papers academic merit.
Not approvedFundamental flaws in the paper seriously undermine the findings and conclusions
Version 2
VERSION 2
PUBLISHED 22 Apr 2015
Revised
Views
13
Cite
Reviewer Report 15 May 2015
Marcus Nyström, Humanities Laboratory, Lund University, Lund, Sweden 
Approved with Reservations
VIEWS 13
I agree with the methodological aspects that the author highlights in his correspondence, and that the Samadani et al. paper would have been improved by a more detailed description of their methods as well as a validation or their method ... Continue reading
CITE
CITE
HOW TO CITE THIS REPORT
Nyström M. Reviewer Report For: Ocular disconjugacy cannot be measured without establishing a solid spatial reference [version 2; peer review: 1 approved, 2 approved with reservations]. F1000Research 2015, 4:71 (https://doi.org/10.5256/f1000research.6868.r8688)
NOTE: it is important to ensure the information in square brackets after the title is included in all citations of this article.
  • Author Response 19 May 2015
    Jun Maruta, Brain Trauma Foundation, One Broadway, 6th Floor, New York, NY 10007, USA
    19 May 2015
    Author Response
    Since it is not clear what Samadani et al. did to obtain the values associated with the described outcome metrics, a quantitative investigation is difficult. To the extent it is ... Continue reading
COMMENTS ON THIS REPORT
  • Author Response 19 May 2015
    Jun Maruta, Brain Trauma Foundation, One Broadway, 6th Floor, New York, NY 10007, USA
    19 May 2015
    Author Response
    Since it is not clear what Samadani et al. did to obtain the values associated with the described outcome metrics, a quantitative investigation is difficult. To the extent it is ... Continue reading
Views
12
Cite
Reviewer Report 24 Apr 2015
Christopher Tyler, Brain Imaging Center, Smith-Kettlewell Eye Research Institute, San Francisco, CA, USA 
Approved with Reservations
VIEWS 12
The title of the piece is not logically correct, and needs further modification. Although the author’s clarification explains how the asymmetry of the light source could, in principle lead to discrepancies in the measurement of ocular disconjugacy, it is based ... Continue reading
CITE
CITE
HOW TO CITE THIS REPORT
Tyler C. Reviewer Report For: Ocular disconjugacy cannot be measured without establishing a solid spatial reference [version 2; peer review: 1 approved, 2 approved with reservations]. F1000Research 2015, 4:71 (https://doi.org/10.5256/f1000research.6868.r8471)
NOTE: it is important to ensure the information in square brackets after the title is included in all citations of this article.
  • Author Response 30 Apr 2015
    Jun Maruta, Brain Trauma Foundation, One Broadway, 6th Floor, New York, NY 10007, USA
    30 Apr 2015
    Author Response
    It seems that this Correspondence is somehow viewed as an attempt to explain the findings of Samadani et al. This responsibility rests with Samadani et al. In my view, that ... Continue reading
COMMENTS ON THIS REPORT
  • Author Response 30 Apr 2015
    Jun Maruta, Brain Trauma Foundation, One Broadway, 6th Floor, New York, NY 10007, USA
    30 Apr 2015
    Author Response
    It seems that this Correspondence is somehow viewed as an attempt to explain the findings of Samadani et al. This responsibility rests with Samadani et al. In my view, that ... Continue reading
Version 1
VERSION 1
PUBLISHED 17 Mar 2015
Views
23
Cite
Reviewer Report 08 Apr 2015
Christopher Tyler, Brain Imaging Center, Smith-Kettlewell Eye Research Institute, San Francisco, CA, USA 
Not Approved
VIEWS 23
Overall, this Correspondence does not offer a significant criticism of the paper of Samadani et al. (2015). The author does not specify what kinds of asymmetries exist due to the camera/source geometry. Usually the subject is centered in the Eyelink ... Continue reading
CITE
CITE
HOW TO CITE THIS REPORT
Tyler C. Reviewer Report For: Ocular disconjugacy cannot be measured without establishing a solid spatial reference [version 2; peer review: 1 approved, 2 approved with reservations]. F1000Research 2015, 4:71 (https://doi.org/10.5256/f1000research.6606.r8105)
NOTE: it is important to ensure the information in square brackets after the title is included in all citations of this article.
  • Author Response 13 Apr 2015
    Jun Maruta, Brain Trauma Foundation, 7 World Trade Center, 34th Floor, 250 Greenwich Street, NY 10007, USA
    13 Apr 2015
    Author Response
    I thank Dr. Tyler for his comments and the opportunity to think through what I had written again. One revision I can make in the second paragraph of the original ... Continue reading
COMMENTS ON THIS REPORT
  • Author Response 13 Apr 2015
    Jun Maruta, Brain Trauma Foundation, 7 World Trade Center, 34th Floor, 250 Greenwich Street, NY 10007, USA
    13 Apr 2015
    Author Response
    I thank Dr. Tyler for his comments and the opportunity to think through what I had written again. One revision I can make in the second paragraph of the original ... Continue reading
Views
19
Cite
Reviewer Report 31 Mar 2015
Johannes van der Steen, Department of Neuroscience, Erasmus Medical Center, Rotterdam, The Netherlands 
Approved
VIEWS 19
The author makes a justified appeal for clarification of methodological issues concerning the study “Eye tracking detects disconjugate eye movements associated with structural traumatic brain injury and concussion” by Samadani et al., 2015. The arguments raised by J. Maruta are very valid. Apart from ... Continue reading
CITE
CITE
HOW TO CITE THIS REPORT
van der Steen J. Reviewer Report For: Ocular disconjugacy cannot be measured without establishing a solid spatial reference [version 2; peer review: 1 approved, 2 approved with reservations]. F1000Research 2015, 4:71 (https://doi.org/10.5256/f1000research.6606.r7999)
NOTE: it is important to ensure the information in square brackets after the title is included in all citations of this article.

Comments on this article Comments (0)

Version 2
VERSION 2 PUBLISHED 17 Mar 2015
Comment
Alongside their report, reviewers assign a status to the article:
Approved - the paper is scientifically sound in its current form and only minor, if any, improvements are suggested
Approved with reservations - A number of small changes, sometimes more significant revisions are required to address specific details and improve the papers academic merit.
Not approved - fundamental flaws in the paper seriously undermine the findings and conclusions
Sign In
If you've forgotten your password, please enter your email address below and we'll send you instructions on how to reset your password.

The email address should be the one you originally registered with F1000.

Email address not valid, please try again

You registered with F1000 via Google, so we cannot reset your password.

To sign in, please click here.

If you still need help with your Google account password, please click here.

You registered with F1000 via Facebook, so we cannot reset your password.

To sign in, please click here.

If you still need help with your Facebook account password, please click here.

Code not correct, please try again
Email us for further assistance.
Server error, please try again.