Keywords
FLSA ruling, postdoctoral salary, research enterprise, science policy, biomedical research, research funding, academic labor, institutional policy
This article is included in the Research on Research, Policy & Culture gateway.
This article is included in the Future of Research (FoR) collection.
FLSA ruling, postdoctoral salary, research enterprise, science policy, biomedical research, research funding, academic labor, institutional policy
The Fair Labor Standards Act (FLSA) (https://www.dol.gov/WHD/overtime/final2016/) establishes standards such as minimum wage and overtime pay for employees in both the public and private sectors in the United States. Through the FLSA a minimum wage and overtime pay (for working more than 40 hours per week) at 1.5 times the employee's regular rate are guaranteed (United States Department of Labor, 2016a).
On December 1 2016, the FLSA will be updated by the U.S. Department of Labor (DOL). One key change is an increase in the salary threshold for exemption from overtime pay from the 2004 level of $23,660 to $47,476. The other key change is indexing the salary level so that it is updated automatically every 3 years pegged to the 40th percentile of full-time salaried workers in the lowest-wage Census region, estimated by the DOL to be $51,168 in 2020. We first describe the timeline of how these updates were decided, and how they affect the postdoctoral researcher population.
On March 13 2014, a memorandum (https://www.whitehouse.gov/the-press-office/2014/03/13/presidential-memorandum-updating-and-modernizing-overtime-regulations) was issued by the White House from U.S. President Barack Obama to Secretary of Labor Thomas Perez, instructing the Department of Labor to investigate updating and modernizing current overtime regulations:
“I hereby direct you to propose revisions to modernize and streamline the existing overtime regulations. In doing so, you shall consider how the regulations could be revised to update existing protections consistent with the intent of the Act; address the changing nature of the workplace; and simplify the regulations to make them easier for both workers and businesses to understand and apply (Obama, 2014).”
On July 6 2015, the Department of Labor issued a “Notice of Proposed Rulemaking,” soliciting feedback by September 4 2015. The notice proposed increasing the current exemption salary of $23,660, set in 2004, to $50,440 in 2016, with automatic updates to the level every 3 years (Obama, 2015; United States Department of Labor, 2016b).
On May 18 2016, the Secretary of Labor, Thomas Perez, gave notice of the final decision on the updates to overtime regulations in the FLSA. The exemption salary would be set at $47,476 (lower than the $50,440 originally proposed) with updates every 3 years determined by future wage growth (United States Department of Labor, 2016f). The date for implementation was set as December 1 2016. Therefore, 2 years after the first indication of a change to overtime regulations, and just under a year from the indication of what those changes were likely to be, an additional 6 months allowance was made to prepare for compliance with the new rule.
As of Nov 1 2016, ongoing efforts to delay implementation of the new rule included H.R.6094, the Regulatory Relief for Small Businesses, Schools, and Nonprofits Act, which passed the U.S. House of Representatives on September 28 2016 by 246 votes to 177. It was then passed to the Senate on September 29 2016 (Congress of the United States of America, 2016). An emergency motion for preliminary injunction was also filed by 21 States (Anon, 2016).
The changes to the FLSA proposed on July 6 2015 stood to make a large impact on higher education. The large rise in the salary threshold for exemption had the potential to affect a wide range of workers in academe. As stated by the College and University Professional Association for Human Resources (CUPA-HR), affected employees could include: “librarians; advisers; counselors; residence hall managers; admissions counselors; financial aid counselors’ student activities officers; human resources professionals and trainers; accountants; head cashiers; textbook managers; ticket managers; alumni relations; fundraising professionals; head of mail services; farm managers; information technology professionals; research and clinical professionals (including many with advanced degrees and those engaged in advanced training such as postdocs); managers in food service, security and building and grounds. Many of these jobs have always been and are well suited to exempt status (CUPA-HR, 2015a).”
A concerted effort was therefore made to reduce the potential impact of FLSA changes on higher education. A letter to the Department of Labor was coordinated by CUPA-HR on behalf of 18 higher education organizations (CUPA-HR, 2015a; CUPA-HR, 2015b). Key recommendations made in the letter were: 1) the Department of Labor providing a longer time to adjust to the changes; 2) proposed lower salary level options of: $29,172, $30,004 or $40,352; and 3) rephrasing language to specifically exempt postdocs based on their “trainee” status in a similar manner to medical residents.
Similarly, the Association of American Medical Colleges (AAMC) submitted a letter supporting this position and adding:
“Any increase in the salary threshold for exemption should be graduated and incremental. AAMC recommends an initial threshold that does not exceed the National Institutes of Health (NIH) guidelines for postdoctoral stipends, currently set at $42,840 for new trainees in [fiscal year] 2015. In addition, postdoctoral scientists should be considered salaried, FLSA-exempt “learned professionals,” similar to medical residents (AAMC, 2015).”
On the other hand, in addition to postdocs themselves commenting on the ruling (Wexler, 2016), on May 10 2016 four unions representing postdocs or higher education employees (American Federation of State, County and Municipal Employees; Service Employees International Union; the United Auto Workers and the National Education Association) met with the Department of Labor to argue against institutional calls for exemption for postdoctoral researchers (Penn, 2016).
Attempts to exempt postdocs and to push for an exemption threshold below current postdoctoral salary levels were unsuccessful. With the announcement of updates to the FLSA, there was a simultaneous announcement that postdocs would not be exempt and would in fact be targeted by the ruling, discussed in the article co-authored by Director of the NIH Francis Collins and the Secretary of Labor Thomas Perez, “Fair Pay for Postdocs: Why We Support New Federal Overtime Rules (Collins & Perez, 2016).”
Employees must meet a series of tests in order to be exempt from overtime payments. First, they must be paid on a salary basis and not an hourly basis, by the “salary basis test.” Second, their salary must meet the minimum salary threshold of $913 per week or $47,476 annually, by the “salary level test” (which does not apply to doctors, lawyers or teachers). Finally, the employee’s primary job duty must pass the “standard duties test”. The duties test is either an executive exemption (e.g. managing a department), an administrative exemption (e.g. being in a primarily clerical role), or a professional exemption, such as that of a postdoc. Unless all 3 tests are passed, the employee is eligible for overtime payment.
The Department of Labor issued a summary of the impact that updates to the FLSA have on higher education (United States Department of Labor, 2016e) and guidance for higher education on compliance with the FLSA ruling (United States Department of Labor, 2016c). Limits to the impact of this ruling include exemptions for those who are in primarily teaching roles (such as adjunct faculty) and students (including undergraduate and graduate students) earning degrees. However, technical staff who are primarily carrying out benchwork and not clerical work are likely affected by the new ruling.
From this point, we will focus particularly on postdoctoral researchers in Science, Engineering and Health, as this population has been the focus of our data collection efforts. However all postdocs (in Science, Technology, Engineering and Math (STEM) disciplines, as well as in humanities and social sciences) primarily engaged in research (and not teaching) at an U.S. institution regardless of visa status and salary source are affected by this ruling as follows:
“Postdoctoral fellows are employees who conduct research at a higher education institution after the completion of their doctoral studies. Postdoctoral fellows are not considered students because they are not working towards a degree...Postdoctoral fellows often meet the duties test for the “learned professional” exemption but must also satisfy the salary basis and salary level tests to qualify for this exemption.” (United States Department of Labor, 2016c).
Raising postdoctoral salaries in the U.S. under the FLSA. Recommendations have been made across a wide swathe of academe, as summarized by Pickett et al. (Pickett et al., 2015). The American Academy of Arts and Sciences (American Academy of Arts and Sciences, 2014), the National Academies (Committee to Review the State of Postdoctoral Experience in Scientists and Engineers et al., 2014), senior biomedical researchers (Alberts et al., 2014), junior scientists (McDowell et al., 2014), organizations representing postdocs (National Postdoctoral Association, 2016) and advisory groups to the NIH (Biomedical Research Workforce Working Group, 2012) have all recommended increases to postdoc salaries in the years prior to the FLSA update, often to the level of at least $50,000, which is higher than the current required level of $47,476 for overtime exemption.
The Department of Labor has issued the following statement in its guidance to higher education about current postdoctoral salaries:
“Under the 2016 National Institutes of Health (NIH) salary guidelines for postdoctoral research fellows, some fellows earn more than the revised salary level. Other postdoctoral research fellows earn less, although it is the Department’s understanding that many postdoctoral research fellow salaries are close to the new salary level, and that any differences are not more than a few thousand dollars a year (United States Department of Labor, 2016c).”
There is an assumption that postdoctoral salaries are, on average, around $45,000 per year for a full-time postdoc (Collins & Perez, 2016) and that most institutions follow the NIH National Research Service Award (NRSA) stipend levels. In theory, therefore, the salary changes expected for postdocs in many cases should approximate the changes in the new NRSA levels (National Institutes of Health, 2016) as shown in Figure 1.
The current salary for postdocs on NRSA grants (blue) in 2016 increases from a minimum of $43,692 at a linear rate with increasing years experience. The FLSA ruling (red) will raise the minimum salary in 2017 to $47,484, which will remain relatively constant until 2 years experience and increase linearly therein (data source: NIH NOT-OD-16-134, (National Institutes of Health, 2016)).
The minimum salary should therefore rise from $43,692 for new postdocs to $47,484, which constitutes an increase of 8.7%. Thus, postdocs with more than 3 years of postdoctoral experience are, in theory, already exempt from this rule. However, it is difficult to gauge exactly how postdoctoral salaries are changing across the U.S. Transparent salary information for postdoctoral positions is very hard to find and the administration of postdocs (McDowell, 2016b) means that many may be on lower salaries than expected. It is not currently possible for all institutions in the United States to identify and obtain information on the salaries of all of their postdocs with certainty.
Another problem with the NRSA assumption is that not all institutions peg their salaries to NRSA levels, and institutional salary policies may indicate more realistic effects of the FLSA on salaries. In 2014, 89% of institutions had a minimum salary policy, where 51% of those institutions set their postdoctoral salary scales to the NRSA scale but ~30% set their minima lower and 7% did not enforce these policies (data in Figure 21, (Ferguson et al., 2014); for a visual description of this see also (McDowell, 2016)). It is also unclear how many postdocs are employed at each of these institutions (populations potentially from 1 to 5761, according to 2014 data from the National Science Foundation (NSF, (National Science Foundation, n.d.))) and therefore the number of U.S. postdocs at different points on this salary range is also unclear. If 11% of U.S. institutions haven’t set a minimum salary level, it is therefore possible (and legal) that there may be full-time postdocs currently earning as little as $23,660, and these salaries will need to double if they are to meet the FLSA exemption ruling.
Implementing the salary change. Institutions have the choice to either increase the minimum salary for postdocs to $47,476, or to classify postdocs as hourly workers.
The first option is difficult because there is no extra money for this ruling, and PIs may have to pay postdocs from research grants such as R01 grants. Salaries of postdocs on training grants/fellowships (NRSA, HHMI and possibly NSF) are likely to be increased (National Institutes of Health, 2016; National Science Foundation, 2016).
The second option, however, may cost more. It would involve implementing a system for keeping track of the hours that postdocs spend in the lab. Many postdocs work, and are expected to work, in excess of a standard 40-hour week. One calculation posits that a postdoc earning the NRSA minimum of $43,692 working 50 hours a week under the new rule would have an increase in salary to $60,076 (Polka, 2016).
In an effort to make salary information as transparently available as possible, we have been gathering information at the FLSA and postdocs resource at Future of Research (Future of Research, 2016b). This data-gathering has involved checking university websites and contacting HR departments at institutions for information on complying with the FLSA ruling for postdocs. We made it clear that this information is to be made publicly available, using as our guide data from the 2014 NSF Survey of Graduate Students and Postdoctorates in Science and Engineering (National Science Foundation, n.d.) using the total number of Science, Engineering and Health postdocs as our postdoc population (as all postdocs are affected). We are in a position, with one month prior to implementation, to describe the current landscape of publicly available information on changes to the administration of postdocs in compliance with the FLSA.
The only other datasource that is publicly available on this is a survey by the Council on Governmental Relations conducted of their membership in August (Council on Governmental Relations, 2016). Of 190 member institutions, 109 responded, 68 of which had medical schools. Out of these, 79 were public institutions and 30 were private.
In August, 63% claimed to have made a decision, 19% said the decision would be made in September, and 15% said their decision would be made in October. Therefore 97% surveyed by now, with a month before implementation, should have made a decision. Based on decisions that institutions made or were leaning towards, the survey reported 75% of institutions would raise salaries, and 25% would allow the tracking of hours, 55% of which leave the decision up to the individual PI. Also, 96 institutions have reported on salary levels with ⅔ reporting at least 50% of salaries, and ¼ reporting at least 75% of salaries were below the new threshold, and 2% reported that 90% of salaries exceeded the new threshold.
In a recent blogpost for Addgene, we reported data that had been collected so far (McDowell, 2016a). In this analysis, we looked at both the percentage of the postdoctoral workforce at institutions implementing various plans for the FLSA, as well as provided data on the percentage of institutions implementing various FLSA plans, as of October 21 2016.
Repeating this analysis a month before compliance is required, we are now able to discuss data for institutions that we have checked or contacted covering 97.5% of the estimated postdoctoral workforce, or every U.S. higher education institution listed in the NSF dataset with > 35 postdocs in 2014 (Dataset 1).
Out of these, 51% of the estimated postdoctoral workforce comes from institutions that have stated they are raising salaries,1.5% from institutions focused on tracking hours, and 4% from institutions allowing the tracking of hours while promoting (but not mandating) salary raising. However, still 41% of postdocs come from institutions that have either reported to us that they have not decided, have no information available, and/or have not yet responded to a request for information (Figure 2A).
Pie charts show the percentage of the postdoctoral population at institutions implementing various plans for FLSA (A) and the percentage of institutions implementing various plans for FLSA (includes institutions so far researched for the FLSA and postdocs resource) (B).
One month away from Dec 1st, we have now checked 56% of institutions, and of those checked, 35.5% are planning to raise salaries, and 57% have no public decision yet available (Figure 2B).
To illustrate the point of what postdocs may know at this point in time, with one month prior to implementation, we take Boston postdocs as an example. The Boston Postdoctoral Association has been taking an active role in gathering institutional information and preparing resources on the FLSA for its members (Boston Postdoctoral Association, 2016). There are 14 academic postdoctoral associations in the Boston Postdoctoral Association (http://bostonpostdocs.org/) and we list them here along with the numbers of postdocs from the NSF dataset we used for our analysis (where known: “Harvard” and “MIT” are each listed as a single institution) and current estimates of 9,000 postdocs in Boston (Table 1).
*Unknown number out of 5,761 at “Harvard” and **Unknown number out of 1,516 at “MIT”
Out of 9,000 postdocs in Boston, data about postdoc numbers and salaries are known for only 740. Whitehead Institute for Biomedical Research and the Department of Brain and Cognitive Sciences cannot be more than a small proportion of the 1,516 at MIT, while Boston Children’s, Dana Farber, Harvard Chan School of Public Health and Harvard University may be a larger number out of 5,761 but likely not the majority. It could be that as many as two thirds of postdocs in Boston - a very well organized group of postdocs already gathering information - are not aware of what their status will be in a month, either because they have not been told, or their institution has not yet made a decision.
We are assuming that all institutions will make information transparently and publicly available, whereas of course there is bound to be a great variation in the institutions that will publish postdoc salary information on the web or respond to queries for FLSA compliance information, and this does not seem to be linked to the size of the institution.
Some institutions (such as “Harvard” and “MIT”) are listed as a single institution in the NSF dataset, and as we have so little data for each (as discussed above) we count them as not having yet made decisions. Combined with previous discussions that the NSF dataset may only approximate postdoc numbers, and this is 2014 data (not up to date), the numbers likely have some degree of variation. Also, in contrast to the Council on Governmental Relations report of August, we see a very striking difference in what has been publicly declared compared with private data. Decisions that have been made this time were predicted to be at 97% whereas we have found only 47% have publicly done so. The ratio of institutions planning to raise salaries to those planning to track hours was 3:1 in the report whereas our data show the ratio closer to 9:1.
We have not yet done a thorough analysis comparing salary reporting by region, or comparing between public and private institutions, however we hope to carry out this analysis as data continues to be collected through December 1st.
Are postdocs on fellowships FLSA exempt? Both Brown and Brandeis universities have suggested that postdocs paid on training grant/fellowship stipends may be FLSA exempt, and so will not be mandating raises in the salaries of postdocs on stipends that are below the exemption level. At the time of writing this manuscript, we are still awaiting responses to requests for further information from institutions. Nevertheless, the position of Brown University is stated explicitly as follows:
“Postdoctoral fellows are defined as non-employees, paid by stipend rather than salary, and are thus not covered by the FLSA (Brown University, 2016).”
The position of Brandeis University is stated publicly on their website as follows (with info that salaries need to be raised for postdoctoral associates, but with no mention of fellows):
“Postdoctoral Fellows come to Brandeis to further their scholarly competence, with fellowship aid through sources other than the NRSA. These sources may be federal or non-federal. Appointments are usually for one semester or more and are renewable, based upon the terms and conditions of the individual award. Postdoctoral Fellows are trainees and do not provide services to the University, and are not considered to be employees. A Postdoctoral Fellow is eligible to be appointed as a Postdoctoral Associate after the term of the Postdoctoral Fellowship has ended (Brandeis University, 2016).”
Postdoctoral fellows are not considered employees by institutions, as they are not paid by the institution. However, reading the directions from the Department of Labor, that is not the same as being recognized as exempt from the FLSA. A postdoc is federally recognized as both a trainee and an employee (Code of Federal Regulations, Title 2, part 200.400(f) (U.S. Government, 2014)) and unless they are in a primarily teaching role, all postdocs come under the FLSA (see Overtime Final Rule and Higher Education (United States Department of Labor, 2016c)). In addition, the Department of Labor defines what “employ’ means in the context of the FLSA:
“The FLSA defines the term “employ” to include the words “suffer or permit to work”. Suffer or permit to work means that if an employer requires or allows employees to work, the time spent is generally hours worked (United States Department of Labor, n.d.).”
The “employer” is the institution that “suffers [someone] to work,” so institutions are the ones responsible for ensuring FLSA compliance. Postdoc fellows are “permitted” to work at the institution. In combination with further guidance from the Department of Labor on independent contractors, the closest possible analogy to postdoctoral fellows (United States Department of Labor, 2014), it is our understanding that if fellowships do not pay full FLSA rates, the employer is still responsible for making sure employees get supplemented up to federal standards. What matters is not where the money comes from, but what a person is doing at an institution that “suffers or permits them to work” there. Guidance in the latest update to the NRSA stipends and applying for supplements (NOT-OD-17-002) makes clear that NIH is taking no position on the status of workers at institutions (National Institutes of Health, 2016).
This may become part of the larger conflict in the debate over whether postdocs are trainees or employees, and what services (including intellectual property) they do or do not provide (Haak, 2002a; Haak, 2002b; Haak, 2002c). This may aggravate existing issues with postdoctoral fellowships, as recipients already face losing benefits (Gaval, 2014), or dealing with tax complications such as imputed income tax (National Postdoctoral Association, n.d.; University of California San Francisco 2015). Elsewhere we have discussed changes that may be taking place to postdoctoral benefits, such as reductions in fringe rates, as a similar but separate effect of the FLSA implementation at institutions (Future of Research, 2016a).
If violations to the FLSA ruling occur, will they be reported? One question that has occupied some discussion about the FLSA is whether violations, such as directing employees to give false reports on timesheets, will actually be reported. The Department of Labor gives advice on how to report these violations (United States Department of Labor, 2016d) and points out that there is a three year statute of limitations, reporting is completely confidential until the point of allegation being pursued and the person then deals with the Department of Labor and not the institution, in reporting violations. In addition, it is illegal for employers to take action against employees based on reporting of violations, and immigration status will not be investigated.
A comparison is often made about the perceived lack of reporting hours’ violations during medical residency, a similar role in the medical system to the postdoc in academia, and so we use this comparison here to illustrate why reporting could be more common in academic science. First, medical residents are exempt from FLSA so a different system of reporting exists to begin with. Medical residents can have up to an additional ~$250,000 debt for tuition, compared to the relatively lower (undergraduate) student debts in the academic path, as well as the cultural eschewing of financial gain, and perhaps have more “skin in the game”. The bottleneck in the medical system is often getting into residency, from where job certainty is much higher than in academia, whereas most postdocs end up leaving academia despite a high interest in staying in it (Sauermann & Roach, 2016). In addition, medical residents may consider that reporting hours may actually harm their own training and the training of others, whereas whether many postdocs actually receive training is of great concern in academe (Pickett et al., 2015) and perhaps the perceived harm to that training may be seen as minimally impacting them. All of this, combined with the 3-year statute of limitations, makes “burning bridges” a much stronger possibility for postdocs.
If a violation of the FLSA is reported, it seems that the burden of proof is on the institution to counter the evidence from the complaint (discussed in (American Council on Education, 2016)). There are many common false assumptions being discussed in academia about how federal labor law can be implemented (Reynolds & Rudnick, 2010), which makes it very interesting that a number of institutions will let departments, or even PIs, decide on how to administer postdocs.
Moving towards greater transparency in postdoc salaries. Our goal in presenting these data is to increase transparency about the postdoc position, in terms of the administration and benefits, in a similar manner to a call for transparency in career outcomes (Polka et al., 2015). We have presented our impression of the information currently available to postdocs about how their roles may be changing in one month, and aim to continue collecting and further analyzing data as we go forward until December 1, 2016.
Possible effects of the FLSA ruling. Tracking hours runs counter to academic culture, and the notion of the postdoc as a “trainee”, someone in a mentored environment developing independence. It is also in contrast to behaviors learned in graduate school and the working culture of the faculty positions to which postdocs are meant to be directed. Analyzing data, writing and reading papers and carrying out other job related duties of the postdoc are often performed during nights and weekends, while away from the lab. How will those hours be tracked to everyone’s satisfaction? Conflicts arising could force postdocs to work fewer hours and thus make themselves less competitive compared to postdocs exempted by salary level or under/over-report their hours, risking reporting violations to the Department of Labor. An institution that tracks hours could also put its postdocs and PIs at a competitive disadvantage compared to other institutions raising salaries. At the moment, the relatively small numbers of institutions tracking hours suggest that the larger implications of the FLSA may be as a result of the raise in postdoctoral salaries.
It is unclear what the effects of the FLSA ruling may be on academe. How will this affect smaller institutions? Will there be a drop in new postdoc hires as they become more expensive? How many postdocs are about to lose their jobs? How many will have to shorten their current positions? Will junior faculty bear the brunt, will mid-career researchers be most strained, or will tenured professors be more likely to cut postdocs loose? Will institutions look to increase admission of graduate students, to keep up the labor at the bench? Will there be a shift to more postdocs on particular training mechanisms or fellowships, where the salary is provided, and less on other types of fellowships or research grants?
Perhaps most importantly, will we as a research enterprise start acting on recommendations in a more timely fashion? The academic system will survive this modernization, and in the long term the likely decrease of the postdoctoral population may be a necessary cap on the expanding “trainee” population. This will make the research enterprise more sustainable by limiting the number of postdocs in the system that can be supported. The FLSA ruling change could have been handled far better by the system in favor of postdocs and hopefully is a call to action in terms of how to deal with other issues affecting the research enterprise in the future. The FLSA ruling imposes changes on the system, but these changes had been recommended for some time and could have been implemented more gradually, and with less pain inflicted on postdoctoral researchers (and not only), than they are now. How to correctly deal with the administration of postdocs at institutions has been in discussion over decades (Curtis, 1969), and raising postdoc salaries has been advocated for as we also describe above. Will other recommended changes within the research enterprise be made by the deliberate action of scientists and administrators, or will they have to be imposed by federal statutes? We hope that the abrupt nature of the FLSA revision serves as a call to redouble efforts for academia to become the driver, rather than the subject, of change.
F1000Research: Dataset 1. FLSA status of postdocs as of 10/31/16, http://dx.doi.org/10.5256/f1000research.10086.d142615 (Bankston & McDowell, 2016)
GS conceived the study and designed the experiments. AB and GS carried out the research. AB collected a large portion of the data. GS made the figures and wrote the manuscript with extensive editing input from AB. The final version was approved by both AB and GS.
This work was supported by a grant from the Open Philanthropy Project to Future of Research, awarded in April 2016.
The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Many thanks to Jessica Polka, David Riglar and Rodoniki Athanasiadou for comments on the manuscript, and Chris Pickett for discussions. Future of Research is supported by a grant from the Open Philanthropy Project (http://www.openphilanthropy.org/focus/scientific-research/miscellaneous/future-research-general-support).
Views | Downloads | |
---|---|---|
F1000Research | - | - |
PubMed Central
Data from PMC are received and updated monthly.
|
- | - |
Competing Interests: No competing interests were disclosed.
Competing Interests: No competing interests were disclosed.
Competing Interests: No competing interests were disclosed.
Alongside their report, reviewers assign a status to the article:
Invited Reviewers | |||
---|---|---|---|
1 | 2 | 3 | |
Version 2 (revision) 28 Sep 17 |
read | read | |
Version 1 17 Nov 16 |
read | read | read |
Click here to access the data.
Spreadsheet data files may not format correctly if your computer is using different default delimiters (symbols used to separate values into separate cells) - a spreadsheet created in one region is sometimes misinterpreted by computers in other regions. You can change the regional settings on your computer so that the spreadsheet can be interpreted correctly.
Provide sufficient details of any financial or non-financial competing interests to enable users to assess whether your comments might lead a reasonable person to question your impartiality. Consider the following examples, but note that this is not an exhaustive list:
Sign up for content alerts and receive a weekly or monthly email with all newly published articles
Already registered? Sign in
The email address should be the one you originally registered with F1000.
You registered with F1000 via Google, so we cannot reset your password.
To sign in, please click here.
If you still need help with your Google account password, please click here.
You registered with F1000 via Facebook, so we cannot reset your password.
To sign in, please click here.
If you still need help with your Facebook account password, please click here.
If your email address is registered with us, we will email you instructions to reset your password.
If you think you should have received this email but it has not arrived, please check your spam filters and/or contact for further assistance.
Comments on this article Comments (1)