Keywords
research value; research waste; qualitative research; high-quality research; femoroacetabular impingement syndrome; primary cam morphology;
This article is included in the Research on Research, Policy & Culture gateway.
Primary cam morphology, an acquired bony prominence at the head-neck junction of the femur, is highly prevalent in athlete populations, and causally associated with femoroacetabular impingement syndrome and early hip osteoarthritis. Experts agreed on key elements for primary cam morphology and a prioritised research agenda for the field. This research agenda will require higher-quality research to achieve meaningful progress on the aetiology, prognosis and treatment of primary cam morphology in athletes.
To explore stakeholders’ perspectives of high-quality research in the research field of primary cam morphology and its natural history.
Grounded in interpretive description, we used semi-structured interviews to explore stakeholders’ perspectives of high-quality research in the primary cam morphology research field. The framework for INcreasing QUality In patient-orientated academic clinical REsearch (INQUIRE) informed the interview guide. Audio-recorded interviews were transcribed and analysed using thematic analysis. We recruited a heterogenous and purposive maximum variation sample, drawing from a network of research contacts.
Fifteen individuals, several with multiple perspectives on research quality in the field, participated. Exploring stakeholders’ perspectives on research quality through an established research quality framework (INQUIRE) illuminated areas for immediate action for research communities in the field of primary cam morphology and its natural history. We crafted five action inviting themes: research communities should: partner with athletes/patients; champion equity, diversity and inclusion; collaborate with one another; pursue open science; and nurture young scholars.
The findings of this study could inform concrete actions by research communities to pursue higher quality research—more research value and less waste—in the field of primary cam morphology and its natural history. Although the five action-inviting themes reflect contemporary trends in research, and could therefore be transferable to other areas of research, their practical application remains context- and field-specific.
research value; research waste; qualitative research; high-quality research; femoroacetabular impingement syndrome; primary cam morphology;
Primary cam morphology develops as a largely benign prominence at the head-neck junction of the hip in many young athletes.1 The risk of developing primary cam morphology is associated with the level of athletic activity during skeletal growth.2–4 Although largely benign, this morphology is associated with femoroacetabular impingement (FAI) syndrome,5 and causes early hip osteoarthritis, with potentially significant consequences for hip-health and athletic careers.6–9 Despite the morphology’s high prevalence (up to 80% in many athletic populations10), many questions remain unanswered. For example, to date, no prospective studies have examined this morphology’s formation and/or prognosis in girls or in populations from the Global South. Scientists cannot yet predict the individuals who might develop the morphology or its hip disease consequences, or who might need their hips replaced. Multi-centre and multi-profession collaboration to produce higher quality research with impact is paramount when promoting research value and avoiding research waste.11
A concept analysis of primary cam morphology was an important first milestone towards more clarity on the morphology and its natural history.1 In addition, the Young Athlete’s Hip Research (YAHiR) Collaborative’s Aspetar-Oxford-La Trobe Young Athlete’s Hip Webinar Series, which delivered 11 webinars during the Covid-19 pandemic, contributed to mobilising an international community of athletes, patients, clinicians, and researchers interested in improving clinical outcomes through coproducing knowledge in the field. This collaboration paved the way for the Oxford Consensus Study on primary cam morphology definitions, terminology, taxonomy, and imaging outcomes as well as a prioritised research agenda on conditions affecting the young person’s hip.12,13 However, at the time of the empirical work described below, no peer reviewed evidence existed on the perspectives of stakeholders in this research field on factors contributing to high quality research. Informed by the comprehensive framework for INcreasing QUality In patient-orientated academic clinical REsearch (INQUIRE),14 we aimed to address this gap.
This study aimed to explore research quality on primary cam morphology and its natural history through the perspectives of athletes, patients, parents and coaches, clinicians, and researchers. Exploring stakeholders’ diverse perspectives on high-quality research through the lens of an existing research quality framework (INQUIRE) could pave the way for authentic collaboration to enhance research quality on primary cam morphology and its natural history.
In this section, we discuss the ontological and epistemological orientation, study design, ethical considerations, sampling strategy, data collection and analysis, and research team reflexivity for this study.
This was a descriptive qualitative study,15,16 situated within a pragmatism-informed interpretive description research paradigm.17–19 By ‘pragmatism-informed’ in this context, we mean drawing on the practical wisdom of practitioners and oriented to informing their practice in concrete situations. An interpretative orientation acknowledges that human experience is both constructed and contextual.
While some qualitative methodologies have a primary aim of developing theory, interpretive description emphasises the need for ‘informed action’:
Interpretive description is an approach to knowledge generation that straddles the chasm between objective neutrality and abject theorizing, extending a form of understanding that is of practical importance to the applied disciplines within the context of their distinctive social mandates. It responds to the imperative for informed action within the admittedly imperfect scientific foundation that is the lot of the human sciences (Ref. 20, p26).
Interpretative description, responding to the needs within applied health sciences to address pragmatic questions,21 seeks to describe and understand a process or phenomenon (in this case, research on primary cam morphology and its natural history) through the subjective perspectives of research participants and, importantly, intends to use this knowledge to inform practice.22,23
This study’s pragmatic orientation manifests at different stages of the research process. For example, the research team’s expert clinical knowledge is seen as solid grounding for research design. It is this practical knowledge, tested and validated in the clinic, which is emphasised in interpretive description and used as a way to provide answers to solve real-world problems.23 Particularly in areas where there is little prior research or empirical data about a health phenomenon, such foreknowledge and expertise are viewed as a useful starting place for orienting research.21
Alongside the foreknowledge that the researcher brings to the study, interpretative description aims to explore the subjective experiences of participants relevant to this study: the experiences and perspectives of doing research on primary cam morphology and its natural history. Participants should therefore be a purposive sample representing the full breadth of different kinds of knowledge and experience of the topic being researched.24,25 Within interpretive description research, this knowledge and understanding is constantly revised in a continuous process of (re) negotiating, where both researchers and participants co-construct a coherent narrative that can inform clinical—and research—practice.26
In summary, interpretive description suits the research question for this study. It facilitates straightforward and pragmatic answers to questions that are relevant to researchers, clinicians, patients, and policy makers15,16 and helps to improve understanding of what works (or might work) best to promote high-quality research in the field of primary cam morphology and its natural history.
Ethical approval was received from the University of Oxford’s Medical Sciences Interdivisional Research Ethics Committee (Project ID R66281) and Qatar University Institutional Review Board (QU-IRB 1239-EA/20) prior to conducting the study. We followed the ‘Standards for Reporting Qualitative Research: A Synthesis of Recommendations’ for this report.27
We developed, piloted, and adapted an interview guide based on the INQUIRE framework to explore participants’ perspectives of research quality on primary cam morphology and its natural history. The INQUIRE framework provides a guide for the practical assessment of clinical research quality at all stages of a research project, and for developing quality enhancement initiatives (Figure 1).14
This framework was a useful scaffold for developing quality enhancement initiatives (Figure 1), addressing five study stages (concept, planning and feasibility, conduct, analysis and interpretation, and reporting and knowledge translation), and six dimensions: (1) protection of patient safety and rights, (2) relevance/patient centredness and involvement, (3) minimisation of bias [1] (internal validity), (4) precision, (5) transparency/access to data, and (6) generalisability [2] (external validity) of the study results.
The six dimensions interact with two promoters, a set of factors that may enhance all quality dimensions at a research institution: (1) an established research infrastructure (e.g. well-trained personnel and functional facilities on-site: 3T MRI with trained radiographer and radiologist for serial hip joint imaging), and (2) sustainability through education (the structures and systems to support young researchers and build capacity through mentoring and developing the next generation, and continuous education of all study personnel to secure a long term productive clinical research environment). The Interview Protocol Refinement (IPR) Framework28 was then used to develop and refine the interview guide (Figure 2).
A purposive and structured variation approach was used to select the sample for this study. This method allowed us to select a sample of stakeholders representing a wide range of expertise and experience. Participants were purposively identified. Most were clinician-researchers who have published in the field between 2010 and 2021; (n=9). Other participants (n=6) were identified from the first author’s collegial, athlete and patient networks, and that of co-researcher Dr Sean McAuliffe (SMA) with oversight by the first author’s DPhil supervisors: Professors Trisha Greenhalgh (TG), Siôn Glyn-Jones (SGJ), Karim Khan (KK) and Mike Clarke (MC). The professional background of the research team allowed us to reach a large population of primary cam morphology research stakeholders, guarding against over-representation of one group. We invited all potential participants through e-mail. This sampling strategy is common in interpretive description and rests on the premise that researchers’ knowledge of the topic area enables them to identify participants who are especially knowledgeable about or experienced with the topic of interest.17,18,22,26,29 Potential participants included clinicians, researchers, patients, athletes, sports coaches, and parents of competitive adolescent athletes. Most participants had more than one role, ‘researcher, clinician, and parent’, for example. This often allowed the first author to explore a multiplicity of perspectives in each individual interview.
The sampling strategy, aimed at maximum variation in stakeholder background and expertise, was informed by literature and the ‘closeness continuum’ model.30 According to this model, participants can have different types of expertise, based on closeness to the topic of interest. Some individuals have a degree of ‘subjective closeness’ to a topic, which involves deep experiential knowledge or real-life experiences. Patients may have this kind of subjective closeness. Participants with professional and/or legal (ethical) responsibility represent a ‘mandated closeness’. Finally, individuals can have a degree of ‘objective closeness’ to a topic, because of their profession or occupation.30 To represent a wide range of experience and expertise in our sample, we purposively included participants from all three categories.
Fifteen individuals participated: six physiotherapists, five physicians, a sport scientist, and three athletes/patients (Table 1). Two physiotherapists were also patients, four participants had adolescent children playing competitive sport, while three were sports coaches. The lead author conducted semi-structured online interviews during the Covid-19 pandemic between June 2020 and February 2022. The interviews lasted on average 60 minutes (range 44:32 to 68:08 minutes).
Using video conferencing technology (Zoom®), all interviews were audio-recorded with permission. Informed oral consent was recorded during the first part of each interview after confirming that participants understood the research project and their rights. Co-researcher (SMA) attended 14 of 15 interviews and kept field notes that provided further interview context for analysis.31 Audio-recorded interviews were transcribed by a third member of the research team, Ms Jolanda Boersma (JB), a research assistant experienced in conducting and transcribing qualitative research, before being imported to qualitative data analysis software NVivo® (QRS international Pty Ltd, Burlington, Massachusetts, United States). To protect their privacy, we assigned a unique number to each participant and deleted identifying information from the transcript.
Given the semi-structured nature of the interview guide, we had the flexibility to invite participants to elaborate on their responses; they could discuss their perspectives in whatever direction, and in as much depth as they wished. We were therefore able to probe beyond the specific questions of the interview guide, exploring participants’ unique personal experiences, practices, and preferences, which shaped their perspective on primary cam morphology research.32 These included, for example, concerns about the morphology that competitive athletes, who were worried about their future sporting careers, might have. We also asked parents and coaches of adolescent athletes how they perceived high load training and competition that might put young athletes at risk of primary cam morphology and future hip disease (Figure 2).
Consistent with interpretive description, we used thematic analysis to analyse the data.33–35 Thematic analysis is an approach that seeks to develop themes across cases, through reading, re-reading, and charting of data.34 It is a form of pattern recognition where identified themes become the categories for analysis.32 Often misunderstood as a single method with one set of procedures, thematic analysis is best thought of as a continuum of methods—from types that place prominent emphasis on developing codes and categories and demonstrating their reliability (both within and between different coders), to more reflexive approaches which place more emphasis on a single researcher developing a plausible and coherent account of the data.34,35
In this study, we chose not to prioritise ‘coding reliability’ since this notion rests to some extent on positivist philosophical assumptions (e.g. that the data are ‘out there’ waiting to be collected and that every researcher analysing the same data should get identical findings). Rather, we sought to use a structured coding framework to support and inform reflexive thematic analysis.34
The analysis therefore incorporated both a deductive coding approach (based on a priori codes generated from the quality dimensions and promoters of the INQUIRE framework14) and a data-driven inductive approach. Early analysis of the transcripts was guided but not constrained by the preliminary codes derived from the INQUIRE framework: we populated codes according to the coding framework, but we also flagged instances in the data that did not fit. Consistent with thematic analysis, two co-researchers (SMA and JB) and the lead author immersed themselves in the data to become familiar with the depth and breadth of the content. We read interview transcripts several times. Based on the INQUIRE framework, JB and the lead author independently coded all interviews and SMA coded half of the interviews. The lead author regularly met with both co-researchers to discuss and reflect on our perspectives that shaped how we identified primary patterns in the data. Once initial coding was complete, discussions among the research team and further analytic work allowed us to identify underlying patterns of shared meaning that drew together several of the initial ‘domain summary’ codes into richer and more complex themes (more ‘fully realised themes’) that revealed multiple facets of a particular meaning or experience.34,35
For example, the initial coding framework emphasised ‘Protection of patient safety & rights’ and ‘Relevance/Patient centeredness and involvement’ as possible ‘domain summary’ themes. This evolved into ‘Research communities should partner with patients/athletes’ to better represent authentic involvement—athletes/patients co-driving research. The process of coding and theme development had both descriptive and interpretive elements, representing what participants said and subjective considerations by the research team of patterns that were not directly evident. Here we aligned with the notion that themes are not ‘discovered’ nor do they represent pre-existing forms of knowledge waiting to ‘emerge’.33–35 Thematic analysis is seen as an active process of knowledge production by the researcher—themes are patterns that a researcher identifies through their perspective of the data.
Interpretive description also draws attention to researchers’ disciplinary orientations and subjectivity. To account for their perspectives, researchers should engage in reflexivity. Reflexivity involves recognising that researchers are part of the process of producing data and their meanings—a ‘sensitivity to the ways in which the researcher and the research process have shaped the collected data, including the role of prior assumptions and experience …’(Ref. 36, p51). The researcher is a ‘valuable instrument’ of the research in interpretive description; their technical knowledge, research background and personal experience are ‘major sources of insight’.22 Findings do not ‘emerge’ from the data, nor do data ‘speak for themselves’. The researcher ultimately determines what constitutes data, which data are relevant, how the final dataset will be presented and structured, and how and to whom the findings will be disseminated—no matter how participatory and collaborative the method.37 Therefore, although we acknowledge the influence of our preconceptions, we perceived our subjective clinical experience and prior knowledge (particularly HPD, SMA) to be a resource in this study.38
This study’s research team consisted of the following: HPD, lead researcher, a practising sport and exercise medicine physician, director of medical education, and DPhil candidate responsible for the overall design of the study, participant recruitment, data collection and analysis; SMA, a practising sports physiotherapist, and PhD-trained qualitative researcher, acted as Qatar-based co-principal investigator, attended 14 of 15 online interviews as an observer and contributed to the analysis; JB, a medical anthropologist with experience in qualitative research (sociology and anthropology) but no clinical experience or prior knowledge of the topic, aided in transcribing and analysing data; TG, a professor of primary healthcare with extensive experience in qualitative and mixed-method research, supervised on all aspects of the study as DPhil supervisor to HPD; SGJ, a practicing orthopaedic surgeon, professor of orthopaedic surgery and experienced researcher, oversaw all aspects of the study as principal investigator and DPhil supervisor to HPD; MC, experienced researcher and DPhil supervisor to HPD, provided oversight to all aspects of the study; KK, sport and exercise medicine physician, and previous journal editor, provided oversight to all aspects of the study as an experienced researcher and DPhil supervisor to HPD. HPD and SMA, SGJ and KK had working relationships with some of the participants.
The research team’s diverse academic training and experiences set the foundations for interdisciplinary dialogue and helped to promote reflexivity throughout the project.25 Olmos-Vega and colleagues (2022, p6) put it thus: ‘… assumptions become most evident when viewed from the point of view of others who do not share them’.39 Several discussions, for example, brought together an anthropological, non-clinical perspective (JB) to theme development with that of a physician with intimate knowledge of the field (HPD), and a PhD physiotherapist working in research and elite sport (SMA). In addition, TG, with vast clinical and (qualitative) research experience, shaped how the lead author approached the complicated deductive-inductive coding dance. An excerpt from his research and DPhil supervision diary provides nuance: ‘Don’t get boxed-in by your (INQUIRE-informed) coding framework. Dive deeper and search for meanings and insightful, new patterns/themes to inform future (research) practice’.
It is important to consider how professional identity and positionality might have influenced aspects of this study, including the research topic, research design, context and process, participants, data collection and analysis.40,41
When selecting a sample, we recruited participants who could contribute meaningfully to the aims of the study, either through their research experience, professional involvement, or personal experience with primary cam morphology. Participants were purposively identified, including from the lead author’s collegial network (research and clinical), as described. Although diverse to a certain extent (clinicians, researchers, athletes, patients, parents), the ten men and five women participants were all white and from the Global North. Participants representing research teams and athletes from the Global South could have shared different perspectives on research quality.
It is important to reflect on the prior relationship with some interviewees, as this ultimately shaped the data collected during this study. Garton and Copland refer to such interviews as ‘acquaintance interviews’.42 Data are generated in a particular way because participants may invoke prior relationships (most often implicitly, but at times explicitly) in these interviews.42
‘Insider status’ offers affordances and challenges. Insider status can often lead to valuable and even unique insights.43 A certain social or professional proximity often allows researchers access to resources that are not always available in more traditional interviews and might not be available to researchers who do not share this familiarity with their participants.42 Thus, some participants could have regarded the lead author as a professional or social proximate rather than an outsider; they might therefore have been more comfortable sharing their perspectives. In keeping with interpretive description, it is through this deep involvement with a small number of individuals familiar with the researcher and willing to share their experiences that it is possible to build trust and gather valuable data.23
Cognisant of the fact that insider status could also be a challenge—participants might feel obliged to assist the researcher because of their prior relationship—we ensured participants knew their rights, including the right to change consent or retract completely.44 Participants received an email explaining the study, their rights, and the informed consent process. They were able to ask questions or raise concerns at any time before or during the interview. Before starting the formal interview, the lead author briefly explained the aim and background of the study again, including participants’ rights. As mentioned earlier, the interview started after verbal consent was recorded and documented in the presence of a second member of the research team (SMA).
Below, we set out the findings on stakeholders’ perspectives of high-quality research on primary cam morphology and its natural history, structured according to five themes (informed by the INQUIRE framework’s six dimensions and two promotors). These action-inviting themes could bolster efforts by research communities to perform higher quality research in this field: research communities should (1) partner with athletes/patients; (2) collaborate with one another; (3) pursue open science; (4) champion equity, diversity, and inclusion; and (5) nurture young scholars. Each theme is described and illustrated with excerpts from one or more participant interviews. Where appropriate, we refer to intersectionality, for example, an athlete-patient and clinician (P8) describing how her experiences and perspectives as an athlete-patient informed clinical practice. As a result, some quotations are longer when we desired to communicate the way a participant illustrated or described a specific situation.
This theme combines and extends two INQUIRE dimensions: protection of patient safety and rights and relevance/patient centeredness and involvement. Our interviewees reported that athlete/patient-centred research is important and multifaceted. The athlete/patient distinction is important—most athletes with primary cam morphology will never become patients. Athletes are at risk of developing primary cam morphology but ‘we know that obviously only a small percentage of people, even if they have primary cam morphology, develop symptoms’. (P5)
More than just being involved, athletes/patients should co-drive research as equal partners. Athletes/patients in this study expressed keenness to get involved in research. This was especially true ‘if patients are aware that the ultimate goal is to help people to get better and to utilise the information in a way that’s going to help people’. (P8 – physiotherapist, athlete, patient) She continued to explain:
I think patients will be willing to help. I think a lot of people want to share their story. And I think it’s actually like a therapeutic part of the journey as well. At least I noticed that for me, when I’m able to, even now, kind of reflect on how far I’ve come. There’s a benefit of that. And you realize that: ‘Okay, my struggle is actually helping other people.’ (P8)
Involvement, however, could be therapeutic at more than one level. Another athlete-patient (P10), discussing how involvement helped her ‘own learning about the condition’, also felt proud to contribute to research (Table 2, quote 1). Educating research teams and other stakeholders ‘can provide valuable input that other people might not be able to give’. (P10)
Discussing his ‘passion to try and create change’ and ‘to try and educate’ (especially parents of young athletes) about the morphology and its hip-disease consequences, another athlete (P9) shared how his ‘whole life was changed because of [his] hips’:
I think that’s where my story, me speaking and educating the parents, and showing them: ‘If this resource was available to my family, and this testing or research project, whatever you want to call it, was there … it would have stopped me going through a year of operations. Untold pain, untold misery, sadness, heartache, you know, financial.’ The list goes on. I think, one thing that we can do, as people who have a voice is to make sure that these parents [are educated]. (P9)
Our interviewees gave several examples of how a partnership approach could facilitate more value and less waste in research. First, engagement pivots on and promotes the relevance of research:
I think, to really explore your question beforehand, and spend quite a lot of time doing that [is important]. So, refining your research question by involving stakeholders, involving clinicians, involving athletes … seeing what is meaningful to them, what do they want to know. (P7)
Second, athletes/patients (including adolescents, their parents, and coaches) could enlighten, not only researchers, but also the research process by illuminating blind spots in their research plans (Table 2, quote 2). In addition to gaining such insight to ‘the practicalities of what is realistic’, professionals also learned that patients ascribe importance to different things than researchers do (Table 2, quote 3). Additionally, patients can help in planning research; ‘they give us ideas that we wouldn’t have if we just think with our research hat on’. (P14)
Third, athlete/patient partnerships change how research communities communicate about research and research findings. A recurring theme in our interviews was the need to avoid jargon and use a language that everyone understands. The way to achieve this, they felt, was to involve all stakeholders from the outset, as illustrated by quote 4 (Table 2). Clinician-researchers and parents of competitive adolescent athletes, in particular, stressed the importance of avoiding alarming and inflammatory language (Table 2, quote 5). A former elite athlete and now sports coach warned that ‘things like “abnormality” perhaps trigger a lay person to automatically think that this is something damaging and negative, and will be inhibiting: so, “lesion”, when you say to me “lesion”, I’m thinking of something more like a scar or an abrasion’. (P12) Although femoroacetabular impingement (FAI) syndrome is the agreed term, ‘syndrome is a negative thing’ (Table 2, quote 6).
Sharing their experiences, several participants were concerned that language and communication style—in research and in the clinic—could create the need for (unnecessary) interventions. A clinician-researcher shared how a patient’s expectations had been shaped by an older footballer-brother who had bilateral hip surgery. The older brother framed the problem based on his own surgical experience (Table 2, quote 7). An athlete-patient and clinician shared her experience as a patient—how the language used and framing of the condition by a surgeon in a position of power left her vulnerable, confused, and distressed:
And so, I ended up going to this surgeon who’s pretty well-known … And I remember, I had not tried physical therapy yet. This was before starting physical therapy. I go in, and I remember, he takes my imaging out that I had, puts it up on the screen and says: ‘Oh, you have a large labral tear, you have a cam and pincer lesion. And if you don’t have a hip arthroscopy, you’re going to get hip arthritis, and end up needing a hip replacement.’ And I remember I just sat there, and I was just crying, and I was alone … I didn’t know much about cam or pincer or labral tear. And then I remember asking: ‘Well, if I don’t get the surgery, and I keep running, what will happen?’ and I remember him saying like, feeling very, you know, definitive in his wording: ‘well, you’ll get hip arthritis.’ … The appointment ended with him saying: ‘Okay, well, you can schedule the surgery on your way out and then we’ll be in touch.’ … I remember leaving there and I just thought, like: ‘Wow!’ Like ‘this is terrible.’ I remember I just was crying because here I was an athlete my whole life. I played college soccer, running was a huge part of my life and to then just be told that I have this condition in my hip. And if I don’t get the surgery, I’m going to end up with hip arthritis. And I have to stop running. And it really just led me down that spiral of catastrophising. (P8)
Fourth, our participants, including parents of young competitive athletes, raised the importance of safe research, particularly when children, female athletes, and competitive athletes are involved. Research communities should guard against breaches of confidentiality (Table 2, quote 8), and protect, especially children, from unnecessary exposure to imaging-related radiation (Table 2, quote 9). Protecting athletes’ health, including those participating in long-term research, and the influence of power-dynamics in competitive sport—especially when ‘juggling’ several managers at the same time—was raised as a safety concern by participant 9. Medical teams, particularly those involved in long-term research, must be empowered to protect athletes, and should, with club managers, be accountable to a higher management (Table 2, quote 10).
Finally, engagement could also be a challenge for athletes/patients, given that it requires them to share knowledge of living with primary cam morphology, which, in most, is an asymptomatic, benign morphology—unlike, for example, knee osteoarthritis (OA) (Table 2, quote 11).
In sum, when athletes/patients are equal partners in research—when they share their experiences and expertise—research would likely be more relevant, safer, and more ethical. Athlete/patient partners, as people who have a voice, could help to shape clearer and less threatening communication in research and in the clinic, and expressed eagerness to share their stories and struggles—to get involved in research and education to help others. Healthcare professionals and researchers seemed equally keen to involve and learn from athlete/patient partners.
This theme combines and extends elements from several INQUIRE dimensions and promotors, including minimisation of bias (internal validity), precision, infrastructure, and sustainability.
Interviewees discussed the need for coordinated efforts to plan and deliver multi-centre and multidisciplinary research on, for example, primary cam morphology aetiology and prognosis (Table 3, quote 12). To strengthen large-scale multi-centre research collaborations—‘helping each other’—research teams should agree on research questions (Table 3, quote 13). Such studies should use the same methodology and capitalise on transparent research centre-specific expertise to facilitate high quality data sharing (Table 3, quote 14).
To reduce attrition and measurement bias, research centre-specific expertise is particularly important when performing and analysing imaging. Long-term prospective studies (with serial hip imaging over time—every five years, for example) could benefit from an international network of collaborating imaging units to accommodate elite athletes who are often contracted to live and play around the world. They could be accommodated at an imaging centre close to them. Imaging collaboration could include shared (online) infrastructure like Digital Imaging and Communications in Medicine (DICOM) (Table 3, quotes 15 and 16).
International collaboration on a registry or large database could have a ‘really big impact’ on this field, benefitting research teams, patients, and healthcare systems (Table 3, quote 17). Collaboration could be bolstered when—with a ‘we need each other’-approach—coordinated by global sporting bodies like the International Olympic Committee (IOC) or FIFA (Table 3, quote 18). Participants commented on data sharing, including their frustration with it. Meaningful data sharing was acknowledged as ‘my biggest problem’ (P4). However, if done well, for example through the 11 IOC Research Centres [3], such data sharing could improve small sample bias and result in large datasets ‘that could be interrogated with better techniques, and with better statistical knowledge’ (Table 3, quote 19).
A common theme was also multidisciplinary team approach to intra-team collaboration, including with academic partners. Multidisciplinary team collaboration should involve athletes, coaches, different medical specialties and topic experts, researchers, and methodologists, for example (Table 3, quote 20 and 21). Some participants described their perspectives and experiences on multi-stakeholder collaboration to facilitate research buy-in. Buy-in could make or break research in this field. How researchers frame their research question, especially in elite sport, is key for engaging with management, big stakeholders, and decision-makers, including finance decision-makers (Table 3, quote 22).
Effective research collaboration among academia and professional sports clubs is important in this field.4,45–47 Researchers working with football clubs benefit when clubs, especially the coaches in the clubs, determine the research questions before engaging ‘the right university’ (Table 3, quote 23). However, such a collaboration could often be a slog, and someone needs to ‘kind of steer the university’ on what is possible and what is not impossible (Table 3, quote 24).
In sum, participants discussed how ‘we are stronger together’ when aligning to pursue large-scale, multi-centre and international collaborations to answer research questions that matter to all. Effective multidisciplinary intra-team collaboration resonated with our interviewees too.
This theme includes and extends the INQUIRE dimension, transparency/access to data. Access—for everyone—to as much information as possible, and translated to lay people’s language, resonated with our interviewees (Table 4, quotes 25 and 26). All stakeholders, including athlete/patients and coaches, should have access to research—in ‘plain language’:
So, it’s going to be athletes and coaches. A lot of scientific language isn’t particularly meaningful to them. And even clinicians, who would have been taught in that area, they still have moved into an environment where they don’t use that language anymore. So, I think, I think Open Access is good, but I think it still needs plain language. (P7)
An athlete/patient participant warned that financial and career benefits for researchers should not trump end users’ access to research —‘it’s silly and very naïve in this day and age that it’s happening’! (P9):
If a person is paid to do this research and is then publishing papers on their own study, it’s again for their benefit. And it’s for the benefit of the financier. So why, even though they’re doing it for themselves, why should we [athletes/patients] not have access to that? (P9)
Peer reviewed publications buried behind paywalls are problematic for young scholars and clinicians alike (Table 4, quote 27). Access should be easy—‘simply click on a button’—and include study protocols to reduce research waste (Table 4, quote 28) and data (Table 4, quote 29). Although open access to data resonated with our interviewees—even if it becomes a future journal requirement for new studies—there are important considerations, including informed consent from participants for anonymised patient data to be shared among research groups (Table 4, quote 30).
Some participants felt that prioritising open access was easier said than done. For example, particularly for early career researchers, impact factor might trump open access; an approach that could disrupt effective dissemination of results (Table 4, quote 31).
Researchers should think carefully when sharing test results with individual research participants (and, in the professional football club context, their sports club medical teams and managers): they should have an agreed protocol for this (Table 4, quote 32) and be comfortable to say: ‘there’s nothing to share’. Particularly when sharing, for example, ‘normal’ imaging results of ‘frankly, probably a pretty typical development [primary cam morphology]’ in athletes (Table 4, quote 33). Research teams should also give athletes/patients ownership of the decision to share, or not to share, their results with club medical staff (Table 4, quote 34).
Finally, participants also expressed concern about, or questioned the need for, open access. They discussed: the high (‘extortionate’) cost of open access publication (Table 4, quote 35); the ‘completely crazy’ academic publication system—paying to sign away copyright (Table 4, quote 36); the problem of predatory or low-quality open access journals (Table 4, quote 37); and their perspective that open access papers are ‘not that important’ as the average clinician ‘don’t really read research papers’—the cost of open access publication ‘pull money away’ from research (Table 4, quote 38).
In sum, our study participants discussed how research communities could pursue open science to improve research quality. Clinicians, researchers, and athletes/patients need to have easy access to important findings. There are perverse incentives (e.g. researchers seeking publication in a high impact factor journal that is only available to readers via a paywall). Finally, the cost of making publications open access could be prohibitive.
This theme includes and extends the INQUIRE dimensions: generalisability (external validity), and relevance/patient centredness & involvement. Our interviewees highlighted several equity, diversity, and inclusion (EDI) elements of high-quality research relevant to the steps of a research project in the hip-and-groin research field.
First, as described in theme 1, research communities should partner with athletes/patients. Such partnerships, to inform research questions, for example, should focus on racial/ethnic and sex/gender minoritised individuals and groups in the EDI context of this research field (e.g. girls, women, Black people, and people from the Global South).
Second, considering study populations, the primary cam morphology research field is largely void of research involving girls and women, and people from the Global South—particularly athletes. This was emphasised by our interviewees too (Table 5, quote 39). To engage more diverse populations, research should not only consider the different impact on males and females, but also involve people of different ages, people with disabilities, and people with different ethnicities (P12). To date, very little research in this field is done in the Global South, for example. A clinician-researcher and patient warned that ‘to understand the injury or morphology well’ it is important not to ‘shut out certain geographical areas’ (P13). Participant 7 confirmed this perspective, discussing research that involved diverse populations with ‘genetic variation’ and different athletic backgrounds (Table 5, quote 40).
Third, research team-specific EDI considerations include fostering an inclusive and equitable research climate within teams and their collaborative networks. Our interviewees discussed: (1) team diversity (e.g. female research participants might feel uncomfortable when male researchers perform a groin evaluation, as illustrated in quote 41 (Table 5)); (2) access for team members who live remotely (e.g. accessible and inclusive online meetings, as illustrated in quote 42 (Table 5)); (3) building capacity (e.g. team member compensation and mentoring ensuring socioeconomic status and knowledge about the research topic do not exclude certain team members, as illustrated in quote 43 (Table 5)).
Finally, EDI in knowledge translation include, as discussed above, easy access to research reports written in lay language, ideally with patient partners (Table 4, quote 26).
This theme includes and extends the INQUIRE promotor: sustainability/education. Mentoring seems to be key for scholarly growth and has been defined as ‘a dynamic, reciprocal relationship in a work environment between and advanced career incumbent (mentor) and a beginner (protégé) aimed at promoting the career development of both.’ (Ref. 48, p17). Four archetypes of mentorship have been proposed: the traditional mentor, the coach, the sponsor, and the connector.49
… the mentor guides, the coach improves, the sponsor nominates, and the connector empowers, but always the mentee benefits. (Ref. 49, pE2)
Interviewees illuminated how research communities could nurture young scholars through mentoring, deconstructed here using the four archetypes above. First, through careful mentoring by humble mentors. Humble mentors model imperfection—they are willing to say, ‘I don’t know’.50 They seem to carefully guide young scholars to pursue relevant research questions ‘as part of something bigger’, as quote 44 (Table 6) illustrates. Second, through mentors that challenge mentees in safe spaces (the coach or supervisor-type mentorship), as quote 45 (Table 6) illustrates. Third, through mentors that create opportunities – the sponsor-type mentorship. Scholars should not be ‘dumped’ into research with a ‘good luck, my friend’ approach (P2). Rather, research teams—especially senior researchers and mentors—should create opportunities for young scholars to lead (Table 6, quote 46). Finally, through mentors that empower. Clinician-researcher (P3) described his role (as a connector-type mentor) in creating a stable and sustainable environment for young scholars, connecting them with a professional sporting organisation (football club) as employer and a university for academic training:
Why don’t we ask the real - performance, injury, whatever it is – questions? Why don’t we generate the questions and then go to the Universities? Get the contract which [is] always the most painful bit. But get the contract sorted out and then doing. If it’s a PhD, we do an interview to find the right student that would fit the University and also our needs. Because they’ll be imbedded for three years within our program, became effectively a member of staff for us, the players knew no difference, they just saw a member of staff and it went really well. (P3)
A clinician-researcher and young scholar (P2) stressed the importance of ‘insight in the ethical way of things’ when creating opportunities for young scholars, and warned against research for the sake of research:
You cannot just only say: ‘I want to do research as quick as possible and get the highest paper with the best impact-factor’ but also think of sustainable quality research … (P2)
Several participants mentioned lack of sustainable employment and funding as a problem, creating ‘considerable stress and lack of certainty about the long-term job and continuity’ (P1), as quote 47 (Table 6) illustrates. Research in this field (‘arthritis’) seems to struggle for funding compared to other fields like cancer (Table 6, quote 48). However, protected employment seems not enough; financial and collegial support for relevant research, with continued access to data after employment, should be cemented in employment contracts (Table 6, quote 49).
In addition to mentoring, participants discussed personal growth when well-organised research teams created opportunities for structured education, for discussing ideas (Table 6, quote 50), and for sharing the struggles of being a young scholar (Table 6, quote 51). Participants emphasised structured education programmes for young scholars. One participant urged education on ‘the rules and the processes of research.’ (P4). Although important, this element is often missing in education; ‘that a lot of people, despite the fact that they have PhDs, still don’t understand the research process, is fascinating to me.’ (P4). Participant 2 agreed, advocating for a structured education programme: ‘We had like a course of two weeks on biomedical statistics, but to be honest, how can you learn biomedical statistics in two weeks?’ (P2). Another participant advocated for ‘having the right people in the right positions to educate the team’ on more field-specific knowledge and skills (P5).
In sum, creating opportunities for young scholars to learn, teach, and lead even large-scale studies in well-supported teams, resonated with participants. Participants agreed that stable and sustainable research environments are key for supporting young scholars’ development into independent researchers.
The findings of this study show that, for higher quality research in the field of primary cam morphology and its natural history, research communities should: partner with athletes/patients; foster collaboration; pursue open science; champion equity, diversity and inclusion, and nurture young scholars (Figure 3). Informed by the INQUIRE framework, these action-inviting themes provide important insights for higher quality research—more value, less waste—on primary cam morphology and its natural history, including hip-disease consequences.
High quality research on primary cam morphology and its natural history is ultimately aimed at benefitting athletes/patients. It is therefore important to keep their preferences, experiences and needs at the centre of research (Figure 3). This approach to research in the field of primary cam morphology and its natural history is supported by the results of the Oxford Consensus Study12,13: athletes/patients should be ‘in charge as partners with power—exerting some control over all decisions’.13
Our first theme echoed that authentic patient and public involvement (PPI) in research—partnering with athletes/patients—could facilitate more relevant, safer, and more ethical research.51 Patient-centred research could help to identify unmet needs and gaps for research communities to prioritise—research questions that are relevant to athletes/patients with primary cam morphology or a related hip disease. These include qualitative research to explore experiences, preferences, and perspectives. It goes without saying that athlete/patient-centred research must be safe and ethical. In the context of primary cam morphology and its natural history, this means, for example, avoiding radiographs when researching aetiology in maturing athletes, protecting participants’ personal information, prioritising general and research-specific ethics and integrity, and valuing methodological rigour.
A haphazard approach to language (including terminology and definitions) could confuse patients.52 This gap was addressed when the research community agreed on primary cam morphology terminology, definitions, taxonomy, and imaging outcomes for research.12 The YAHiR Collaborative and others are working to implement this agreement and to address areas of tension and dissent. This will take time; many clinicians and researchers still use cam ‘lesion’, ‘deformity’ or ‘impingement’ instead of the agreed ‘morphology’.5,12 With athletes/patients as partners, research communities would likely be more inclined to prioritise clear and non-threatening language when stakeholders communicate about the morphology and its hip-disease consequences.
Second, high-performing research teams should collaborate with one another—a key INQUIRE element of high-quality research.14 Such collaborations could catalyse, among other benefits, larger data sets (through well-planned multi-centre research projects on primary cam morphology aetiology and prognosis, for example), increased methodological rigour (by involving, for example, methodologists and specialist radiologists from the outset), and better framing of research questions to secure wider buy-in (of football club managers, for example). Professor Trish Greenhalgh shared ‘3 tips for authentic research collaboration from interdisciplinary health research’ in Session 4 of the 2022 Oxford Young Athlete’s Hip Symposium: ‘build relationships and trust’, ‘foster tolerance of uncertainty’, and ‘harness conflict productively’.53
Third, the research community should pursue open science. Participants emphasised access for everyone to as much information as possible—including protocols, datasets, and summaries of results in non-scientific language. Several participants discussed ‘extortionate’ costs of open access publishing and warned against predatory and low-quality open access journals. These problems are not unique to the hip-and-groin research field. With an estimated annual turnover of $2 billion, the open access publishing model has become the ‘mainstream approach to delivering scientific knowledge with Article Processing Charges as driving force’.54 Predatory journals and publishers, a problem in all research fields,55 were defined as ‘entities that prioritize self-interest at the expense of scholarship and are characterized by false or misleading information, deviation from best editorial and publication practices, a lack of transparency, and/or the use of aggressive and indiscriminate solicitation practices’.56 This consensus definition is likely to contribute to a coordinated strategy aimed at eradicating the plague of predatory journal and publishers.
Fourth, high-quality research on primary cam morphology champions EDI. An EDI-conscious research community at each stage of the research process, would be more aware of possible blind spots, including a tokenistic, tick-box approach to EDI.57 Similar to other research fields, there is a lack of diversity and inclusion in sport and exercise medicine, science and rehabilitation in general, but specifically Black female athletes.58–60 Other fields have prioritised efforts to improve EDI, including in academia61 and nursing.62 An EDI lens should not only inform research populations but also research teams. Our findings suggest such a research community would likely (1) prioritise more diverse research populations and research teams with an immediate focus on girls and women, and the Global South (diversity); (2) secure access to equal and fair opportunities to minoritised individuals and populations (equity); and (3) emphasise inclusion as ‘a sense of belonging: feeling respected, valued, and seen for who we are as individuals’.63
Finally, participants in this study emphasised young scholars, in high-quality research, should be nurtured. This echoed the move away from an ‘unhealthy reliance on impact factors’ to assessing scientific research quality,64 to rather focus on nurturing and mentoring the next generation of scholars.65 They are carefully mentored, share, and learn together, benefit from opportunities created by their mentors and seniors, and thrive when employed with funding—creating a stable and sustainable research environment.
The findings of this study, informed by the six dimensions and two promotors of the INQUIRE framework, are consistent with current trends in assessing research. However, what research quality in health care is, also depends on context and research type. The INQUIRE framework’s dimensions—minimisation of bias, precision, and generalisability—illuminate a predominantly positivist lens to assessing research quality. For example, we don’t trust results of cohort studies plagued by researcher bias and imprecision. ‘Confirmability’, ‘credibility’, and ‘transferability’, on the other hand, are concepts for defining and investigating rigorous qualitative research.66–68 A carefully constructed conceptual framework for research quality in health care can inform efforts to improve research in a specific field. A new, more inclusive framework could, for example, be the catalyst to moving a field beyond the ‘impact-factor-is-king’ approach to assessing research quality, to embracing a more contemporary approach. In this study, our analysis started with the INQUIRE framework but also explored research quality beyond the positivist frame of enquiry.
Despite worldwide quests, a uniform approach to describing and assessing research quality and impact is still contested. The 2014 ‘Increasing Value, Reducing Waste’ series in The Lancet69–74 spotlighted waste in biomedical research and made 17 recommendations to increase research value, addressed to five main stakeholders—funders, regulators, journals, academic institutions, and researchers. The authors of this series formed an alliance (the Reduced Research Waste and Reward Diligence [REWARD] campaign),75 emphasising five principles—several echoed in our findings—to maximise research potential, including (1) the right research priorities; (2) robust research design, conduct and analysis; (3) regulation and management that are proportionate to risks; (4) access to all information on research methods and findings; and (5) complete and usable reports of research. However, a follow-up article in 2016, providing an overview of the effects of The Lancet’s Series and REWARD campaign, concluded that, overall, and despite early corrective actions by some stakeholder groups, further work was needed to increase research value.11 Six years later, the tide continues to turn against research waste and, importantly, the narrow notion that high quality research and impact can only be ‘measured with a number’.65,76
The findings of this study resonate with the key quality concepts of the Agreement on Reforming Research Assessment [4]. This agreement emphasises research (quality) assessment based primarily on qualitative judgement and more-inclusive assessment systems.76 Commendably, this agreement was co-produced ‘bottom-up’ by research stakeholders from 350 research organisations and 40 countries as ‘an exercise of consensus’, based on a ‘common vision, and shared responsibility and direction.’.77 This inclusive approach is a foundation to collaborate—a call for collective action. To date (31 July 2023) and supported by the Coalition for Advancing Research Assessment initiative,78 608 organisations worldwide have signed the agreement.79 Others have paved the way for this approach, notedly in the transdisciplinary research context,80 and patient-orientated academic clinical research’ (the INQUIRE framework described earlier).14
Belcher et al. (2016) proposed a framework of four main principles when assessing research quality in transdisciplinary research.80 These principles are (1) relevance (the importance, significance, and usefulness of the research problem, objectives, processes, and findings to the problem context); (2) credibility (the research findings are robust, and the sources of knowledge are dependable. This includes a clear demonstration of the adequacy of the data and the methods used to procure the data including clearly presented and logical interpretation of findings); (3) legitimacy (the research process is perceived as fair and ethical, including ethical and fair representation of all involved, and the appropriate and genuine inclusion and consideration of diverse participants, values, interests, and perspectives); and (4) effectiveness (the research generates knowledge and stimulates actions that address the problem and contribute to solutions and innovations).
In sum, there are no shortage of research quality frameworks; however, how these frameworks are applied to inform research practice depends on several factors, including context. Nevertheless, there seems to be a world-wide movement towards a more qualitative assessment of research quality.
To our knowledge, this is the first study in the hip-and-groin research field exploring research stakeholders’ perspectives on research quality. In light of these efforts to articulate research quality, limitations of this study deserve particular attention. Although our aim was to explore (describe and understand) perspectives on research quality of a diverse stakeholder group (rather than a deep case-by-case phenomenological analysis of a smaller homogenous group) the study population could have been even more diverse—we did not, for example, recruit any participants from the Global South or Black female athletes. This was perhaps a blind spot – patients, particularly in this research field, are not only middle-aged white males. Participants from the Global South at the intersection of race and gender, compared to their white Global North counterparts, would likely have different perspectives on participation and access to three-dimensional imaging, for example.
Although the data in this study provided a rich and complex picture of a diverse group of participants’ experiences and perspectives on research in the field of primary cam morphology and its natural history, it did not aim to completely capture the phenomenon under scrutiny.81 Our interviewees emphasised language and communication about the morphology, referring to ‘inflammatory’ language, for example. What ‘inflammatory’ is, however, depends on the hearer. Research communities might therefore choose to adopt a more flexible approach to defining ‘inflammatory’ language. We need more research on the perspectives and needs of subgroups living with primary cam morphology and its hip disease consequences, focussing on women, adolescents and the Global South. Village-born Kenyan long-distance runners who pad 25 miles a day barefoot, for example, or youngsters playing football for many hours per week in rural villages in South Africa: do they develop primary cam morphology or its hip disease consequences? what are their challenges, priorities and concerns? These and other gaps in current research should be addressed by the YAHiR Collaborative and collaborators.
The research team reflected on two aspects of our sampling strategy. First, the structured variation approach to sampling (informed by the ‘closeness continuum’) resulted in breadth, rather than individual depth, of perspectives. However, our purpose was not an in-depth phenomenological analysis; we were interested in multiple perspectives on research quality from a diverse stakeholder group. Second, the role of prior relationships between researchers and some participants. The familiar nature of some ‘acquaintance interviews’ might have shaped the data gathered during this study.42 For example:
… But you know better than anybody, that some of the athletes may feel that osteoarthritis in 10 years’ time is much less important than what their pain-and-function is the season. (P15)
Starting the sentence with ‘you know better than anyone’, the participant aligned himself with the lead investigator and interviewer, drawing upon their shared knowledge. The participant was still the interviewee, but it could be seen that he also invoked the professional relationship with the lead investigator.42 Some participants might have assumed the lead investigator knew the answer anyway, limiting the extent to which the interviewee elaborated on their responses. For that reason, we had a third person (SMA) present during the interview allowing the lead investigator the opportunity to ask, for example: ‘For SMA’s benefit, could you just explain why?’
Finally, we briefly mention critical orientations like power and equity. Epistemologically, were our orientation more ‘critical theory’ than pragmatism-informed interpretivist, we would have paused to unpack these constructs more.
Exploring stakeholders’ perspectives on research quality through an established research quality framework (INQUIRE) illuminated areas for immediate action in the research field of primary cam morphology and its natural history. Research communities in this field should: partner with athletes/patients; collaborate authentically with one another; champion equity, diversity, and inclusion; pursue open science, and nurture young scholars. Such an approach would ultimately benefit athletes and patients.
The findings of this study could inform concrete actions by research communities to pursue higher quality research—more research value and less waste—in the field of primary cam morphology and its natural history. Although the five action-inviting themes reflect contemporary trends in research, and could therefore be transferable to other areas of research, their practical application remains context- and field-specific.
Ethical approval was received from the University of Oxford’s Medical Sciences Interdivisional Research Ethics Committee (Project ID R66281) and Qatar University Institutional Review Board (QU-IRB 1239-EA/20) prior to conducting the study.
The research team carefully considered open access to all research data (transcribed interviews). However, we decided not to publish the transcribed interviews in an open access repository for three main reasons: First, the hip-and-groin in athletes research field is small. The research field on femoroacetabular impingement syndrome and related bony morphologies in athletes is even smaller. Our research participants - 15 elite athletes, coaches, clinicians and researchers in this small field - could therefore be easily identified even with complete anonymization of interview transcripts. Second, although verbal informed consent was recorded as part of each interview, we did not seek explicit informed consent from participants to publish de-identified transcripts nor did me get University of Oxford Institutional Review Board permission to do so. Finally, to help the reader and support our research findings, we provide very extensive quotations to underpin our study results (in the manuscript text but also as results tables). Upon reasonable request (e.g. for peer review or further research), the research team would consider to provide full access to the data (transcribed interviews). Such requests should be directed to the corresponding author: Dr HP Dijkstra.
Informed consent by research participants: Due to COVID-19 restrictions at the time, all interviews were conducted online and recorded after obtaining (and recording) verbal informed consent at the beginning of each interview. This process was clearly outlined in our Ethical Approval documents and approved by the University of Oxford’s Medical Sciences Interdivisional Research Ethics Committee and the Qatar University Institutional Review Board as detailed above.
This manuscript has been published as Chapter 6 (More value and less waste in research on primary cam morphology and its natural history: a qualitative interview study of stakeholders’ perspectives) of the lead author’s DPhil Evidence-Based Health Care thesis: Improving research quality on primary cam morphology. The full thesis can be accessed here (Oxford University Research Archive): https://ora.ox.ac.uk/objects/uuid:288081e3-b59b-4488-af49-45a510a76dfc
1 The term ‘bias’ is usually used in relation to quantitative research. A related term in qualitative research is ‘perspective’. Interpretive qualitative researchers consider that there is no such thing as an unbiased sample, but that it is important to include a wide range of perspectives. This is how we interpreted this criterion in the framework when exploring stakeholders’ perspectives on qualitative research.
2 The term ‘external validity’ is usually in relation to quantitative research. ‘Transferability’ refers to the generalisability of inquiry in qualitative research.
3 International Olympic Committee (IOC) Research Centres for the Prevention of Injury and Illness. Eleven IOC Research Centres are supported by a four-year grant for 2023-2026: https://olympics.com/ioc/medical-research/research-centres
4 Work on this Agreement, drafted by Science Europe, the European University Association, and Dr Karen Stroobants, supported by the European Commission, started in January 2022. This agreement ‘… set a shared direction for changes in assessment practices for research, researchers, and research performing organisations, with the goal to maximise the quality and impact of research. It includes principles, commitments, and timeframes for reforms and lays out principles for a Coalition of organisations willing to work together in implementing the changes.’ - https://www.scienceeurope.org/our-resources/agreement-reforming-research-assessment/
Views | Downloads | |
---|---|---|
F1000Research | - | - |
PubMed Central
Data from PMC are received and updated monthly.
|
- | - |
Is the work clearly and accurately presented and does it cite the current literature?
Yes
Is the study design appropriate and is the work technically sound?
Yes
Are sufficient details of methods and analysis provided to allow replication by others?
Yes
If applicable, is the statistical analysis and its interpretation appropriate?
Not applicable
Are all the source data underlying the results available to ensure full reproducibility?
Partly
Are the conclusions drawn adequately supported by the results?
Yes
Competing Interests: No competing interests were disclosed.
Reviewer Expertise: Orthopedics, hip morphology, cam morphology
Is the work clearly and accurately presented and does it cite the current literature?
Partly
Is the study design appropriate and is the work technically sound?
Partly
Are sufficient details of methods and analysis provided to allow replication by others?
Yes
If applicable, is the statistical analysis and its interpretation appropriate?
Not applicable
Are all the source data underlying the results available to ensure full reproducibility?
Yes
Are the conclusions drawn adequately supported by the results?
Partly
Competing Interests: No competing interests were disclosed.
Reviewer Expertise: Musculoskeletal pain; Qualitative research; Equity
Alongside their report, reviewers assign a status to the article:
Invited Reviewers | ||
---|---|---|
1 | 2 | |
Version 1 19 Sep 24 |
read | read |
Provide sufficient details of any financial or non-financial competing interests to enable users to assess whether your comments might lead a reasonable person to question your impartiality. Consider the following examples, but note that this is not an exhaustive list:
Sign up for content alerts and receive a weekly or monthly email with all newly published articles
Already registered? Sign in
The email address should be the one you originally registered with F1000.
You registered with F1000 via Google, so we cannot reset your password.
To sign in, please click here.
If you still need help with your Google account password, please click here.
You registered with F1000 via Facebook, so we cannot reset your password.
To sign in, please click here.
If you still need help with your Facebook account password, please click here.
If your email address is registered with us, we will email you instructions to reset your password.
If you think you should have received this email but it has not arrived, please check your spam filters and/or contact for further assistance.
Comments on this article Comments (0)