Keywords
i-LEAD, GEEKS, HIV/AIDS, EMR, NDR, Governance, Public Health Informatics, Digital Health, Informatics Savvy Health Organisation (ISHO), Nigeria.
Nigeria has strategically invested in digital health to achieve HIV/AIDS epidemic control, meet SDG health targets, and advance towards UHC. Despite progress, challenges persist. This paper details Nigeria’s commitment, in collaboration with PEPFAR, CDC, and other agencies, to address Health Information System (HIS) challenges through participation in the Intergovernmental Learning Exchange to Advance Data-Driven Decision Making (I-LEAD) programme.
The i-LEAD programme followed a 3-phase approach: 1) conducted an expedited Informatics-Savvy Health Organisation (ISHO) assessment to identify critical national HIS challenges; 2) enhanced informatics capabilities of selected Nigerian delegates, including a purpose-fit session, Bring Your Own Difficult Decision (BYODD), involving SMEs to collaboratively refine, contextualise and guide the localised development of actionable solutions for the national HIS challenges; and 3) outlined the nation’s approach to implementing the HIS solutions
The expedited ISHO assessment identified 5 HIS challenges: governance, interoperability, data security, Electronic Medical Record (EMR) centralisation, and funding. Participating in the i-LEAD programme strengthened Nigeria’s leadership technical capacity in informatics, particularly in strategic visioning and planning, with the BYODD sessions resulting in the collaborative development of localised solutions to address the 5 HIS challenges. In the post-i-LEAD phase, efforts focused on 2 activities for the HIS solutions. These activities are 1) improving data quality through harmonisation of value data sets, and 2) decentralising I-LEAD learning and building the capacity of Public Health Informatics (PHI) technical groups through progressive levels of Growing Expertise in E-Health Knowledge and Skills (GEEKS) training. These activities were selected because of their potential to deliver the maximum impact within the HIS ecosystem.
Nigeria’s active participation and commitment through the I-LEAD programme have strengthened its digital health agenda, leveraging health informatics to enhance healthcare delivery and achieve broader health goals. This approach can serve as a model for other developing nations facing similar health informatics hurdles.
i-LEAD, GEEKS, HIV/AIDS, EMR, NDR, Governance, Public Health Informatics, Digital Health, Informatics Savvy Health Organisation (ISHO), Nigeria.
Globally, the widespread integration of digital technology has transformed how various industries operate, including those in the healthcare sector. Digital technology in health increases the accessibility to medical information, telemedicine, electronic health records, and cutting-edge diagnostics, resulting in more efficient, personalised, accessible, and improved delivery of quality healthcare services.1 It is expected that the widespread adoption of these technologies in health would increase the potential for global connectedness by growing countries’ progress towards bridging the digital divide within their respective health systems, developing informatics-savvy groups to secure and sustain these interoperable systems, and achieving improved quality of healthcare for all.1,2 Nigeria is one such developing country that has made significant investments in the digital health space to bridge the digital divide to achieve Human Immunodeficiency Virus and Acquired Immune Deficiency Syndrome (HIV/AIDS) epidemic control and achieve its vision to be a nation free from the Acquired Immune Deficiency Syndrome (AIDS) disease, meet the 2030 agenda by accelerating progress across the health-related Sustainable Development Goals (SDG), and ultimately, advance towards Universal Health Coverage (UHC) for her populace.3
Nigeria’s digital health sector has witnessed remarkable growth and transformation in recent years. The country has recognised the pivotal role of digital technology in improving healthcare access and delivery, especially in the diagnosis, treatment and management of HIV/AIDS disease, which is a known contributor to national mortality rates. Presently, the Nigerian digital health ecosystem comprises several global health technologies that have been adapted and implemented to enhance patient care and streamline healthcare management.3–6 These technologies include Health Information Systems (HIS) like the National Health Management Information System (NHMIS) driven by the District Health Information System (DHIS2), the National Health Workforce Registry (NHWR) that is based on the iHRIS Manage Software, Electronic Medical Records (EMR) based on OpenMRS and other platforms, and a National Data Repository (NDR), leveraging popular Free and Opensource solutions.3–7 In addition, the government of Nigeria, in partnership with global organisations like the United States’ President’s Emergency Plan for AIDS Relief (PEPFAR), has also initiated numerous programs aimed at optimising digital healthcare governance and enhancing the infrastructure base, and there has been remarkable achievement.8–10 The country has also adopted a national eHealth strategy and policy framework to oversee the incorporation of technology into the healthcare sector, encouraging the seamless exchange of data among healthcare institutions. However, some challenges persist.
Digital eHealth governance in Nigeria is not fully functional when compared to the global benchmark.6 While there is an eHealth strategy in place, complete with a monitoring and evaluation framework, it faces challenges when it comes to practical implementation. Various digital technological solutions have been developed independently, often without adherence to the recommended health information standards for data exchange, transmission, and messaging, as well as security, privacy, and hardware. These siloed and isolated initiatives limit the smooth exchange of data among them, consequently affecting the quality of healthcare services rendered at the various points of care and impeding collaborative efforts in reducing the epidemic impact of HIV/AIDS. Additionally, there are concerns regarding financing digital health in the country.6 Finding a sustainable funding model remains a challenge for many projects and programs, and, notably, the absence of a workforce proficient in informatics to effectively plan for, manage and sustain the digital health sector further complicates the landscape.
This paper outlines the measures taken by the Government of Nigeria, spearheaded by the Federal Ministry of Health (FMoH) through the National AIDS, Viral Hepatitis and STI Control Programme (NASCP), along with other ministries such as the Federal Ministry of Women Affairs (FMoWA) and the Nigerian Ministry of Défense (NMoD) and in collaboration with key international partners. These efforts were supported by the United States’ President’s Emergency Plan for AIDS Relief (PEPFAR) and its implementing agencies, including the Centres for Disease Control and Prevention (CDC), the Department of Defense (DoD), and the United States Agency for International Development (USAID). Together, these diverse stakeholders worked to identify and address common national HIS challenges, with a focus on optimising and operationalising the national digital health governance, enhancing the coordination of HIV/AIDS disease programme areas to attain epidemic control, and, more importantly, cultivating an informatics-savvy workforce able to sustain the Nigerian digital health ecosystem. These were achieved through participation and commitment to the I-LEAD programme.
The I-LEAD programme aims to empower leaders, managers, and technical experts engaged in public health informatics in envisioning the digital health landscape, formulating effective strategies to realise their vision, and successfully implementing and sustaining these strategies. This becomes especially valuable for Nigeria, as the nation endeavours to harness digital investments and solutions to enhance healthcare delivery, achieve a nation free of AIDS, and ultimately attain UHC for its population.
It has been nearly four decades since the outbreak of Nigeria’s first HIV/AIDS cases. Since then, the government of Nigeria, with support from international partners such as PEPFAR, has been actively involved in the fight against HIV/AIDS to attain epidemic control and achieve an AIDS-free Nigeria, with zero new infections, zero discrimination and stigma and zero AIDS-related deaths.11 Recently, the Nigerian government has taken significant steps towards optimising the management of patient health information, elevating data quality, and fostering a more efficient and coordinated approach to healthcare services, particularly within the realm of HIV/AIDS programme management. To support this paradigm shift, PEPFAR, through its agency partners; CDC, USAID and DoD, and in-country technical partner, Public Health Information Surveillance, Systems and Solutions (PHIS3), partnered with the government of Nigeria in institutionalising relevant eHealth technologies in alignment with the recommended National Health Information Architecture. As of December 2023, EMRs have been deployed across a total of 2,439 health facilities in all states in Nigeria, including the Federal Capital Territory Abuja. In addition, a central repository of de-identified patient-level data aggregated from these service delivery points, called the National Data Repository (NDR), has also been deployed with over 1.9 million patients actively in treatment as of the same date.12 Apart from implementing these eHealth technologies, a series of multifaceted and phased capacity-building sessions was also conducted to drive ownership and sustainability post-donor support.
Some of these learning and development workshops were designed to align with the various administrative structures of the government, emphasising broad health informatics-related activities such as strategy development. Other sessions delved into the practical implementation of these strategies by building capacity for the relevant actions and procedures needed to translate these strategic goals into actionable activities. Additionally, some workshops focused on the effective utilisation of institutionalised digital tools within the context of HIV/AIDS care. Nevertheless, challenges were encountered in establishing the crucial link between formulating a robust national digital health vision, creating comprehensive cross-cutting strategies that spanned all disease and health areas, and effectively translating these long-term and medium-term strategies into operational actions to foster the growth of the digital landscape in Nigeria.
The Intergovernmental Learning Exchange to Advance Data-Driven Decision Making, which is commonly referred to as I-LEAD, is a programme that aims to empower diverse country-level leaders beyond decision-making and policy formulation capacities, managers and technical experts in the public health informatics space. The programme supports these nationally diverse stakeholders in envisioning the digital health landscape, formulating effective strategies to realise their vision, and successfully implementing and sustaining these strategies for impact.
To ensure effective planning, implementation, and sustainability of national digital health solutions and their impact on ensuring the delivery of care, PHI professionals in leadership and managerial capacities should cultivate proficiency across four fundamental dimensions: Vision, Strategy, Operations, and Tactics (VSOT).13 The I-LEAD programme primarily focuses on the initial two components of this framework. Completing I-LEAD includes an additional learning event called Growing Expertise in E-Health Knowledge and Skills (GEEKS). GEEKS focuses on the other two dimensions: operations and tactics. Together, the synergy of combining these learning programs, I-LEAD and GEEKS, results in a collective strengthening of the proficiency of a diverse spectrum of PHI stakeholders. The combined approach, which addresses all four VSOT framework dimensions, guarantees that national entities, including PHI leaders and decision-makers or policy formulators, managers, and technical experts, who are essential in conceiving the digital health landscape and developing strategies to realise it, are better prepared to realise their vision, and effectively execute and maintain these strategies.
The I-LEAD programme is conducted on a per-demand basis, and the frequency depends on the requests received from countries that are expected to commit to the programme requirements. One crucial commitment involves following through with the roadmap as an integral part of the post I-LEAD phase. Nigeria, through the FMoH/NASCP and its PEPAR partners, expressed their interest in attending the 2023 edition, which also included representation from other countries in the eastern African region.
To ensure Nigeria’s active involvement in the I-LEAD programme, a core technical team was established, comprising representatives from FMoH-NASCP, PHIS3, and the Technical Assistance Platform (TAP) - a CDC-supported project driven by PATH that aims to assist Nigeria in harnessing and implementing sustainable digital health technologies. This core team had two primary responsibilities, with the first securing Nigeria’s participation in the I-LEAD event. The core team collaborated with the I-LEAD organisers, notably staff from the CDC headquarters in Atlanta, to provide orientation on the prerequisites and processes for attending the I-LEAD event. This orientation also covered Nigeria’s commitment post I-LEAD. The second core team’s responsibility was to coordinate the Nigerian delegates attending the event in completing the I-LEAD preparatory activities. One such activity was leveraging an evidence-based method, the ISHO assessment framework, to identify national HIS challenges to bring to the event.
The technical core team identified and selected 17 delegates to represent Nigeria. The Nigerian delegation included government representatives from the Federal Ministry of Health and NASCP, Federal Ministry of Women Affairs (FMoWA), and Nigerian Ministry of Defence (NMoD), as well as individuals from various inter-agency organisations such as the CDC, DoD, USAID, APIN Public Health Initiatives/PHIS3, Palladium Group/Data.Fi, and PATH.
With support from the I-LEAD organisers and the core technical team, the delegates underwent a comprehensive orientation that covered various aspects of the I-LEAD process in optimising country HIS ecosystems. This included a detailed explanation of the prerequisites for participation and a thorough understanding of Nigeria’s commitment to the post I-LEAD activities. In addition, the delegates were trained to enhance their capacities in utilising the ISHO framework in assessing national informatics systems readiness, identifying HIS gaps across key health system domains impacting healthcare service delivery, and using those insights to inform strategic planning activities and health system strengthening initiatives. Notably, identifying these national HIS gaps must be done empirically through the conduct of an ISHO assessment. This is a fundamental requirement for participating in the I-LEAD programme.
ISHO stands for Informatics-Savvy Health Organisation.14,15 The ISHO toolkit was originally developed by the Public Health Informatics Institute (PHII) to guide governments, agencies, or any organisation in assessing their informatics readiness and capabilities, to develop e-Health strategies, information systems, electronic health information exchanges, and ensure the availability of an informatics-savvy workforce to achieve a digital public health future.14 The ISHO toolkits consist of 2 types of tools: an above-site and site level. Both tools achieve their goal by assessing informatics capabilities across three strategic pillars. The first pillar, “Vision, Policy, and Governance”, focuses on the existing digital health governing structures, delving into the implementation status of current digital health policies, strategies, and costed plans. The second is “Skilled Workforce”, which examines the structures that ensure the continuous supply and availability of informatics-savvy health workers. The last pillar is “Effective Information Systems”, which evaluates the technological aspects of the current information technology capabilities.15–21
Using the above site ISHO tool, the Nigerian delegates conducted an expedited ISHO assessment at the national level in Nigeria. Each delegate, representing key government ministries including the FMoH and NASCP, the FMoWA, the NMoD, and implementing partners supporting the Nigerian government HIV/AIDS response, played a key role in conducting the assessment. The goal of the evaluation was to determine national HIS strengths, as well as identify informatics challenges, towards establishing a national baseline. Furthermore, completing this stage is a prerequisite for taking part in a BYODD session during the I-LEAD event. This interactive session provides the platform where critical HIS challenges in participating countries are collectively addressed with support from global public health informatics experts.
The completed above-site ISHO tools were collated, after which the Nigerian delegates convened multiple times to collectively review and analyse each completed above-site tool. Responses from each completed above-site tool were aggregated in a structured format to identify recurring patterns across the different evaluated domains, synthesise emergent themes and collectively shortlist the HIS challenges for presentation in the I-LEAD’s BYODD session.
The national HIS gaps identified after conducting the expedited above-site ISHO assessment were further shortlisted. This was done after several consultative meetings with the government of Nigeria and health informatics Subject Matter Experts (SME) internally and externally, from the CDC headquarters. A selection criterion was developed, and factors such as implementation impact in the digital health space, required resources such as human resources for health (HRH) and cost of implementation, as well as the anticipated timelines, were used to rank and prioritise HIS challenges.
Several health informatics challenges were identified following the analysis of the expedited above-site ISHO assessment and presented in Figure 2. Issues around HIS governance and coordination were a notable challenge. Others revolved around data security, systems interoperability, EMR centralisation and strategies for improvement of data quality, data management and use, sustainability, and funding.
Further discussions were held amongst the delegates attending the I-LEAD and health informatics SME from the government of Nigeria and PEPFAR to distil the identified gaps into five (5) that would be addressed at the I-LEAD event. The foremost informatics gap centred on (1) governance, while others revolved around (2) information system interoperability, (3) data security, (4) EMR centralisation to address the availability of 3 fully established EMRs in Nigeria, and (5) securing digital health funding.
The Nigerian delegate’s capacity was built across various aspects in envisioning, conceptualising, and developing country-level informatics strategies using multiple evidence-based problem-solving methodologies. Specific to the BYODD sessions, it consisted of numerous iterative sessions with SMEs. During these sessions, the HIS challenges specific to Nigeria were presented, rigorously examined, leveraging different problem-solving methodologies, other country experiences, all tailored to the unique local context. The Nigerian HIS challenges were subsequently addressed and redefined, and 5 solutions are presented in Table 1 below. Of the 5 proposed solutions, 4 were HIS governance-related. These were proposed due to the peculiarities of our multi-stakeholder environment, ensuring coordination and focused intervention to achieve considerable impact with modest resource requirements through efficient implementation planning.
HIS challenge domain | Activity | Description | Priority |
---|---|---|---|
*HIS Governance and Systems Interoperability | Improving data quality through harmonisation of value data sets | Improve data exchange between all EMRs in Nigeria, NigeriaMRS, LAMISPlus and ViVa, with the NDR through harmonisation of value data sets | *High (5) |
Knowledge Sharing and Sustainability | Decentralise I-LEAD learning and/or build the capacity of PHI technical groups by convening a TIER 1 and 2 GEEKS training | This activity focuses on harnessing the benefits of the VSOT framework by combining the I-LEAD and GEEKS programmes. This activity shall foremost decentralise the knowledge gained during the I-LEAD and then plan for and conduct a GEEKS programme for technical experts | *High (5) |
HIS Governance | Digital Health Strategy Implementation and Use | Operationalise and monitor the implementation of the revised Nigeria Digital Health Strategy to enhance the effectiveness of streamlined healthcare operations | High (4) |
HIS Governance | Addressing digital health data standards challenges through TA for the Digital Health Standards Subcommittee | Technical assistance (TA) to support digital health standards subcommittees of the National Digital Health Technical Committee (NDHTC) | High (4) |
HIS Governance (Security) | Conduct security vulnerability and risk assessment on EMR and NDR systems | Identifying and addressing potential security vulnerabilities and risks within the EMR and NDR | Medium (3) |
The first HIS governance streamlined activity focused on improving data quality through the harmonisation of value data sets across all EMRs in the country.
The second activity identified from the broader HIS governance challenges focused on the existing Nigerian digital health strategy, specifically, on its implementation and role in supporting interoperability across key information systems to optimise healthcare service delivery. This included activities related to operationalising and monitoring the rollout of the revised strategy. Addressing digital health data standards challenges through technical assistance for the Nigerian digital health standards subcommittee and conducting a security vulnerability and risk assessment on health information systems involved in HIV/AIDS, EMRs, and NDR systems were the third and fourth streamlined activities. The fifth and last activity was on knowledge transfer to promote ownership and sustainability post-donor support. This focused on decentralising the knowledge gained from the I-LEAD, harnessing the fullness of the VSOT framework by conducting a progressive GEEKS event. A detailed roadmap outlining the various tasks to be undertaken across the streamlined activities presented in Table 1 was created and is provided in Appendix I.
Finally, as part of the Nigerian government’s commitment to the I-LEAD programme, two activities were prioritised for implementation. These included improving data quality through harmonisation of value data sets and decentralising I-LEAD learning and building the capacity of PHI technical groups by convening a tier 1 and 2 GEEKS training.
In preparation for the I-LEAD programme, the Nigerian delegates engaged in activities to identify common national HIS gaps. This emerged through an evidence-based approach by conducting an expedited above-site ISHO assessment. Following the assessment, multiple consultative meetings and discussion sessions were held to prioritise identified HIS challenges with the highest priority. Overall, 5 HIS challenges were selected for the I-LEAD event after consultative meetings with the Nigerian technical team and delegates, with support from PHI SMEs in-country and externally from supporting donors and implementing partners.
Participating in the I-LEAD demonstrated successful resolution of the shortlisted HIS gaps. Five (5) practicable strategies with the most significant potential to address the identified national HIS issues were generated based on criteria that were unique to our locality, and these were presented in Table 1 above. Furthermore, two (2) of these strategies were selected and earmarked for implementation by the Nigerian delegates as part of the post I-LEAD commitment. These activities were selected based on criteria such as impact on the digital health space, availability of existing structures or some level of previous work to build on, and the resources required. The first activity cuts across two domains of the Nigerian digital health space: governance and system interoperability. Its objective is to enhance data exchange among all EMRs in Nigeria; NigeriaMRS, LAMISPlus and ViVA EMR, with the NDR through harmonisation of value data sets. The second activity focused on knowledge dissemination and harnessing the benefits of the VSOT framework through participating in the I-LEAD programme. This initiative sought to decentralise I-LEAD learnings, specifically focusing on the first two components of the VSOT framework: vision and strategy. Additionally, it is also aimed to enhance the capabilities of the internal PHI technical groups by organising tier 1 and 2 GEEKS training, with the GEEKS training specifically addressing the last two components of the VSOT framework: operation and tactics.
There was a limitation in the I-LEAD approach presented in Figure 1. The limitation was the expedited above-site ISHO assessment conducted to identify and shortlist HIS gaps taken to the I-LEAD event. The evaluation was a rapid one and limited in scope. Although the technical core team embarked on multiple consultative meetings with PHI SMEs locally and externally to mitigate this, we recommend conducting a more comprehensive ISHO assessment, one that encompasses both above-site and site level evaluations. This expanded assessment would provide a more thorough understanding of HIS challenges and better inform strategies for future improvements.
Abbreviations: AI, Artificial intelligence; BYODD, Bring Your Own Difficult Decision; CDC, US Centers for Disease Control and Prevention; DoD, United States Department of Defense; FHIR, Fast Healthcare Interoperability Resources; GEEKS, Growing Expertise in E-Health Knowledge and Skills; GoN, Government of Nigeria; HIS, Health information system; I-LEAD, Intergovernmental Learning Exchange to Advance Data-Driven Decision Making; ISHO, Informatics-Savvy Health Organization; PEPFAR, United States President’s Emergency Plan for AIDS Relief; PHIS3, Public Health Information Surveillance, Systems and Solutions; USAID, United States Agency for International Development; TAP, Technical Assistance Platform; VSOT, Vision, Strategy, Operations, and Tactics.
In conclusion, I-LEAD adopts an evidence-based methodology for shaping policies to tackle health informatics challenges countries face. This approach differs significantly from the conventional approach most developing countries use, which is often ineffective and lacks widespread impact in the broader health sector. The I-LEAD approach employs an empirical strategy in determining national health informatics-related challenges. It incorporates a series of capacity-building activities to reinforce PHI’s leadership and management skills. This approach helps in envisioning long-term informatics-related objectives and provides tailored approaches to address challenges to the specific needs of the locality.
For the Nigerian delegation led by the FMoH, engaging in the I-LEAD program resulted in numerous significant advantages. This initiative served as a valuable platform for advancing their proficiency in health policy and governance, focusing particularly on key areas such as data sharing, data security, innovative financing, and sustainability. The program also addressed essential knowledge domains like data integration, interoperability, FHIR and Terminology Standards, as well as Machine Learning and Generative Artificial Intelligence. Additionally, it encompassed strategies for enhancing workforce recruitment, development, and retention within the informatics realm. Furthermore, the I-LEAD program facilitated direct interaction with experts in the health informatics field, enabling the delegation to harness evidence-based techniques for addressing identified PHI challenges in Nigeria. Lastly, the FMoH’s commitment to implementing the refined PHI solution was solidified through their participation in the program, establishing the groundwork for bridging the digital divide in the country.
The findings and interventions outlined in this report bear significant implications for policy and practice in Nigeria’s healthcare landscape. Firstly, the identification of national health informatics challenges, particularly in governance, interoperability, data security, EMR centralisation, and funding, emphasised the necessity for a thorough and well-coordinated digital health strategy. This will guide policymakers to prioritise establishing, implementing, and monitoring robust governance frameworks to facilitate the smooth integration of various digital health initiatives in Nigeria.
Furthermore, the commitment to address these challenges through the I-LEAD programme signifies a shift towards evidence-based policymaking. The I-LEAD programme incorporated BYODD sessions, which harnessed the expertise of global PHI experts to refine and streamline Nigeria’s HIS challenges into actionable activities with the broadest impact across multiple health domains.
Finally, the emphasis on improving data exchange between EMRs as part of the post I-LEAD phase demonstrates the Nigerian government’s commitment to building a skilled workforce and ensuring the integrity and confidentiality of health data. This phase opens the path for better data-driven decision-making and more efficient healthcare operations. Policymakers can utilize this model to shape future initiatives, creating a robust and responsive digital health ecosystem and acting as a model for other countries facing similar difficulties.
The views and opinions expressed in this article are those of the authors and do not necessarily reflect the official policy or position of any affiliated agency of the authors.
All data supporting the results are included within this article and its related files.
Figshare: iLEAD Experience in Nigeria: Supplementary Data: https://doi.org/10.6084/m9.figshare.29345027.22
This project contains the following data:
• Figure 1. jpg - Overview of the Nigeria I-LEAD Experience across 3 phases: preparatory activities, the I-LEAD main event, and post I-LEAD activities.
• Figure 2. jpg - National HIS Challenges Identified After Expedited Above-Site ISHO Assessment.
• Table 1 – Redefined HIS Challenges After BYODD Sessions.
• Appendix 1 - Nigeria I-LEAD Roadmap.xlsx.
• ISHO Expedited Assessment Templates and Completed Tools.
Data are available under the terms of the Creative Commons Attribution 4.0 International license (CC-BY 4.0).
We would like to express our heartfelt gratitude to the organisers of the I-LEAD 2023 edition for the East and West African region. Special thanks go to the following persons:
1. Herman Tolentino
2. Sri Wilmore
3. Tadesse Wuhib
4. Neranga Liyanaarachchige
5. Maria Jolly
6. Jan MacGregor
7. Daniel Rosen
8. Julianna Kohler
9. Nega Gebreyesus
10. Katy Handley
Sincere thanks also go to the following persons, who were part of the Nigerian delegates.
Views | Downloads | |
---|---|---|
F1000Research | - | - |
PubMed Central
Data from PMC are received and updated monthly.
|
- | - |
Is the work clearly and accurately presented and does it cite the current literature?
Partly
Is the study design appropriate and is the work technically sound?
Partly
Are sufficient details of methods and analysis provided to allow replication by others?
No
If applicable, is the statistical analysis and its interpretation appropriate?
Not applicable
Are all the source data underlying the results available to ensure full reproducibility?
No
Are the conclusions drawn adequately supported by the results?
Partly
Competing Interests: No competing interests were disclosed.
Reviewer Expertise: comparative health (policy) research, workforce development
Is the work clearly and accurately presented and does it cite the current literature?
Partly
Is the study design appropriate and is the work technically sound?
Partly
Are sufficient details of methods and analysis provided to allow replication by others?
Partly
If applicable, is the statistical analysis and its interpretation appropriate?
I cannot comment. A qualified statistician is required.
Are all the source data underlying the results available to ensure full reproducibility?
No
Are the conclusions drawn adequately supported by the results?
Partly
Competing Interests: No competing interests were disclosed.
Reviewer Expertise: Digital Health, Information Systems in Digital Transformation, Emerging Technologies, Industry 4.0, E-Wallet
Alongside their report, reviewers assign a status to the article:
Invited Reviewers | ||
---|---|---|
1 | 2 | |
Version 1 01 Aug 25 |
read | read |
Provide sufficient details of any financial or non-financial competing interests to enable users to assess whether your comments might lead a reasonable person to question your impartiality. Consider the following examples, but note that this is not an exhaustive list:
Sign up for content alerts and receive a weekly or monthly email with all newly published articles
Already registered? Sign in
The email address should be the one you originally registered with F1000.
You registered with F1000 via Google, so we cannot reset your password.
To sign in, please click here.
If you still need help with your Google account password, please click here.
You registered with F1000 via Facebook, so we cannot reset your password.
To sign in, please click here.
If you still need help with your Facebook account password, please click here.
If your email address is registered with us, we will email you instructions to reset your password.
If you think you should have received this email but it has not arrived, please check your spam filters and/or contact for further assistance.
Comments on this article Comments (0)