Effectiveness of a mobile health intervention on infant and young child feeding among children ≤ 24 months of age in rural Islamabad over six months duration [version 1; peer review: 3 approved with reservations]

Background: Childhood development is highly influenced by feeding practices at the infancy and young age of children. Unfortunately, according to the National Nutrition Survey (2011), the prevalence of exclusive breastfeeding in Pakistan was 21% at four months, and 13% at six months of age with 51.3% of mothers initiating semisolid foods to their children at the recommended 6-8 months of age. The latest Pakistan Demographic & Health Survey (PDHS 2018) however; indicates that only 48% of infants are exclusively breastfed which has been improved from 38% as reported in the past five years but still more improvement is anticipated. Methods: A quasi-experimental study design was employed for this post-intervention survey assessing effectiveness of mobile health (mhealth) regarding infant & young child feeding (IYCF) among pregnant and lactating mothers in Tarlai, Islamabad from May to June 2018. A total of 135 mothers who were earlier included in the intervention phase were recruited after obtaining verbal & written consent. The data was entered in EpiData (3.1) and analyzed in SPSS version 21. Results: The mean age of these pregnant and lactating mothers was Open Peer Review


Introduction
Childhood under-nutrition is a major public health problem which has been contributing extensively to childhood mortality and morbidity 1 . Globally; 45% of child mortality results due to'undernutrition' which highlights the right of every child to good nutrition. According to World Health Organization (2018), globally more than 100 million children were found to be stunted, and nearly 52 million were found to be wasted in 2016 alone. Adequate nutrition is required for optimal growth and development of children 2 . Evidence indicates that undernutrition leads to severe cognitive and behavioural disabilities throughout life if not managed in early infancy [3][4][5] . The magnitude of malnutrition is extensive in the South Asian region leading to high rates of stunting, wasting, and disease burden 5 . One of the major causes of these high indicators of undernutrition is poor infant and young child feeding (IYCF) practices. The WHO and United Nations International Children's Emergency Fund (UNICEF) recommends early initiation of breastfeeding within an hour after birth, and exclusive breastfeeding for the first 6 months during infancy with timely and appropriate initiation of complementary feeding 6 . Despite this recommendation, the recognized adverse effects of malnutrition and undernutrition among infants and children have been significantly reported in various studies 7-9 . Regarding infant and young child feeding practices, around 40% of infants from 0-6 months of age had been exclusively breastfed, worldwide. Whereas, only a few children acquire adequate nutrition along with proper complementary feeding which is appropriate for their age group they belong to 6. In developing countries, these sub-optimal feeding practices of infants and young children contribute to the prevailing burden of malnourishment. According to the Pakistan Demographic Health Survey (PDHS, 2018), almost 38% of children under five years of age are stunted, 23% are underweight, and 7% are wasted. Although the national findings of PDHS (2018) indicate that improved nutritional status of children has resulted in decline of stunted children from 45% in 2012-2013 10 . However, the findings are still alarming. The suboptimal IYCF practices could be attributed to a lack of knowledge, lower socioeconomic status, and relatively low levels of education of mothers or caregivers 11 . Emphasis has been laid on implementing effective innovative interventions to improve nutrition among children particularly in poor resource countries. One of the most effective strategies laid down by WHO to improve IYCF practices is effective counselling on proper nutritional practices through community health workers 12,13 . In Pakistan, these community health workers are referred to as Lady Health Workers (LHWs), recruited under the National Program for Family Planning and Primary Health Care 14 . With support from WHO, the government of Pakistan launched the 'Lady Health Workers Programme' in 1994, which was mainly aimed to provide an effective grassroot level system for accessing primary health care 14 . This program was aspired to bridge the communities for accessing primary healthcare through LHWs. Moreover; among the various roles and responsibilities under this program, the LHWs are also expected to provide nutritional counselling. However, the deliverables by LHWs somehow are affected due to being overburdened 15 .
Thus, it is imperative that a facilitating system if is provided to these LHWs which could result to lower their existing burden of responsibilities. Among some of the innovative strategies of providing health service, mobile health or mhealth, is gaining momentum in low-and middle-income countries. As defined by WHO mhealth is the "provision of health services and information via mobile and wireless technologies" 16 . The innovation and use of information and technology through mhealth has been vastly employed to address access, resource utilization, and coverage gaps. Many developing countries including those in South Asia have been employing mhealth approach through the Community Health Workers or peer counsellors to improve healthcare as an innovative strategy 17,18 . A study conducted in Bangladesh demonstrated gaps in IYCF related service delivery which prompted the need of healthcare messages, including information related to emergency and medical care, to be delivered through mobile phones. The potential benefits and necessity of mhealth led the technology to embrace community-based nutrition services to improve the service delivery and coverage related to IYCF nutrition. Mass-scale behavioural interventions that actively included social mobilization at the community-level, media campaigns, and counselling by trained workers have also been found useful 18-20 . Evidence from India suggest that IYCF related nutrition among children can be improved using counselling strategies aimed at the parents 21 . Limited evidence is available from Pakistan indicating effectiveness of mhealth related to IYCF nutrition. Therefore, considering the current situation in Pakistan, we planned to pilot this technology with counselling by LHWs. For this intervention we first conducted a formative study in collaboration with Lady Health Worker (LHW) programme, which aided in development and implementation of a mhealth based program to counsel women on proper nutritional practices related to infant and young children (IYCF) in a rural periphery located in Islamabad. In this case, a user-friendly audio-visual android-based mobile application was developed for LHWs who were then trained and supervised on its use.
Our mhealth intervention was deployed on pregnant and lactating mothers from July 2016 to December 2016 in rural Islamabad. The aim was to test the feasibility and acceptance of mhealth intervention among the target population. A pre-intervention survey was conducted one month prior to the intervention in June 2016 followed by a post intervention survey conducted in April to June 2018 to determine the effectiveness of mhealth intervention in improving infant and young child feeding (IYCF) nutrition related knowledge, attitude and practices among pregnant and lactating mothers in rural Islamabad (Both surveys are available as Extended data 22 ). The specific objective of this post-intervention study was to compare the pre and post mhealth intervention related knowledge, attitude & practices of pregnant and lactating mothers regarding IYCF.

Study design
A quasi-experimental study design was employed to determine the effectiveness of mhealth in improving knowledge, attitude, and practices of pregnant and lactating mothers regarding IYCF in rural Islamabad.

Study setting
Islamabad is the federal capital territory of Pakistan. According to census conducted in 2017, the total population of Islamabad is more than 2 million 23 . The rural population of Islamabad comprises of 991,747 individuals with approximately 165,490 number of households 24 . This study was conducted in Tarlai Kalan which is a rural union council in Islamabad which comprises of around 37,500 households.

Study population
As mentioned, our intervention was deployed to pregnant and lactating women residing in Tarlai, Islamabad (See Figure 1). The study area is covered by the Lady Health Workers (LHWs) who are considered as the first level healthcare providers in this community. Upon availability and approval from the district health office, ten LHWs were randomly selected and trained on IYCF. Out of these ten LHWs, five were selected on basis of their best performance during the IYCF training. The sampling frame was based on these five selected LHW-wise households. Pregnant or lactating mothers residing within the catchment area of Tarlai, Islamabad and have children of ≤2 years of age were recruited and registered. Their husbands were also invited to participate and after obtaining consent the post-intervention study was conducted. Non-residents, non-consenting cases and mothers with serious co-morbidities were excluded from the study.

Intervention
A user-friendly audio-visual android based mobile application was developed which contained the formulated messages related to IYCF. The content of messages was prepared and translated into local language 'Urdu' after extensive review by experts, which were mainly based on WHO and UNICEF guidelines 13,25 .
Intervention Design: Based upon the results of phase one study (pre-intervention survey), it was decided that biweekly voice and text messages on appropriate IYCF practices were to be disseminated to the recruited pregnant and lactating mothers, along with their mothers in law and husbands. The project team was then trained by a mobile application developer to create their application along with the message content for the voice and text messages.

Messages:
A team of public health professionals, paediatricians, health informatics professionals, academicians and program managers formulated the messages based on WHO and UNICEF guidelines. These messages were initially drafted in English and then translated into Urdu which was identified as preferred language in phase one. The messages were drafted for pregnant and women in their third trimester for lactating mothers of children between 0-24 months of age. An age and stage model was employed such that the messages were to be disseminated according to the week of pregnancy or age of the child as the case may be. Once these messages were created, they were incorporated into a specialized message scheduling system whereby separate audio and text based message libraries were created to be sent to recipients.
Mobile Application: The application was created over a period of 3 months with testing to optimise the user experience. The application had two modules which were registration and follow up. Each module further included two sections, one for the pregnant women from their third trimester and one for children 0-12 months. The questions within each module were drafted in Urdu and included logical checks and errors based on the responses to avoid errors in data entry. The LHWs were to first register pregnant women or mothers of children of 0-12 months of age using the registration form. The included data consisted of name of the mother and the child, age, gender of the child, date of birth, last menstrual period (in case of pregnant women), address, phone number and dietary habits. From the next visit onwards, they were instructed to use the follow up forms to collect monthly data on their dietary intake, supplement intake (in case of pregnant women) and any associated illnesses or problems. A laptop/desktop-based dashboard was also created to import data collected in the field by the LHWs. The same dashboard also had the capacity to monitor the LHW activity through display activity times, number of forms sent, and time spent with each mother. Through the same dashboard the project manager had the capacity to create mobile application users. After creation of the mhealth application, it was installed into android phones and following pretesting by the team members it was then modified.
Once the application was ready and the message library was created, the project team sought written permission from the Federal District Health Office (DHO) to recruit the LHWs of Union Council of Tarlai Kalan for the intervention. The DHO assigned an assistant district coordinator who assisted the project team in recruiting the LHWs. Upon availability of the LHWs, a three-day training workshop was scheduled in a health house. A health house is a household of LHWs. The agenda of the training was to first educate the LHWs on IYCF, explain the objective of the intervention and train them on using the application. A pre-and post-test on knowledge on IYCF was also conducted during the training. This was followed by a field visit to test the use of the application in the field. After obtaining the national identity card copies of the selected LHWs, they were then provided with android-based smart phones along with the SIMS and mhealth application installed. Consent to be a part of the was also obtained for participating in the project, along with their National Identity card copies (this is required by the Pakistan Telecommunication Authority (PTA) for provision of sim cards).
Upon selection, the participating LHWs were then requested to provide a list of eligible pregnant and lactating mothers for the project within their catchment area. These comprised of three groups including all pregnant women in their third trimester, children from 0-6 months of age and those mothers who had children of 7-12 months of age. Before including their names

PHASE 1
A formative study was conducted before the intervention funded by the Department of Foreign Affairs and Trade (DFAT), Australia to test the feasibility and acceptance of mhealth intervention to target population.

A final list of participients was created which included pregnant and lactating mothers under the catchment population of selected LHWs
Participating participients were provided with mobile phones and SIM cards upon taking their National Identity Card copies A laptop/desktop based dashboard was also created to import data collected in the field by the LHWs. The same dashboard also had the capacity to monitor LHW activity through display about activity times, number of forms sent, time spent with each mother PHASE 2 Recruited participants for the intervention (N=135) 1. Pregnant women in their third trimester 2. Lactating mothers having children from 0-6 months 3. Lactating mothers having children 7-24 months of age All information obtained from the participients was incorporated in the messaging system according to the woman's stage of pregnancy and age of the child. These messages were initially drafted in English and then translated into Urdu, which was identified as the preferred language in formative phase.
After the initiation of intervention, LHWs followed their registered participients on monthly basis in their routine visits and used the application to counsel them using the audiovisual aid which was generated based upon their responses to the questions asked. The monitoring dashboard was used to monitor the LHW activity on regular timely intervals.
Using GPS coordinated data, the time spent and visits by LHWs was also observed for each household. At the same time, weekly one voice and one text message was sent to the mobile phones of the participients to educate them on appropriate IYCF practices. The voice and text messages were sent on phones in morning and evening for recruited women and for their husbands or fathers, respectively.
A user friendly android based mobile application was developed. A team of public health professionals, pediatricians, health informatics professionals, academicians and program managers formulated the messages content based on WHO and UNICEF guidelines. Upon which the mobile application was developed, tested and retested over a period of three (03) months and was installed into android phones provided to participants. This application had two modules-registration and follow up.
A written permission was obtained from the Federal District Health Office (DHO) to recruit LHWs of UC Tarlai Kallan, Islamabad. A total of 10 LHWs were randomly recruited and were provided a three day training workshop. Out of them, 05 LHWs were randomly selected who conducted the field work.
in the study, the LHWs were advised to describe the purpose of the mhealth project to the respondents or the caretakers (which were assumed as those individuals who were responsible for the care of infant or the child at their homes). Only those individuals or caretakers who had consented to be a part of the intervention were included. On average, around 10-15 individuals' names were provided under each group by each LHW. Once the lists were provided, three individuals under each group for each LHW were selected and assigned to be included in the intervention through a lottery / draw method. These respondents were randomly picked out of all the recruited participants whose names were included in a draw box to receive the mhealth intervention. The participants consisted of primary participants who were pregnant women and mothers of children of 0-12 months of age followed by secondary participants who were mothers in law/grandmothers and husbands/fathers of the primary participants. The purpose of including the other family members was sociocultural. As in the first phase of the project; it was indicated that for a successful delivery of mhealth intervention, involving husbands and mothers in law will be very important. This was so that the participants would own the intervention and consider themselves as participants in the study.
Once the final list of participants was created, a one-day inaugural session was organized for them near to their place of their residence so as to brief them about the intervention. A pre-intervention survey was conducted after which they were provided with mobile phones along with SIM cards upon obtaining their National Identity Card copies and their written consent for participating in the study. Once all the information was obtained from the participants, it was then incorporated in the messaging system according to the stage of pregnancy and age of the child for the purpose of dissemination of IYCF nutrition related knowledge. From the next day, mhealth intervention was initiated as all the LHWs registered their participants and they were then followed up every month in their routine visits. They were also counselled and provided with information on using the mobile application and audio-visual aids which was generated based upon their responses to the questions being asked regarding IYCF.
At the same time, a weekly voice and text message was sent to the mobile phones of the participant to educate them on appropriate IYCF practices. The voice message was sent on Tuesday mornings to the phones of the females and evenings for the husbands/fathers, whereas the text message was sent on Thursday at the same time. The content of both the voice and text messages was the same to avoid confusion. Every month the pregnant women and mothers of children were also called up through our call centre to inquire about the routine LHW visit, whereby they were asked about the visit and whether if they had received the voice and text messages. They were also asked about the content of sent messages which they had received. A monitoring dashboard was used to monitor the LHW activity, whereby the project manager observed whether the visits were actually made using GPS coordinated data. Similarly, the time when the visit was made was also noted along with the time spent in each household. This intervention lasted for six months starting from July to December 2016 followed by a short post intervention research consisting of a focus group discussion with the mothers.

Data collection instrument
A structured, post intervention questionnaire was used for data collection which was developed on the same lines as that of the pre-intervention survey. The initial version of questionnaire was developed through extensive review of literature and experts review 19,25 . The questionnaire's Part A comprised of socio-demographic characteristics of the study participants which included age and education level of the women, number of children, family size, place of birth, and mode of delivery. Part B and C contained questions related to breastfeeding, exclusive breastfeeding, and complementary feeding.
The study variables related to knowledge, attitude and practices regarding IYCF were timely initiation of breastfeeding after birth, advisable duration of breastfeeding and exclusive breastfeeding, complementary feeding initiation and continuation, and practices related to prelacteal feeding. The data was collected through telephonic interviews which were indicated as a preference in our formative study. Only if the woman was unreachable via the phone were they then visited at their house for the interview which was facilitated by the respective LHW of the respondents' catchment area.

Statistics analysis
The collected data was double-entered in EpiData software version 3.1. It was analyzed using SPSS version 21. The total sample size was 135 eligible women which were recruited based on the sampling frame created earlier for the intervention phase. Both descriptive and inferential statistics are reported in frequencies and percentages, including the percentage difference for pre and post knowledge, attitude, and practices related to IYCF nutrition.

Ethical consideration
Ethical clearance was obtained from Hospital Ethics Committee of Pakistan Institute of Medical Sciences (PIMS), Islamabad 26 . Informed consent (both written and verbal) was obtained from all study participants prior to their recruitment in the study. These women and their husbands were approached and were explained about the study purpose. Their queries to the study were addressed and they were provided with necessary information to contact in case of withdrawing from the study. They were also ensured about their privacy and confidentiality to be protected. Mineral Water 08 5.9

Results
Tube Well 15 11.9 * No Formal Education, LHW=Lady Health Worker of these women was 'unemployed'. The birth place of children as reported by 77 (57.3%) of women was a government facility, and the mode of delivery of 86 (63.7%) women was reported as 'normal'. The common source of water was 'tap water' in the households according to 50 (37%) of women.
The findings of our survey elucidated that the mhealth intervention was effective in improving the overall knowledge of mothers regarding IYCF from 74 (54.8%) in 2016 to 94 (69.6%) in 2018 after the intervention (Table 4). However, the overall pre-intervention knowledge of 34 pregnant mothers regarding breastfeeding, exclusive breastfeeding and complementary feeding was 75.6%which decreased to 46.7% among 21of these women even after the mhealth intervention. This emphasizes the need of increasing awareness among pregnant women, in particular ( Table 2).
The overall attitude regarding IYCF among 59 (43.7%) of the mothers before intervention, and among 86 (63.7%) of the mothers after intervention, was found to be positive. Whereas; overall practices of 22 (16.3%) mothers before intervention and 88 (65.2%) of the mothers after intervention were found adherent to good practices (Table 4). A noticeable percentage increase in knowledge related to prelacteal feeding considered as harmful and the benefits of colostrum was 28.2% and 23%, respectively (Table 2).
A percentage difference of 46.4 was observed in attitude of mothers towards consistency of food consumed by their children, which was 12.1% before intervention, and was found to be adequate among 58.5% of the mothers after intervention. Furthermore, practices regarding complementary feeding and additional foods during the first six months of infancy were 0.0% before the intervention which was significantly raised to 66.7% among these mothers (Table 3). In addition, 55 (40.7%) of the mothers reported to be visited 'once' by LHW, followed by 49 (36.3%) of the mothers who were visited 'twice' on a monthly basis (Table 1). Pre-and post-intervention findings are available as Underlying data 22 .

Discussion
For child survival, growth and development, a key strategy is to improve infant and young child feeding (IYCF) related practices which is becoming an essential component of child health programs in various countries 27 . The results of our post-mhealth intervention survey regarding infant and young child feeding (IYCF) conducted in a rural territory in Islamabad yielded to be effective in improving the knowledge, attitude, and practices of pregnant and lactating mothers. Based on findings of our earlier research conducted on the same study population we found that community-based nutritional intervention such as 'mhealth' offer new opportunities for effective and efficient service delivery, resource utilization, and improving access to healthcare 28 . Improving infant and young child feeding (IYCF) practices in poor resource setting can be effectively contextualized through information technology involving mhealth. Specific socio-cultural barriers hindering the access of mothers to The findings of our survey elucidate that specific focus should be placed on the components of knowledge related to breastfeeding and exclusive breastfeeding during early infancy. However; relevance and quality of mhealth to other components of maternal and child health must be rigorously studied to promote the proliferation of mobile phones as a source of acquiring health information in developing countries.
Despite the improvement in overall knowledge, attitude and practices of women related to IYCF in our study, certain important components related to breastfeeding showed steady findings. The knowledge of women regarding advisable duration of breastfeeding, early initiation of breastfeeding after birth, and timely complementary feeding initiation with additional food to be given to in early 6 months of infancy showed no significant change after mhealth intervention. This could be attributed to a prolong washout period after the deployment of mhealth intervention among the mothers or it can possibly subject to recall bias. Despite this more than a quarter of women in our study still practised and considered prelacteal feed such as honey and water as advantageous for the infant. This was found to be consistent to the findings of research studies conducted in Myanmar, Ethopia & India where prelacteal feeding was perceived as a cultural practice and was related to maternal beliefs 31-34 .
There seems to be a paucity of relevant available literature on assessing the effectiveness of mhealth, particularly in the context of infant and young child nutrition particularly in Pakistan 28 , which signifies its importance in implementing such interventions in poor resource settings. In contrast to our earlier research findings on testing the acceptance of mhealth among women residing in Tarlai Kalan Islamabad, a study from Sri Lanka demonstrated that women preferred to interact with healthcare providers on their maternity and child health needs 35 . In our study, the majority of women favoured the use of mobile phones to access information related to infant and young child feeding. On the basis of which, we therefore recommend scaling up of the health intervention in poor resource settings.
Our study findings reflect that extensive mobile coverage has emerged as an innovative tool in rural Islamabad, and has acted as a facilitator which can effectively reach the underserved communities for providing health as well as education regarding infant and young child nutrition.

Strengths and limitations
• Overall, the strength of the deployed intervention lies in an increase in the practices of mothers related to IYCF nutrition • This was a novel intervention, the first of its kind in Pakistan • Additionally, we have managed to incorporate the intervention within the existing LHW program rather than having to create a new intervention. This would enable the intervention to be scaled up feasibly • One of our study limitations is that we conducted telephonic interviews which can introduce potential biases in responses of the mothers unlike in face-face interview approach.

Conclusion
Our study indicates that community-based nutritional interventions using mhealth are innovative and effective in increasing IYCF related knowledge, attitude and practices among mothers. Cost-effectiveness of such behaviour change approaches and interventions should be assessed for future implementation in maternal and child health related programmes.

Software availability
The source code of android phone-based application developed for the Lady Health Workers (LHWs) under the project "Sehatmnd Kl" is the property of Maternal, Neonatal and Child Health Research Network (MNCHRN) and cannot be made public.
All content used in the app to provide information to the recruited mothers is available as Extended data 22 . This project contains the following extended data:

If applicable, is the statistical analysis and its interpretation appropriate? Partly
Are all the source data underlying the results available to ensure full reproducibility? Yes My main comments are: The intent of the authors is good. They made a lot of effort to well describe the intervention and conduct pre-and post-intervention surveys.
However: The design does not optimistic conclusions. I think the authors should be very modest and discuss some key limitations: the selection was not randomly done, there was no comparator to your study (cluster randomized trial). Also, the questionnaire was quantitative and you did not capture the qualitative aspect of the intervention (feasibility, acceptability, sustainability, etc). We opted for quasi-experimental (pre-post) design and convenience-based sampling was done for the selection of participants form the sampling frame. The qualitative component, we covered in the formative study where we tested the acceptance of the intervention mentioned in the introduction section, last paragraph.
The introduction is long but the authors did not use the space to justify the study in Pakistan. Just saying that "there is insufficient information" is not the good justification. Revised in the introduction. flow diagram, this age group is further subdivided into 0-6 and 7-24 months of age. It is unclear how the application designed only for 0-12 months of age could have catered for age group beyond 12 months. The flow diagram has repeatedly wrong spellings of "participants". In paragraph three, following the heading "mobile application" again contradicts the 7-24 months of age and states 7-12 months of age. age 6, paragraph two, the text has not been able to explain to the reader whether the SIM and mobile were acquired for the LHWs or for all the participants. This should be clearly stated and differentiated. ○ Additional points for methods: For practices, why were there non-direct or indirect observations? The acquired knowledge of the participants during the intervention can lead to over reporting of good practices to please the researchers (Hawthorne effect). Furthermore, did the researchers take into an account the effect of other sources of knowledge (confounders), which could supplement or negatively impact their intervention, and how did they take care of them and controlled those factors? ○

Results:
Results are divided into descriptive and inferential statistics. However, no test of significance was applied for the inferential statistics. Just on the bases of difference of percentages in pre-and post-is insufficient to claim significant effectiveness.

○
The results should be written in order of the objectives of the study as they were achieved.

○
The tables are cited without proper and ascending sequence.

Discussion:
Instead of discussing the mHealth intervention in length, depicting their inclination towards supporting their positive results only, the authors should do impartial and unbiased discussion. They should also discuss the implication of negative results, why some practices also increased while a few declined, what could be the underlying factors (supported by literature), claiming that the women favored the use of mobile phone to access information was not supported by any result given in the text.

References:
About 30% of references were of more than five years old.

If applicable, is the statistical analysis and its interpretation appropriate? Partly
Are all the source data underlying the results available to ensure full reproducibility? therefore by effectiveness we mean the success of deploying mhealth intervention for IYCF. Hence, differences were calculated pre-post to assess the increase in knowledge, attitude and practices among the study participants.
Methods: Ten can be written as 10, as numbers below 10 are written in words only.

Revised
For intervention part, the authors had messages translated to Urdu from English just once. However, the standard is to back translate it in English so that they are exactly the same as they were before the initial translation. The messages were back translated into English language, the text has been revised.
The paragraph on "intervention design" needs rephrasing as the text is confusing. Similarly, the paragraph on "messages" also needs rephrasing, so that the reader easily understand what the authors wanted them to know.

Rephrased
Sampling frame creates big confusion. In the start it is 0-24 months of age children. But then it changes to 0-12 months in the later text (mobile application part). Further, in the flow diagram, this age group is further subdivided into 0-6 and 7-24 months of age. It is unclear how the application designed only for 0-12 months of age could have catered for age group beyond 12 months. The flow diagram has repeatedly wrong spellings of "participants". In paragraph three, following the heading "mobile application" again contradicts the 7-24 months of age and states 7-12 months of age. The mobile application part is the intervention phase where mothers having children of 0-12 months of age were recruited in 2016 but messages were sent according to the age groups defined which were from 0-6 months and 7-12 months. Later on in the post-intervention survey which was conducted in 2018, we included the same population but the age of the children was set 0-24 months so to match the ages of children. Spelling errors have been corrected. In the paragraph three, the age group refers to the pre-intervention phase.
Age 6, paragraph two, the text has not been able to explain to the reader whether the SIM and mobile were acquired for the LHWs or for all the participants. This should be clearly stated and differentiated. Revised. The text has been mentioned in paragraph two, line number 11.
Additional points for methods: For practices, why were there non-direct or indirect observations? The acquired knowledge of the participants during the intervention can lead to over reporting of good practices to please the researchers (Hawthorne effect). Furthermore, did the researchers take into an account the effect of other sources of knowledge (confounders), which could supplement or negatively impact their intervention, and how did they take care of them and controlled those factors? Practice-based knowledge questions were asked from the study participants without observation. We did not took into account Hawthorne effect or other confounding factors though we have mentioned that this evaluation was conducted after 2016 in 2018 and have mentioned in limitations about potential biases.

Results:
Results are divided into descriptive and inferential statistics. However, no test of significance was applied for the inferential statistics. Just on the bases of difference of percentages in pre-and post-is insufficient to claim significant effectiveness. For effectiveness we referred to it the success of using mhealth for dissemination of knowledge regarding IYCF.
The results should be written in order of the objectives of the study as they were achieved. The tables are cited without proper and ascending sequence. Revised and table have cited correctly in ascending order.

Discussion:
Instead of discussing the mHealth intervention in length, depicting their inclination towards supporting their positive results only, the authors should do impartial and unbiased discussion. They should also discuss the implication of negative results, why some practices also increased while a few declined, what could be the underlying factors (supported by literature), claiming that the women favored the use of mobile phone to access information was not supported by any result given in the text. Decrease of some practices has been ascribed to prolong wash period mentioned in the text paragraph 3 line number 6. The discussion might be read as narrow due to limited evidence on use of mhealth for IYCF knowledge and quality of mhealth for MNCH programs. But negative results have been discussed and supported by literature in paragraph two line numbers 3 & 5, paragraph three line number 10. The use of mobile phone to access information was been demonstrated by the results of our formative study.
References: About 30% of references were of more than five years old. There are 12 references that are more than five years old, due to limited available data so we searched literature that is available in past 10 years.
It would be more informative, if the interface of the application is attached to the paper and the type of options available for the participants to receive information on IYCF. Competing Interests: None.
The benefits of publishing with F1000Research: Your article is published within days, with no editorial bias • You can publish traditional articles, null/negative results, case reports, data notes and more • The peer review process is transparent and collaborative • Your article is indexed in PubMed after passing peer review • Dedicated customer support at every stage • For pre-submission enquiries, contact research@f1000.com