Randomized Controlled Trial (RCT) of SMS Messages to Pregnant Women in Peru: WAWARED RCT
Patricia J. Garcia 1,2*, Jose Perez-Lu 1, Walter H. Curioso 1,3, Cesar P. Carcamo 1, Diether Beuermann 4
1Epidemiology, STD/AIDS Unit, School of Public Health, Cayetano Heredia University, Lima, Peru
2Department of Global Health, University of Washington, Seattle, WA, USA
3Department of Biomedical Informatics and Medical Education. University of Washington, Seattle, WA, USA
4Inter-American Development Bank, Washington DC, USA
*Corresponding author: Patricia J. Garcia, Epidemiology, STD/AIDS Unit, School of Public Health, Cayetano Heredia University, Lima, Peru
Received Date: 24 May, 2021 Accepted Date: 14 June, 2021 Published Date: 18 June, 2021
Citation: Garcia PJ, Perez-Lu J, Curioso WH, Carcamo CP, Beuermann D (2021) Randomized Controlled Trial (RCT) of SMS Messages to Pregnant Women in Peru: WAWARED RCT. Rep Glob Health Res 4: 131. DOI: 10.29011/2690-9480.100131
Abstract
Background: Pregnancy-related complications continues to be unacceptable high, especially in low resource countries. Antenatal Care (ANC) could be an effective intervention. However, still most pregnant women in the developing world go to only one-or less than the recommended ANC visits during their whole pregnancy, so there is a need of strategies to improve ANC attendance. Digital technologies represent an innovative approach to increase ANC attendance. Within the Project WAWARED: “Getting connected for better maternal and child health”, we included a Randomized Controlled Trial (RCT) to evaluate the impact of the introduction of individually tailored SMS messages to pregnant women in Peru. The objective of this paper is to present the results of the WAWARED RCT and examine the effects of SMS messages in ANC visits, behavioral outcomes, maternal and neonatal outcomes.
Methods: The WAWARED system sent automatic SMS messages according to gestational age and any specific pathology registered in the Electronic Medical Records (EMR). ANC appointment reminders were sent, and additional educational messages were also sent to the intervention group until the end of the pregnancy. 651 participants were randomized to the intervention group and the control group respectively.
Findings: Pregnant women who received SMS messages were 6% more likely to attend more than 6 ANC visits and 25% more likely to attend the visits on time. This effect was modified by education, since all the effect was seen in women with secondary or higher education. There was no significant difference in the rates of Low Birth Weight (LBW) between groups.
Conclusions: SMS sent to pregnant women had a significant effect in increasing the number of ANC visits and these effects were more evident in women with more education, but it was also possible that the introduction of the EMR helped to improve the number of ANC in both control and intervention groups.
Introduction
Pregnancy-related complications continues to be unacceptable high, especially in low resource countries. The World Health Organization (WHO) estimates that every day at least 830 women die from preventable causes related to pregnancy and childbirth [1,2]. Globally, countries have agreed on a target under the Sustainable Development Goal 3 to reduce global maternal mortality to less than 70 per 100 000 births by 2030, with no country having a maternal mortality rate of more than twice the global average [3]. Since most causes of maternal deaths are preventable, there is an urgent need for effective interventions. Antenatal Care (ANC) could be an effective intervention since it provides a platform for health promotion, prevention, screening, and diagnosis of diseases and is an opportunity to provide the social and psychological support that women need for a healthy pregnancy [4]. However, although early ANC visits have the potential to avoid pregnancy-related complications; still most pregnant women in the developing world go to only one-or less than the recommended ANC visits during their whole pregnancy, so there is a need of strategies to improve ANC attendance [5,6].
Mobile phones are becoming one of the most important ways to communicate and keep in touch. Short Message Services (SMS) have been used for behavioral change in disease prevention, in disease management and to increase patient attendance to outpatient clinics [7-11]. For maternal care, studies have shown that most pregnant women (even in developing countries) have access to SMS and have interest in receiving messages with educational information [12-14]. However, there are no robust evidence on the impacts of these interventions on maternal health outcomes. Within the Project WAWARED: “Getting connected for a better maternal and child health”, funded by the Mobile Citizen Program of the Inter-American Development Bank, we included a Randomized Controlled Trial (RCT) to evaluate the impact of the introduction of individually tailored SMS messages to pregnant women in Peru [15]. “WAWA” is the Quechua word for baby. Quechua is the main native language of Peru. “RED” means network. The objective of this paper is to present the results of the WAWARED RCT and examine the effects of SMS messages in ANC visits, behavioral outcomes, maternal and neonatal outcomes.
Methods
The WAWARED project involved the implementation of an Electronic Medical Record System (EMR) for maternal health in the Region of Callao-Ventanilla in Peru [16]. This EMR was linked to automatic SMS messages to pregnant women tailored to their health profile and gestational age which was evaluated through a RCT which is presented in this manuscript.
Development of SMS and the automated text message system
SMS development was informed by behavioral change theory [17,18]. Following the methodology used by other studies, we took several steps for developing the messages using formative research [19] and validating them; addressing the technology to send SMS, and piloting the system [20,21].
1. Focus groups and in-depth interviews to address needs and to define content, format and design SMS messages: We performed focus groups with pregnant women to identify the type of text messages, topics they would like to receive, and the timing and frequency of SMS.
2. At the beginning we proposed SMS aimed to increase adherence to ANC visits: “appointment remainders”. During the focus groups women shared their needs of having other additional types of messages: “educational messages” i.e. importance of hand washing; “motivational messages” i.e. “You are doing well with your pregnancy! Good job!”; “nutritional messages” and “special messages” according to diseases. Furthermore, participants told us that they would like to receive the messages 3 times a week (Monday, Wednesday and Saturday) at 9:00 am. At the end of this step we decided to design the four different types of messages. In addition, we conducted in depth interviews with pregnant women to understand the reasons why they go or do not go to their ANC visits. With this information we crafted the contents of the appointment reminders and motivational messages. All the other messages were created reviewing national guidelines and recommendations regarding ANC [21]. Additional in-depth interviews were performed with health providers involved in ANC to explore the information that were already given during ANC visits and to get their suggestions on the content of the draft SMS. Health providers were very in agreement with the types of messages we decided to work on.
3. Validation of the SMS: We perform additional focus groups with pregnant women to validate the messages for completeness, cultural correctness, relevance and understandability. In addition, we conducted a focus group with midwives and authorities of the Ministry of Health to validate the final messages. At the end we had 10 motivational messages, 35 appointment reminders, 67 educational messages and 268 specific messages for the total course of pregnancy.
4. Technological Component: We received a number of free text messages from a local telephone company and we used their SMS platform to distribute messages to women with cell phones having them as providers.
5. For women with cell phones from other companies, we used the Tropo company services. Tropo (https://www.tropo.com) is a provider of communication services, specialized in mass messaging and connectivity with SMS.
6. Pilot testing: We developed a pilot study to test the automated text messaging system, including 92 pregnant women.
Trial Design and participants
We conducted the RCT to evaluate the SMS involving the 15 health centers and 1 hospital from the Ventanilla/Callao health network. Eligible participants were pregnant women, at least 18 years old, with 20 weeks’ gestation or less coming to one of the health centers or the hospital for her first ANC visit, reporting ability to read, having a cell phone and being interested to participate in the study. In Peru, incoming SMS are free of charge, so participants did not incur in any costs.
Sample Size
Sample size calculations were based on percent of pregnant women (60%) who attended at least 6 ANC visits during their pregnancy in the region of Callao in previous years [22,23]. With 651 women in each arm, using α =0.05 and presuming 12% loss to follow-up, we estimated achieving 80% power to detect a difference of at least 8% in the proportion of women coming to at least 6 ANC visits on time.
Randomization
All the health centers located in Ventanilla-Callao had an operational EMR for maternal care started through the WAWARED project. For the RCT we introduced a module on the EMR for eligibility to participate. The randomization lists were established before initiating the study. In addition, the randomization used permuted block design, with blocks of four subjects to maintain the adequacy of randomization.
For all pregnant women coming to her first ANC, the EMR identified those with at least 18 years old, with 20 weeks’ gestation or less and with a cell phone. The computer screen showed this message inviting women to participate in the study: “We have a system that we want to evaluate for appointment reminders, preventive and motivational messages for pregnant women, would you be interested in participating in the investigation?”. If the woman was interested, the health provider (usually a professional midwife) read the verbal informed consent showed in the screen with the woman, assess other eligibility criteria and the agreement was documented in the computer as a yes. The mobile phone number was rechecked and information about the mobile phone provider was added. Each woman was randomized to either receive or not the SMS messages automatically by the system. Health providers were not informed of the assignment of the participant.
Intervention
After the automatic randomization, the system started to send SMS messages according to gestational age and any specific pathology registered in the EMR. ANC appointment reminders were sent every Monday and the day before the scheduled appointment. Furthermore, every Wednesday and Saturday, additional educational messages suggesting healthy foods, vitamin intake reminders, hygiene practices or messages specific to recorded diseases were also sent to the treated group until the end of the pregnancy (week 40).
Measure of Outcomes
Most of the data analyzed came from the EMR (attendance to ANC, birth weight, and hemoglobin levels). Additionally, at the end of the pregnancy women from the intervention and control groups were interviewed to collect data on food intake and reported adherence to iron/folic acid in the last week of pregnancy (exit questionnaire). The interview took approximately 10 minutes.
Analysis
Primary outcome
The primary outcome of the RCT was the percentage of pregnant women who attended at least 6 ANC within the whole pregnancy period. In addition, we also assessed the percentage of pregnant women who attended at least 6 ANC on time (at the scheduled date) within the pregnancy period.
Secondary outcomes
Secondary outcomes included behavioral responses in terms of feeding habits and intake of iron/folic acid. SMS included recommendations of healthy food items that should be eaten and discouragements suggesting the avoidance of certain items. We build two different indexes measuring the incidence of both recommended and not recommended food items within each woman’s diet measured through an exit questionnaire. To do so, we computed indicator variables for each food item taking the value of one if the woman reported consumption of the item; while zero otherwise. Then, for each indicator variable, we computed the mean and the standard deviation of the control group. After this, to each food item indicator of the entire sample (both treated and control women), we applied a standardization by subtracting the control group mean and dividing by the control group standard deviation. Finally, we averaged the standardized indicators for both recommended and not recommended food items to obtain both indexes. These indexes are expressed in standard deviations with respect to the control group. That is, the indexes have zero mean and unity standard deviation for the control group; so that the differences in the average of the indexes between treated and control groups are expressed in standard deviations of the distribution of control women. To measure behavioral changes in terms of iron/folic acid intake, we consider the percentage of pregnant women who reported taking all their doses on time during the last week of pregnancy.
Finally, we included as secondary outcomes the percentage of women who were found anemic (hemoglobin level below 11) at the end of pregnancy (maternal outcome) and the percentage of newborns with low birth weight (below 2,500 grams) (neonatal outcome).
Statistical analysis
We used Stata/SE v14.1 (Stata Corp., College Station, TX, USA) for analysis. All tests were two-sided with a significance level of 5%.
Descriptive statistics for both groups were calculated including demographic characteristics. Categorical variables were summarized using the number and proportion of patients, while continuous variables were presented using the mean and the Standard Deviation (SD).
The primary and secondary outcomes were examined using the intention-to-treat principle. For categorical outcomes, we compared the proportions between intervention and control groups using relative risk regression adjusted for woman’s age, distance from the household to the health center, woman’s educational attainment and occupation with a log link and clustered error variance at the health center level. For continuous outcomes, we compared the mean between intervention and control groups using multivariate regression adjusted for woman’s age, distance from the household to the health center, woman’s educational attainment and occupation with clustered error variance at the health center level.
In addition, as this intervention required the ability to read and understand SMS messages, we considered an analysis of possible effect modification by stratifying the sample by the woman’s educational attainment (women without secondary education vs women with completed secondary education or higher). Educational attainment intends to capture not only the ability to read and understand the SMS, but also the awareness of the potential benefits of ANC.
Ethical Considerations
All participants provided electronic verbal consent as described before. The study was approved by ethical review committees of the Universidad Peruana Cayetano Heredia (IRB number 56864) and the Regional Health Directorate of Callao, Peru.
Results
Study Participants
There were 6100 women who attended the health establishments in Ventanilla for first ANC visit between 2012- 2013. Only 2135 of the participants met the initial eligibility criteria (first ANC visit, 18 years or older, and less than 20 weeks of pregnancy). From them, 1,495 had a cellphone and 1,302 (87%) agreed to participate in the study. 651 participants were randomized to the intervention group and the control group respectively. All the participants were followed throughout their gestational period. At the end of the follow-up, 576 (88%) of the intervention group and 586 (90%) of the control group had their exit questionnaire. (Figure 1).
Most maternal characteristics were balanced between study arms at baseline. The only difference was in the proportion women reporting as their occupation being students between the control (9.8%) and the intervention (6.3%) groups (p=0.01) (Table 1).
Antenatal Care Visits
Regarding ANC visits, we found significant differences between intervention and control groups. In the intervention group, 499 of 576 (86.6%) pregnant women attended to 6 or more ANC visits compared to 482 of 586 (82.3%) in the control group [Relative Risk (RR) 1.06, 95% Confidence Interval (CI) 1.01 – 1.11, P=0.03]. When the comparison relates to attend to 6 or more ANC visits on time, in the intervention group, 134 of 575 (23.3%) did so, compared to 108 of 582 (19.6%) in the control group (RR 1.25, 95% CI 1.06-1.48, P=0.01) (Table 2).
Behavioral Outcomes
The mean of the recommended food index in the intervention group is 0.06 higher compared to the control group [95% CI 0.02 - 0.09, P=0.01]. There was not statistical difference in the mean non-recommended food index between intervention and control groups. We did not find any difference between intervention and control groups in relation to reported iron intake in the last week (P=0.25).
Maternal and Neonatal Outcomes
At the end of the pregnancy, 98 of 460 (21.3%) in the intervention group had anemia compared to 106 of 476 (22.3%) in the control group (RR 0.97, 95% CI 0.76-1.23, P=0.80). Surprisingly the levels of anemia at the end of pregnancy for both groups were similar to the levels at baseline (Table 1). There was no significant difference in the rates of low birth weight (LBW) between groups. LBW was found in 27 of 576 (4.7%) of newborns from the intervention group compared to 28 of 586 (4.8%) in control group (RR 0.98, 95% CI 0.68-1.40, P=0.91) (Table 2).
Treatment Effects by Educational Attainment
In the stratified analysis by level of education we found a significant effect on the group that has secondary or higher education in the following variables: Attend to 6 or more ANC visits (RR 1.06, 95% CI 1.01-1.12, P=0.01); attend to 6 or more ANC visits on time (RR 1.25, 95% CI 1.02-1.53, P=0.03); higher recommended food index (RR 0.06, 95% CI 0.01-0.11, P=0.03); and took iron on time (RR 1.09, 95% CI 1.01-1.18, P=0.03) (Table 3).
Discussion
The RCT showed that pregnant women who received SMS messages were 6% more likely to attend more than 6 ANC visits and 25% more likely to attend the visits on time. The other important finding is that the effect was modified by education, since all the effect was seen in women with secondary or higher education. No significant difference in the rates of Low Birth Weight (LBW) between groups was found.
One of the most commonly documented uses of mHealth is the one-way text-message and phone reminders to encourage follow-up appointments. A systematic review and metanalysis on the impact of text-based electronic notifications on improving clinic attendance included 26 articles, none included ANC [24]. The review showed that patients who received notifications were 23% more likely to attend clinic visits compare to those who received no notification. Our results are similar to a system implemented in Kenya where a mobile phone SMS-based system was used to track pregnancy and maternal and child outcomes [25]. The authors concluded that implementation of mobile-phone systems at the community level could contribute to improving emergency obstetric and neonatal care. In Zanzibar, an intervention, based on a mobile phone text message and voucher component contributed to improve the health of the newborns [26].
The WHO, in a 2016 document, recommended increasing the number of “contacts” or ANC visits from 4 to 8, to better assess mothers and babies and to improve the support and communication between healthcare providers and pregnant women [4,27]. We used the indicator of more than 6 ANC visits for this study, following the current Peruvian National Guidelines. However, we added the analysis of equal of more than 8 ANC and found a significant difference between the intervention and control arm (RR 1.18, 95% CI 1.06-1.33, P=0.003).
It is interesting to note that reviewing reports from the Ventanilla region from previous years, only 60% of pregnant women completed more than 6 ANC visits. But during the study in the control group we documented that around 85% of the pregnant women had more than 6 ANC. Although SMS were sent only to the intervention group, as part of the study, we implemented the EMR for both intervention and control groups. It is possible that just the use of EMR in our study, allowed providers to better register data, to schedule visits directly from the EMR and to have a better follow up of patients, resulting in improving their adherence to the clinic visits for both intervention and control groups. EMRs in general have shown to be promising as facilitators for health care improvement. A recent state-of-the-art review found that the most commonly emphasized process improvement associated with EMR relates to improved efficiency of time-consuming or error prone tasks [28]. Nevertheless, reduction of missed appointments has been associated with the introduction of EMRs tools [29].
In relation to iron intake, we did not find any effect in the prevention or reduction of anemia in our population. One interesting observation is that the level of anemia found in this group of pregnant women, was relatively low (21.3%-23-5%) compare to the prevalence of anemia in general population of pregnant Peruvian women (27.9%) [30]. A very similar situation happened with another secondary outcome, LBW. The prevalence of LBW in our study was lower (4.8%) than that of the general population in Peru (8.2%) [31]. One explanation could be related to the inclusion criteria we used for the recruitment of pregnant women, including only those women coming before 20 weeks of gestation to their first ANC. These women could be selected women, those more concerned about their health and with better nutritional practices and healthier lives and therefore had lower levels of anemia and LBW. In addition, to be able to detect any effect on anemia or LBW we would have needed a larger sample size and we calculated our sample size based on the number of ANC visits, which really was our main outcome of interest.
Successful reading comprehension requires the ability to analyze, synthesize, and evaluate information [32], and these abilities could be acquired when finishing secondary studies. Reading comprehension in Peru has been found to be related with socio-cultural factors and gender [33]. A population like ours, with no secondary studies could have had limitations on their reading comprehension and difficulties to understand the content of the SMS despite they could read them, and this could explain why most of the positive effect of the messages was seen in women with secondary education or more. The provision of information can influence people’s behavior only when they are able to process the new information [34].
Conclusion
In our study, SMS had a significant effect in increasing the number of ANC visits and these effects were more evident in women with more education, but it was also possible that the introduction of the EMR helped to improve the number of ANC in both control and intervention groups. We did not find significant differences in relation to iron intake, anemia or LBW, but the study was not powered for these secondary outcomes.
WAWARED (EMR and SMS) continued to be used in the Ventanilla-Callao network of health centers and it was implemented in the other health networks of Peru. In December 2015, an agreement with the Peruvian Ministry of Health (MINSA) was subscribed to transfer the WAWARED system for national implementation. In 2017, a directive from the Ministry of Health (Ministerial Resolution Nº 021-2017/MINSA) established the use of the WAWARED system in health care establishments at the national level. The implementation started progressively in 2017, and by 2018, more than 1000 MINSA health facilities are using the system nationally and the implementation continues. WAWARED is a clear example of a successful and sustainable collaboration between academia, the national and regional governments and an international developing financing agency.
Acknowledgements
To all the health professionals that participated in the WAWARED study.
Ethics approval: Ethics approval was provided by Universidad Peruana Cayetano Heredia Research Ethics Board.
References
- World Health Organization. Maternal Mortality Facts.http://www.who.int/news-room/fact-sheets/detail/maternal-mortality .Last accessed April 30th, 2021.
- Winnikoff B (1990) Women’s Health in Developing Countries. In: Wallace y Giri (eds) Health Care of Women and Children in Developing Countries 37-47.
- United Nations Sustainable Development Goals. https://sustainabledevelopment.un.org/sdg3 Last accessed April 30th, 2021.
- Tuncalp O, Pena-Rosas JP, Lawrie T, Bucagu M, Oladapo OT, et al. (2017) WHO recommendations on antenatal care for a positive pregnancy experience—going beyond survival. BJOG 124: 860-862.
- Joyce T (1990) Self-Selection, Prenatal Care, and Birthweight Among Blacks, Whites and Hispanics in New York City [Internet]. National Bureau of Economic Research dic. Report No.: 3549.
- Bhutta ZA, Darmstadt GL, Haws RA, Yakoob MY, Lawn JE (2009) Delivering interventions to reduce the global burden of stillbirths: improving service supply and community demand. BMC Pregnancy Childbirth 9 Suppl 1: S7.
- GSMA Intelligence. https://www.gsmaintelligence.com/ Last accessed April 30th, 2021.
- Krishna S, Boren SA, Balas EA (2009) Healthcare via Cell Phones: A Systematic Review. Telemedicine and e-Health 15: 231-240.
- Berrouiguet S, Baca-García E, Brandt S, Walter M, Courtet P (2016) Fundamentals for future mobile-health (mHealth): a systematic review of mobile phone and web-based text messaging in mental health. Journal of medical Internet research. 18.
- Perron NJ, Dao MD, Kossovsky MP, Miserez V, Chuard C, et al. (2010) Reduction of missed appointments at an urban primary care clinic: a randomised controlled study. BMC family practice. 11:79.
- Cole-Lewis H, Kershaw T (2010) Text messaging as a tool for behavior change in disease prevention and management. Epidemiol Rev 32: 56-69.
- Tezcan B, Von Rege I, Henkson H, Oteng-Ntim E (2011) Unified communication to reach vulnerable mothers. J Obstet Gynaecol. 31: 122-124.
- Cormick G, Kim NA, Rodgers A, Gibbons L, Buekens PM, et al. (2012) Interest of pregnant women in the use of SMS (short message service) text messages for the improvement of perinatal and postnatal care. Reprod Health. 9: 9.
- Jareethum R, Titapant V, Chantra T, Sommai V, Chuenwattana P, et al. (2008) Satisfaction of healthy pregnant women receiving short message service via mobile phone for prenatal support: A randomized controlled trial. J Med Assoc Thai. 91: 458-463.
- Pérez-Lu JE, Iguiñiz Romero R, Bayer AM, García PJ (2015) [Wawared Peru: reducing health inequities and improving maternal health by improving information systems in health] Rev Peru de Med Exp Salud Publica. 32: 373-377.
- Curioso WH, Roman H, Perez-Lu J, Castagnetto JM, García PJ (2010) [Improving maternal health information systems: validation of electronic medical records in Callao, Peru]. Rev Peru Med Exp Salud Publica 27: 487-489.
- Norcross JC, Krebs PM, Prochaska JO (2011) Stages of change. J Clin Psychol 67: 143-154.
- Shaw RJ, Bosworth HB, Hess JC, Silva SG, Lipkus IM, et al. (2013) Development of a Theoretically Driven mHealth Text Messaging Application for Sustaining Recent Weight Loss. JMIR Mhealth Uhealth 1: e5.
- Busse P, Curioso W (2011) Diseño de mensajes de texto para motivar a madres gestantes a que acudan a su centro de salud en una zona urbano-marginal del Perú. Diálogo regional sobre Sociedad de la Informació Lima: UPCH.
- Ybarra ML, Holtrop JS, Bağci Bosi AT, Emri S (2012) Design considerations in developing a text messaging program aimed at smoking cessation. J Med Internet Res 14: e103.
- Blitchtein-Winicki D, Zevallos K, Samolski MR, Requena D, Velarde C, Briceño P, et al. (2017) Feasibility and Acceptability of a Text Message-Based Smoking Cessation Program for Young Adults in Lima, Peru: Pilot Study. JMIR Mhealth Uhealth. 5: e116.
- Ministerio de Salud del Peru. Guías Nacionales de Atención Integral de la Salud Sexual y Reproductiva. Ministerio de Salud; 2004. http://bvs.minsa.gob.pe/local/dgsp/63_guiasnac.pdf Last accessed April 30th, 2021.
- Plan Operativo Anual 2010. Callao, Perú: DIRESA Callao; 2010. http://www.diresacallao.gob.pe/wdiresa/documentos/planeamiento/2010.pdf Last accessed January 30th, 2021.
- Robotham D, Satkunanathan S, Reynolds J, Stahl D, Wykes T (2016) Using digital notifications to improve attendance in clinic: systematic review and meta-analysis. BMJ Open 6: e012116.
- Ngabo F, Nguimfack J, Nwaigwe F, et al. (2012) Designing and Implementing an Innovative SMS-based alert system (RapidSMS-MCH) to monitor pregnancy and reduce maternal and child deaths in Rwanda. Pan Afr Med J 13: 31.
- Lund S, Rasch V, Hemed M, Boas IM, Said A, et al. (2014) Mobile Phone Intervention Reduces Perinatal Mortality in Zanzibar: Secondary Outcomes of a Cluster Randomized Controlled Trial. JMIR Mhealth Uhealth 2: e15.
- World Health Organization. WHO recommendations on antenatal care for a positive pregnancy experience. Geneva, Switzerland, 2016. http://apps.who.int/iris/bitstream/10665/250796/1/9789241549912-eng.pdf?ua=1 Last accessed April 30th, 2021.
- Jawhari Badeia, Ludwick Dave, Keenan Louanne, Zakus David, Hayward Robert (2016) Benefits and challenges of EMR implementations in low resource settings: a state-of-the-art review. BMC Med Inform Decis Mak 16: 116.
- Alamo ST, Wagner GJ, Sunday P, Wanyenze RK, Ouma J, et al. (2012) Electronic medical records and same day patient tracing improves clinic efficiency and adherence to appointments in a community based HIV/AIDS care program, in Uganda. AIDS Behav 16: 368-374.
- Gonzales GF, Tapia V, Gasco M, Carrillo C (2011) Hemoglobina materna en el Perú: diferencias regionales y su asociación con resultados adversos perinatales. Revista Peruana de Medicina Experimental y Salud Publica. julio de 28: 484-491.
- Rendón MT, Apaza DH, Vildoso MT (2012) Incidencia y factores de riesgo de bajo peso al nacer en población atendida en hospitales del Ministerio de Salud del Perú. Ginecol Obstet Mex 80: 51-60.
- Goldman SR (2012) Adolescent literacy: learning and understanding content. Future Child 22: 89-116.
- Silva SM, Verhoeven L, Leeuwe J van (2011) Socio-cultural variation in reading comprehension development among fifth graders in Peru. Read Writ. 1 de septiembre de 24: 951-969.
- Dupas P (2011) Health Behavior in Developing Countries. Annual Review of Economics 3: 425-449.