Journal Information |
Article Information |
|
|
Early-warning health and process indicators for sentinel surveillance in Madagascar 2007-2011 |
|
|
|
Abstract |
Background: Epidemics pose major threats in resource-poor countries, and surveillance tools for their early detection and response are often inadequate. In 2007, a sentinel surveillance system was established in Madagascar, with the aim of rapidly identifying potential epidemics of febrile or diarrhoeal syndromes and issuing alerts. We present the health and process indicators for the five years during which this system was constructed, showing the spatiotemporal trends, early-warning sign detection capability and process evaluation through timely analyses of high-quality data. Methods: The Malagasy sentinel surveillance network is currently based on data for fever and diarrhoeal syndromes collected from 34 primary health centres and reported daily via the transmission of short messages from mobile telephones. Data are analysed daily at the Institut Pasteur de Madagascar to make it possible to issue alerts more rapidly, and integrated process indicators (timeliness, data quality) are used to monitor the system. Results: From 2007 to 2011, 917,798 visits were reported. Febrile syndromes accounted for about 11% of visits annually, but the trends observed differed between years and sentinel sites. From 2007 to 2011, 21 epidemic alerts were confirmed. However, delays in data transmission were observed (88% transmitted within 24 hours in 2008; 67% in 2011) and the percentage of forms transmitted each week for validity control decreased from 99.9% in 2007 to 63.5% in 2011. Conclusion: A sentinel surveillance scheme should take into account both epidemiological and process indicators. It must also be governed by the main purpose of the surveillance and by local factors, such as the motivation of healthcare workers and telecommunication infrastructure. Permanent evaluation indicators are required for regular improvement of the system. |
|
The concept of surveillance was developed principally for control of the transmission of infections and for the early detection of outbreaks. The main elements of surveillance methods have been described elsewhere. Surveillance is a continuous, systematic process of descriptive information collection, validation, analysis, interpretation, and dissemination for use in planning, and in the implementation and evaluation of public health policies and strategies for the prevention and control of diseases or disease outbreaks [1-3]. The public health problems approached in this way, including acute and chronic diseases and environmental hazards, are diverse, necessitating the development of tools for the timely monitoring of disease trends. Furthermore, surveillance systems must be evaluated regularly, to ensure that they provide valuable information in an efficient manner [4,5].
Efficient disease surveillance systems are the key to the timely detection of early-warning signs potentially signalling the occurrence of disease outbreaks or epidemics. The World Health Organisation (WHO) has highlighted the importance of improving national epidemic surveillance capacities [6,7]. Recently developed innovative tools, such as mobile telephone technology and electronic systems, have facilitated the improvement of surveillance systems, by reducing data processing [8]. However, these systems are mostly implemented in high-income countries [9], as most developing countries are faced with logistic and budgetary constraints, resulting in low-quality surveillance systems based on pen-and-paper methods. In many cases, these low-tech systems provide health institutions with inadequate support, resulting in frequent “health crises” [10]. Moreover, the healthcare infrastructure, laboratory diagnostic capacity, skills and number of physicians in these countries are generally insufficient to deal with emerging diseases likely to cause epidemics. Consequently, delays in raising the alarm often limit the possibility of an effective early response to new, emerging public health problems.
The need for an efficient sentinel surveillance network in Madagascar was highlighted by worldwide infectious disease threats to public health, such as severe acute respiratory syndrome (SARS) in 2003, avian influenza A H5N1 in 2005 and the Chikungunya epidemics observed in the Indian Ocean region in 2006. In addition, the 2005 International Health Regulations stressed the importance of commitment to the goal of global security and asked all member states to establish and implement effective surveillance and response systems, making it possible to detect and contain public health threats of national and international importance. As a result, the government of Madagascar, in partnership with the Institut Pasteur de Madagascar, established 13 fever sentinel sites in 2007, expanding the network to 34 sites by 2011, to improve the timely detection and management of febrile disease outbreaks. Two key attributes of the sentinel surveillance system are monitored continuously: timeliness and data quality. This system was designed to identify outbreaks for which public health interventions may be required early enough for such interventions to be effective.
We report here the indicators, for 2007 to 2011, of the syndromic sentinel surveillance network, presenting spatiotemporal trends, alert detection capability and evaluations of the process on the basis of timeliness and quality data.
The sentinel surveillance network in Madagascar has been described elsewhere [11,12]. Briefly, it includes primary healthcare centres (sentinel sites) from across the country (Figure 1) and is managed by a national steering committee. The network was expanded from 13 influenza-like illness (ILI) sentinel sites in 2007 to 34 sentinel sites in 2011, with the aim of improving geographic coverage and representativeness of the country as a whole (4 sites are located in Antananarivo) (Figure 1). The sentinel surveillance system makes use of syndromic indicators to monitor the occurrence of selected diseases of importance for the country. The main criterion for the inclusion of cases or patients is fever or diarrhoea. For patients with fever, additional screening criteria (based on syndromic case definitions) are used to identify specific syndromes: malaria, ILI, dengue-like syndromes. Standard WHO case definitions are used, to ensure comparability [11,12]. Malaria diagnosis requires biologic confirmation with a positive rapid diagnostic test in patients with fever syndromes.
Cases and patients at the participating sites are identified by trained healthcare personnel participating in the surveillance network on a voluntary basis. One of the key features of the system is the timely transmission of syndromic data, on a daily basis, by coded short message service (SMS) messages sent from mobile phones. Upon reception at the IPM, the data transmitted in this manner are input daily into a specifically designed MS Access® database and analysed as soon as possible after the patients’ initial visit. This results in a turnaround time of 24 hours, from data collection to reception at the IPM, even for data sent from the most remote areas of the country. The data received by SMS include: sentinel site code, date of data collection, total number of outpatient consultations, total number of confirmed malaria cases, total number of ILI cases, total number of dengue-like cases, total number of diarrhoea cases, and the number of consultations by age group. The age groups were those commonly used by the Ministry of Health in Madagascar: less than 1 year, 1-4 years, 5-14 years, 15-24 years, 25 years and over.
Surveillance data are analysed and presented in easy-to-interpret tables and graphs providing the number of cases for each syndrome monitored. In addition, daily and weekly baselines (mean number of cases in the corresponding period of previous years) are calculated for each syndrome and plotted against current observations, to identify early signs of outbreaks triggering alerts. The information is disseminated on a weekly and monthly basis to healthcare staff involved in the network and to the staff of the Ministry of Health (MoH) in Madagascar.
From January 2007 to December 2011, the data collected on a daily basis corresponded to 917,798 visits (Table 1). The age distribution of the patients concerned, as a function of the total numbers of visits and febrile syndromes, is indicated in Table 1. In total, 102,200 cases (11.1%) of fever were reported. Fever syndromes accounted for 12.1% of visits in 2007, 12.2% in 2008, 11.8% in 2009, 10.8% in 2010 and 10.0% in 2011 (p<0.01, Table 2).
ILI accounted for 14.7% of fever cases in 2007, 8.5% in 2008, 21.3% in 2009, 20.2% in 2010 and 32.8% in 2011 (p<0.01), according to the data transmitted by SMS (Table 3). Dengue-like syndromes (Table 3) accounted for 18.6% of fever cases in 2007, 8.7% in 2008, 10.2% in 2009, 11.5% in 2010 and 4.2% in 2011 (p<0.01). Confirmed cases of malaria (Table 3) accounted for 12.0% of fever cases in 2007, 8.3% in 2008, 10.6% in 2009, 16.8% in 2010 and 12.4% in 2011 (p<0.01). From January 2008 to December 2011, 40,510 cases (4.8%) of diarrhoea were reported in the 837,881 visits (Table 3). Diarrhoea cases accounted for 3.1% of visits in 2008, 4.9% in 2009, 5.5% in 2010 and 5.1% in 2011 (p<0.01).
The epidemiological characteristics of groups with fever-related syndromes, such as those with ILI, identified by the sentinel surveillance system, were investigated by the plotting of daily count data on a graph (Figure 2). Daily and weekly counts, as a function of the regional pattern, were also plotted and analysed for each sentinel centre (data not shown). Figure 2 shows a peak in the number of daily visits in November 2009 corresponding to an increase in the number of febrile syndromes and ILI cases.
A plot of the distribution of febrile and other syndromes over the various years (Figures 2-5) showed that ILI was the dominant cause of fever in most of the country, from 2009 onwards. A subanalysis of the longitudinal data, using only the first 13 sentinel sites established in 2007-2011, yielded similar trends (Figure 4).
From 2007 to 2011, 21 alerts resulting from syndromic surveillance were confirmed by biological surveillance and led to a response and epidemiological investigations to assess the risk.
In October 2008, in Morondava, on the west coast of Madagascar, an increase in the percentage of febrile syndromes and the percentage of ILI cases was recorded. Samples were requested and influenza virus A (H3N2) was detected.
In January 2009, an increase in the percentage of febrile syndromes and in the number of confirmed malaria cases was identified, leading to an investigation of factors potentially associated with an increase in malaria transmission.
In 2010, excess cases of dengue-like syndromes were declared in Mananjary health district, which is located on the southeast coast. The Chikungunya virus was identified and the epidemic confirmed.
None of these events were detected by the routine surveillance system. However, there was no organised response to any of these outbreaks because the MoH lacked the means to deal with these large events.
Relevant process indicators have been identified for the monitoring of the network. These indicators are presented in Table 2 and concern principally the data transmission and data validation processes.
Overall, 85% of the data were transmitted within the 24-hour time frame. This indicator was introduced in 2008. The percentage of data for which transmission was delayed increased from 2008 (12.3%) to 2011 (32.6%), and considerable differences between sentinel sites were observed for this indicator (Table 3).
As previously described [11,12], an individual fever form had to be completed and sent to the IPM for each declared case of febrile syndrome. The fever forms were used to validate the syndrome data transmitted by SMS. Specific forms relating to fever were completed for 82,333 of the patients presenting fever (80.6%). In 2007, 99.9% of the febrile syndromes were documented on a fever form, but this percentage had fallen to 63.4% by 2011.
The sex ratio (male/female) for those with febrile syndromes was 0.88. Age was known for 81,981 patients (99.5%), and the mean age of the patients was 12.5 years (CI 95%: [12.4-12.7]). The age-group distribution is presented in Table 4. ILI, defined on the basis of the symptoms noted on the fever forms (fever and cough, or fever and sore throat), accounted for 49.4% (40,709) of all cases of febrile illness, but significant differences in these percentages (p<0.01) were found between years: 49.2% (4,739/9,633) in 2007, 53.6% (8,884/16,579) in 2008, 55.6% (11,102/19,969) in 2009, 42.8% (8,563/19,992) in 2010 and 45.9% (7,421/16,160) in 2011.
The sentinel surveillance system in Madagascar has two key functions: it provides an early warning of potential threats to public health and it can be used to manage public health programmes, by providing data for malaria indicators, for example. It can rapidly detect unexpected increases in the incidence of fever or diarrhoea syndromes and the biological surveillance associated with the syndromic surveillance programme can then identify the causes of these syndromes.
This system has been described in terms of the methods used [11] and in relation to aspects of influenza surveillance [12,13], such as the spread of the influenza A(H1N1)pdm09 virus [14,15]. During the influenza A(H1N1)pdm09 pandemic, the circulation of this virus in Madagascar was detected and the spread of the virus was followed from October 2009 to March 2010 [14]. We have already highlighted the weaknesses of the routine disease surveillance system in Madagascar, which is based on passive collection and limited capacities for diagnosis outside the capital city. None of the early-warning signs was identified by routine surveillance. Routine surveillance is useful for monitoring long-term programmes, but inappropriate for the timely detection of aberrant patterns. By contrast, syndrome-based near-real time surveillance can detect unusual events more rapidly [15-18]. This timeliness is a key element of the surveillance system and should be evaluated periodically [19].
The evaluation of surveillance systems should promote the most effective use of public health resources, by ensuring that surveillance systems operate efficiently [20]. The sentinel system in Madagascar was clearly simple and rapid, but we found that some process indicators tended to decline over time, due to high staff turnover. The decrease in the number of fever forms received annually, between 2007 and 2011, is one of the weaknesses of this system. The increase in the number of sentinel sites increased the workload of central staff managing the different activities. A lack of co-ordination hindered the training of new healthcare workers entering the network, and changes in practices were discovered only during supervision in the field. Challenges resulting from high staff turnover have also been identified in other countries [6,8]. The indicators used for the continuous assessment of the sentinel network in Madagascar are useful for a rapid, basic internal evaluation, but an external evaluation approach is also required, using CDC guidelines [21], for example, and including economic indicators as an integral part of the surveillance evaluation process [4].
The choice of methods used in the sentinel surveillance system in Madagascar was based on the capabilities of the volunteer healthcare providers and the financial resources available. The Madagascan network has grown over the years and its expansion is probably now limited by the human resources required to manage the network and data analysis. We have found that progressive step-by-step implementation is best, with assessment of the various processes, evaluations of network management capacity and the training of healthcare workers, to make the processes more acceptable.
Despite the results obtained to date, the sustainability of this system remains unclear, although data transmission costs amount to only about 2 US dollars per sentinel site per month. The Madagascan network has been supported by funding from various sources over the years, focusing on different health topics. Self-sustainability is another challenge, as already described [8], and has already been identified as a weakness of this network. We therefore need to focus on the first steps of surveillance system implementation and all system changes. Initial funds targeted arbovirosis, because of the spread of Chikungunya epidemics in Indian Ocean countries in 2006, and influenza, due to the threat posed by avian flu. However, the steering committee subsequently decided to include other diseases associated with febrile syndromes. This policy has been tremendously successful, making it possible for the network to provide epidemiological information not only about arboviruses, but also about malaria and influenza, throughout the country. In 2008, the first human case of Rift Valley fever was detected, by this network, at Taolognaro (in the south of the country), a site used for both syndromic and biological surveillance. For malaria, the network has monitored the shift from control to elimination following the strengthening of malaria prevention and control measures. The usefulness of sentinel networks for influenza detection is well documented and was assessed in the last pandemic period in 2009 [15]. Funding for work on these diseases has improved geographical coverage and made it possible to extend the network over the last five years. This network has become an additional tool for public health decision-making. The syndromic surveillance has been shown to be an effective approach to surveillance and, thanks to the availability of large mobile phone networks throughout Madagascar, the cost of real-time data transmission is low. This surveillance method may also facilitate compliance with the revised International Health Regulations for low-income countries and the aim of the Global Outbreak Alert and Response Network (GOARN) [22].
However, the rapidity with which the system can identify unexpected events, which is seen as an advantage [23], must be weighed against delays in the response. For instance, the time required to conduct investigations and retrieve diagnostic and epidemiological information might negate the advantage of rapid data acquisition, particularly in developing countries, in which it can be hard to find the resources necessary for investigations.
The lack of historical data made it difficult to interpret the syndromic trends at each sentinel centre. One of the challenges in our system is determining epidemiological baselines for each centre, to facilitate the development of better statistical methods and more sensitive alert thresholds, as suggested by several authors [24-28]. Indeed, five years after the establishment of this network, large amounts of data are already available and data analysis methods have identified trends for ILI, malaria and dengue-like syndromes in areas of Madagascar with different climates. We now need to develop spatiotemporal models to increase the sensitivity of the alert detection process. However, limited geographical coverage and limited resources may prevent the detection of some epidemic events by this network.
It is clear that the greatest advantage of this system is the ease with which it can be implemented, thanks to the availability of mobile phones and mobile phone networks. Furthermore the quality of the homogeneous data collected will make it possible to improve the system relative to its principal objective: identifying epidemic events early. We recommend this solution for other African countries, because it performs very well and provides rapid benefits in terms of public health decision-making.
[1] This work was made feasible by the setting up of a sentinel network supported by WHO Geneva (APW/Ref. OD/AP-08-02451), the French Ministry of Health, the Madagascan Ministry of Health through “projet CRESAN” (crédit IDA – 3302-1-MAG (CRESAN-2)), the US Centers for Disease Control and Prevention (Cooperative Agreement Number: U51/IP000327-01), the US Department of Health and Human Service (Grant Number 6 IDSEP060001-01-01) via the International Network of Pasteur Institutes and the President’s Malaria Initiative program (USAIDS). We would like to thank Kathleen Victoir and Marc Jouan from the International Network of Pasteur Institutes.
We thank all the staff from the Madagascan National Influenza Centre for influenza testing (Julia Guillebaud, Arnaud Orelle, Girard Razafitrimo and Vololoniaina Raharinosy), and the National Laboratory for Arbovirus (Jean Théophile Rafisandrantantsoa, Jean-Pierre Ravalohery and Josette Razainirina) for all laboratory tests.
We would like to express our gratitude to Dr Yolande Nirina Raoelina, who was one of the key people involved in setting up the sentinel network, and all the staff from the MoH. We are deeply indebted to all the doctors and nurses involved in sentinel surveillance on a daily basis in Madagascar.