Category Archives: Service Provision Assessment (SPA)

04 Apr 2019

Spotlight on Implementing Agencies: Democratic Republic of the Congo

In January 2019, The DHS Program welcomed visitors from the Democratic Republic of the Congo. This post is one in a series of interviews with visitors to DHS headquarters.

Don’t read French? You can use the translate feature at the top of the page!

Nom : Didine K. Kaba

Pays d’origine :  République Démocratique du Congo

Titre et organisation : Professeur (MD, PhD), Département d’Epidémiologie et Bio statistiques, Ecole de Santé Publique de l’Université de Kinshasa

Rôle dans l’EPSS RDC 2017-2018 : Co-Investigateur de l’enquête


Vous pouvez nous raconter un peu sur votre expérience avec l’EPSS RDC 2017-2018 ?

C’est une enquête intéressante qui nous a permis d’auto évaluer nos compétences dans la réalisation d’une enquête de grande envergure. Dans l’EPSS, il s’est agi d’un échantillon des formations sanitaires disséminées partout en RDC.

Le pays étant grand (26 provinces), les données ont été collectées par vague, qui a été décidée afin de diminuer les sites de formation, permettre une bonne supervision des formations, et assurer ainsi la qualité des données.

Une autre chose que nous avons expérimenté, c’est l’appropriation de l’enquête par le Ministère de la Santé Publique, présent de l’adaptation des questionnaires jusqu’à la rédaction du premier draft du rapport de l’enquête. Son implication à tous les niveaux a facilité la tâche à nos différentes équipes, plus particulièrement à celles chargées de la collecte des données.

L’EPSS RDC 2017-2018 est la première EPSS en RDC. Vous pouvez commenter sur quelques défis ou succès spécifiques à une telle enquête, surtout étant la première expérience ?

Un défi c’est l’immensité du pays, avec accès très difficile dans l’arrière-pays, sans compter le fait que des conflits armés étaient encours dans le pays pendant la collecte des données. Au sein d’une même province, le transport aérien était parfois nécessaire pour accéder à des formations sanitaires soit séparées des autres par des champs de guerre ou alors d’accès difficile par route. Nous disposions également dans l’échantillon des formations sanitaires qui ne pouvaient être atteintes que par pirogue ou hors-bord. Ainsi, nous devrions d’une part respecter l’échantillon des formations sanitaires pour assurer la représentativité et d’autre part veiller à la sécurité des agents de collecte des données. Ce défi a également été relevé. En effet, nous avons collecté les données dans 1380 formations sanitaires sur les 1412, seuls deux pourcents de formations sanitaires n’ont pas été enquêtées.

Comment espérez-vous que les données de l’EPSS RDC 2017-2018 soient utilisées ?

Ces données sont très importantes et très attendues dans le pays. Chaque programme s’intéressera aux données en lien avec son domaine d’intervention. Les données de cette évaluation serviront à l’identification des problèmes à résoudre en vue de l’amélioration de la qualité de l’offre de service des soins en RDC.

Quelles sont d’autres leçons apprises ou pensées que vous aimeriez partager ?

  • Une autre procédure de rédaction d’un rapport d’enquête : informations clés pour chaque chapitre, encadrés pour définir chaque indicateur et commentaires par caractéristique de base ;
  • Maitrise de la formation des adultes/Andragogie : utilisé dans la formation des agents de collecte des données ;
  • Analyse des éditions secondaires des données et des tableaux de qualité avec feedback vers les agents de terrain pour l’amélioration de la qualité des données collectées ;
  • La collaboration entre institutions et le fait d’avoir de la considération des uns envers les autres au sein de l’équipe de recherche ont été le gage de la réussite de l’EPSS RDC 2017-2018. Chaque membre de l’équipe de recherche (agent de collecte des données, facilitateurs/superviseurs, agent de saisie, équipe informatique, équipe de coordination, etc.) avait fait de cette enquête son affaire. Notre motivation était la satisfaction de voir l’enquête se dérouler avec succès. Oui, c’était ça la clé de notre réussite.

The 2017-18  Democratic Republic of the Congo SPA  was released on March 22, 2019.

Download the final report here.

© ICF

21 Mar 2019

DHS Data Users: Insights on Health System Quality from the Service Provision Assessments

© 2017 Magali Rochat/VectorWorks, Courtesy of Photoshare

This new blog series, DHS Data Users, captures examples of how you, the data user, have incorporated data from DHS, MIS, and/or SPA surveys into your analyses, at your institution, or to influence policies or programs. If you are interested in being featured in the ‘DHS Data Users’ blog series, let us know here by submitting your example of DHS Program data use. 


The year 2018 saw an upswell of interest in health system quality with the publication of three global reports highlighting critical deficits in quality in health systems in low- and middle-income countries [1,2,3]. Much of the empirical basis for these reports was drawn from the Service Provision Assessments (SPA), the lesser-known surveys conducted by The Demographic and Health Surveys (DHS) Program, which provide comprehensive assessments of health systems in low-resource settings from Haiti to Nepal.

These surveys include a detailed audit of facility resources, provider interviews, direct observations of primary care services, and exit interviews with patients or caretakers. Each assessment is a sample of the complete health system (public and private) or in some cases a complete census. The resulting wealth of data enables assessment of structural inputs to quality of care, the care process – both competent care and user experience – and some outcomes from care, primarily user confidence in the health system. A small but increasing number of researchers is delving into all the SPA data have to offer. Among the insights the SPA surveys have yielded just from my own research are:

  • Most health systems assessed are not fully prepared for basic health care.
    A comparative study of 8,443 facilities in 9 countries based on SPA surveys between 2007 and 2015 found that hospitals averaged between 69% (Senegal 2012-2014) and 82% (Tanzania 2015, Namibia 2009) on the service readiness index defined by the World Health Organization for primary health facilities. Non-hospitals achieved at best 68% readiness (Namibia 2009) and at worst only 41% (Uganda 2007, Bangladesh 2014) [4]. Within primary care services – antenatal care, family planning, and sick child care – service-specific service readiness is not highly predictive of competent care being delivered.
  • Across facilities with a similar level of readiness, provider adherence to clinical guidelines varied widely. Correlation between readiness and observed clinical quality was more consistent for observations of labor and delivery, though only two SPA surveys include these data [5].
  • In Kenya, where the 2010 SPA did include direct observation of labor and delivery, both structural quality of maternity care and observed clinical quality was higher in facilities in wealthier areas than facilities in poorer areas, with women in the poorest areas receiving care that complied with only half of recommended clinical guidelines on average [6].
  • Across 8 countries, adherence to clinical guidelines was lower in sick child care, where providers completed only 38% of the standard Integrated Management of Childhood Illness (IMCI) items, than in family planning (46%) and antenatal care (57%) [7]. The median sick child consultation lasted only 8 minutes [8]. Focusing specifically on Malawi, where the survey team conducted a limited re-examination of sick children, providers diagnosed pneumonia in only 1 in 5 children who showed symptoms of pneumonia per the IMCI guidelines [9].
  • Analysis of the 2013-2014 Malawi SPA survey with a simultaneous household survey suggested that poor quality care may contribute to avertable neonatal mortality, with a predicted prevalence of neonatal mortality of 28.3 deaths per 1,000 in lower quality facilities and 5.2 deaths per 1,000 in higher quality facilities, among women who would choose higher quality if it were more accessible to them [10].

As attention shifts from describing health system quality to improving it at scale, robust and ongoing measurement will be an essential tool for governments and researchers alike, particularly the direct observation of care delivery and perspective from patients themselves that makes the SPA such a unique and valuable resource.

References


Written by Dr. Hannah Leslie

Dr. Hannah Leslie is a Research Associate at the Harvard Chan School of Public Health; she served as the Measurement Research Lead for the Lancet Global Health Commission on High-Quality Health Systems in the SDG Era. She received her MPH and Ph.D. in Epidemiology from the University of California, Berkeley. Her research has made extensive use of the Service Provision Assessment surveys to 1) develop metrics of structure and process quality in LMICs, 2) describe current quality of care, and 3) assess predictors and effects of poor quality. Her recent work focuses on effective coverage calculations, patient experience measurement, and quality of care as a driver of HIV testing and treatment retention.

07 Apr 2016

Measuring health care: The Service Provision Assessment Survey

http://dhsprogram.com/publications/publication-SPA22-SPA-Final-Reports.cfm

When DHS and other population-based surveys indicate potential problems with a country’s health care systems, such questions are raised:

“Are certain services available in health facilities?”
“What is the quality of those services?”
“Are there factors at the service delivery level that could be contributing to the problems?”

The Service Provision Assessment (or SPA) survey attempts to bridge this gap while fulfilling the need to monitor health systems strengthening in surveyed countries.

Let’s say a national strategy is initiated to address a growing obesity problem and its associated issues, diabetes and hypertension. A component of the strategy may focus on improving a country’s health facilities by increasing the number that have diabetes services available.

2014-15 Tanzania SPA Key Findings

2014-15 Tanzania SPA Key Findings

It may also strengthen readiness of those facilities to provide quality services – more staff who are up-to-date on trainings for provision of diabetes services, more equipment (such as blood pressure apparatuses, adult weighing scales, and height boards), improved diagnostic capacity (the ability to conduct blood glucose and urine protein tests), and increased availability of medicines to manage diabetes. These are all indicators a SPA survey provides.

The improvements in service availability and readiness may lead to early identification of risk factors, early diagnosis and initiation of management, and, perhaps, a gradual decline in unmanaged diabetes.

2014-15 Tanzania SPA Key Findings video series
The SPA survey is designed to collect information from a sample of functioning health facilities in a country on the availability of services, readiness of facilities to provide health services in many areas, and measures of quality of care. Four different questionnaires are used to collect data at the facility, provider, and client levels. Survey data collection is done by teams of health workers.

If the DHS is a snapshot of a population’s health, the SPA is a snapshot of the service environment and those who provide and receive services, which drives population health. Though it can be challenging to directly link health facility data with population data, the SPA is useful in providing support and context to the DHS.

The first SPA surveys took place in Guatemala, Kenya, and Bangladesh in the late 1990’s, and continue to be implemented today. To date, 22 SPA surveys have been conducted, the latest being the 2014 Bangladesh Health Facilities Survey and 2014-15 Tanzania SPA. Ongoing surveys include the 2015 Nepal SPA and Senegal Continuous SPA. Be the first to know when those will be available (along with all other surveys) by signing up for email alerts, or by following us on Facebook and Twitter

The information provided on this Web site is not official U.S. Government information and does not represent the views or positions of the U.S. Agency for International Development or the U.S. Government.

The DHS Program, ICF
530 Gaither Road, Suite 500, Rockville, MD 20850
Tel: +1 (301) 407-6500 • Fax: +1 (301) 407-6501
dhsprogram.com