ALL Metrics
-
Views
-
Downloads
Get PDF
Get XML
Cite
Export
Track
Study Protocol

Reporting of health equity considerations in equity-relevant observational studies: Protocol for a systematic assessment

[version 1; peer review: 2 approved with reservations]
PUBLISHED 06 Jun 2022
Author details Author details
OPEN PEER REVIEW
REVIEWER STATUS

This article is included in the Sociology of Health gateway.

This article is included in the Health Services gateway.

This article is included in the Research on Research, Policy & Culture gateway.

This article is included in the Equitable Cancer Care collection.

Abstract

Background: The mitigation of unfair and avoidable differences in health is an increasing global priority. Observational studies including cohort, cross-sectional and case-control studies tend to report social determinants of health which could inform evidence syntheses on health equity and social justice. However, the extent of reporting and analysis of equity in equity-relevant observational studies is unknown.
Methods: We define studies which report outcomes for populations at risk of experiencing inequities as “equity-relevant”. Using a random sampling technique we will identify 320 equity-relevant observational studies published between 1 January 2020 to 27 April 2022 by searching the MEDLINE database. We will stratify sampling by 1) studies in high-income countries (HIC) and low- and middle-income countries (LMIC) according to the World Bank classification, 2) studies focused on COVID and those which are not, 3) studies focused on populations at risk of experiencing inequities and those on general populations that stratify their analyses. We will use the PROGRESS framework which stands for place of residence, race or ethnicity, occupation, gender or sex, religion, education, socioeconomic status, social capital, to identify dimensions where inequities may exist. Using a previously developed data extraction form we will pilot-test on eligible studies and revise as applicable.
Conclusions: The proposed methodological assessment of reporting will allow us to systematically understand the current reporting and analysis practices for health equity in observational studies. The findings of this study will help inform the development of the equity extension for the STROBE (Strengthening the Reporting of Observational studies in Epidemiology) reporting guidelines.

Keywords

Observational studies, health equity, research reporting, research methodology, study design

Introduction

Less than a decade remains until the 2030 deadline set by the United Nations to meet the 17 Sustainable Development Goals1 aimed at global economic, social, and environmental transformation. One of the 17 goals, and a cross-cutting theme across several others,2 is health equity, defined as the absence of differences in health that are avoidable and unjust.3 The achievement of health equity as a priority has been widely endorsed by several international organizations4,5 and resonates with the moral imperative of social justice and recognition of human rights principles.

A major challenge is the lack of evidence that includes thoughtful, rigorous collection of health equity data to inform program development and policymaking.6 In fact, global organizations such as the World Health Organization (WHO) and the Pan American Health Organization (PAHO) have called for the improvement of equity considerations in the reporting of research.710 Thus, the integration of health equity in research is needed in both primary and secondary research.1114 In primary research, observational studies are particularly well-suited for investigating health equity as they often include populations at risk of experiencing inequities.15,16 Observational studies are analytical or descriptive studies evaluating a research question without changing exposure to an intervention.17 In the absence of a control group, they can be descriptive in nature but do not permit the investigation of causal associations.18 Observational studies predominate in health-related research,19,20 and are used to investigate numerous types of research questions, such as detecting rare or late adverse effects of treatments and to explore complex systems.21 Furthermore, observational studies have highlighted the vast inequities in society during the COVID-19 pandemic,22 and simultaneously, have had an important role in informing public health responses.23,24

The well-known STROBE (Strengthening Reporting of Observational studies in Epidemiology) reporting guideline, which is intended to be used for the reporting of observational studies, is used by over 60% of authors of observational studies.25 However, despite widespread use of the STROBE reporting guidelines, there is a persistent lack of integration and reporting of sex and gender (among other dimensions) in observational studies.2628 Comprehensive reporting in research is essential to assess its reliability, reproducibility and methodological rigour, and ensure that the research meets the needs of the potential users.29 Using reporting guidelines contributes to meeting these goals by increasing the completeness and transparency of research papers.3033 The inadequate reporting may be, in part, due to lack of guidance on reporting equity items in such studies.

Complex health systems questions and addressing social determinants of health may require multi-stakeholder and intersectoral collaboration and engagement, for which equity perspectives can serve as a linchpin.34 Observational studies also allow for addressing questions on health policy, health systems, and health services organization, delivery, prioritization, and implementation.3537 Different frameworks are available to describe factors associated with health equity.38,39 The Campbell and Cochrane Equity Methods Group, for example, proposes using the PROGRESS-Plus framework. This acronym is widely used and stands for Place of residence, Race or ethnicity, Occupation, Gender or sex, Religion, Education, Socioeconomic status, and Social capital.39 The “plus” accounts for additional characteristics that could result in inequitable health outcomes. Although the reporting on equity in observational research would increase the value of research outcomes through the recognition of how these dimensions impact interventions, the application and use of equity frameworks in reporting health research are not yet standard practice. Therefore, our objective is to systematically evaluate how equity-relevant observational studies describe characteristics of their samples, design features and analysis, and interpretation of their findings across PROGRESS-Plus; we also aim to use the findings of this study to inform the development of an equity reporting guideline.

Methods

Figure 1 outlines the overarching process to be followed in the conduct of this study; from identifying relevant studies at title and abstract stage to data extraction and analysis.

0866b5c8-b3ef-45f3-bc4a-3c9c0562878d_figure1.gif

Figure 1. Study flow diagram.

Eligibility criteria

We will include health equity-relevant observational studies from all settings, published between 1 January 2020, and 27 April 2022. We define health equity, health equity-relevant studies and observational studies in Table 1. We chose to focus on equity-relevant studies, since these are most likely to have methods of describing populations experiencing inequities, and are most likely to include methods to assess similarities or differences in effects for populations experiencing inequities.

Table 1. Definitions of terms used in the methodological assessment.

TermDefinition and explanation
Health inequityHealth inequity is defined as avoidable and unfair differences in health.3
Health equity-relevant studiesWe define “health equity-relevant” as studies that focus on individuals or populations experiencing inequities or studies of mixed populations that analyzed at least one health outcome across one or more PROGRESS factor.12,40 We define health outcomes according to the WHO definition, as “changes as in health status that result from the provision of health services”.41 This includes studies focused on populations at risk of experiencing inequities such as people who are homeless and asylum seekers, as well as studies which present disaggregated results or evaluate outcomes across one or more PROGRESS factors. However, studies which control for PROGRESS in analyses without analyzing differences across the factors are not considered equity-relevant. For example, studies of breast cancer in women would not be considered health equity-relevant since women are not disadvantaged in opportunities for health as it relates to breast cancer care. However, if stratified analysis was done to compare mortality of women living in rural vs urban area (or other PROGRESS factors), the study would be considered equity-relevant. Similarly, a study of low-income or racialized women accessing breast cancer care would be considered health equity-relevant because they experience different opportunities in obtaining care.
Observational studiesWe define observational studies as analytical or descriptive studies evaluating a research question without changing exposure to an intervention.17,18 Observational studies are classified in the STROBE reporting guideline into three types: 1) cohort: following an exposed population over time; 2) case-control: comparing exposures between people with a particular disease outcome (cases) and people without that outcome (controls); and 3) cross sectional: assessing all individuals in a sample at the same point in time.21 Studies conducted using routinely collected data stored in administrative datasets can be classified into these three types of studies.42

We will not include studies focused on Indigenous populations in this evaluation, as they will be assessed in a separate but complementary study led by Indigenous researchers as it will require a different sampling approach and methodological assessment. We decided not to use “Plus” criteria for eligibility since they require a greater deal of judgement regarding the contextual factors that may result in inequities. We will exclude case series and case reports since they do not include a reference population or comparison group enabling assessment of differences across PROGRESS factors.

Sampling strategy

Based on consultation with our interdisciplinary team of researchers and decision-makers, and patients and public, we will use a three-factor, randomized sampling strategy to balance: 1) studies in high-income countries (HIC) and low- and middle-income countries (LMIC) according to the World Bank classification, 2) studies focused on COVID-19 and those which are not, 3) studies focused on populations experiencing inequities and those that stratify their analyses. We chose to stratify by country because of the importance of the context and resources in LMIC settings which affect health inequities both among LMIC and between LMIC and HIC,4345 Given the evidence on exacerbation of inequities during the COVID-19 pandemic, we decided to ensure balance across studies related to COVID-19 and those that are not.46

Although we chose only three factors for the sampling strategy, we will assess all aspects of PROGRESS-Plus in the included studies; thus other populations experiencing inequities will be included, such as people who are living with low income, homeless, migrants, asylum-seekers, and racialized individuals. Table 2 lists examples of studies that meet our eligibility criteria.

Table 2. Examples of health equity-relevant observational studies published after 2020.

LMICHIC
COVID+COVID-COVID+COVID-
General population-i.e. mixedEpidemiological characteristics of patients with severe COVID-19 infection in Wuhan, China: evidence from a retrospective observational study47Effectiveness of seasonal malaria chemoprevention at scale in west and central Africa: an observational study48Patterns of use of secondary mental health services before and during COVID-19 lockdown: observational study49School Entry, Educational Attainment, and Quarter of Birth: A Cautionary Tale of a Local Average Treatment Effect50
Focused on populations experiencing inequitiesEthnic and regional variations in hospital mortality from COVID-19 in Brazil: a cross-sectional observational study51Demystifying the factors associated with rural–urban gaps in severe acute malnutrition among under-five children in low- and middle-income countries: a decomposition analysis52Hesitant or Not? The Association of Age, Gender, and Education with Potential Acceptance of a COVID-19 Vaccine: A Country-level Analysis53
A case-control and cohort study to determine the relationship between ethnic background and severe COVID-1954
Health Care Utilization Before and After the “Muslim Ban” Executive Order Among People Born in Muslim-Majority Countries and Living in the US55

Sample size

We will randomly select a sample of 320 equity-relevant observational studies, since assessing all potential eligible studies would be unmanageable for our review team. To ensure we assess a sample that provides comparable results, we conducted sample size calculation for binary outcomes (categorical questions for consideration of equity in the studies) with 95% confidence intervals of ± 6% for observed proportions of 50% (i.e. assuming that half of the studies would report at least one PROGRESS characteristic). This sample size has also been used in similar studies.5659 We acknowledge that the study does not have sufficient power to allow a comparison of reporting across the three prioritized groups, so we will only report data descriptively. Eligible studies will be exported into Microsoft Excel and sorted using a random sequence using the built-in random-number generator. We will sample the studies as specified in Table 3.

Table 3. Sampling strategy for equity-relevant studies across the prioritized topics.

LMICHICTotal
COVID+COVID-COVID+COVID-
General population40404040160
Focused on populations experiencing inequities40404040160
Total80808080320

COVID+: studies related to COVID-19, COVID-: studies not related to COVID-19. LMIC: Low-middle income countries, HIC: High Income countries.

Search strategy

We have designed a search strategy in collaboration with a librarian (TR) experienced in systematic reviews, using a method designed to optimize term selection.60 A validated search filter to identify equity-focused studies was adapted for use in this study,61 and additional terms to increase retrieval of papers about indigenous populations were added (lines 213-232).62,63 These were developed in collaboration with our Indigenous Steering Committee. Studies related to Indigenous populations will be identified from these search terms and will be utilized to conduct an independent but highly complementary study focused on Indigenous populations.

We used a validated search filter for observational studies with two extra terms to retrieve cross-sectional studies.64 We further added the terms “Instrumental variable”, “discontinuity design”, “interrupted time series”, “discontinuity design”, “matching”, “synthetic control” and “difference-in-difference” to our search strategy to ensure that we capture observational econometric studies that meet our eligibility criteria. Review articles and randomized controlled trials will be excluded from these results using validated study design filters for Ovid MEDLINE.65 The draft search strategy is stored in the Open Science Framework (OSF) repository (Extended data67). We will test the search strategy with a set of 10 studies that we identify to be eligible.

We will restrict our search to the last two years because we are interested in describing current analysis and reporting of equity, not trend over time. This period also captures the girth of the literature published throughout the pandemic. We conducted a preliminary search of Ovid MEDLINE for papers published between 1 January 2020, to 17 April 2022 and obtained 16,263 citations. Due to the high volume of results retrieved, we decided that searching only one database would be feasible. In the conduct of this study, we expect an adequate number of observational studies in this period to meet our eligibility criteria.

Screening

Studies will be screened at title and abstract level by a single investigator using DistillerSR software.66 One investigator will screen the full texts of studies, and OD will validate. Conflicts will be resolved through discussion with a third reviewer at weekly meetings. We will use the DistillerSR randomization function to randomly sample citations at a set interval of 20% of unreviewed citations until we reach the planned sample size.

At full-text screening, we will tag eligible studies according to our prioritized topics (Type of equity relevance, country income setting, COVID-19 research).

Data extraction

Data will be extracted independently by two extractors. We will develop and pretest a data extraction form using DistillerSR. We will conduct training on the data collection with data extractors using sets of three to five studies at a time, until there is 80% agreement across all items between extractors. Conflicts will be resolved by discussion between extractors and reaching consensus. We will develop a data dictionary to ensure consistent extraction across team members and refine during pre-testing.

We will capture study characteristics including the purpose of the study (focused on populations experiencing inequities or whether the study included general populations in which there may be populations experiencing inequities), title/abstract, background/rationale, study design, population characteristics, results, analyses, interpretation of applicability and discussion. We will collect details on the motivation behind studies for a separate evaluation of the way equity is defined in these studies and the motivation for studying equity-seeking populations. The complete list of items is provided in our OSF repository (Extended data67).

We will assemble the author contact details for a separate survey of authors (of the included studies) to ask about engagement with populations experiencing inequities, since we believe that engagement with populations experiencing inequities informs better reporting on health equity. The reason for conducting the survey is because we expect that some of the results related to equity would not be well reported in the articles.

Data analysis

We will descriptively present the reporting of each item for the observational studies in our sample by tabulating the data for each item to assess the frequency of reporting. We will conduct subgroup analysis on studies that considered health equity as a reason for conducting the study.

Dissemination

Our findings will be shared on pre-print servers and submitted for peer-review publication. In addition, we plan on sharing our findings on Twitter and at relevant conferences for wider dissemination.

Discussion

The primary objective of this study will be to describe the reporting and analysis of equity in equity-relevant observational studies. By focusing on studies that meet this criteria, we will document studies that have missed opportunities for providing information regarding populations at risk of experiencing inequities. Moreover, this exercise may help us identify examples of equity considerations in observational studies, according to our candidate items for the equity extension for STROBE reporting guideline, to illustrate how and to what extent they are presented in the literature.

Our study is not without limitations. First, our search of only MEDLINE would be expected to yield studies mostly from HIC and focused on clinical topics. However, we plan to mitigate this selection bias by purposefully stratifying sampling across country income setting and randomly selecting a sample from the eligible studies. Second, although a third of early COVID-19 literature has been shared as preprints, we will not include studies from pre-print servers as studies in peer-review journal articles tend to show substantial improvements in the quality of reporting compared to pre-prints. Therefore, it may not be appropriate to pool preprints with peer-reviewed published articles. Future work could aim to investigate the difference in reporting of health equity in articles published in pre-print servers compared to peer-reviewed articles.

The proposed list of extraction items is extensive and provides several gateways for future projects to fill gaps in understanding the integration and reporting of equity in research. Using the results of this methodological assessment, we plan to conduct a sociological discourse analysis of motivation for assessing health equity in equity-relevant observational studies. In accordance with the plan for this extension, we will conduct an independent study on Indigenous research, led by Indigenous researchers, to identify and describe well-reported studies using the CONSIDER checklist. Furthermore, the selective sampling across prioritized groups provides an opportunity to conduct more focused investigations, tailored to each respective topic (i.e. LMIC, COVID-19 research).

Data availability

Underlying data

No data are associated with this protocol.

Extended data

Open Science Framework: STROBE-equity reporting guidelines, https://osf.io/cp3z2.67

This project includes the following extended data:

  • Search strategy.docx

  • Extraction items mapped to the STROBE-Equity candidate items.docx

Data are available under the terms of the Creative Commons Attribution 4.0 International license (CC-BY 4.0).

Comments on this article Comments (0)

Version 1
VERSION 1 PUBLISHED 06 Jun 2022
Comment
Author details Author details
Competing interests
Grant information
Copyright
Download
 
Export To
metrics
Views Downloads
F1000Research - -
PubMed Central
Data from PMC are received and updated monthly.
- -
Citations
CITE
how to cite this article
Dewidar O, Rader T, Waddington H et al. Reporting of health equity considerations in equity-relevant observational studies: Protocol for a systematic assessment [version 1; peer review: 2 approved with reservations] F1000Research 2022, 11:615 (https://doi.org/10.12688/f1000research.122185.1)
NOTE: it is important to ensure the information in square brackets after the title is included in all citations of this article.
track
receive updates on this article
Track an article to receive email alerts on any updates to this article.

Open Peer Review

Current Reviewer Status: ?
Key to Reviewer Statuses VIEW
ApprovedThe paper is scientifically sound in its current form and only minor, if any, improvements are suggested
Approved with reservations A number of small changes, sometimes more significant revisions are required to address specific details and improve the papers academic merit.
Not approvedFundamental flaws in the paper seriously undermine the findings and conclusions
Version 1
VERSION 1
PUBLISHED 06 Jun 2022
Views
8
Cite
Reviewer Report 17 Aug 2023
Ihoghosa Iyamu, The University of British Columbia, Vancouver, British Columbia, Canada 
Approved with Reservations
VIEWS 8
Thanks for the opportunity to review this study protocol. It focuses on an important topic of health equity analyses and reporting in scientifica articles and this is very important. There are however opportunities to provide additional detail that can improve ... Continue reading
CITE
CITE
HOW TO CITE THIS REPORT
Iyamu I. Reviewer Report For: Reporting of health equity considerations in equity-relevant observational studies: Protocol for a systematic assessment [version 1; peer review: 2 approved with reservations]. F1000Research 2022, 11:615 (https://doi.org/10.5256/f1000research.134140.r183191)
NOTE: it is important to ensure the information in square brackets after the title is included in all citations of this article.
Views
22
Cite
Reviewer Report 16 Dec 2022
Khic-Houy Prang, University of Melbourne, Melbourne, Australia 
Approved with Reservations
VIEWS 22
Thank you for the opportunity to read your study protocol which aims to develop a health equity reporting guideline for observational studies. I commend the authors on undertaking an ambitious review across diverse settings and population groups to identify health ... Continue reading
CITE
CITE
HOW TO CITE THIS REPORT
Prang KH. Reviewer Report For: Reporting of health equity considerations in equity-relevant observational studies: Protocol for a systematic assessment [version 1; peer review: 2 approved with reservations]. F1000Research 2022, 11:615 (https://doi.org/10.5256/f1000research.134140.r151179)
NOTE: it is important to ensure the information in square brackets after the title is included in all citations of this article.

Comments on this article Comments (0)

Version 1
VERSION 1 PUBLISHED 06 Jun 2022
Comment
Alongside their report, reviewers assign a status to the article:
Approved - the paper is scientifically sound in its current form and only minor, if any, improvements are suggested
Approved with reservations - A number of small changes, sometimes more significant revisions are required to address specific details and improve the papers academic merit.
Not approved - fundamental flaws in the paper seriously undermine the findings and conclusions
Sign In
If you've forgotten your password, please enter your email address below and we'll send you instructions on how to reset your password.

The email address should be the one you originally registered with F1000.

Email address not valid, please try again

You registered with F1000 via Google, so we cannot reset your password.

To sign in, please click here.

If you still need help with your Google account password, please click here.

You registered with F1000 via Facebook, so we cannot reset your password.

To sign in, please click here.

If you still need help with your Facebook account password, please click here.

Code not correct, please try again
Email us for further assistance.
Server error, please try again.