Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

A systematic review and quality analysis of pediatric traumatic brain injury clinical practice guidelines

  • Roselyn Appenteng,

    Roles Conceptualization, Data curation, Formal analysis, Methodology, Project administration, Writing – original draft, Writing – review & editing

    Affiliation Duke University School of Medicine, Durham, North Carolina, United States of America

  • Taylor Nelp,

    Roles Data curation, Formal analysis, Writing – review & editing

    Affiliation Division of Emergency Medicine, Duke University Medical Center, Durham, North Carolina, United States of America

  • Jihad Abdelgadir,

    Roles Data curation, Formal analysis, Writing – review & editing

    Affiliation Division of Global Neurosurgery and Neurology, Department of Neurosurgery, Duke University Medical Center, Durham, North Carolina, United States of America

  • Nelly Weledji,

    Roles Data curation, Formal analysis, Writing – review & editing

    Affiliation University of North Carolina School of Medicine, Chapel Hill, North Carolina, United States of America

  • Michael Haglund,

    Roles Writing – review & editing

    Affiliations Division of Global Neurosurgery and Neurology, Department of Neurosurgery, Duke University Medical Center, Durham, North Carolina, United States of America, Duke Global Health Institute, Duke University, Durham, North Carolina, United States of America

  • Emily Smith,

    Roles Conceptualization, Writing – review & editing

    Affiliations Division of Global Neurosurgery and Neurology, Department of Neurosurgery, Duke University Medical Center, Durham, North Carolina, United States of America, Duke Global Health Institute, Duke University, Durham, North Carolina, United States of America

  • Oscar Obiga,

    Roles Formal analysis, Writing – review & editing

    Affiliations Duke Global Health Institute, Duke University, Durham, North Carolina, United States of America, Mbarara Regional Referral Hospital, Mbarara, Uganda

  • Francis M. Sakita,

    Roles Formal analysis, Writing – review & editing

    Affiliation Kilimanjaro Christian Medical Center, Moshi, Tanzania

  • Edson A. Miguel,

    Roles Formal analysis, Writing – review & editing

    Affiliation Division of Pediatric Intensive Care, State University of Maringá, Maringá, Paraná, Brazil

  • Carolina M. Vissoci,

    Roles Formal analysis, Writing – review & editing

    Affiliation Department of General Surgery, North Wing Regional Hospital, Asa Norte, Brasilia, Brazil

  • Henry Rice,

    Roles Writing – review & editing

    Affiliation Duke Division of Pediatric Surgery, Duke University Medical Center, Durham, North Carolina, United States of America

  • Joao Ricardo Nickenig Vissoci,

    Roles Conceptualization, Methodology, Validation, Writing – review & editing

    Affiliations Division of Emergency Medicine, Duke University Medical Center, Durham, North Carolina, United States of America, Division of Global Neurosurgery and Neurology, Department of Neurosurgery, Duke University Medical Center, Durham, North Carolina, United States of America

  • Catherine Staton

    Roles Conceptualization, Methodology, Supervision, Validation, Writing – original draft, Writing – review & editing

    catherine.staton@duke.edu

    Affiliations Division of Emergency Medicine, Duke University Medical Center, Durham, North Carolina, United States of America, Division of Global Neurosurgery and Neurology, Department of Neurosurgery, Duke University Medical Center, Durham, North Carolina, United States of America, Duke Global Health Institute, Duke University, Durham, North Carolina, United States of America

Abstract

Background

Traumatic brain injuries (TBI) are a significant cause of mortality and morbidity for children globally. Adherence to evidence-based treatment guidelines have been shown to improve TBI outcomes. To inform the creation of a pediatric TBI management guideline for a low and middle income country context, we assessed the quality of available clinical practice guidelines (CPGs) for the acute management pediatric TBI.

Methods

Articles were identified and retrieved from MEDLINE, EMBASE, Cochrane Library, LILACS, Africa-Wide Information and Global Index Medicus. These articles were screened by four reviewers independently. Based on the eligibility criteria, with the exception of literature reviews, opinion papers and editor’s letters, articles published from 1995 to November 11, 2016 which covered clinical recommendations, clinical practice or treatment guidelines for the acute management of pediatric TBI (within 24 hours) were included for review. A reference and citation analysis was performed. Seven independent reviewers from low, middle and high income clinical settings with knowledge of pediatric TBI management appraised the guidelines using the AGREE II instrument. Scores for the CPGs were aggregated by domain and overall assessment was determined.

Results

We screened 2372 articles of which 17 were retained for data extraction and guideline appraisal. Except for one CPG from a middle income country, the majority (16/17) of the guidelines were developed in high income countries. Seven guidelines were developed specifically for the pediatric population, while the remaining CPGs addressed the acute management of TBI in both adult and pediatric populations. The New Zealand Guideline Group (NZGG, 2006) received the highest overall assessment score of 46/49 (93.88%) followed by the Scandinavian Neurotrauma Committee (SNC, 2016) with a score of 45/49 (91.84%) followed by the Scottish Intercollegiate Guideline Network (SIGN, 2009) and Brain Trauma Foundation (BTF 2012) both with scores of 44/49 (89.80%). CPGs from Cincinnati Children’s Hospital (CCH 2006) and Sao Paulo Medical School Hospital/Brazilian Society of Neurosurgery (USP/BSN, 2001) received the lowest score of 27/49 (55.10%) subsequently followed by the Appropriateness Criteria (ACR, 2015) with 29/49 (59.18%). The domains for scope and purpose and clarity of presentation received the highest scores across the CPGs, while applicability and editorial independence domains had the lowest scores with a wider variability in score range for rigor of development and stakeholder involvement.

Conclusions

To our knowledge, this is the first systematic review and guideline appraisal for pediatric CPGs concerning the acute management of TBI. Targeted guideline creation specific to the pediatric population has the potential to improve the quality of acute TBI CPGs. Furthermore, it is crucial to address the applicability of a guideline to translate the CPG from a published manuscript into clinically relevant local practice tools and for resource limited practice settings.

Introduction

Traumatic brain injuries (TBI) are a significant cause of mortality and morbidity among children. [13] Between 2002 to 2006, for children between 0 to 14, emergency department visits for fall-related TBIs increased by 62% from 290 to 470.5 per 100,000. Children now account for the highest rates of TBI-related emergency room visits across the general population. [1, 46]

Although the incidence of pediatric TBI varies broadly, the burden of trauma and associated TBI is comparatively higher in low and middle income countries (LMIC). [2, 7, 8] Globally, 95% of injuries in the pediatric population occurs in LMICs. An estimated 950,000 deaths occur annually due to injuries sustained by children of which 90% are unintentional. Worldwide, injuries are the leading cause of death for children aged 10 to 19 years. In children under 15 years, TBIs account for the highest rates of unintentional injuries. [9, 10] The CRASH trial, a multinational randomized controlled trial evaluating corticosteroid used to treat significant head injury, demonstrated a 2 times higher odds of mortality following severe TBI in LMICs in comparison high income countries (HICs). [8]

While the mechanism of injury varies by age, motor-vehicle crashes are the predominant cause of injury followed by falls, in the US and worldwide. [1, 2, 11] The burgeoning development of motorization and transportation systems remains unmatched by the existing safety infrastructure in low and middle income countries. As such, children have an increased vulnerability to traumatic injuries and TBIs within this context especially as pedestrians. [9, 12] Moreover, the sequelae of TBI extends beyond mortality to the potential for disability and associated emotional and financial cost. [13, 14]

To improve TBI outcomes for the LMIC pediatric population, evidence-based treatment guidelines must serve a pivotal role alongside the continuum of care which integrates injury prevention initiatives with a robust trauma system and comprehensive rehabilitation services. In 1995, the Brain Trauma Foundation developed and subsequently published the Guidelines for the Management of Severe Traumatic Brain Injury.[15] The fourth edition continues to focus on identifying the best evidence to guide clinical practice and improve TBI outcomes in the adult population.[16] The Guidelines for Medical Management of Severe TBI for infants, children and adolescents was later developed in 2003 and a subsequent edition was released in 2012 to synthesize the best evidence and inform clinical practice in the pediatric population.[17,18]

Adherence to guidelines have been shown to improve outcomes in the management of TBIs. Keris et al. demonstrated a reduction in hospital case fatality rate in adult TBI patients with the implementation of TBI guidelines in Latvia.[19] In a retrospective and prospective data analysis, Palmer et al demonstrated an odds ratio of 9.13(95% CI 3.25, 25. 67) of a good outcome in comparison to a poor outcome or death when American Association of Neurological Surgeons Guidelines for the management of severe head injury were adapted for a TBI protocol in community hospital setting.[20] Similar studies have demonstrated improvement in clinical outcomes following the implementation of the Brain Trauma Foundation’s guidelines in both the adult and pediatric population[2123].

However, implementing a suitable clinical practice guideline (CPG) for the management of acute TBI in an LMIC poses a challenge. Literature on TBI guideline creation and use in LMIC is limited. [24] Of the 24 TBI clinical practice guidelines appraised in a previous systematic review, Patel et al found only one developed in a LMIC. [25] Furthermore, the gap between the available resources and the requisite resource capacity necessary to effect guideline recommendations as well as the variability in trauma systems often remain unaddressed. [25, 26] In order to inform the locally driven creation of acute pediatric TBI management guideline for an LMIC context, we aim to assess the quality of available CPGs for the acute diagnostics and management of pediatric TBI by undertaking a systematic review of the available literature.

Materials and methods

Protocol and registration

A protocol for this review is undergoing review for registration in the PROSPERO (International Prospective Register of Systematic Reviews) database (S1 Text). This systematic review is reported according to the Preferred Reporting Items for Systematic Review and Meta-Analyses (PRISMA) Statement (S2 Table). [27]

Eligibility criteria

The inclusion criteria for articles were the following: abstracts must mention either (clinical) recommendations, (clinical) practice guidelines or treatment guidelines for the acute management of TBI (within 24 hours). Subsequently, full texts were retrieved and excluded if the texts were literature reviews, opinion papers or editor’s letters, published prior to 1995. Furthermore, the clinical practice guidelines (CPGs) had to include the pediatric population as defined by the age range from birth to 18 years or a subset of the pediatric population. The newest versions of the CPGs were included for review, if multiple editions were available. All levels of TBI severity were included in this review. We contacted authors to find English versions of candidate abstracts with published non-English full texts.

Identification of studies

The search strategy was used to identify relevant abstracts from MEDLINE, EMBASE, Cochrane Library, LILACS, Africa-Wide Information and Global Index Medicus is provided in S1 Table. Additional abstracts were retrieved from the Duke University Medical Center Guidelines repository. These guidelines are sourced from the National Guidelines Clearinghouse, American College of Emergency Medicine, Canadian Medical Association-Clinical Practice Guidelines and National Institute of Health and Clinical Excellence Guidelines. After the full text review, we performed a reference and citation analysis primarily using Web of Science. The citation analysis was augmented with Google Scholar and a manual search of references was performed when necessary.

Literature search

We identified candidate abstracts with “Craniocerebral Trauma”, “Brain injury”, “Practice Guideline” [Publication Type], “Evidence-Based Medicine” as MeSH terms. Limits to exclude animals, editorials, letters, case reports and comments were also applied in the search strategy as demonstrated in S1 Table for MEDLINE. No language or date limits were applied to the database search.

Study selection

Four reviewers working in pairs, (R.A. and T.N.) and (J.A. and N.W.) evaluated the titles and abstracts independently. Thereafter, full-text manuscripts were retrieved and independently evaluated with the eligibility criteria for inclusion. Articles included from the reference and citation analysis were also evaluated based on the eligibility criteria. We included articles based on consensus and any disagreements were resolved by a third reviewer (C.S.)

Data extraction

The two pairs of reviewers, (R.A. and T.N.) and (J.A. and N.W.), independently extracted general characteristics of the CPGs. The information obtained included the following: year of publication, year updated (if multiple versions available), country of guideline development, institution or organization responsible for guideline development and the type of group responsible for the development of the guideline, specific descriptors including professional, academic, non-profit, international or mixed were provided. Additionally, the focus of the guideline whether prehospital care, early management, imaging, ICU or covering the complete spectrum of care was also indicated. The patient population, if present and severity of brain injury reported in the guideline was also extracted. We noted the income delineation of the country or countries of origin for the guideline as high-, middle- or low- income with according to the World Bank’s determination. [28]

Quality assessment

Seven appraisers from low, middle and high income clinical settings with knowledge of pediatric TBI management independently evaluated the quality of the final CPGs using the Appraisal of Guidelines for Research and Evaluation (AGREE) II instrument. [29, 30] The appraisers were from the USA, Brazil, Tanzania and Uganda. Both English and Portuguese translations of the AGREE II user’s manual were provided to the appraisers. The CPGs were evaluated using an electronic form adapted from the user’s manual. The AGREE II instrument is the current gold standard tool for assessing the quality of CPGs and the quality of the development of the guideline. [31] The tool consists of six thematic domains which are addressed using 23 items. Each item is graded on a seven-point scale with “strongly agree” garnering the highest score of 7 and “strongly disagree” associated with a 1. The six domains include the following: scope and purpose, stakeholder involvement, rigor of development, clarity of presentation, applicability and editorial independence. [29]

Domain one focuses on the scope and purpose of the guideline specifically evaluating the overall objective, pertinent health questions and target population covered by guideline. The stakeholder involvement addressed in domain two determines whether relevant professional groups were involved in the development of the guideline, if the CPGs are reflective of the views and preferences of the target population and seeks for a definition of the guideline’s target users. Domain three determines whether the body of evidence leading to the recommendations in the guidelines, was systematically searched and included for review based on clear selection criteria. Furthermore, this domain determines whether the strengths and weaknesses of the body of evidence were assessed, whether the link between recommendations and the evidence was well delineated in the guideline, if the method(s) for formulating the recommendations was clear and if the recommendations reflect an evaluation of pertinent health benefits, risks and side effects. Lastly, domain three assesses the involvement of an external expert review of the guideline before publication and if there is a method to update the guideline. [29]

Domain four which examines the clarity of presentation of the CPGs evaluates whether the recommendations are specific and unequivocal, present different options for management and if the most important recommendations can be easily identified. Domain five delves into the applicability of the CPG. This domain considers the facilitators and barriers that impact the use of the guideline. Additionally, it evaluates the availability of tools and resources to implement the guidelines, information on the resource utilization cost and economic consideration pertaining to guideline as well as the presence of audit criteria. The editorial independence of the guideline is addressed in the sixth domain, where the potential competing interests of the guideline development group and the influence of the funding body’s views are assessed. [29]

Subsequently, a global assessment of the guideline was performed with an overall seven-point scale quality rating. Here, appraisers also determined whether they would recommend the CPG for use by indicating “yes”, “yes with modifications” or “no”. [29]

Data analysis

The individual scores for the 23 items were summed within each respective domain, according to the AGREE II user’s manual to determine the overall domain scores for each CPG. Afterwards, the individual domain scores are scaled according to the following formula:

The highest possible scaled score for a domain is equivalent to 100% while 0% equates to the lowest possible scaled score. The percentage scores were calculated for the six domains of each guideline. A descriptive analysis of the CPGs was performed and an assessment for the CPGs according to the respective domains is provided. An intraclass correlation coefficient (ICC) was calculated using R for statistical computing to assess the consistency of appraisers’ evaluations across each domain. A criteria of 0.7 was used an acceptable inter-rater reliability value. [29, 32]

Results

Study selection

The initial search strategy produced 2824 titles and abstracts resulting in 2,372 unique records for review after the removal of 452 duplicates (Fig 1). Subsequently, 1755 abstracts were exempted from further review based on the eligibility criteria. A reference and citation analysis was performed to retrieve an additional 15 manuscripts. Altogether, 632 full texts with CPGs were reviewed according to the eligibility criteria of which 17 were retained for data extraction and guideline appraisal. We contacted authors to find English versions of 37 non-English texts; of the responses we received none that fit inclusion and exclusion criteria were found.

thumbnail
Fig 1. Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) Flow Diagram.

https://doi.org/10.1371/journal.pone.0201550.g001

CPG characteristics

The systematic review of the literature resulted in the appraisal of 17 CPGs (Table 1) for the acute management of pediatric TBI. Although the CPGs originated from 5 different continents namely Asia, South America, Europe and North America, Australia, 10 were developed in North America [18, 3341]; of these 8 were from USA. [18, 3335, 3740] Apart from one guideline [42], all the CPGS were developed in predominantly high income countries or by an international committee representative of a consortium of high income countries. [18, 3341, 4348]The 17 guidelines were created by a variety of guideline development groups namely, four professional organizations [3335, 45], two academic institutions [39,40], three non-profit organizations [18, 36, 37, 48], two national institutes [43, 44], two regional or state trauma programs[38, 41], two international committees [46, 47]and one from a collaboration of an academic and professional institute[42]. The target of 10 of the CPGs included both the adult and pediatric population [18, 34, 37, 38, 4246, 48] while 7 were restricted primarily to the pediatric population. [18, 33, 35, 36, 39, 40, 47] Altogether, the CPGs spanned the full spectrum of TBI severity. Here, 7 CPGs addressed all levels of severity [33, 38, 4144, 48] while 6 focused on mild or minor TBI. [3436, 39, 40, 46] Furthermore, 3 CPGs specifically highlighted the management of severe TBI [18, 37, 45] and a remaining CPG focused on both minor and moderate TBI. [49] The focus of the CPGs varied broadly with one CPG primarily addressing prehospital care [37], seven focused on early management of acute TBI [35, 38, 39, 41, 43, 46, 47] and one CPG [33] specifically addressed imaging in the acute setting. In addition, two guidelines focused on early management and rehabilitation [34, 48], two early management and ICU care [18, 42], two early management and subsequent evaluation or more specifically return to play evaluation in the setting of a concussion. [36, 40] Two guidelines addressed a broader spectrum of care including prehospital care, early management, surgical or specialist care and ICU or neurosurgical unit care. [44, 45]

thumbnail
Table 1. Characteristics of clinical practice guidelines.

https://doi.org/10.1371/journal.pone.0201550.t001

Quality assessment

The AGREE II evaluation of CPGs with the scaled scores and appraisers’ comments are highlighted by domain and the overall assessment is also addressed. The domain specific results are provided in Table 2 while the overall assessment of the CPGs are described in Table 3. The consistency of raters’ appraisal for each domain, which was determined with the interrater reliability is presented in Table 4.

thumbnail
Table 4. Inter-rater reliability for the AGREE II domains.

https://doi.org/10.1371/journal.pone.0201550.t004

Domain one—Scope and purpose

Evaluation and Management of Children Younger than Two Years Old with Apparently Minor Head Trauma: Proposed Guidelines (AAP, 2001) received the highest score of 97.62% in this domain. The lowest score of 65.08% was for the Guidelines for Neurosurgical Trauma in Brazil (USP/BSN, 2001).

Domain two-Stakeholder involvement

The highest score of 89.68% was from the Early Management of Patients with a Head Injury (SIGN, 2009) while the Guidelines for Neurosurgical Trauma in Brazil (USP/BSN, 2001), with a core of 35.71%, received the lowest score in the domain.

Domain three-Rigor of development

Guidelines for Neurosurgical Trauma in Brazil (USP/BSN, 2001) received the lowest score of 20.24%. Early Management of Patients with a Head Injury (SIGN, 2009) scored the highest in this domain with 89.58%

Domain four-Clarity of presentation

Traumatic Brain Injury: Diagnosis, Acute Management and Rehabilitation (NZGG, 2006) received the highest score of 95.24%. Guidelines for the Management of Severe Head Injury, 2nd Edition guidelines from the Guidelines Committee on the Management of Severe Head Injury, the Japan Society of Neurotraumatology (JSN, 2012) received 66.67% as the lowest.

Domain five-Applicability

Early Management of Patients with a Head Injury (SIGN, 2009) received the highest score of 79.17% in this domain. The lowest score of 18.45% was for mild traumatic brain injury in children: just another bump on the head? (CCH 2006)

Domain six-Editorial independence

The highest score was 88.10% which was for the Traumatic Brain Injury: Diagnosis, Acute Management and Rehabilitation (NZGG, 2006). Guidelines for Neurosurgical Trauma in Brazil (USP/BSN, 2001) received the lowest score of 20.24%.

Overall guideline assessment

New Zealand’s Traumatic Brain Injury: Diagnosis, Acute Management and Rehabilitation (NZGG, 2006) received the best overall assessment with 46 out of the maximum 49 points. The Scandinavian guidelines for initial management of minor and moderate head trauma in children (SNC 2016) with 45 out of the maximum 49 points received the next highest overall score. Subsequently, the Early Management of Patients with a Head Injury (SIGN, 2009) and Guidelines for the acute medical management of severe traumatic brain injury in infants, children, and adolescents-second edition (BTF 2012) both received 44 out of 49 points for overall assessment.

At 27 out of 49 points, Mild traumatic brain injury in children: just another bump on the head? (CCH 2006) and Guidelines for Neurosurgical Trauma in Brazil (USP/BSN 2001) received the lowest scores for overall guideline assessment. With a score of 29 out of 49 points, the American College of Radiology’s Appropriateness Criteria Head Trauma—Child (ACR 2014) received the next lowest score.

While the level of recommendation varied for each CPG, all the guidelines were recommended for use. However, Traumatic Brain Injury: Diagnosis, Acute Management and Rehabilitation (NZGG, 2006) received the highest recommendation for use from all appraisers (100%). Subsequently, the Scandinavian guidelines for initial management of minor and moderate head trauma in children (SNC 2016) and the Evaluation and Management of Children Younger than Two Years Old with Apparently Minor Head Trauma: Proposed Guidelines (AAP, 2001) received the next highest recommendation for use; both CPGs were individually recommended by 85.71% of appraisers for use without modification. In contrast, 42.86% of appraisers would not recommend either Mild traumatic brain injury in children: just another bump on the head? (CCH 2003) or the Guidelines for Neurosurgical Trauma in Brazil (USP/BSN 2001) for use.

Appraisers consistency

Interrater reliability for four domains namely, Stakeholder involvement, Rigor of Development, Applicability, Editorial Independence and Overall Guideline Assessment were above 0.70 demonstrating an acceptable consistency. [50] The domains for Scope and Purpose and Clarity of Presentation, which were lower in consistency, resulted in intraclass correlation values of 0.65 and 0.56 respectively.

Discussion

To the best of our knowledge, this is the first systematic review and guideline appraisal of CPGs for the acute management of pediatric TBI. Of the 17 CPGs evaluated in this study, ten were developed for both the pediatric and adult population while the remaining guidelines were specifically created for the pediatric population. On average, the domains for scope and purpose and clarity of presentation received the highest scaled scores across the CPGs in contrast to the domains for applicability and editorial independence which received the lowest scores. In this study, the CPGs with the best overall assessments include two guidelines restricted to the pediatric population, namely the Scandinavian guidelines for initial management of minor and moderate head trauma in children (SNC 2016) and the Guidelines for the acute medical management of severe traumatic brain injury in infants, children, and adolescents (BTF 2012). Furthermore, guidelines appraised as the best quality were created by professional guideline development groups with broad expertise and the experience of creating previous versions of these guidelines. Only one CPG was created by a guideline development group from an upper middle income country (UMIC); majority of the guidelines were developed in high income countries (HICs). Our findings suggest that future acute pediatric TBI guidelines may benefit in quality when the guideline is population specific and recognized as an adaptive process with the advantage of being developed with the expertise of a dedicated guideline development body. The missing perspectives of LMICs in the process of guideline creation is essential in TBI care.

The guidelines with the highest overall assessment were developed by the Scandinavian Neurotrauma Committee, Scottish Intercollegiate Guidelines Network, the Brain Trauma Foundation and the now dissolved New Zealand Guideline Group. Moreover, the CPGs, SNC 2016, SIGN 2009, BTF 2012 and NZGG 2006 received the highest scores for rigor of development. This domain evaluates whether the CPG uses a robust systematically searched evidence base that is critically appraised by a development team with broad clinical and technical expertise to directly inform CPG recommendations. The four guidelines shared two overarching factors: not only were the CPGs developed by professional guideline groups, but the members of these groups had clinical, research and methodological expertise well suited to the endeavor and the CPGs with the exception of SNC 2016, had undergone iterations with previous pediatric editions. However, SNC 2016 was borne out of the experience of creating multiple TBI guidelines. [5153]. As such the process of CPG is best viewed as progressively adaptive and the quality is significantly informed by the composition and expertise of the group creating the guideline. [54]

In this study, two guidelines limited to the pediatric population emerged among the appraised guidelines with the highest overall quality. These CPGs are specifically The Scandinavian guidelines for initial management of minor and moderate head trauma in children (SNC, 2016) and the Guidelines for the acute medical management of severe traumatic brain injury in infants, children, and adolescents (BTF, 2012) [18, 44, 47, 48] In contrast, NZGG 2006, SIGN 2009 and NICE 2007 which address both adult and pediatric TBI received the highest overall assessment and received the highest recommendation for use in previous CPG appraisals.[25, 44, 48, 55, 56] Our findings suggest that the quality of TBI guideline development may significantly benefit from addressing a specific population; Moreover, AAP 2001, a pediatric specific guideline, was appraised as the highest quality CPG in the domain for scope and purpose, the most highly scored domain. Notably, the domain for scope and purpose addresses the central impetus for the development of a guideline: the health questions pertinent to the guideline endeavor, the population of interest and the overall guideline objective. Targeted guideline development around a population serves to streamline evidence and prioritize recommendations, all details that are crucial to improving the quality of the guideline. [25, 55, 56]

The dearth of CPGs from LMICs in the context of the multiple CPG and CPG updates from HIC highlights a missing perspective in TBI guideline development. One of several issues inherent in using CPGs developed in HIC in LMIC is the recommendations may not result in the same outcome. This situation was best demonstrated in the South American trials: Treatment of Intracranial Pressure (BEST Trip) trials where following ICP monitoring recommendations resulted in no significant difference between patients treated by ICP monitoring protocol and patients whose treatment was based on imaging and clinical examination.[57, 58] Current efforts by the Global Neurotrauma Research group are underway to create guidelines for the management of severe TBI for LMIC by determine whether intracranial hypertension in severe TBI patients can be managed without ICP monitoring.[59] Not only must a CPG be adaptable to a local context but the evidence base for recommendations must be interpreted within that context as well. AGREE II indirectly addresses the potential for adaptation as a guideline strategy or direct implementation of a guideline by evaluating the quality of the applicability domain. However, similar to previous TBI CPG appraisals, this was the weakest domain in our review. Improving the quality of CPGs in addressing how well the guidelines translate from published material into actual clinical practice tools can potentially impact the adaptation of CPGs for resource limited settings. The World Health Organization’s Guidelines for Essential Trauma Care has demonstrated efforts to create guidelines that can be adapted across a range of resource settings and along with guideline adaptation tools, good quality TBI CPGs can be adapted in LMICs. [60, 61]

Limitations

Despite the extensive search of databases with access to both English and non-English texts, it is possible that we may have missed CPGs from countries with unpublished or non-English TBI guidelines. To the best of our efforts, we contacted authors of non-English texts with potential abstracts for English versions of the guidelines. Furthermore, we contacted Chinese medical schools and medical centers with online publications on acute TBI for local CPGs but such guidelines within our scope were unavailable. Additionally, AGREE II guideline is inherently a subjective tool with a potential for bias. However, based on the moderate to high interrater reliability, the increased number of appraisers and diverse clinical experience of the appraisers the potential for bias was minimized significantly.

Conclusion

CPGs for the acute management of pediatric TBI, as tools for evidence-based medicine, have the capacity to inform the development of trauma care systems and improve the quality of health care delivery. Targeted guideline creation for this specific population has the potential to improve the quality of acute pediatric TBI CPGs. Moreover, considering the guideline development process as adaptive over the long term creates the opportunity to build expertise in guideline development which in turn informs the quality of the CPG. It is crucial to address the applicability of a guideline to translate the CPG from a publication into a clinically relevant local practice tools and for resource limited practice settings.

Supporting information

S2 Table. Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) 2009 checklist.

https://doi.org/10.1371/journal.pone.0201550.s002

(PDF)

Acknowledgments

Meetings: Interim analysis has been presented at Duke University School of Medicine’s Alpha Omega Alpha Medical Society 47th Annual Scientific Research Symposium. August 4th, 2017 in Durham, NC, USA.

References

  1. 1. Faul M, Xu L, Wald MM, Coronado VG. Traumatic Brain Injury in the United States: Emergency Department Visits, Hospitalizations and Deaths 2002–2006. Atlanta (GA): Centers for Disease Control and Prevention, National Center for Injury Prevention and Control 2010.
  2. 2. Hyder AA, Wunderlich CA, Puvanachandra P, Gururaj G, Kobusingye OC. The impact of traumatic brain injuries: A global perspective. NeuroRehabilitation. 2007;22(5):341–53. pmid:18162698.
  3. 3. Murgio A, A AF, Sanchez Munoz MA, B S., Leung KM. International Multicenter Study of Head Injury in Children. ISHIP Group. Childs Nervous System. 1999;15(6–7):318–21.
  4. 4. CDC. Rates of TBI-related Emergency Department Visits by Age Group-United States, 2001–2010: Centers for Disease Control and Prevention; 2016 [cited 2017 21 June]. https://www.cdc.gov/traumaticbraininjury/data/rates_ed_byage.html.
  5. 5. CDC. Rates of TBI-related Deaths by Age Group-United States, 2001–2010: Centers for Disease Control and Prevention; 2016 [cited last accessed 2017 21 June]. https://www.cdc.gov/traumaticbraininjury/data/rates_deaths_byage.html.
  6. 6. CDC. Rates of TBI-related Hospitalizations by Age Group-United States, 2001–2010: Centers for Disease Control and Prevention; 2016 [cited last accessed 2017 21 June]. https://www.cdc.gov/traumaticbraininjury/data/rates_hosp_byage.html.
  7. 7. Dewan MC, Mummareddy N, Wellons JC 3rd, Bonfield CM. Epidemiology of Global Pediatric Traumatic Brain Injury: Qualitative Review. World Neurosurgery. 2016;91(1878–8769 (Electronic)):497–509. pmid:27018009
  8. 8. De Silva MJ, Roberts I, Perel P, Edwards P, Kenward MG, Fernandes J, et al. Patient outcome after traumatic brain injury in high-, middle- and low-income countries: analysis of data on 8927 patients in 46 countries. International Journal of Epidemiology. 2009;38(2):452–8. pmid:18782898
  9. 9. WHO. World report on child injury prevention. Geneva, Switzerland World Health Organization, 2008.
  10. 10. WHO. The Global Burden of Disease: 2004 Update Geneva, Switzerland: World Health Organization, 2008.
  11. 11. Brazinova A, Rehorcikova V, Taylor MS, Buckova V, Majdan M, Psota M, et al. Epidemiology of Traumatic Brain Injury in Europe: A Living Systematic Review. Journal of Neurotrauma. 2016;(1557–9042 (Electronic)). Epub Aug 25. pmid:26537996
  12. 12. WHO. Road Safety in the African Region Geneva, Switzerland World Health Organization, 2015.
  13. 13. Schneier AJ, Shields BJ, Hostetler SG, Xiang H, Smith GA. Incidence of Pediatric Traumatic Brain Injury and Associated Hospital Resource Utilization in the United States. Pediatrics. 2006;118(2):483. pmid:16882799
  14. 14. Keenan HT, Bratton SL. Epidemiology and Outcomes of Pediatric Traumatic Brain Injury. Developmental Neuroscience. 2006;28(4–5):256–63. pmid:16943649.
  15. 15. Bullock R, Chesnut RM, Clifton G, Ghajar J, Marion DW, Narayan RK, et al. Guidelines for the management of severe head injury. Brain Trauma Foundation. European Journal of Emergency Medicine 1996;3(3):109–27.
  16. 16. Carney N, Totten AM, O’Reilly C, Ullman JS, Hawryluk GWJ, Bell MJ, et al. Guidelines for the Management of Severe Traumatic Brain Injury, Fourth Edition. Neurosurgery. 2017;80(1):6–15. pmid:27654000
  17. 17. Adelson PD, Bratton SL, Carney NA, et al. Guidelines for the acute medical management of severe traumatic brain injury in infants, children, and adolescents. Pediatric Critical Care Medicine. 2003;4(S1-S75).
  18. 18. Kochanek PM, Carney N, Adelson PD, Ashwal S, Bell MJ, Bratton SL, et al. Guidelines for the Acute Medical Management of Severe Traumatic Brain Injury in Infants, Children, and Adolescents-Second Edition. Pediatric Critical Care Medicine. 2012;13(Suppl 1):S1–82. pmid:22217782
  19. 19. Keris V, Lavendelis E, Macane I. Association between implementation of clinical practice guidelines and outcome for traumatic brain injury. World Journal of Surgery. 2007;31(6):1352–5. pmid:17464541
  20. 20. Palmer S, Bader MK, Qureshi A, Palmer J, Shaver T, Borzatta M, et al. The impact on outcomes in a community hospital setting of using the AANS traumatic brain injury guidelines. Americans Associations for Neurologic Surgeons. Journal of Trauma Nursing. 2001;2001(0022–5282 (Print)):657–64.
  21. 21. Fakhry SM, Trask AL, Waller MAW, Dorraine D. Management of brain-injured patients by an evidence-based medicine protocol improves outcomes and decreases hospital charges. Journal of Trauma 2004;56(3):499–500.
  22. 22. Vavilala MS, Kernic MA, Wang J, Kannan N, Mink RB, Wainwright MS, et al. Acute Care Clinical Indicators Associated with Discharge Outcomes in Children with Severe Traumatic Brain Injury. Critical care medicine. 2014;42(10):2258–66. pmid:25083982
  23. 23. Gupta D, Sharma D, Kannan N, Prapruettham S, Mock C, Wang J, et al. Guideline Adherence and Outcomes in Severe Adult Traumatic Brain Injury for the CHIRAG (Collaborative Head Injury and Guidelines) Study. World Neurosurgery. 2016;89:169–79. http://dx.doi.org/10.1016/j.wneu.2015.12.097. pmid:26806065
  24. 24. Burton A. A key traumatic brain injury initiative in India. The Lancet Neurology. 15(10):1011–2. pmid:27339662
  25. 25. Patel A, Vieira MM, Abraham J, Reid N, Tran T, Tomecsek K, et al. Quality of the Development of Traumatic Brain Injury Clinical Practice Guidelines: A Systematic Review. PLOS ONE. 2016;11(9):e0161554. pmid:27583787
  26. 26. Rubiano AM, Carney N, Chesnut R, Puyana JC. Global neurotrauma research challenges and opportunities. Nature. 2015;527(7578):S193–S7. http://www.nature.com/nature/journal/v527/n7578_supp_custom/abs/nature16035.html#supplementary-information. pmid:26580327
  27. 27. Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. International Journal of Surgery. 2010;8(5):336–41. http://dx.doi.org/10.1016/j.ijsu.2010.02.007. pmid:20171303
  28. 28. Bank TW. World Bank Country and Lending Groups [cited 2017 June 30]. https://datahelpdesk.worldbank.org/knowledgebase/articles/906519-world-bank-country-and-lending-groups.
  29. 29. Consortium ANS. The AGREE II Instrument [Electronic version].2009 Retrieved <June, 29, 2017>. from http://www.agreetrust.org
  30. 30. Brouwers MC, Kho ME, Browman GP, Burgers JS, Cluzeau F, Feder G, et al. AGREE II: advancing guideline development, reporting and evaluation in health care. CMAJ: Canadian Medical Association Journal. 2010;182(18):E839–E42. pmid:20603348
  31. 31. Siering U, Eikermann M, Hausner E, Hoffmann-Eßer W, Neugebauer EA. Appraisal Tools for Clinical Practice Guidelines: A Systematic Review. PLOS ONE. 2013;8(12):e82915. pmid:24349397
  32. 32. R Core Team. R: A language and environment for statistical computing Vienna, Austria: R Foundation for Statistical Computing 2016.
  33. 33. Ryan ME, Palasis S, Saigal G, Singer AD, Karmazyn B, Dempsey ME, et al. ACR Appropriateness Criteria Head Trauma-Child. Journal of the American College of Radiology. 2014;11(10):939–47. pmid:25164794
  34. 34. West TA, Bergman K, Biggins SM, French B, Galletly J, Hinkle JL, et al. Care of the Patient with Mild Traumatic Brain Injury Glenview, Illinois 2011.
  35. 35. Schutzman SA, Barnes P, Duhaime A-C, Greenes D, Homer C, Jaffe D, et al. Evaluation and Management of Children Younger Than Two Years Old With Apparently Minor Head Trauma: Proposed Guidelines. Pediatrics. 2001 2001/05//:983–93.
  36. 36. Zemek R, Duval S, Dematteo C, Solomon B, Keightley M, Osmond M, et al. Guidelines for Diagnosing and Managing Pediatric Concussion. Toronto, ON: Ontario Neurotrauma Foundation, 2014.
  37. 37. Badjatia N, Carney N, Crocco TJ, Fallat ME, Hennes HMA, Jagoda AS, et al. Guidelines for prehospital management of traumatic brain injury 2nd edition. Prehospital Emergency Care. 2008;12(sup 1):S1–S52.
  38. 38. Sacco F, Zafren K, Brown K, Cohen T, Coopes BJ, G John, Hudson D, et al. Guidelines for the management of head injuries in remote and rural Alaska. Alaska Med. 2004;46(3):58–62. pmid:15839596
  39. 39. Cook RS, Schweer L, Shebesta KF, Hartjes K, Falcone RA Jr. Mild traumatic brain injury in children: just another bump on the head? Journal of Trauma Nursing 2006;13(2):58–65. pmid:16884134
  40. 40. Kamerling SN, Lutz N, Posner JC, Posner JF, V Marla. Mild traumatic brain injury in children: practice guidelines for emergency department and hospitalized patients. The Trauma Program, The Children’s Hospital of Philadelphia, University of Pennsylvania School of Medicine. Pediatric Emergency Care 2003;19(6):431–40. pmid:14676497
  41. 41. Hebb MO, Clarke DB, Tallon JM. Development of a provincial guideline for the acute assessment and management of adult and pediatric patients with head injuries. Canadian Journal of Surgery. 2007;50(3):187–94.
  42. 42. de Andrade AF, Marino R, Ciquini O, Figueiredo EG, M A. G. Guidelines for neurosurgical trauma in Brazil. World Journal of Surgery. 2001;25(9):1186–201. pmid:11571957
  43. 43. NICE. Head Injury: assessment and early management Clinical guideline [CG176]. London: NICE: National Institute for Health and Clinical Excellence 2014.
  44. 44. SIGN. SIGN 110: Early Management of Patients with a head injury. A national clinical guideline Edinburgh: Scottish Intercollegiate Guidelines Network, 2009.
  45. 45. Shigemori M, Abe T, Aruga T, Ogawa T, Okudera H, Ono J, et al. Guidelines for the Management of Severe Head Injury, 2nd Edition from the Guidelines Committee on the Management of Severe Head Injury, the Japan Society of Neurotraumatology. Neurologia medico-chirurgica. 2012;52(1):1–30. pmid:22278024
  46. 46. Vos PE, Alekseenko Y, Battistin L, Ehler E, Gerstenbrand F, Muresanu DF, et al. Mild traumatic brain injury. European Journal of Neurology. 2012;19(2):191–8. pmid:22260187
  47. 47. Astrand R, Rosenlund C, Undén J. Scandinavian guidelines for initial management of minor and moderate head trauma in children. BMC Medicine. 2016;14(1):33. pmid:26888597
  48. 48. Group" NZG. Traumatic Brain Injury: Diagnosis, Acute Management and Rebilitation. Wellington: New Zealand Guidelines Group, 2006.
  49. 49. Astrand R, Romner B, Lanke J, Unden J. Reference values for venous and capillary S100B in children. Clin Chim Acta. 2011;412. pmid:21864523
  50. 50. Schmitt N. Uses and Abuses of Coefficient Alpha. Psychological Assessment 1996;9(4):350–3.
  51. 51. Romner B, Ingebrigtsen T, Kock-Jensen C. Scandinavian guidelines for management of head injuries. Evidence-based management of minimal, mild and moderate head injuries. Lakartidningen. 2000;97(26–27):3186–92. pmid:10925580
  52. 52. Juul N, Sollid S, Sundstrom T, Kock-Jensen C, Eskesen V, Bellander B-M, et al. [Scandinavian guidelines on the pre-hospital management of traumatic brain injury]. (1603–6824 (Electronic)).
  53. 53. Unden J, Ingebrigtsen T, Fau—Romner B, Romner B. Scandinavian guidelines for initial management of minimal, mild and moderate head injuries in adults: an evidence and consensus-based update. BMC Medicine. 2013;11(50). pmid:23432764
  54. 54. Eccles MP, Grimshaw JM, Shekelle P, Schünemann HJ, Woolf S. Developing clinical practice guidelines: target audiences, identifying topics for guidelines, guideline group composition and functioning and conflicts of interest. Implementation Science: IS. 2012;7:60. pmid:22762776
  55. 55. Alarcon JD, Rubiano AM, Chirinos MS, Valderrama A, Gich I, Alonso-Coello P. Clinical practice guidelines for the care of patients with severe traumatic brain injury: a systematic evaluation of their quality. The Journal of Trauma and Acute Care Surgery. 2013;75(2):311–9. pmid:23887565
  56. 56. Tavender EJ, Bosch M, Green S, O’Connor D, Pitt V, Phillips K, et al. Quality and Consistency of Guidelines for the Management of Mild Traumatic Brain Injury in the Emergency Department. Academic Emergency Medicine. 2011;18(8):880–9. pmid:21843224
  57. 57. Chesnut RM, Temkin N, Carney N, Dikmen S, Rondina C, Videtta W, et al. A trial of intracranial-pressure monitoring in traumatic brain injury. New England Journal of Medicine 2012;367(26):2471–81. pmid:23234472
  58. 58. Sahuquillo J, Biestro A. Is intracranial pressure monitoring still required in the management of severe traumatic brain injury? Ethical and methodological considerations on conducting clinical research in poor and low-income countries. Surgical Neurology International. 2014;5:86. pmid:25024886
  59. 59. Global Neurotrauma Research. Managing severe TBI without ICP monitoring—guidelines development and testing 2012 [cited 2017 June 30]. http://www.globalneurotrauma.org/CBG.html.
  60. 60. Mock C, Lormand J, Goosen J, Joshipura M, Peden M. Guidelines for essential trauma care. Geneva, Switzerland: World Health Organization, 2004.
  61. 61. The ADAPTE Collaboration. The ADAPTE Process. Resource Toolkit for Guideline Adaptation. version 2.0. 2009.