Skip to main content

Value of gait analysis for measuring disease severity using inertial sensors in patients with multiple sclerosis: protocol for a systematic review and meta-analysis

Abstract

Background

Gait impairment is a hallmark of multiple sclerosis (MS) which significantly endangers the quality of life of the individual. Inertial measurement units (IMUs) are small, light wearable sensors that can be used in routine neurological practice. InertiaLocoGraphy (ILG), the quantification of gait with IMUs, has proven useful to detect early changes in MS undetectable with standard stopwatch-timed measures. Still, whether such markers are useful for evaluating the severity of the disease remains unknown. Therefore, the correlation between ILG and disease progression would be worth exploring.

Methods

We will search MEDLINE via PubMed, Cochrane, and EMBASE electronic databases to identify articles published before May 2, 2018 that measure gait using IMUs in MS patients. In addition, grey literature will be searched. Inclusion criteria will be adults with a clinical diagnosis of MS and gait measured by using inertial sensors. We will exclude from the meta-analysis articles that do not provide sufficient data for evaluating the correlations between ILG parameters and disease severity as measured by at least one of the six following tests: the Expanded Disability Status Scale (EDSS), the Multiple Sclerosis Walking Scale-12 (MSWS), the Multiple Sclerosis Severity Score (MSSS), the Multiple Sclerosis Impact Scale (MSIS-29), the Multiple Sclerosis Functional Composite (MSFC), and the Timed 25-ft Walk Test (T25FW). Extracted data from included articles will be presented descriptively, and effect sizes will be computed based on the recommendations from the Cochrane Collaboration handbook and RevMan software.

Discussion

Identifying changes in disease state throughout the course of MS is essential for optimal care. Current clinical and performance tests allow for identifying advanced gait alteration but lack sensitivity to detect subtle gait change. IMUs can be easily used in clinical practice to quantify gait in MS patients. Nevertheless, whether these outcomes are clinically relevant is uncertain because no study has evaluated their correlation with disease severity across different settings. This systematic review and meta-analysis would bring insight into the potential of this outcome as a marker of disease evolution.

Systematic review registration

This review was registered with the International Prospective Register of Systematic Reviews on May 2, 2018 (Registration: CRD42018092651). Both the search strategy and study protocol are available at https://www.crd.york.ac.uk/PROSPERO/display_record.php?RecordID=92651.

Peer Review reports

Background

Multiple sclerosis is a heterogeneous demyelinating disease of the central nervous system with varying clinical presentation and progression. Gait impairment is a hallmark of MS and lower limb function is perceived as the most important bodily disability across the disease spectrum [1]. Thus, there is a need for objective gait assessment both in routine clinic care and in clinical research trials to improve gait and balance follow-up in people with MS. Mobility is measured by the Expanded Disability Status Scale (EDSS), which has been criticized for its lack of sensitivity to change [2, 3] and its high interrater variability [4]. The Multiple Sclerosis Severity Score (MSSS) is another scale, which is obtained by normalizing the EDSS score for disease duration [5]. Patient-reported outcomes are also useful to inform disease severity; the Multiple Sclerosis Walking Scale-12 (MSWS) is a 12-item measure of the impact of MS on walking while the Multiple Sclerosis Impact Scale (MSIS-29) is a 29-item measure of the impact of MS on day-to-day life in the past 2 weeks. However, both are subjective. Gait speed is measured by using stopwatch-timed tests such as the Timed 25-ft Walk Test (T25FW), which has been criticized for being highly variable [6, 7]. Finally, the Multiple Sclerosis Functional Composite (MSFC) is an instrument used more and more frequently which encompass three tests, including the T25FW, expressed as a single score along a continuous scale [8]. However, it is prone to practice effects [9] and variability [6, 7].

Inertial measurement units (IMUs) are small, light integrated systems that measure linear and angular motion usually with a triad of accelerometers and triad of gyroscopes, often associated with a magnetometer. Motion capture systems based on these wearable sensors have become widely used for the biomechanical analysis of human movement. InertiaLocoGraphy (ILG), the quantification of gait with IMUs, was first reported 70 years ago [10] and has now been implemented in a wide range of neurological and non-neurological diseases [11, 12]. It can be used both at the hospital, mainly for short tests, and at home for more long-term physiological gait assessment [13]. ILG has proven useful to detect early changes in MS undetectable with already-mentioned assessments [1]. Still, whether such markers are useful for evaluating the severity of the disease remains unknown. Therefore, the correlation between ILG and disease progression would be worth exploring.

This meta-analysis is aimed at evaluating the value of inertial gait parameters in assessing disease severity in MS patients. Six objectives will be evaluated as follows:

Primary outcome:

  • Correlation of ILG with EDSS

Secondary outcomes:

  • Correlation of ILG with MSSS

  • Correlation of ILG with MSWS

  • Correlation of ILG with MSIS-29

  • Correlation of ILG with stopwatch-timed T25FW

  • Correlation of ILG with MSFC

Scales for which data for at least one parameter cannot be retrieved for at least two articles from different authors will only be mentioned and commented on in the discussion of the paper.

From our preliminary literature search, we expect the assessment of fall risk to be highly variable across studies. If not, the correlation of gait features with the assessment of fall risk will be added as a seventh objective.

Methods/design

The literature search and analysis will follow the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) [14] and Meta-analysis of Observational Studies in Epidemiology (MOOSE) [15] guidelines.

Search strategy

We will search MEDLINE via PubMed, Cochrane, and EMBASE electronic databases to identify articles published before May 2, 2018, that measure gait using inertial sensors in MS patients. In addition, grey literature will be searched in Google Scholar, Opengrey.eu, Greylit.org, WorldCat, World Health Organization Clinical Trials Search Portal, ClinicalTrials.gov, and the European Union Clinical Trials Register. All reference lists and bibliographies of included studies will be reviewed for relevant studies that could be missed by this electronic search.

The search will involve the population-specific keywords “multiple sclerosis” or “MS” with intervention-specific terms such as “gait” or “walk*” or “step*” and comparison-specific keywords “sensor” or “wearable” or “inertial” or “IMU” or “accelerometer” or “gyroscope” or “motion analysis”. No keywords for the Outcome component of the PICO framework will be added to increase the sensitivity of the search. The Boolean word AND will be used between the PICO components.

Inclusion criteria

Randomized controlled trials (RCTs), non-randomized controlled trials, and observational studies will be eligible for inclusion. Inclusion criteria will be adults with a clinical diagnosis of MS and gait measured by using inertial sensors (accelerometer and/or gyroscope).

Exclusion criteria

We will exclude articles of studies that do not include people with MS (population criterion), quantify other activities such as standing or running or that assess general physical activities using only step count or walking bout length (GAIT criterion), and use sensors other than IMUs (IMU criterion).

We will exclude from the meta-analysis articles that do not provide sufficient data for pooling results despite authors being contacted for missing information (see paragraph Data extraction and analysis). Data will be considered sufficient in one of the three following situations: correlation between gait parameters with EDSS, MSSS, MSWS, MSFC, MSIS-29, or T25FW reported or obtained from the main author; raw values of gait parameters and EDSS, MSSS, MSWS, MSFC, MSIS-29, or T25FW reported or obtained from the main author for every patient; and raw values of gait parameters reported or obtained from the main author for groups of patients, with groups drawn from their EDSS, MSSS, MSWS, MSFC, MSIS-29, or T25FW values respectively (REPORTING criterion).

We expect very few studies set up at home. Because protocols at home vary widely from protocols in clinical or laboratory settings, ambulatory studies should be analyzed separately. Consequently, ambulatory studies will be excluded from the analysis if we cannot find at least three studies from which a common effect size can be drawn.

Review process

Potentially eligible studies will be screened for eligibility independently by two review authors (FQ and AV). The population criterion will be assessed on the basis of titles and abstracts of papers, and the other criteria will be assessed in the main text. We will import articles to Zotero, and all articles will be reviewed (title, abstract, and main text when needed) to discard those that do not meet the criteria. In case of discrepancies between reviewers, they will discuss until a consensus is reached. If no consensus is reached, a third author (DR) will arbitrate. Eligible papers will be assessed for risk of bias and data will be extracted.

Risk of bias appraisal

A risk of bias assessment will be performed by using a 20-item quality checklist for longitudinal studies that we adapted from Hubble et al. [16] by altering one item and adding three more items to better fit the requirements of our aim (Additional file 2).

Each article will be assessed by two assessors (FQ and AV), with each assessor blinded to the score given by the other. Disagreements will be discussed and the rounded mean of both scores will be chosen as the final score if no agreement is found.

Data extraction and analysis

Study review

Upon selecting articles for inclusion, references will be imported in Microsoft Excel for data extraction. One assessor (AV) will extract and collate information. Another assessor (FQ) will verify the extracted data from all included articles. We will extract the following data:

  • Study characteristics: authors, title, year of publication, inclusion and exclusion criterion, sample size

  • Population characteristics: sex, age, weight, height, body mass index, EDSS, MSSS, MSWS, MSIS-29, MSFC, T25FW fall assessment

  • Gait evaluation conditions: environment (laboratory versus ambulatory), floor type and sequence of steps, speed, sensitization tactics (eyes open or close, single, or double task), aid use

  • Sensor characteristics: position, brand, and sampling frequency;

  • Gait features: description and raw data when available

  • Statistical analysis: test for normality, test used, whether correction for multiple comparison was applied, confounding factors, parameter significance

The data extraction tables will be pilot-tested and refined before extraction.

Correlation coefficients will be extracted when available. If correlation coefficients are not reported, the full raw data will be sought and retrieved. If neither correlation coefficients nor raw data are available, either will be requested from the main author (see paragraph Data extraction and analysis). If the main author cannot provide this information, the difference in means and the standardized mean difference will be retrieved.

When data are not available in the main text, we will search supplemental materials for more detailed information. When data on sensors (such as the sampling frequency) are not available even in supplemental materials, we will search for the data in preceding articles from the same author. For crossover studies, we will consider the data before the crossover started. Authors will be contacted up to three times via e-mail to obtain data not available in the main text. If data are only available by graphical representation, two authors (FQ, AV) will use Plot Digitizer to extract data from graphs: the final value will be the mean of these two extractions. Data extraction means will be reported in the manuscript.

Data pooling: parameter homogenization

First, to maximize the number of data points for a given parameter, we will try to derive from all studies any given parameter that was reported in at least one included study. For that aim, the following formulas will be implemented:

\( \mathrm{CV}=\frac{\mathrm{SD}}{\mathrm{mean}} \) where CV is the coefficient of variation, SD is the standard deviation, mean is the mean of the same parameter;

\( \mathrm{if}\ \mathrm{ri}=\frac{\left|P1-P2\right|}{\mathrm{mean}\left(P1,P2\right)}\ \mathrm{and}\ \mathrm{rf}=\frac{P1}{P2},\mathrm{then}:\mathrm{rf}=2\times \frac{\mathrm{ri}-1}{\mathrm{ri}+1}\ \mathrm{and}\ \mathrm{drf}=4\times \frac{\mathrm{dri}}{{\left(\mathrm{ri}+1\right)}^2} \) where ri and rf will both be use as an index of symmetry;

$$ \mathrm{swing}\ \mathrm{time}=\mathrm{step}\ \mathrm{time}-\mathrm{stance}\ \mathrm{time} $$
$$ \mathrm{double}\ \mathrm{stance}\ \mathrm{time}=\mathrm{stride}\ \mathrm{time}-2\times \mathrm{swing}\ \mathrm{time} $$

To minimize redundancy, when two proportional parameters are reported (e.g., step time or stride time likely appearing depending on the article), the parameter that was computed the least often in the included articles will be transformed by multiplying by the proportionality coefficient to match the other parameter (in the case above, the proportionality coefficient would be 1/2 if the stride time was the parameter the less computed between the two).

Data pooling: metrics

Second, we expect studies to assess disease severity using different metrics, mainly, correlation coefficients, between-group comparisons for two groups (standardized or unstandardized mean differences), between-group comparisons for several groups (eta squared, partial eta squared, and omega squared), or odds ratios. To conduct the meta-analysis across all of the effect sizes, these must be transformed into a common metric. Because thresholds for subgroups are not consensual, we will use the correlation coefficient as the effect size. We will transform the correlation coefficient (r) by using the Fisher z transformation (using z = atanh(r)) and perform the analysis using this index. This will allow us to use tests for normal distributions. Then, the summary values will be converted back to correlations for presentation (r = tanh(z)) [17].

Strategy for data synthesis

Extracted data from included articles will be presented descriptively, and effect sizes will be computed based on the recommendations from the Cochrane Collaboration handbook and RevMan software.

RevMan 5.3 will be used to create the forest plots for the meta-analysis. A fixed-effects model will be chosen when heterogeneity is low to moderate (I2 < 50%) [18]; otherwise, a random-effects model will be used.

Sensitivity analysis

When a given feature is reported in at least three studies from different authors, funnel plots will be used to search for possible publication bias. Sensitivity analysis will be used to explore the impact of recording settings (floor type [ground vs treadmill], sequence of steps [ambulatory vs clinical setting and U-turn vs no U-turn], speed instruction [convenient vs fastest]) on the computed gait features and their correlation with disease severity. The overall quality of the evidence for each outcome will be evaluated by using the GRADE criteria following the Cochrane Collaboration recommendations if enough RCTs and interventional studies are included [19].

Discussion

Identifying changes in disease state throughout the course of MS is essential for optimal care [20]. Current clinical and performance tests (EDSS, MSSS, MSWS, MSIS-29, MSFC, T25FW) allow for identifying advanced gait alteration but lack sensitivity to detect subtle gait dysfunction or progression. IMUs can be easily used in clinical practice to quantify gait in MS patients. Nevertheless, whether these outcomes are clinically relevant is uncertain because no study has evaluated their correlation with disease severity across different settings. This systematic review and meta-analysis would bring insight into the potential of this outcome as a marker of disease evolution.

We acknowledge several limitations to this study. Although PRISMA guidelines will be adhered to and the methodology will be strictly followed, completely accounting for the limitations of included studies is impossible. Because MS patients present variable symptoms, populations will vary across studies. A recent meta-analysis evaluating gait alteration in MS revealed that gait studies included mainly individuals with low EDSS levels, which may limit the sensitivity as well as the external validity of the findings [21]. Interventions are also susceptible to heterogeneity because gait analysis protocols as well as algorithms used and features computed are numerous [15]. Because speed has been shown to depend on the set-up (time or length of the exercise) [13, 22], there might be significant heterogeneity for gait feature outcomes across studies. These elements can decrease the validity of the meta-analysis. Nevertheless, these weaknesses will be assessed to allow us to discuss results accordingly. Furthermore, grey literature will be searched in addition to traditional databases of published literature to try to limit publication bias. Another limitation lies in the fact that we will not review correlations of gait features to disease severity for various evolution states in a given patient. Therefore, we cannot directly conclude that a parameter that would prove to be associated with clinical scales in this review can be used as a severity marker in a given patient. Such assumption would require postulating that individual-based correlations can be interpolated from population-based correlations, which must be verified. For this aim, longitudinal studies only should be included, which we expect to be impossible at this time because of their small number in the literature. Furthermore, the quantitative synthesis of the effect of sensitizing conditions—for example, fatigued, dual-tasking, eyes-closed walk, narrow-step width, and obstacle negotiation—on altered gait parameters identified by this review should also be investigated to enhance the assessment and treatment of gait in individuals with MS.

Abbreviations

EDSS:

Expanded Disability Status Scale

ILG:

InertiaLocoGraphy

IMU:

Inertial measurement unit

MS:

Multiple sclerosis

MSFC:

Multiple Sclerosis Functional Composite

MSIS-29:

Multiple Sclerosis Impact Scale

MSSS:

Multiple Sclerosis Severity Score

MSWS:

Multiple Sclerosis Walking Scale-12

T25FW:

Timed 25-ft Foot Walk

References

  1. Heesen C, Böhm J, Reich C, Kasper J, Goebel M, Gold S. Patient perception of bodily functions in multiple sclerosis: gait and visual function are the most valuable. Mult Scler J. 2008;14(7):988–91.

    Article  CAS  Google Scholar 

  2. Meyer-Moock S, Feng Y-S, Maeurer M, Dippel F-W, Kohlmann T. Systematic literature review and validity evaluation of the Expanded Disability Status Scale (EDSS) and the Multiple Sclerosis Functional Composite (MSFC) in patients with multiple sclerosis. BMC Neurol. 2014;14:58.

    Article  Google Scholar 

  3. Noseworthy JH. Clinical scoring methods for multiple sclerosis. Ann Neurol. 1994;36:S80–5.

    Article  Google Scholar 

  4. Noseworthy JH, Vandervoort MK, Wong CJ, Ebers GC. Interrater variability with the Expanded Disability Status Scale (EDSS) and Functional Systems (FS) in a multiple sclerosis clinical trial. The Canadian Cooperation MS Study Group. Neurology. 1990;40(6):971–5.

    Article  CAS  Google Scholar 

  5. Roxburgh RHSR, et al. Multiple sclerosis severity score: using disability and disease duration to rate disease severity. Neurology. 2005;64(7):1144–51.

    Article  CAS  Google Scholar 

  6. Goodman AD, et al. Dose comparison trial of sustained-release fampridine in multiple sclerosis. Neurology. 2008;71(15):1134–41.

    Article  CAS  Google Scholar 

  7. Kragt JJ, van der Linden F a H, Nielsen JM, Uitdehaag BMJ, Polman CH. Clinical impact of 20% worsening on timed 25-foot walk and 9-hole peg test in multiple sclerosis. Mult Scler Houndmills Basingstoke Engl. 2006;12(5):594–8.

    Article  CAS  Google Scholar 

  8. Rudick RA, Cutter G, Reingold S. The multiple sclerosis functional composite: a new clinical outcome measure for multiple sclerosis trials. Mult Scler Houndmills Basingstoke Engl. 2002;8(5):359–65.

    Article  CAS  Google Scholar 

  9. Fischer JS, Rudick RA, Cutter GR, Reingold SC. The Multiple Sclerosis Functional Composite measure (MSFC): an integrated approach to MS clinical outcome assessment. Mult Scler J. 1999;5(4):244–50.

    Article  CAS  Google Scholar 

  10. Smidt GL, Arora JS, Johnston RC. Accelerographic analysis of several types of walking. Am J Phys Med. 1971;50(6):285–300.

    CAS  PubMed  Google Scholar 

  11. Barrois R, et al. Quantify osteoarthritis gait at the doctor’s office: a simple pelvis accelerometer based method independent from footwear and aging. Comput Methods Biomech Biomed Engin. 2015;18(1):1880–1.

    Article  Google Scholar 

  12. Barrois R, et al. Observational study of 180° turning strategies using inertial measurement units and fall risk in post-stroke hemiparetic patients. Front Neurol. 2017;8:194.

    Article  Google Scholar 

  13. Vienne A, Barrois RP, Buffat S, Ricard D, Vidal P-P. Inertial sensors to assess gait quality in patients with neurological disorders: a systematic review of technical and analytical challenges. Front Psychol. 2017;8:817.

    Article  Google Scholar 

  14. Moher D, Liberati A, Tetzlaff J, Altman DG, PRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. J Clin Epidemiol. 2009;62(10):1006–12.

    Article  Google Scholar 

  15. Stroup DF, et al. Meta-analysis of observational studies in epidemiology: a proposal for reporting. Meta-analysis Of Observational Studies in Epidemiology (MOOSE) group. JAMA. 2000;283(15):2008–12.

    Article  CAS  Google Scholar 

  16. Hubble RP, Naughton GA, Silburn PA, Cole MH. Wearable sensor use for assessing standing balance and walking stability in people with Parkinson’s disease: a systematic review. PLoS One. 2015;10(4):e0123705.

    Article  Google Scholar 

  17. Borenstein M, Hedges LV, Higgins JPT, Rothstein HR. Introduction to meta-analysis. Chichester: Wiley; 2009.

    Book  Google Scholar 

  18. Higgins JPT, Thompson SG, Deeks JJ, Altman DG. Measuring inconsistency in meta-analyses. BMJ. 2003;327(7414):557–60.

    Article  Google Scholar 

  19. Ryan R, Hill S. How to GRADE the quality of the evidence. Cochrane Consumers Commun Group. 2016. Available at http://cccrg.cochrane.org/author-resources. Version 3.0 December 2016.

  20. Jokubaitis VG, et al. Predictors of long-term disability accrual in relapse-onset multiple sclerosis. Ann Neurol. 2016;80(1):89–100.

    Article  Google Scholar 

  21. Comber L, Galvin R, Coote S. Gait deficits in people with multiple sclerosis: a systematic review and meta-analysis. Gait Posture. 2017;51:25–35.

    Article  Google Scholar 

  22. Gijbels D, et al. Which walking capacity tests to use in multiple sclerosis? A multicentre study providing the basis for a core set. Mult Scler J. 2012;18(3):364–71.

    Article  Google Scholar 

Download references

Acknowledgements

Not applicable.

Funding

This work will be funded by Centre National de la Recherche Scientifique (CNRS), Service de Santé des Armées (SSA), Université Paris Descartes, Institut pour la Recherche sur la Moelle épinière et l’Encéphale (IRME) and Centre National d’Etudes Spatiales (CNES).

The funding source has no role in the study design and will have no role in the collection, analysis, and interpretation of data or in the writing of the report. The corresponding author will have full access to all data and has final responsibility to submit the paper for publication.

Availability of data and materials

All data generated during this study will be included in the published article and its Additional files 1 and 2. All data that will be analyzed will be found in reference articles or published in the Additional files 1 and 2 upon acceptance from contacted authors.

Author information

Authors and Affiliations

Authors

Contributions

AV conceived the study and the statistical analysis. FQ conceived the study. PPV initiated the study design. DR initiated the study design. All authors contributed to the refinement of the study protocol and approved the final manuscript.

Corresponding author

Correspondence to A. Vienne-Jumeau.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Additional files

Additional file 1:

Standardized form for data extraction. (DOCX 40 kb)

Additional file 2:

20-item quality checklist. (DOCX 42 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Vienne-Jumeau, A., Quijoux, F., Vidal, P.P. et al. Value of gait analysis for measuring disease severity using inertial sensors in patients with multiple sclerosis: protocol for a systematic review and meta-analysis. Syst Rev 8, 15 (2019). https://0-doi-org.brum.beds.ac.uk/10.1186/s13643-018-0918-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/s13643-018-0918-z

Keywords