Skip to main content
Download PDF
  • Research article
  • Open access
  • Published:

Validation of a one year fracture prediction tool for absolute hip fracture risk in long term care residents

BMC Geriatrics volume 18, Article number: 320 (2018) Cite this article

Abstract

Background

Frail older adults living in long term care (LTC) homes have a high fracture risk, which can result in reduced quality of life, pain and death. The Fracture Risk Scale (FRS) was designed for fracture risk assessment in LTC, to optimize targeting of services in those at highest risk. This study aims to examine the construct validity and discriminative properties of the FRS in three Canadian provinces at 1-year follow up.

Methods

LTC residents were included if they were: 1) Adults admitted to LTC homes in Ontario (ON), British Columbia (BC) and Manitoba (MB) Canada; and 2) Received a Resident Assessment Instrument Minimum Data Set Version 2.0. After admission to LTC, one-year hip fracture risk was evaluated for all the included residents using the FRS (an eight-level risk scale, level 8 represents the highest fracture risk). Multiple logistic regressions were used to determine the differences in incident hip or all clinical fractures across the provinces and FRS risk levels. We examined the differences in incident hip or all clinical fracture for each FRS level across the three provinces (adjusted for age, BMI, gender, fallers and previous fractures). We used the C-statistic to assess the discriminative properties of the FRS for each province.

Results

Descriptive statistics on the LTC populations in ON (n = 29,848), BC (n = 3129), and MB (n = 2293) are: mean (SD) age 82 (10), 83 (10), and 84 (9), gender (female %) 66, 64, and 70% respectively. The incident hip fractures and all clinical fractures for FRS risk level were similar among the three provinces and ranged from 0.5 to 19.2% and 1 to 19.2% respectively. The overall discriminative properties of the FRS were similar between ON (C-statistic = 0.673), BC (C-statistic = 0.644) and MB (C-statistic = 0.649) samples.

Conclusion

FRS is a valid tool for identifying LTC residents at different risk levels for hip or all clinical fractures in three provinces. Having a fracture risk assessment tool that is tailored to the LTC context and embedded within the routine clinical assessment may have significant implications for policy, service delivery and care planning, and may improve care for LTC residents across Canada.

Peer Review reports

Background

It has been estimated that 1 in 4 Canadians will be 65 years or older by 2036 [1]. As the population ages, a greater number of older adults will need residential support such as long-term care (LTC). LTC Residents are often frail, since their multiple physical and cognitive deficits place them at high risk of falls, disability, and death [2, 3]. Hip fractures are the most common type of fracture in LTC (49% of all fractures) [4]. They are more common in older adults living in LTC (49%) than in the community (29%) [4, 5], and lead to more hospitalizations [6] and worsening health-related quality of life [7]. In Canada, 45% of LTC residents with hip fracture die within 12 months [8] and of the survivors, 48% are no longer ambulatory [8].

Hip fracture prediction and prevention in LTC residents receive little attention due to the multiple comorbidities and medical complexity of LTC residents [9, 10] and the challenges of predicting fracture in this population. It is difficult to identify LTC residents with high fracture risk, as the commonly used fracture risk assessment tools in Canada, including the Canadian Fracture Risk Assessment Tool (FRAX) and the Canadian Association of Radiologists and Osteoporosis Canada tool (CAROC) [11,12,13,14], are not valid or generalizable for residents of LTC [15, 16]. FRAX and CAROC typically provide a 10-year fracture risk assessment timeframe, which is too long, given the mean 2.4-year life expectancy of LTC residents [17]. A recent study showed that FRAX (with bone mineral density) may predict incident hip fracture at one year [18]. Bone mineral density is heavily weighted in current fracture risk assessment protocols, but bone mineral density is not feasible to obtain in LTC. In addition, FRAX is not tailored to frail, institutionalized LTC residents. Thus, fracture prediction outputs of FRAX-Canada and CAROC may not be suitable for decision making and care planning among frail LTC residents [19, 20].

Recently, our team developed the Fracture Risk Scale (FRS) [21], a standardized outcome scale for identifying LTC residents at risk for fracture within one year. The FRS can be obtained from the Resident Assessment Instrument Minimum Data Set (RAI-MDS 2.0), which is a comprehensive, standardized assessment that is used upon admission and on a quarterly basis thereafter, to gather information on a wide range of socio-demographic and clinical characteristics [22,23,24]. The FRS was developed using Ontario residents’ data from the RAI-MDS 2.0, the Discharge Abstract Database (DAD) and the National Ambulatory Care Reporting System (NACRS). However, the FRS was not externally validated (in a population other than the tool development sample), nor was its validity tested in other Canadian provinces. As a predictive model, the FRS’ reproducibility (performing sufficiently accurate across new samples from the same target population) and transportability (performing well across samples from different but related source populations) [25] need to be tested prior widespread adoption. Therefore, we conducted this validity study to examine the FRS performance across a new sample and in different but related population of LTC residents in other provinces [21].

This study aims to: 1) assess the discriminative properties of the FRS using C-statistics and examine the construct validity of the FRS by comparing incident hip fractures and all clinical fractures (includes hip, spine, humerus, forearm, pelvis fractures) for each fracture risk levels in LTC residents across three Canadian provinces at 1-year follow up; 2) compare incident hip and all clinical fractures in LTC residents across three Canadian provinces; and 3) compare incident hip and all clinical fractures between the FRS risk levels. To examine the construct validity study of the FRS [26], we hypothesize that incident hip fractures for each fracture risk levels in LTC residents in the three Canadian provinces are not statistically different when type 1 error is ≤0.05.

Methods

Study design and population

This retrospective cohort study uses data from the RAI-MDS 2.0. In Canada, LTC facilities provide living accommodation for people who need 24-h professional health services, personal care and services, including meals, laundry, housekeeping, frequent assistance with activities of daily living, on-site supervision or monitoring to ensure safety or well-being [27, 28]. LTC residents were included if they: 1) were adults admitted to LTC homes in Canada from April 1st, 2006 to March 31st, 2010; and 2) were assessed with the RAI-MDS 2.0. LTC residents were excluded if they: 1) had multiple admissions; 2) reported on the RAI-MDS 2.0 to have end stage disease, were comatose, received hospice, or respite care; 3) were expected to have a short stay; 4) had the admission assessment completed more than 14 days after the date of admission (to exclude any assessment for existing residents); or 5) had no reassessments during the one-year follow-up. The project received ethics approval from the University of Waterloo Office of Research Ethics (ORE no 17045).

Fracture rating scale

The FRS is different from existing fracture risk assessment tools in that it does not use bone mineral density and includes fracture risk factors that are relevant to the long-term care (LTC) population [21]. Moreover, to ensure that it was valid for LTC residents and easily scalable, the FRS was designed and validated using large population-based datasets that include routinely collected data from LTC residents. The FRS was developed using decision tree analysis and the included items are walking in corridor (independent, supervision to extensive assistance or total assistance/walking did not occur), wandering (no wandering to infrequent wandering, less than daily wandering, or daily wandering), falling status within the past 30 days (no/yes), cognitive performance scale (intact cognition, borderline intact or mild impairment, or moderate to very severe impairment), transfer status (how resident moves between surfaces to and from; bed, chair, wheelchair, standing position), (independent to extensive assistance, or total assistance/transfer did not occur), age greater than 85 years (no/yes), body mass index (BMI) (< 18, 18–30, or > 30 kg/m2), and previous fractures in past 180 days (no/yes) [21]. The FRS includes eight fracture risk level categories (level 1 represents the lowest and level 8 represents the highest fracture risk). Within the FRS, assessment of risk continues through the decision tree until a terminal risk level is identified. For example, individuals who can walk in corridor independently with BMI > 30 are defined as fracture risk level 3. However, if BMI is between 18 and 30, risk level also depends on history of falls, fracture and cognitive performance.

Incident fractures

Over the course of one-year follow-up period, residents were classified as to the presence or absence of an incident fracture. To capture incident fractures, we accessed in-patient hospital records and emergency department records [23, 24]. DAD is received directly from acute care facilities or their respective health/regional authority or ministry/department of health and it contains demographic, administrative and clinical data of all Canadian provinces except Quebec [29]. NACRS contains data for all hospital-based and community-based ambulatory care including day surgery, outpatient and community-based clinics and emergency departments [30]. NACRS data is received directly from participating facilities or from regional health authorities or ministries of health. Data collection methods may vary by facility. We were able to link DAD and NACRS data to RAI-MDS data for this analysis.

Incident fractures were defined using International Statistical Classification of Diseases and Related Health Problems, 10th Revision, Canada (ICD-10-CA) codes, captured in DAD and NACRS. The codes were selected using the Revised Framework for National Surveillance on Osteoporosis and Osteoporosis-related Fractures of the Public Health Agency of Canada [31]. A resident with one of the hip fracture codes (hip (S72.0, S72.1, S72.2) present on either a hospitalization or emergency department visit within one year after the admission assessment was code as having hip fracture. A resident with at least one of these codes within one year after the admission assessment was coded as having a fracture (hip (S72.0, S72.1, S72.2), spine (S22.0, S22.1, S32.0, S32.7, S32.8), humerus (S42.2), forearm (S52.x, S62.x) and pelvis (S32.1, S32.3, S32.4, S32.5, S32.7, S32.8)).

Statistical analysis

The study population demographics, prior falls and fractures, and fracture incidence estimates are expressed as mean (SD) for continuous data and counts and percentages for categorical data. Percent of incident hip fracture and all clinical fractures (hip, spine, humerus, forearm, pelvis fractures) for each FRS risk level in the three provinces were calculated. Multivariable logistic regression models were used to determine if incident hip fractures are different across the provinces and to calculate the odds ratio of incident hip fractures in each FRS risk level. In this logistic regression, the incident hip fractures were the dependent variable (DV) and provinces (Ontario was used as the reference group) and FRS risk levels (FRS risk level 1 was used as the reference level) were the independent variables (IV). We tested the significance of the interaction term of FRS and provinces in the logistic regression model to determine if the incident hip fracture in each FRS risk level is different across the provinces. The logistic regression analyses were adjusted for age, BMI, gender, fallers in the last 180 days, previous fracture, and the size of the residential home (small, medium or large). All the analyses were repeated using all incident fractures as DV. To assess the discriminative properties of the FRS for each province, we used the C-statistic. All the statistical analyses were conducted using SAS V.9.4 (SAS Institute).

Results

The final study sample includes 35,270 participants (ON = 29,848, BC = 3129 and MB = 2293) and is displayed in Fig. 1. Of the eligible residents, 703 (ON = 447, BC = 169 and MB = 87) were not included in the analysis due to data entry errors. Table 1 demonstrates the characteristics of LTC residents in the three provinces. Table 2 describes FRS items in LTC residents of the three provinces. Of the included residents, 3561 (10.1%) residents died before the end of the one-year follow-up period. The characteristics of the excluded and included resident are comparable. Of the excluded residents 48.8% aged 85 years or older, and 67.9% are female. The age, gender distribution and comorbidities are similar across the provinces; with less than 1% of LTC residents having had a hospital admission within 3 months from LTC admission. Falls, incident fractures, and BMI were similar across the provinces as well. All of the Manitoba homes in the study were from one urban centre, as the remainder of the province does not use RAI-MDS.

Fig. 1
figure 1

Study sample flow diagram

Full size image
Table 1 Baseline characteristics of the study participants
Full size table
Table 2 Fracture rating scale items in the three provinces
Full size table

Incident hip fractures and all clinical fractures in all risk levels ranged from 0.5 to 19.2% and 1 to 19.2% respectively (Figs. 2 and 3, respectively). Table 3 demonstrates the provincial fracture counts and percent by FRS levels. The incident hip fractures were comparable across the three provinces (BC = 1.27 (1.04, 1.55), MB = 1.30 (1.04, 1.62), when ON is the reference province). Also, there was no statistically significant difference in all clinical fractures (BC = 0.97 (0.81, 1.16), MB = 0.84 (0.68, 1.04), when ON is the reference province) across the three provinces (Table 4). When adjusting for the provinces, the odds of incident hip fractures and all clinical fractures in all the FRS risk levels were significantly different compared to level 1 with consistently increasing odds of fractures with higher FRS risk levels, as shown in Table 4.

Fig. 2
figure 2

Incident Hip fracture for Fracture Rating Scale risk levels

Full size image
Fig. 3
figure 3

All Incident fracture for Fracture Rating Scale risk levels

Full size image
Table 3 Provincial fracture counts and percent by FRS levels
Full size table
Table 4 Differences in Hip Fracture across provinces and Fracture risk scale risk levels
Full size table

All the interaction terms associated with FRS risk levels and provinces were not statistically significant. This indicates the similarity of incident hip fractures and all clinical fractures for each FRS risk levels in the three provinces. The overall discriminative properties of the FRS were similar between ON (c-statistic = 0.67), BC (c-statistic = 0.64) and MB (c-statistic = 0.65) samples. The proportion of hip fractures that occurred in residents with a FRS level of 1–3 ranged from 4.9–7% across provinces, whereas the proportion of hip fractures that occurred in residents with a FRS of 6–8 was higher (> 26%).

Discussion

Our study demonstrates the validity of the FRS for predicting hip and all clinical fractures in LTC residents living in several Canadian provinces. As recommended by the Cosmin initiative [26], an international initiative that aims to improve the selection of health measurement instruments; hypothesis-testing construct validity is a critical component of evaluating outcome measures’ psychometric properties. This study confirmed our hypothesis and showed that incident hip and all clinical fractures for each FRS risk levels in LTC residents in the three Canadian provinces were similar, confirming that the FRS is reproducible and transportable for LTC residents living in different geographical areas [25]. Therefore, our results confirmed that FRS can be used to identify LTC residents with high risk of hip or all fractures across different Canadian provinces.

We have previously shown that the FRS is able to identify LTC residents at highest risk of fracture in the initial FRS development study [21]. The FRS is an adequate reflection of the outcome of interest (one-year incident fracture). Our study builds on this work by examining FRS performance in LTC residents in three geographical areas. A clinical prediction tool performance is determined by assessing a model’s calibration and discrimination [32]. Calibration is the agreement between prediction from the model (FRS model) and observed outcomes (incident hip and all clinical fractures) and indicates a model’s predictive accuracy [33], which was shown in Table 4. Discrimination is the ability of the prediction model (FRS model) to set apart participants with and without the outcome of interest (incident hip and all clinical fractures); those with the outcome of interest should have a higher predicted risk compared to those who do not have it [33] which was also shown in Table 4.

Unlike commonly used fracture risk assessment tools (FRAX and CAROC), FRS is a unique one-year fracture prediction tool that is composed of risk factors specific to LTC residents. FRS is embedded in the RAI-MDS 2.0, which is completed within 14 days of a resident entering a home and quarterly thereafter. In addition, the FRS can be obtained from the interRAI Long Term Care Facility assessment, which is the successor to the RAI-MDS 2.0 [24, 34]. Thus, FRS can be easily and regularly implemented in LTC without burden on the LTC staff [9, 10, 35, 36]. As we demonstrated the FRS’ validity, we suggest it can be used for LTC resident care planning across Canada and possibly internationally. Recently, Fracture Risk Assessment in Long-term Care (FRAiL) tool has been developed, which aims to predict two-year hip fracture risk in nursing home residents [16]. The FRAiL tool developed using RAI-MDS 2.0 assessment of nursing home residents in the United States. FRAiL tools included Fifteen items to predict hip fracture: older age, white race, female, impaired cognition, activities of daily living independence, locomotion independence, urinary continence, previous falls, transfer independence, easily distracted, wandering, absence of osteoarthritis, absence of pressure ulcer, low BMI, and diabetes. There are some common items in FRS and FRAiL tools such as wandering, falling, cognitive performance scale, transfer status, age, BMI, and previous fractures.

Recommendations for preventing fracture in LTC have been developed to provide non-pharmacologic and pharmacologic strategies for fracture prevention in frail older adults living in LTC [37]. However, there is a current gap in osteoporosis treatment and fracture prevention in LTC residents [38,39,40,41,42,43]. One of the barriers to implement fracture prevention guideline is the lack of information about fracture risk assessment [44]. The easily implemented and validated FRS tool may overcome this barrier. To help LTC clinicians prescribing the appropriate intervention to residents who are identified as “at risk”, our team will develop and implement an electronic Clinical Assessment Protocol (CAP) in LTCs. The Fracture Risk CAP will automatically produce recommendations for residents based on their FRS fracture risk level and will inform clinical decision making as part of the person-centered care planning process to fill the gap of fracture prevention in LTC. Other CAPs have been developed to draw the attention of the healthcare provider to a matter (such as Activities of daily living, delirium and Cardiorespiratory) that can be improved and should be considered in LTC residents’ care plan [45].

Strengths of this study include the use of a large, representative sample of LTC residents with RAI-MDS 2.0 data linked with DAD and NACRS. As it is recommended to externally validate the model in samples from related source populations (LTC residents in other provinces) [25], we examined the performance of the FRS outside of the development sample. Assessing the relation between the development and validation samples allowed us to explain the FRS (clinical) transportability and (statistical) reproducibility [25].

We acknowledge that our study has limitations. We excluded LTC residents with short life expectancy based on the data from the RAI-MDS 2.0 (participants who have end stage disease, were comatose, received hospice, or respite care, or expected a short stay), as we aim to inform decisions related to fracture prediction and prevention for those whom life expectancy is 1 year or greater. Therefore, our findings may not be generalizable to some LTC residents. We included participants who died before the end of the one-year follow up in the analysis, which may underestimate the incident fracture, as these people may have a higher likelihood of fracture. Competing risk framework was not employed in the analyses, as we excluded individuals who were likely to die within a year apriori. Despite not employing competing risk framework, our result shows that FRS performs reasonably well in identifying at risk people. We used a validated framework to capture incident fractures (Revised Framework for National Surveillance on Osteoporosis and Osteoporosis-related Fractures of the Public Health Agency of Canada [31]), however, vertebral and other fractures are likely not fully captured. Our study was limited to the variables collected in the RAI-MDS 2.0 and may not have captured all relevant risk factors for hip or all clinical fractures in LTC residents.

Conclusion

The FRS is a valid tool for identifying LTC residents at different risk levels for hip or all clinical fractures in three provinces. Having a fracture risk assessment tool that is tailored to the LTC context and embedded within the routine clinical assessment may have significant implications for policy, service delivery and care planning, and may improve care for LTC residents across Canada.

Abbreviations

BC:

British Columbia

CAP:

Clinical Assessment Protocol

CAROC:

Canadian Association of Radiologists and Osteoporosis Canada tool

CI:

Confidence Interval

DAD:

Canadian Discharge Abstract Database

DV:

Dependent Variable

FRAX:

Fracture Risk Assessment Tool

FRS:

Fracture Rating Scale

ICD-10 code:

International Classification of Disease-10 code

IV:

Independent Variable

LTC:

Long Term Care

MB:

Manitoba

NACRS:

National Ambulatory Care Reporting System

ON:

Ontario

RAI-MDS 2.0:

Resident Assessment Instrument Minimum Data Set

SD:

Standard Deviation

References

  1. Canada S. Living arrangements of seniors. Census in brief No. 4.; 2011.

  2. Abellan van Kan G, Rolland Y, Houles M, Gillette-Guyonnet S, Soto M, Vellas B. The assessment of frailty in older adults. Clin Geriatr Med. 2010;26(2):275–86.

    Article  Google Scholar 

  3. Bergman H, Ferrucci L, Guralnik J, Hogan DB, Hummel S, Karunananthan S, et al. Frailty: an emerging research and clinical paradigm--issues and controversies. J Gerontol A Biol Sci Med Sci. 2007;62(7):731–7.

    Article  Google Scholar 

  4. Papaioannou A, Kennedy CC, Ioannidis G, Cameron C, Croxford R, Adachi JD, et al. Comparative trends in incident fracture rates for all long-term care and community-dwelling seniors in Ontario, Canada, 2002-2012. Osteoporos Int. 2016;27(3):887–97.

    Article  CAS  Google Scholar 

  5. Tarride JE, Burke N, Leslie WD, Morin SN, Adachi JD, Papaioannou A, et al. Loss of health related quality of life following low-trauma fractures in the elderly. BMC Geriatr. 2016;16:84.

    Article  Google Scholar 

  6. Ronald LA, McGregor MJ, McGrail KM, Tate RB, Broemling AM. Hospitalization rates of nursing home residents and community-dwelling seniors in British Columbia. Can J Aging. 2008;27(1):109–15.

    Article  Google Scholar 

  7. Dyer SM, Crotty M, Fairhall N, Magaziner J, Beaupre LA, Cameron ID, et al. A critical review of the long-term disability outcomes following hip fracture. BMC Geriatr. 2016;16:158.

    Article  Google Scholar 

  8. Beaupre LA, Jones CA, Johnston DW, Wilson DM, Majumdar SR. Recovery of function following a hip fracture in geriatric ambulatory persons living in nursing homes: prospective cohort study. J Am Geriatr Soc. 2012;60(7):1268–73.

    Article  Google Scholar 

  9. Doupe M, St John P, Chateau D, Strang D, Smele S, Bozat-Emre S, et al. Profiling the multidimensional needs of new nursing home residents: evidence to support planning. J Am Med Dir Assoc. 2012;13(5):487 e9–17.

    Article  Google Scholar 

  10. A B. An Overview of Long-Term Care in Canada and Selected Provinces and Territories.; 2007.

  11. Siminoski K, Leslie WD, Frame H, Hodsman A, Josse RG, Khan A, et al. Recommendations for bone mineral density reporting in Canada: a shift to absolute fracture risk assessment. J Clin Densitom. 2007;10(2):120–3.

    Article  Google Scholar 

  12. Siminoski K, Leslie WD, Frame H, Hodsman A, Josse RG, Khan A, et al. Recommendations for bone mineral density reporting in Canada. Can Assoc Radiol J. 2005;56(3):178–88.

    PubMed  Google Scholar 

  13. Kanis JA, Johnell O, De Laet C, Johansson H, Oden A, Delmas P, et al. A meta-analysis of previous fracture and subsequent fracture risk. Bone. 2004;35(2):375–82.

    Article  CAS  Google Scholar 

  14. Leslie WD, Lix LM, Langsetmo L, Berger C, Goltzman D, Hanley DA, et al. Construction of a FRAX(R) model for the assessment of fracture probability in Canada and implications for treatment. Osteoporos Int. 2011;22(3):817–27.

    Article  CAS  Google Scholar 

  15. Bravo G, Dubois MF, De Wals P, Hebert R, Messier L. Relationship between regulatory status, quality of care, and three-year mortality in Canadian residential care facilities: a longitudinal study. Health Serv Res. 2002;37(5):1181–96.

    Article  Google Scholar 

  16. Living arrangements of seniors. Catalogue no. 98–312-X2011003: Statistics Canada; 2011.

  17. Jones AL, Dwyer LL, Bercovitz AR, Strahan GW. The National Nursing Home Survey: 2004 overview. Vital Health Stat 13. 2009(167):1–155.

  18. Leslie WD, Majumdar SR, Morin SN, Lix LM, Johansson H, Oden A, et al. FRAX for fracture prediction shorter and longer than 10 years: the Manitoba BMD registry. Osteoporos Int. 2017;28(9):2557–64.

    Article  CAS  Google Scholar 

  19. Cox L, Kloseck M, Crilly R, McWilliam C, Diachun L. Underrepresentation of individuals 80 years of age and older in chronic disease clinical practice guidelines. Can Fam Physician. 2011;57(7):e263–9.

    PubMed  PubMed Central  Google Scholar 

  20. Mutasingwa DR, Ge H, Upshur RE. How applicable are clinical practice guidelines to elderly patients with comorbidities? Can Fam Physician. 2011;57(7):e253–62.

    PubMed  PubMed Central  Google Scholar 

  21. Ioannidis G, Jantzi M, Bucek J, Adachi JD, Giangregorio L, Hirdes J, et al. Development and validation of the fracture risk scale (FRS) that predicts fracture over a 1-year time period in institutionalised frail older people living in Canada: an electronic record-linked longitudinal cohort study. BMJ Open. 2017;7(9):e016477.

    Article  Google Scholar 

  22. Morris JN, Nonemaker S, Murphy K, Hawes C, Fries BE, Mor V, et al. A commitment to change: revision of HCFA's RAI. J Am Geriatr Soc. 1997;45(8):1011–6.

    Article  CAS  Google Scholar 

  23. Hawes C, Morris JN, Phillips CD, Fries BE, Murphy K, Mor V. Development of the nursing home resident assessment instrument in the USA. Age Ageing. 1997;26(Suppl 2):19–25.

    Article  Google Scholar 

  24. Hirdes JP, Ljunggren G, Morris JN, Frijters DH, Finne Soveri H, Gray L, et al. Reliability of the interRAI suite of assessment instruments: a 12-country study of an integrated health information system. BMC Health Serv Res. 2008;8:277.

    Article  Google Scholar 

  25. Debray TP, Vergouwe Y, Koffijberg H, Nieboer D, Steyerberg EW, Moons KG. A new framework to enhance the interpretation of external validation studies of clinical prediction models. J Clin Epidemiol. 2015;68(3):279–89.

    Article  Google Scholar 

  26. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. J Clin Epidemiol. 2010;63(7):737–45.

    Article  Google Scholar 

  27. Hirdes JP, Mitchell L, Maxwell CJ, White N. Beyond the 'iron lungs of gerontology': using evidence to shape the future of nursing homes in Canada. Can J Aging. 2011;30(3):371–90.

    Article  Google Scholar 

  28. Long-term facilities-based care 2004 [Available from: https://www.canada.ca/en/health-canada/services/home-continuing-care/long-term-facilities-based-care.html.

  29. Discharge Abstract Database Metadata (DAD): Canadian Institute of Health Information; 2018 [Available from: https://www.cihi.ca/en/discharge-abstract-database-metadata.

  30. National Ambulatory Care Reporting System Metadata (NACRS): Canadian Institute of Health Information; 2018 [Available from: https://www.cihi.ca/en/national-ambulatory-care-reporting-system-metadata.

  31. O’Donnell S, Canadian Chronic Disease Surveillance System Osteoporosis Working G. Use of administrative data for national surveillance of osteoporosis and related fractures in Canada: results from a feasibility study. Archives of osteoporosis. 2013;8:143-.

  32. Steyerberg EW, Vickers AJ, Cook NR, Gerds T, Gonen M, Obuchowski N, et al. Assessing the performance of prediction models: a framework for traditional and novel measures. Epidemiology. 2010;21(1):128–38.

    Article  Google Scholar 

  33. EW S. Clinical prediction models: a practical approach to development, validation, and updating. New York: Springer; 2009.

  34. Onder G, Carpenter I, Finne-Soveri H, Gindin J, Frijters D, Henrard JC, et al. Assessment of nursing home residents in Europe: the services and health for elderly in long TERm care (SHELTER) study. BMC Health Serv Res. 2012;12:5.

    Article  Google Scholar 

  35. Chamberlain SA, Gruneir A, Hoben M, Squires JE, Cummings GG, Estabrooks CA. Influence of organizational context on nursing home staff burnout: a cross-sectional survey of care aides in Western Canada. Int J Nurs Stud. 2017;71:60–9.

    Article  Google Scholar 

  36. Bowers BJ, Esmond S, Jacobson N. The relationship between staffing and quality in long-term care facilities: exploring the views of nurse aides. J Nurs Care Qual. 2000;14(4):55–64 quiz 73-5.

    Article  CAS  Google Scholar 

  37. Papaioannou A, Santesso N, Morin SN, Feldman S, Adachi JD, Crilly R, et al. Recommendations for preventing fracture in long-term care. CMAJ. 2015;187(15):1135–44 E450-61.

    Article  Google Scholar 

  38. Wall M, Lohfeld L, Giangregorio L, Ioannidis G, Kennedy CC, Moser A, et al. Fracture risk assessment in long-term care: a survey of long-term care physicians. BMC Geriatr. 2013;13:109.

    Article  Google Scholar 

  39. Kennedy CC, Ioannidis G, Thabane L, Adachi JD, O'Donnell D, Giangregorio LM, et al. Osteoporosis prescribing in long-term care: impact of a provincial knowledge translation strategy. Can J Aging. 2015;34(2):137–48.

    Article  Google Scholar 

  40. Jachna CM, Shireman TI, Whittle J, Ellerbeck EF, Rigler SK. Differing patterns of antiresorptive pharmacotherapy in nursing facility residents and community dwellers. J Am Geriatr Soc. 2005;53(8):1275–81.

    Article  Google Scholar 

  41. Kennedy CC, Ioannidis G, Thabane L, Adachi JD, Marr S, Giangregorio LM, et al. Successful knowledge translation intervention in long-term care: final results from the vitamin D and osteoporosis study (ViDOS) pilot cluster randomized controlled trial. Trials. 2015;16:214.

    Article  Google Scholar 

  42. Colon-Emeric CS, Lyles KW, House P, Levine DA, Schenck AP, Allison J, et al. Randomized trial to improve fracture prevention in nursing home residents. Am J Med. 2007;120(10):886–92.

    Article  Google Scholar 

  43. Giangregorio LM, Jantzi M, Papaioannou A, Hirdes J, Maxwell CJ, Poss JW. Osteoporosis management among residents living in long-term care. Osteoporos Int. 2009;20(9):1471–8.

    Article  CAS  Google Scholar 

  44. Alamri SH, Kennedy CC, Marr S, Lohfeld L, Skidmore CJ, Papaioannou A. Strategies to overcome barriers to implementing osteoporosis and fracture prevention guidelines in long-term care: a qualitative analysis of action plans suggested by front line staff in Ontario. Canada BMC Geriatr. 2015;15:94.

    Article  Google Scholar 

  45. OECD, Union E. A Good Life in Old Age?2013.

Download references

Acknowledgments

Not applicable

Funding

The Ministry of Health and Long-Term Care through the Ontario Osteoporosis Strategy for Long-Term Care. AN received PhD studentship funding from Osteoporosis Canada to complete this project. In addition, funding for the analytic dataset was provided by the public Health Agency of Canada through a grant to JPH (Project#6271-15-2010/3970773). The funding sources had no role in the design and conduct of the study; collection, management, analysis and interpretation of the data; or preparation, review or approval of the manuscript.

Availability of data and materials

The data that support the findings of this study will not be shared. Our access to the de-identified record-level data is provided through the Canadian Institute for Health Information (CIHI), under license from interRAI, the international non-profit organization that holds the copyright for the assessment itself. Other interested researchers could also submit requests to CIHI if they wish to access the study data.

Author information

Authors and Affiliations

  1. Geriatric Education and Research in Aging Sciences (GERAS), St Peter’s Hospital, 88 Maplewood Ave, Hamilton, ON, Canada

    Ahmed M. Negm, George Ioannidis, Lora Giangregorio, Laura Pickard & Alexandra Papaioannou

  2. School of Rehabilitation Sciences, IAHS 403, McMaster University, 1400 Main St. W., Hamilton, Ontario, L8S 1C7, Canada

    Ahmed M. Negm & Julie Richardson

  3. Department of Medicine, McMaster University, Hamilton, Ontario, Canada

    George Ioannidis, Laura Pickard, Jonathan D. Adachi & Alexandra Papaioannou

  4. School of Public Health and Health Systems, University of Waterloo, Waterloo, Ontario, Canada

    Micaela Jantzi, Jenn Bucek & John P. Hirdes

  5. Department of Kinesiology and Schlegel-UW Research Institute for Aging, University of Waterloo, Waterloo, Ontario, Canada

    Lora Giangregorio

  6. Department of Health Research Methods, Evidence, and Impact, McMaster University, 1280 Main St West, Hamilton, ON, Canada

    Julie Richardson, Lehana Thabane & Alexandra Papaioannou

Authors
  1. Ahmed M. Negm
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. George Ioannidis
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Micaela Jantzi
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jenn Bucek
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Lora Giangregorio
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Laura Pickard
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. John P. Hirdes
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Jonathan D. Adachi
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Julie Richardson
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Lehana Thabane
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Alexandra Papaioannou
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

AN was responsible for study design, data analysis and interpretation and drafting of manuscript, MJ and GI was responsible for study design, data analysis and interpretation and drafting of manuscript. JB, JDA, LG, LT, JR, JH, LP and AP were responsible for study design, data interpretation and critical review of the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Ahmed M. Negm.

Ethics declarations

Ethics approval and consent to participate

The project received ethics approval from the University of Waterloo Office of Research Ethics (ORE no 17045). The need for consent is deemed unnecessary because the MDS 2.0 assessments are performed in Long-term care homes on all residents as part of regular clinical practice that is mandated by the Ministries of Health in the relevant Canadian provinces. For example, in Ontario, the Health Care Consent Act provides rules with respect to consent to treatment in a Health Care environment. It specifically states that the “assessment or examination of a person to determine the general nature of the person’s condition is not considered to be treatment and would therefore not require consent”.

Consent for publication

Not applicable.

Competing interests

All authors declare no support from any organisation for the submitted work; no financial relationships with any organisations that might have an interest in the submitted work in the previous three years; no other relationships or activities that could appear to have influenced the submitted work (GI, MJ, JB, JPH, LT, JR). JPH reported funding from PHAC. AN reported funding from Osteoporosis Canada. LG reports personal fees from ICON. AP and LP report grants from Ontario Ministry of Health and Long-Term Care Ontario Osteoporosis Strategy. JDA reports grants and personal fees from Amgen, grants and personal fees from Eli Lilly, personal fees from AgNovos, during the conduct of the study; non-financial support from Osteoporosis Canada, non-financial support from International Osteoporosis Foundation, outside the submitted work.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Negm, A.M., Ioannidis, G., Jantzi, M. et al. Validation of a one year fracture prediction tool for absolute hip fracture risk in long term care residents. BMC Geriatr 18, 320 (2018). https://0-doi-org.brum.beds.ac.uk/10.1186/s12877-018-1010-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/s12877-018-1010-1

Keywords

BMC Geriatrics

ISSN: 1471-2318

Contact us