Skip to main content
  • Research article
  • Open access
  • Published:

Internet-based randomised controlled trials for the evaluation of complementary and alternative medicines: probiotics in spondyloarthropathy

Abstract

Background

The clinical effectiveness of complementary and alternative medicines (CAMs) is widely debated because of a lack of clinical trials. The internet may provide an effective and economical approach for undertaking randomised controlled trials (RCTs) of low-risk interventions. We investigated whether the internet could be used to perform an internet-based RCT of a CAM fulfilling the revised CONSORT (Consolidated Standards of Reporting Trials) statement quality checklist for reporting of RCTs. A secondary aim was to examine the effect of probiotics compared to placebo in terms of well-being over 12 weeks.

Methods

People aged ≥18 years with confirmed spondyloarthropathy living in the United Kingdom with internet access were invited to participate in an internet-based RCT of probiotic compared to placebo for improving well-being and bowel symptoms. The intervention was a probiotic containing 4 strains of live bacteria or identical placebo taken by mouth daily for 3 months. The primary outcome measure was the performance of the trial according to the revised CONSORT statement.

Results

147 people were randomised into the trial. The internet-based trial of the CAM fulfilled the revised CONSORT statement such as efficient blinding, allocation concealment, intention to treat analysis and flow of participants through the trial. Recruitment of the required number of participants was completed in 19 months. Sixty-five percent (96/147) completed the entire 3 months of the trial. The trial was low cost and demonstrated that in an intention to treat analysis, probiotics did not improve well-being or bowel symptoms.

Conclusion

The internet-based RCT proved to be a successful and economical method for examining this CAM intervention. Recruitment, adherence and completion rate were all similar to those reported with conventional RCTs but at a fraction of the cost. Internet-based RCTs can fulfil all the criteria of the revised CONSORT statement and are an appropriate method for studying low-risk interventions.

Trial registration

ISRCTN36133252

Peer Review reports

Background

The use of complementary and alternative medicines (CAMs) has increased considerably in the Western industrialised countries in the past decade. CAMs are often used for maintaining wellness and in addition conventional care for chronic and acute health conditions [1]. However, there is real debate around their use [24] because of the lack of high quality scientific evidence for their effectiveness. Randomised controlled trials (RCTs) are considered the highest form of scientific evidence for any primary research study. However, few RCTs have been performed on CAMs as there is little incentive for manufacturers to undertake the considerable financial investments required for phase 1–4 clinical trials that assess efficacy, effectiveness, safety and cost-effectiveness [5] when individual CAMs may be provided by several providers and can not be protected by patent. Also, many CAMs can be marketed without the legal restrictions placed on drugs. These barriers mean that the potential benefits of CAMs are generally not adequately assessed, and patients may be denied potentially effective and safe interventions from the national health service.

Internet-based trials may provide a highly economical way of overcoming many of these logistical and funding barriers. Internet-based trials can cut down on cost of staff time (including clinical costs and data entry time), allow frequent contact with participants, enable recruitment across a large area (national or international) instead of requiring multi-centred study design and less common conditions can be examined. We examined whether an internet-based RCT could generate high quality evidence regarding the effectiveness of a widely used CAM/food supplement in a specific patient population by evaluating the performance of the trial according to the revised CONSORT statement [6]

Our chosen intervention was probiotics in spondyloarthropathy (SpA a group of related disorders) as probiotics have an excellent safety profile [7] and are considered a food supplement. There is considerable evidence from clinical and epidemiological studies that inflammation of the gut is involved in triggering spondyloarthropathy [811] and in the severity of the resultant joint inflammation [12, 13] Probiotics may help in treating this bowel inflammation [1416] and are advertised for ankylosing spondylitis, the prototypic SpA on several commercial internet sites, despite the absence of any published clinical trials.

Objectives

Primary

To examine if an internet-based RCT of a CAM can meet the revised CONSORT statement quality checklist for reporting of RCTs.

Secondary

To examine the effect of probiotic on well-being compared to placebo.

Methods

Participants

Participants were recruited from a link posted on the website of the national patient-led charity, the National Ankylosing Spondylitis Society (NASS). The trial web site provided information regarding the trial and stipulated that participants had to be 18 years or over, resident in the UK, have access to the internet and a diagnosis of SpA. Participants printed-out and signed a consent form and posted it to researchers. This included permission from the participant for the research team to contact their doctor (either general practitioner or rheumatologist) to confirm that they knew the participant, that the participant was more than 18 years old, had a diagnosis of SpA made by a rheumatologist and confirmed by X-ray or magnetic resonance scan, and did not have a immunosuppressive disorder such as HIV/AIDS or cancer. All the participants included in the study had a confirmation from their rheumatologist or GP that they had sacroiliitis as diagnosed using an X ray or MRI. Therefore, no participants have peripheral arthropathy only.

We also asked for the doctor to confirm other conditions such as iritis, psoriasis or inflammatory bowel disease. Participants were asked to stop taking live yogurts or other probiotic preparations for the duration of the study. Participants were encouraged to phone the research team if they required further information.

Interventions

The probiotic (10 g lyophilized powder containing live bacteria: Lactobacillus salivarius (CUL61) 6.25 × 109 cfu (colony forming units), Lactobacilllus paracasei (CUL08) 1.25 × 109cfu, Bifidobacterium infantis (CUL34) 1.25 × 109 cfuand Bifidobacterium bifidum (CUL20) 1.25 × 109 cfu) and the placebo (10 g maltodextrin) capsule were the same colour, size, smell and contained powder of identical appearance. Capsules were sent through the post and participants were instructed to keep the capsules in the refrigerator and take 1 capsule by mouth daily for 3 months.

Outcome measures

Outcome 1: to fulfil the revised CONSORT statement for reporting of parallel-group randomised trials for an internet-based RCT of a CAM (probiotics).

Outcome 2: Comparison of probiotic and placebo group in terms of well-being, bowel symptoms and arthritis severity (disease activity and function) after 12 weeks of treatment.

Sample size

We required a sample size of 140 participants for 95% power at 5% significance level (two sided) to detect a clinically relevant difference [17] in wellbeing of 1.5 (standard deviation 2.6) allowing for a 30% drop out rate. The analysis was by intention to treat, with participants being analysed according to the group to which they were randomised. No interim analyses were planned or performed.

Random allocation

Sequence generation

A random allocation sequence, without the use of blocks, was generated by the manufacturer of the probiotic intervention (Cultech Ltd., Port Talbot, UK) using a computer generated random number sequence. The sequence allocated participants on a 1:1 basis to either the probiotic or placebo arms of the study.

Allocation concealment

The allocation sequence was held by the manufacturer and was not accessible to the researchers until all data had been collected, analysed, interpreted and findings given to an independent researcher. The study team allocated participants consecutively to the randomization number sequence and, thereby, to the assigned trial intervention. The individuals generating the random number sequence were in a different site to those recruiting participants and posting out the intervention, and no members of the research team met any of the participants.

Blinding

Participants and researchers were blinded to group assignment. No member of the research team had face-to-face contact with any of the participants.

Statistical methods

The secondary end points were compared using general linear models, taking into account baseline values, age, sex and disease duration. Patients with complete and missing data (i.e. missing questionnaires) were compared to examine whether the assumption of data missing in a non-random way could be rejected. At the end of the study the manufacturers informed the research team which participants were in Group A or Group B but the identity of these groups was only revealed after analysis had been completed and the results submitted to an independent third-party. All patients who had completed at least the baseline questionnaire were analysed in an intention to treat analysis.

Follow-up

Baseline data was collected using the secure trial internet site and included sex, age at onset of disease symptoms, flare of symptoms in the past 7 days and medication. On the same day each week for 3 months, participants completed a 10 cm visual analog scale for the self assessment of well-being [18], bowel symptoms (diarrhoea, stomach pain, blood in stools), disease activity (pain, discomfort, morning stiffness, fatigue and tenderness, all averaged to give a composite score [19]) and function [20, 21]. There was also space to make additional comments regarding their health or the trial intervention. Participants reported on the number of study capsules that they had taken during the previous week. Each week patients were contacted by e-mail to remind them to complete the on-line questionnaire. If they did not complete a questionnaire they were contacted by e-mail to find out why.

Ethical approval

Granted by London MREC ref 04/2/18 in 2004

Results

This internet-based RCT of a CAM (probiotic) was able to fulfil the revised CONSORT statement quality checklist for reporting of RCTs (Table 1)

Table 1 How an internet-based trial can meet the quality criteria of the revised CONSORT statement

Participants

Of 160 consent forms received, 147 (91.9%) were eligible and were randomised (See Figure 1). Of 160 people giving consent, only 1 person was excluded because of no reply from their primary care practitioner or rheumatologist (See Figure 1). There were 11 who we could not get the diagnosis of SpA independently confirmed and one withdrew consent. Participants were recruited from throughout the UK including; Aberdeen, Brighton, Cornwall, Huddersfield, London and Cardiff and all had the opportunity to phone the researcher to discuss the study prior to consent. Participants showed good adherence to completing the weekly on-line questionnaire, with 65% (96/147) completing the study for the entire 3 months. If we remove the participants who were excluded (as a result of moving out of the UK, or developing other medical conditions) then adherence to completing the questionnaires was 70%.

Figure 1
figure 1

Flow diagram of the progress through the probiotics trial.

Recruitment

The website was made available to participants on 1st September 2004 and the site was closed 19 months later (March 2006), when 147 participants had been randomised.

Baseline data

The two groups were well balanced for baseline characteristics (see Table 2). However, the probiotic group appeared to have poorer function and global well-being, and used more non-steroidal anti-inflammatory drugs (NSAIDs).

Table 2 Baseline characteristics of participants1

There was no significant difference in the baseline characteristics of participants who did not complete the entire 3 months trial and those who were lost to follow-up (Those completing the trial were 71.6% male (68/95), average age 43.9, disease duration 20 years compared non-completers who were 64% male (25/39), age 41 and disease duration 19 years). Therefore, the last recorded measurement was carried forward for analysis for all participants. There was no significant difference in the number of patients stopping/starting doses of concurrent AS medication in the placebo compared to the intervention arm.

CAM Outcome

There was no statistically or clinically significant difference between placebo and probiotic groups in terms of global well-being, bowel symptoms or severity of arthritis. The estimated probiotic effect was a worsening in well-being of 0.16 units on the 0–10 scale (with 0 being best and 10 being worst), with the 95% confidence interval (-0.6 to 0.93) well outside the bounds of clinical relevance (a required change in well-being of approximately 1.5 units) (See Table 3 for details and other outcome measures).

Table 3 Outcome variables

Adherence to medication

Of those who started the study (69 placebo and 66 probiotic), 3938 out of a possible 5796 (67.9% placebo) and 3748 out of a possible 5544 (67.6% probiotic) tablets were reported to have been taken.

Adverse events

11 people reported adverse events that they felt could be due to the trial interventions, 5 in the placebo group and 6 in the probiotic group. In the placebo group there were reports of stomach cramps (3), indigestion (1) and general decline in well being (1). In the probiotic group there were reports of stomach cramps (3), indigestion (1), painful spots (1) and dizzy spells (1). In two cases the participants stopped the trial medication and reported by e-mail that the symptoms had continued.

Discussion

This internet-based trial of a CAM worked well as assessed by the revised CONSORT statement (Table 1) [6]. The required number of participants were recruited from a wide geographical area in a reasonable time frame and 92% of respondents were eligible for the trial. General practitioners and rheumatologists confirmed participant's identity and assessed eligibility for the trial without payment, suggesting a high level of support for this approach to clinical research among clinicians.

Participants' compliance with the trial procedure was satisfactory with 65% submitting all the required on-line questionnaires and a reported 68% compliance with the trial intervention. Future internet-based RCTs could include more objective assessments than self reporting. For example, participants could submit biological samples by post for detection of the intervention.

Participation in internet-based trials requires internet access and self motivation to access the research website, participants need to read the study information and then submit a consent form. This might limit generlisabiltiy as they may not be representative of the wider community. However, the fact that the participants have themselves initiated their involvement in the study demonstrates motivation and may also encourage their compliance and thus, increase validity of the findings.

Other factors are likely to discourage compliance in internet-based clinical trials. Participants in traditional RCTs may perceive a benefit from face-to-face contact with health professionals and other members of the research team. Although this may encourage compliance, it is labour intensive and creates a somewhat artificial environment for testing an intervention and the internet approach may better stimulate the "real world" regarding compliance with interventions. Thus, traditional RCTs may be more suitable for explanatory RCTs and the internet-based approach may be suitable for pragmatic RCTs. Methods to increase compliance in internet studies might include telephone contact with researchers, a requirement to post back unused capsules, and alarms or reminders that the intervention is due. Compliance in the probiotic group may have been considerably higher if it had been effective in reducing symptoms and improving well being. Thus, generalizability of traditional RCTs suffers from the artificial trial environment which does not occur in internet-based RCTs [22].

The lack of direct contact with participants compromises follow-up for adverse events. All of the published internet-based studies to date have tested low-risk interventions. They have included a trial of kava and valerian for anxiety and insomnia [23], topical ointment for herpes labialis [24] and a glucosamine for knee pain in osteoarthritis [25]. Probiotics have an excellent safety record [7]. Therefore, we considered this preparation to be suitable for testing using this approach.

This trial was funded by a grant for £4977 from NASS which covered the cost of the data collection, researcher time, postage of medication and letters to doctors and analysis (probiotics were provide free of charge and writing up time was not included in funding). This compares favourably with the costs of traditional RCTs.

In this study the probiotic preparation was not found to improve well-being, disease activity or function compared to placebo. However, it could be argued that the sample tested had long term advanced disease and probiotics may be may be beneficial in the early stages of SpA or for people with milder disease. In addition, it is possible that a larger dose or different mixture of strains of probiotic may have had a beneficial outcome.

In conclusion, we consider that internet-based RCT's are an effective and economical way to test low risk interventions where close follow-up for adverse events is not required. This approach may be particularly suited to CAMs, where traditional RCT's are unlikely to be undertaken, to deliver the evidence-base required by the regulatory authorities [3, 4, 26]

Conclusion

An internet-based approach allowed us to perform a high quality RCT according to the revised CONSORT statement at low cost. Internet-based trials may be a cost-effective approach for assessing low-risk interventions. In this study probiotics showed no statistical or clinical significant improvement in SpA.

Abbreviations

CAMs:

complementary and alternative medicines

CONSORT:

Consolidated Standards of Reporting Trials

NASS:

National Ankylosing Spondylitis Society

NSAIDs:

non-steroidal anti-inflammatory drugs

RCT:

Randomised controlled trial.

SpA:

spondyloarthropathy

References

  1. Fonnebo V, Grimsgaard S, Walach H, Ritenbaugh C, Norheim AJ, MacPherson H, Lewith G, Launso L, Koithan M, Falkenberg T, Boon H, Aickin M: Researching complementary and alternative treatments--the gatekeepers are not at home. BMC Med Res Methodol. 2007, 7: 7-10.1186/1471-2288-7-7.

    Article  PubMed  PubMed Central  Google Scholar 

  2. Thompson T, Feder G: Complementary therapies and the NHS. BMJ. 2005, 331 (7521): 856-857. 10.1136/bmj.331.7521.856.

    Article  PubMed  PubMed Central  Google Scholar 

  3. Franck L CC: Should NICE evaluate complementary and alternative medicines?. BMJ. 2007, 334: 506-507. 10.1136/bmj.39122.512211.BE.

    Article  PubMed  PubMed Central  Google Scholar 

  4. Paterson C: Appraisals of specific treatments are needed. BMJ. 2007, 334 (7594): 600-10.1136/bmj.39156.570208.FA.

    Article  PubMed  PubMed Central  Google Scholar 

  5. Stiglitz JE: Scrooge and intellectual property rights. BMJ. 2006, 333 (7582): 1279-1280. 10.1136/bmj.39048.428380.80.

    Article  PubMed  PubMed Central  Google Scholar 

  6. Moher D, Schulz KF, Altman DG: The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomized trials. J Am Podiatr Med Assoc. 2001, 91 (8): 437-442.

    Article  CAS  PubMed  Google Scholar 

  7. Hammerman C, Bin-Nun A, Kaplan M: Safety of probiotics: comparison of two popular strains. BMJ. 2006, 333 (7576): 1006-1008. 10.1136/bmj.39010.630799.BE.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Rudwaleit M, Baeten D: Ankylosing spondylitis and bowel disease. Best Pract Res Clin Rheumatol. 2006, 20 (3): 451-471. 10.1016/j.berh.2006.03.010.

    Article  PubMed  Google Scholar 

  9. Reveille JD, Arnett FC: Spondyloarthritis: update on pathogenesis and management. Am J Med. 2005, 118 (6): 592-603. 10.1016/j.amjmed.2005.01.001.

    Article  CAS  PubMed  Google Scholar 

  10. De Keyser F, Baeten D, Van den Bosch F, De Vos M, Cuvelier C, Mielants H, Veys E: Gut inflammation and spondyloarthropathies. Curr Rheumatol Rep. 2002, 4 (6): 525-532. 10.1007/s11926-002-0061-6.

    Article  PubMed  Google Scholar 

  11. Brophy S, Pavy S, Lewis P, Taylor G, Bradbury L, Robertson D, Lovell C, Calin A: Inflammatory eye, skin, and bowel disease in spondyloarthritis: genetic, phenotypic, and environmental factors. J Rheumatol. 2001, 28 (12): 2667-2673.

    CAS  PubMed  Google Scholar 

  12. Mielants H, Veys EM, Cuvelier C, De Vos M, Goemaere S, De Clercq L, Schatteman L, Gyselbrecht L, Elewaut D: The evolution of spondyloarthropathies in relation to gut histology. III. Relation between gut and joint. J Rheumatol. 1995, 22 (12): 2279-2284.

    CAS  PubMed  Google Scholar 

  13. Baeten D, De Keyser F, Mielants H, Veys EM: Ankylosing spondylitis and bowel disease. Best Pract Res Clin Rheumatol. 2002, 16 (4): 537-549. 10.1053/berh.2002.0249.

    Article  PubMed  Google Scholar 

  14. Karimi O, Pena AS, van Bodegraven AA: Probiotics (VSL#3) in arthralgia in patients with ulcerative colitis and Crohn's disease: a pilot study. Drugs Today (Barc). 2005, 41 (7): 453-459. 10.1358/dot.2005.41.7.917341.

    Article  CAS  Google Scholar 

  15. Bibiloni R, Fedorak RN, Tannock GW, Madsen KL, Gionchetti P, Campieri M, De Simone C, Sartor RB: VSL#3 probiotic-mixture induces remission in patients with active ulcerative colitis. Am J Gastroenterol. 2005, 100 (7): 1539-1546. 10.1111/j.1572-0241.2005.41794.x.

    Article  PubMed  Google Scholar 

  16. Gionchetti P, Rizzello F, Venturi A, Brigidi P, Matteuzzi D, Bazzocchi G, Poggioli G, Miglioli M, Campieri M: Oral bacteriotherapy as maintenance treatment in patients with chronic pouchitis: a double-blind, placebo-controlled trial. Gastroenterology. 2000, 119 (2): 305-309. 10.1053/gast.2000.9370.

    Article  CAS  PubMed  Google Scholar 

  17. Pavy S, Brophy S, Calin A: Establishment of the minimum clinically important difference for the bath ankylosing spondylitis indices: a prospective study. J Rheumatol. 2005, 32 (1): 80-85.

    PubMed  Google Scholar 

  18. Jones SD, Steiner A, Garrett SL, Calin A: The Bath Ankylosing Spondylitis Patient Global Score (BAS-G). Br J Rheumatol. 1996, 35 (1): 66-71. 10.1093/rheumatology/35.1.66.

    Article  CAS  PubMed  Google Scholar 

  19. Garrett S, Jenkinson T, Kennedy LG, Whitelock H, Gaisford P, Calin A: A new approach to defining disease status in ankylosing spondylitis: the Bath Ankylosing Spondylitis Disease Activity Index. J Rheumatol. 1994, 21 (12): 2286-2291.

    CAS  PubMed  Google Scholar 

  20. Calin A, Garrett S, Whitelock H, Kennedy LG, O'Hea J, Mallorie P, Jenkinson T: A new approach to defining functional ability in ankylosing spondylitis: the development of the Bath Ankylosing Spondylitis Functional Index. J Rheumatol. 1994, 21 (12): 2281-2285.

    CAS  PubMed  Google Scholar 

  21. Brophy S, Hunniford T, Taylor G, Menon A, Roussou T, Calin A: Assessment of disease severity (in terms of function) using the internet. J Rheumatol. 2004, 31 (9): 1819-1822.

    PubMed  Google Scholar 

  22. Bonell C, Oakley A, Hargreaves J, Strange V, Rees R: Assessment of generalisability in trials of health interventions: suggested framework and systematic review. BMJ. 2006, 333 (7563): 346-349. 10.1136/bmj.333.7563.346.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  23. Jacobs BP, Bent S, Tice JA, Blackwell T, Cummings SR: An internet-based randomized, placebo-controlled trial of kava and valerian for anxiety and insomnia. Medicine (Baltimore). 2005, 84 (4): 197-207. 10.1097/01.md.0000172299.72364.95.

    Article  Google Scholar 

  24. Formica M, Kabbara K, Clark R, McAlindon T: Can clinical trials requiring frequent participant contact be conducted over the Internet? Results from an online randomized controlled trial evaluating a topical ointment for herpes labialis. J Med Internet Res. 2004, 6 (1): e6-10.2196/jmir.6.1.e6.

    Article  PubMed  PubMed Central  Google Scholar 

  25. McAlindon T, Formica M, Kabbara K, LaValley M, Lehmer M: Conducting clinical trials over the internet: feasibility study. BMJ. 2003, 327 (7413): 484-487. 10.1136/bmj.327.7413.484.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Day M: Maping the alternative route. BMJ. 2007, 334: 929-931. 10.1136/bmj.39192.475382.AD.

    Article  PubMed  PubMed Central  Google Scholar 

Pre-publication history

Download references

Acknowledgements

We would like to thank the NASS for providing funding and allowing us to announce the trial on their website. We would like to thank Cultech Ltd. for providing the probiotics and helping with the study methods and Waters Creative Limited (Digital Technium, Swansea University) for designing and providing the database used to follow participants in the trial.

The NASS, Cultech Ltd and Waters Design had no role or influence in study design, analysis or interpretation.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Sinead Brophy.

Additional information

Competing interests

The author(s) declare that they have no competing interests.

Authors' contributions

SB, SA and MG wrote and designed the protocol. CBu and SB collect the data with input and advice from SS and SA. CBo, SB and MG analysed the data. All authors were involved in interpreting and writing the final results and manuscript.

Authors’ original submitted files for images

Below are the links to the authors’ original submitted files for images.

Authors’ original file for figure 1

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Brophy, S., Burrows, C.L., Brooks, C. et al. Internet-based randomised controlled trials for the evaluation of complementary and alternative medicines: probiotics in spondyloarthropathy. BMC Musculoskelet Disord 9, 4 (2008). https://0-doi-org.brum.beds.ac.uk/10.1186/1471-2474-9-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/1471-2474-9-4

Keywords