Correction
11 Sep 2013: Bastani A, Jaberzadeh S (2013) Correction: A Higher Number of TMS-Elicited MEP from a Combined Hotspot Improves Intra- and Inter-Session Reliability of the Upper Limb Muscles in Healthy Individuals. PLOS ONE 8(9): 10.1371/annotation/ca8c5e69-bdd5-4ac2-9c42-993792c37b33. https://doi.org/10.1371/annotation/ca8c5e69-bdd5-4ac2-9c42-993792c37b33 View correction
Figures
Abstract
We aimed to determine, using transcranial magnetic stimulation (TMS), the number of elicited motor evoked potentials (MEPs) that induces the highest intra- and inter-sessions reliability for the extensor carpi radialis (ECR) and first dorsal interosseus (FDI) muscles. Twelve healthy subjects participated in this study on two separate days. Single pulse magnetic stimuli were triggered with Magstim 2002 to obtain MEPs from the muscles of interest, with the subjects in a relaxed position. Reliability of MEP responses was investigated in three blocks of 5, 10 and 15 trials. The intra- and inter-session reliability of the MEPs' amplitudes and latencies were assessed using intraclass correlation coefficients (ICCs). Repeated measures ANOVA and paired t-tests revealed no significant time effect in the MEP amplitude and latency measurements (P>0.05). The ICCs indicated high intra-session reliability in the MEPs' amplitudes for the ECR and FDI muscles (0.77 to 0.99, 0.90 to 0.99, respectively) and latency (0.80 to 1.00, 0.75 to 0.97, respectively). The MEPs' amplitudes also had high inter-session reliability (0.84 to 0.97, 0.88 to 0.93, respectively), as did their latency (0.80 to 0.90, 0.75 to 0.97, respectively). Highest intra- and inter-session reliability was achieved for blocks of 10 and 15 trials. Our data suggest that intra- and inter-session comparisons should be performed using at least 10 MEPs in “combined hotspot” stimulation technique to ensure highest reliability.
Citation: Bastani A, Jaberzadeh S (2012) A Higher Number of TMS-Elicited MEP from a Combined Hotspot Improves Intra- and Inter-Session Reliability of the Upper Limb Muscles in Healthy Individuals. PLoS ONE 7(10): e47582. https://doi.org/10.1371/journal.pone.0047582
Editor: Angela Sirigu, French National Centre for Scientific Research, France
Received: May 3, 2012; Accepted: September 17, 2012; Published: October 15, 2012
Copyright: © Bastani, Jaberzadeh. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: These authors have no support or funding to report.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Transcranial magnetic stimulation (TMS) is a non-invasive, safe and painless technique for assessment of brain corticospinal excitability in both healthy individuals and patients with neurological conditions [1]–[4]. One of the major advantages of TMS is the ability of the magnetic pulses to pass unchanged through the scalp to induce an electric current in underlying conductive brain tissues [1], [5], [6]. When applied over the primary motor cortex (M1) of a target muscle, TMS depolarizes nerve cells descending corticospinal pathways to contralateral muscle(s) of interest and elicits a motor response called “motor evoked potential” (MEP). This response can be recorded using surface electromyography (EMG) electrodes placed over the target muscle(s) [7]–[9].
TMS-induced MEPs have been used as a reliable outcome measure of corticospinal excitability changes in a range of research protocols [10]–[12]. Two important characteristics of recorded MEPs are amplitude and latency, which provide valuable information about corticospinal pathways. MEP amplitude is an indicator of M1 corticospinal excitability [13]: larger amplitudes indicate higher excitability and smaller amplitudes indicate lower excitability [13]. On the other hand, variation in MEP latency indicates change in the central and peripheral conduction time required for transmission of induced action potential from the M1 to the target muscle(s) [9].
A significant aspect of any clinical or experimental assessment tool is its test-retest reliability [7], [8], [14], [15]. Reliability refers to ‘the consistency of measurements’ [16]: it tests the stability of scores over time and involves the degree to which repeated measurements provide similar results [17]. A reliable measurement of MEPs guarantees stable amplitude size and latency in different testings over time [14], [18]. Reliability assures that any changes observed in the repeated measure designs and/or pre- and post-therapeutic interventions are genuine and are due to physiological changes rather than errors arising from methodological variabilities [19].
Previous studies suggested a relationship between the number of recorded MEPs and the level of reliability [14], [15], [20]. Studies using a mean of 5 recorded MEPs resulted in good to high reliability in amplitude measures compared to studies involving one to four MEPs per block; for example, Christie et al's recordings of two, three or four MEPs per block resulted in poor reliability [14], [20]. Recent intra- and inter-session reliability studies of MEPs also suggest that recorded MEPs are more reliable when larger numbers of trials are recorded and averaged for analysis [14], [15], [20]. Doeltgen et al. reported that an average of 10 MEPs provides high reliability in inter-session measurements [15]. The number of MEPs required to produce reliable measurement may vary in different settings and be specific to the study design, number of examinees, assessment and reliability measurement methods or techniques, and recorded muscle(s) of interest.
Despite the widespread use of TMS in recent years, few studies have focused on the test-retest reliability of resting MEPs in upper limb muscles [14], [20], [21]. Two studies, showed moderate reliability in MEP amplitude for the abductor digiti minimi (ADM) and first dorsal interosseus (FDI) in healthy individuals [14], [20]. In contrast, Livingstone et al. (2008) reported less consistency in the resting MEP amplitude for the abductor pollicis bravis (APB), FDI and ADM muscles. Nevertheless, Livingstone et al's [21] MEP amplitude coefficients were lower than those reported by Kamen [20] for the biceps muscle, prompting the hypothesis that the reliability of MEP amplitude may be muscle specific [20], [22]. In addition, Kamen [20] reliably measured MEP amplitude during simultaneous M1 stimulation of the biceps and FDI muscles (0.95 and 0.081, respectively). On the other hand, Livingston and Ingersoll [21] demonstrated high reliability for MEP latency obtained from APB, FDI and ADM muscles [21].
In TMS studies several researchers found a single hotspot for a given muscle and then analyzed MEPs simultaneously evoked from that site but in other muscles for which the TMS parameters were not optimized [7], [15], [20], [21], [23]. This is not a flawless approach and fails to show a complete picture of cortical changes in all targeted muscles. To address this issue, it might be better to use a “combined hotspot” with overlap M1s for all muscles of interest.
To our knowledge, while investigations of the intra- and inter-session MEP reliability of multiple upper limb muscles exist [7], [15], [20], [21], [23], no researchers have assessed the reliability of MEPs recorded from a “combined hotspot”, which could be useful for the studies in which MEPs of two or more muscles are simultaneously elicited.
The purpose of the current study was to compare the intra- and inter-session reliability of peak-to-peak amplitude and latency of different blocks of simultaneous elicitation of MEPs from the combined hotspot for ECR and FDI muscles at rest. We hypothesized that MEPs elicited from a combined hotspot, with optimized parameters for all target muscles, are reliable. Due to the stochastic nature and trial-to-trial variability of the TMS-elicited MEPs in all muscles and the fact that averaging may reduce this variability, we also hypothesized that there is a direct relationship between the number of MEPs in each block and reliability, and that the intraclass correlation coefficients (ICCs) of MEPs amplitude and latency are not muscle specific.
Materials and Methods
2.1. Subjects
Twelve healthy volunteers (six women, six men) with a mean age of 30.3±6.8 (yrs) (range 21 to 47 yrs) a mean weight of 74.5±10.4 (kg) and a mean height of 171.4±7.8 (cm) were tested in two sessions separated by at least 48 hours. All were consistent right-handers according to the 10-item version of the Edinburgh Handedness Inventory (mean laterality index = 100) [24]. Prior to the experiments, all participants completed the Adult Safety Screening Questionnaire [25] to determine their suitability for TMS. Participants were informed about the experimental procedures and gave written informed consent according to the declaration of Helsinki. All experimental procedures were approved by the Monash University Human Research Ethics Committee. Each subject was tested at the same time of the day to avoid diurnal variation.
2.2. Electromyography (EMG) recording
Participants were seated in an adjustable podiatry chair, with the right forearm pronated and the wrist joint in neutral position on the arm rest. To ensure good surface contact and reduce skin resistance, a standard skin preparation procedure of cleaning and abrading was performed for each site of electrode placement [26]–[28]. MEPs were recorded from the right ECR and FDI muscles at rest, using pre-gelled self-adhesive bipolar Ag/AgCl disposable surfaces electrodes with an inter-electrode distance of 3 cm for the ECR and 2 cm for the FDI muscle (measured from the centres of the electrodes). The locations of ECR and FDI muscles were determined based on anatomical landmarks [29] and observations of muscle contraction in the testing position (wrist extension and radial deviation for ECR, and index finger abduction for FDI muscle) [30]. The accuracy of EMG electrode placement was verified by asking the subject to maximally contract the muscles of interest while the investigator monitored online EMG activity. The ground electrode was placed ipsilaterally on the styloid process of the ulnar bone [31]. Then, the electrodes were secured with tape. All raw EMG signals were band-pass filtered (10–500 Hz), amplified (×1000) and sampled at 1000 Hz and collected on a PC running commercially-available software (LabChart™ software, ADInstruments, Australia) via a laboratory analogue-digital interface (The PowerLab 8/30, ADInstruments, Australia) for later off-line analysis.
2.3. Measurement of corticospinal excitability by TMS
Participants were seated upright and comfortable with head and neck supported by a head rest. Single pulse magnetic stimuli were delivered using a Magstim 2002 (Magstim, UK) stimulator with a flat 70 mm figure-of-eight magnetic coil. Using the international 10–20 system, the vertex (Cz) point was measured and marked to be used as a reference [28]. The magnetic coil was placed over the left hemisphere (cortex), contralateral to the target muscles. The coil was set at an angle 45° to the midline and tangential to the scalp, such that the induced current flowed in a posterior-anterior direction. To determine the optimal site of stimulation (hotspot), the coil was moved around the M1 of the target muscles to trigger the M1 overlapped area for both the ECR and FDI muscles that gave the largest MEP response. This overlapped M1 area was called the “combined hotspot”.
The surface area of representation and the coordinates of the combined hotspot for the FDI and ECR muscles were found and marked based on the size of the MEP amplitude. As illustrated by Devanne et al. [32], the optimal spot for stimulation of the FDI muscle is more anteriorly and laterally located relative to the vertex than that for the ECR muscle. Figure 1 explains the concept of the combined hotspot.
The overlap between the two representations is shown in green. Cz: The position of vertex. Adapted with modification from Devanne et al. (2006) study [32].
After localizing the optimal stimulation site, the coil position was marked on the scalp to ensure consistency in the placement of the coil for the remainder of the testing. The full hotspot identification procedure was performed in each session. Resting motor threshold (RMT) was defined as the minimal stimulus intensity that evoked 5 MEPs in a series of 10 tests with amplitude of at least 50 µV [4], [6], [9], [33] from the combined hotspot of both ECR and FDI muscles. Hence, the same RMT was used for both muscles. The RMT for each subject was determined by increasing and decreasing stimulus intensity in 1–2% intervals until MEPs of appropriate size were elicited. For all further MEP measurement, the TMS intensity was set at 120% of each individual's RMT. Fifteen stimuli were elicited to assess corticospinal excitability at each time point. The stimulus intensity remained constant throughout the study session for each subject.
2.4. Procedures
All individuals participated in two experimental sessions. The protocol in session 1 enabled us to study the reliability of MEP amplitude and latency within a session (intra-session reliability). The corticospinal excitability of the ECR and FDI muscles was assessed at three consecutive time points (T1, T2 and T3) separated by intervals of 20 minutes. The EMG electrodes were left in place and the TMS coil was removed while the subjects rested for 20 minutes, with no hand or wrist movements allowed.
The second session of testing was held at least 48 hours after the first one. This session was shorter and only involved recording of MEPs at one time point (T1). Comparison of these data with the T1 from session 1 enabled us to study the inter-session reliability of MEPs' size and latency for the ECR and FDI muscles.
2.5. Data management and statistical analysis
Twelve subjects were required for a true ρ 0 of 0.7 against an alternative ρ1 of 0.9, based on a 95% significant level and a power of 80% (β = 0.20) for three time points [34].
The peak-to-peak amplitudes and latencies of elicited MEPs were measured for the ECR and FDI muscles. The MEPs' amplitudes were measured from the positive to the negative peak of the signals and MEPs latency was calculated from the stimulus artifact indicator to the first deflection of the signal. To assess the intra- and inter-session reliability of recorded MEPs, the averaged MEPs at each time point (T1, T2 and T3) were calculated in separate blocks of the first 5 (Block 1), first 10 (Block 2) and all 15 responses (Block 3).
Two-way repeated measure analysis of variance (ANOVA) and paired t-tests were used to detect systematic bias between the repeated measurements within or between days, respectively. This test shows the degree of agreement between the measurements and assesses the closeness of the repeated measures [35]. The correlation between the measurements was assessed using the ICC [8], which is the most appropriate reliability outcome measure for measurements on a continuous scale.
ICCs were calculated for blocks of the first 5, 10 and all 15 elicited MEPs in order to identify the number of trials which produced the greatest intra-session reliability. The same protocol was applied to calculate the inter-session reliability (between sessions 1 and 2) for MEPs' amplitudes and latencies. The ICCs, based on a two-way single measure mixed effects model (ICCs (3,1)), were calculated for averaged MEPs in each block for both inter- and intra-session reliability. The reliability coefficient ranges from 0 to 1, with values closer to 1 representing stronger reliability. Although the interpretation of ICCs is subjective, Portney and Watkins (2009) [35], suggested that coefficients below 0.50 represent poor reliability, from 0.50 to 0.75 correspond to moderate reliability, and values above 0.75 signal high reliability.
Unlike the ICC, which is a relative measure of reliability, standard error of measurement (SEM) was calculated which provides an absolute index of reliability [36]. The SEM quantifies the precision of individual scores on a test (within-subject reliability) and indicates to what extent the values observed at different time points vary from the ‘true’ value of that excitability parameter for a given subject [37]. The interpretation of SEM focuses on the assessment of reliability for individual subjects [38], and SEM determines the effect of measurement error on the test score of an individual examinee. SEM is estimated as follows: SEM = SD, where SD is the standard deviation of the scores from all subjects and ICC is the reliability coefficient [19], [37], [39]. The larger the SEM, the lower the reliability of the test and the less precision there is in the measurements taken and scores obtained.
All data are presented as mean±SD, the level of statistical significance was set at 5%, and all analyses were conducted using SPSS for Windows Version 19.
Results
All participants completed both sessions of data collection. The mean interval between sessions of measurements was 52.7±4.6 hours.
3.1. Intra-session reliability
MEPs amplitude and latency.
The averaged RMT and consequent stimulus intensity for both muscles were 45% (45.2±10.4) and 54% (54.3±12.5) of the stimulator output, respectively. A representative single subject's data (Figure 2a and b) showed minimal changes for the mean amplitude of the MEPs for ECR and FDI muscles at all three time points. Indeed, repetition of the measurements by the same examiner every 20 minutes after the first test revealed no significant differences in the group mean values of any of the measurements recorded (Tables 1 and 2). Repeated measures ANOVA revealed no significant time effect in any of the measurements for ECR muscle and FDI muscles (Tables 1 and 2).
a) ECR, and b) FDI muscles with 5, 10 and 15 MEPs per block in three time points.
ICCs ranged from 0.77 for block 1 (5 MEPs) to 0.99 for block 3 (15 MEPs). MEP amplitudes showed high reliability within a session for both ECR and FDI muscles (Table 3). As expected, higher ICCs were achieved for blocks of 10 and 15 MEPs in all comparisons.
The mean and ICC results for MEP latency of the ECR and FDI muscles are shown in Tables 2 and 4, respectively. MEP latency showed high stability over the three replicates within a session for both the ECR (ICCs = 0.80 to 1.00) and FDI (ICCs = 0.75 to 0.97) muscles. As expected, slightly higher ICCs were achieved for blocks of 10 and 15 trials in all comparisons.
3.2. Inter-session reliability
MEP amplitude and latency.
The averaged RMTs and consequent stimulus intensities for both muscles were 46% (46±10.8) and 55% (55.2±13.0) of stimulator output, respectively. A representative single subject's data showed minimal changes in mean MEP amplitude for the ECR and FDI muscles (Figure 3a and b). Moreover, repetition of the measurements by the same examiner in two different sessions held at least 48 hours apart did not reveal any significant differences in the group mean MEP amplitude and latency values (Tables 1 and 2). Paired t-tests comparing the means of all variables between the two sessions showed no statistically significant differences for the ECR and FDI muscles (Tables 1 and 2). ICCs for MEP amplitudes ranged from 0.84 for block 1 (5 MEPs) to 0.97 for block 2 (10 MEPs) for the ECR muscle and 0.88 for block 1 (5 MEPs) to 0.93 for block 2 (10 MEPs) for the FDI muscle. Marginally higher ICCs were achieved for block 3 (15 MEPs) for the ECR muscle, with no change in the ICCs of the FDI muscle for blocks of 10 and 15 trials (Table 3).
a) ECR and b) FDI muscle with 5, 10 and 15 MEPs per block in three time points.
ICC values for MEP latency ranged from 0.82 to 0.90 for block 1 and 2 (5 and 10 MEPs, respectively) for ECR and 0.75 to 0.80 for block 1 and 2 (5 and 10 MEPs, respectively) for the FDI muscle (Table 4). As expected, slightly higher ICCs were achieved for block 3 (15 MEPs) in all comparisons. The ICCs were higher in all three blocks for the ECR muscle compared to the FDI muscle.
Discussion
In this study we assessed the intra- and inter-session reliability of the amplitude and latency of different blocks of simultaneous TMS-elicited MEPs from the ECR and FDI muscles. Correlations between individuals and sessions were determined using ICCs [8]. Systematic bias was evaluated by measuring the level of agreement using ANOVA or a paired t-test where appropriate. The reliability established in this study is also intra-rater reliability, because all data were collected by the same rater.
4.1. Intra-session reliability
The agreement and high values of ICCs between pre- and post-MEP measurements observed in both ECR and FDI muscles indicate high within-session reliability. These intra-session reliability results are in agreement with those of Christie et al. [14], who reported an ICC of 0.97 for the reliability of MEP amplitude derived from the ADM muscle. Furthermore, MEP latencies ranged from 16.4±0.9 ms for the ECR to 22.9±1.2 ms for the FDI muscles, results in agreement with MEP latency data reported by Ravnborg and Dahl [40] and Wu et al. [41]. As expected, motor evoked latencies demonstrated an absolute intra-session consistency for the FDI muscle and very high reliability for the ECR muscle. This can be explained by the careful positioning of EMG surface electrodes within the session and the consistency in the alignment and position of the TMS magnetic coil on the combined M1.
The results indicate a direct relationship between the number of recorded MEPs in each block of stimulation and the level of reliability, supporting the hypothesis of our study. We established high reliability in this session for 5, 10 and 15 MEPs per block, indicating that even an average of 5 MEP amplitudes is enough to establish high within-session reliability, in agreement with Christie et al. [14]. This result also supports Kamen's [20] findings of good to high reliability of MEP amplitude in the FDI and biceps muscles in healthy individuals.
4.2. Inter-session reliability
The agreement and also high and consistent ICCs indicate high inter-session reliability of MEP measurement in both ECR and FDI muscles. The ICCs of all three blocks in the present experiment are larger than those reported by Kamen [20] for the FDI muscle (0.60–0.81) and Christie et al. [14] for the ADM muscle (0.65–0.83). Although no previous reliability studies focused on forearm muscles, our ICCs for the ECR muscle were comparable with Kamen's findings [20] for the biceps muscle (0.95–0.99) for blocks of 10 and 15 MEPs. These values are higher than those reported by Livingston and Ingersoll [21], who found small (0.28) to moderate (0.72) ICCs for the FDI, APB and ADM muscles. Our results indicate that MEP amplitude remains constant in healthy subjects, even with a 48 hour interval between testing sessions.
MEP latency is sensitive to electrode positioning [42], particularly given that electrode placement over forearm muscles is inevitably more variable than in intrinsic hand muscles. Therefore, the high reliability of MEP latency found in this study suggests the consistent positioning of EMG electrodes across the two sessions. Although the reliability of MEP latency has not been previously investigated for forearm muscles, our results are in keeping with those of Livingston and Ingersoll [21], who showed that the MEP latency of distal hand muscles remained stable, with an ICC of 0.87 across different sessions.
In this study, the combined hotspot was more toward the periphery for the FDI muscle. Therefore, one potential explanation for the small MEPs recorded in the FDI muscle is that the MEP size might be smaller in the periphery of the cortical representation compared to that at the hotspot. However, it is interesting to see that the reliability remained high despite this small MEP size. In agreement with previous studies, reliability measures reached high values when 5 trials were included in the present analysis, with a slight increase in reliability when 10 or all 15 trials were considered. As the highest reliability was achieved by increasing the number of MEPs per block, we recommend the use of at least 10 MEP trials when the research includes multiple independent sessions of data collection and simultaneous M1 stimulations.
The high reliabilities demonstrated by high ICCs for MEP amplitude and latency in our study are in agreement with data reported for the upper limb muscles by some authors, regardless of whether they had used ICCs [7], [43], ANOVA or coefficient of variation (CV) [44], [45] for the statistical analysis. The ICC values recorded in the present study showed an overall reliability of over 0.75 in both the intra- and inter-session assessments.
The shape, size and orientation of the coil are main factors that determine the size of stimulated area as well as the direction of the induced current flow [46]. Moreover, a factor that could theoretically affect MEP amplitudes' reliability is the use of a neuronavigation system in eliciting MEPs. However, two recent studies found no decrease in the variability [47] and no further improve in reliability [48] of MEPs with TMS navigated systems. We used a conventional TMS assessment technique without a navigation system, but our results were in agreement with previous studies demonstrating high reliability in TMS mapping parameters with smaller numbers of MEPs, both with [49] and without [14] the use of a neuronavigation system.
The results support our hypothesis that TMS-elicited MEPs are not muscle specific. High reliability in both ECR and FDI muscles confirms data reported by Lefebvre et al. [50] demonstrating that TMS reliability is not muscle specific. However, Kamen [20] produced contradictory findings indicating that reliability varies according to the muscle of investigation, and that higher reliability in the biceps muscle could be a function of its location or M1 size in comparison to distal hand muscles.
It is important to note that SEM values were lower in blocks 2 and 3 (10 and 15 MEPs, respectively) than in block 1 (5 MEPs) for both the ECR and FDI muscles. In addition, SEM was similar in blocks 2 and 3 for the FDI muscle. Overall, the SEM became smaller as the number of MEPs per block increased from 5 to 15. As the observed values lie within the SEM from the true score, this shows the significance of increasing the number of recorded MEPs to bring the observed values closer to the true scores.
Based on the data presented here, TMS-elicited MEPs can be reproduced with a high degree of consistency to simultaneously assess the corticospinal pathways from both ECR and FDI muscles when performed in a controlled laboratory environment. Our findings are also useful for interpreting individual intervention effects in TMS-related studies where any changes in MEP responses can be considered as an intervention effect. TMS is frequently used in investigations such as brain mapping or recruitment curves, and can involve 250 or more stimulations. Our results indicate acceptable reliability with 5 MEPs per block, enabling researchers to avoid unnecessary stimulations to the brain. However, to increase the reliability of inherently variable and sensitive measurements, more MEPs per block should be recorded.
One limitation of our study is that we studied only healthy young participants, so findings cannot be extrapolated to older and/or unwell subjects. This study was also limited in that it only evaluated one intensity (120% RMT), so we are unable to expand our findings to higher or lower intensities, although previous studies have shown that stimulation by higher intensities provides higher reliability [49].
The results of our study only indicate intra-rater reliability. An obvious further direction is to perform similar study by testing the inter-rater reliability for multi-center studies.
Author Contributions
Conceived and designed the experiments: AB SJ. Performed the experiments: AB. Analyzed the data: AB. Contributed reagents/materials/analysis tools: AB SJ.
References
- 1.
Baker A (1985) Non-invasive magnetic stimulation of the human motor cortex. Lancet 1106–1107.
- 2. Barker A, Freeston I, Jalinous R, Jarratt J (1987) Magnetic stimulation of the human brain and peripheral nervous system: an introduction and the results of an initial clinical evaluation. Neurosurgery 20: 100.
- 3. Liepert J, Hallett M, Samii A, Oddo D, Celnik P, et al. (2000) Motor cortex excitability in patients with cerebellar degeneration. Clinical neurophysiology 111: 1157–1164.
- 4. Rossini P, Barker A, Berardelli A, Caramia M, Caruso G, et al. (1994) Non-invasive electrical and magnetic stimulation of the brain, spinal cord and roots: basic principles and procedures for routine clinical application. Report of an IFCN committee. Electroencephalography and Clinical Neurophysiology 91: 79–92.
- 5. Corneal SF, Butler AJ, Wolf SL (2005) Intra-and intersubject reliability of abductor pollicis brevis muscle motor map characteristics with transcranial magnetic stimulation. Archives of physical medicine and rehabilitation 86: 1670–1675.
- 6. Hallett M (1996) Transcranial magnetic stimulation: a useful tool for clinical neurophysiology. Annals of neurology 40: 344–345.
- 7. Malcolm M, Triggs W, Light K, Shechtman O, Khandekar G, et al. (2006) Reliability of motor cortex transcranial magnetic stimulation in four muscle representations. Clinical neurophysiology 117: 1037–1046.
- 8.
Pourtney L,Watkins M (2000) Foundations of clinical research: application to practice. Connecticut: Appleton and Lange. 892 p.
- 9.
Wassermann E, Epstein CM, Ziemann U (2008) The Oxford handbook of transcranial stimulation: Oxford University Press, USA. 747 p.
- 10. McKay D, Ridding M, Thompson P, Miles T (2002) Induction of persistent changes in the organisation of the human motor cortex. Experimental Brain Research 143: 342–349.
- 11. Ridding M, McKay D, Thompson P, Miles T (2001) Changes in corticomotor representations induced by prolonged peripheral nerve stimulation in humans. Clinical Neurophysiology 112: 1461–1469.
- 12. Marconi B, Filippi G, Koch G, Pecchioli C, Salerno S, et al. (2008) Long-term effects on motor cortical excitability induced by repeated muscle vibration during contraction in healthy subjects. Journal of the neurological sciences 275: 51–59.
- 13.
Deuschl G, Eisen A (1999) Recommendations for the practice of clinical neurophysiology: guidelines of the International Federation of Clinical Neurophysiology: Elsevier Science Health Science div. 304 p.
- 14. Christie A, Fling B, Crews RT, Mulwitz LA, Kamen G (2007) Reliability of motor-evoked potentials in the ADM muscle of older adults. Journal of neuroscience methods 164: 320–324.
- 15. Doeltgen SH, Ridding MC, O'Beirne GA, Dalrymple-Alford J, Huckabee ML (2009) Test-retest reliability of motor evoked potentials (MEPs) at the submental muscle group during volitional swallowing. Journal of neuroscience methods 178: 134–137.
- 16. Rothstein J (1985) Measurement and clinical practice: theory and application. Measurement in Physical Therapy: Clinics in Physical Therapy. New York, NY, Churchill Livingstone Inc 7: 1–46.
- 17. De Vet HCW, Terwee CB, Knol DL, Bouter LM (2006) When to use agreement versus reliability measures. Journal of Clinical Epidemiology 59: 1033–1039.
- 18. Lexell JE, Downham DY (2005) How to assess the reliability of measurements in rehabilitation. American journal of physical medicine and rehabilitation 84: 719.
- 19. Weir JP (2005) Quantifying test-retest reliability using the intraclass correlation coefficient. Journal of Strength and Conditioning Research 19: 231–240.
- 20. Kamen G (2004) Reliability of motor-evoked potentials during resting and active contraction conditions. Medicine and science in sports and exercise 36: 1574.
- 21. Livingston SC, Ingersoll CD (2008) Intra-rater reliability of a transcranial magnetic stimulation technique to obtain motor evoked potentials. International Journal of Neuroscience 118: 239–256.
- 22. Cacchio A, Cimini N, Alosi P, Santilli V, Marrelli A (2009) Reliability of transcranial magnetic stimulation-related measurements of tibialis anterior muscle in healthy subjects. Clinical neurophysiology 120: 414–419.
- 23. Plowman-Prine E, Triggs W, Malcolm M, Rosenbek J (2008) Reliability of transcranial magnetic stimulation for mapping swallowing musculature in the human motor cortex. Clinical neurophysiology 119: 2298–2303.
- 24. Oldfield RC (1971) The assessment and analysis of handedness: the Edinburgh inventory. Neuropsychologia 9: 97–113.
- 25. Keel JC, Smith MJ, Wassermann EM (2001) A safety screening questionnaire for transcranial magnetic stimulation. Clinical neurophysiology 112: 720–720.
- 26. Gilmore KL, Meyers JE (1983) Using surface electromyography in physiotherapy research. Aust J Physiother 29: 3–9.
- 27.
Robertson VJ, Robertson V, Low J, Ward A, Reed A (2006) Electrotherapy explained: principles and practice: Butterworth-Heinemann. 431 p.
- 28.
Schwartz MS (2003) Biofeedback: A practitioner's guide: the guilford press.930 p.
- 29.
Perotto A, Delagi EF (2005) Anatomical guide for the electromyographer: the limbs and trunk: Charles C Thomas Pub Ltd. 345 p.
- 30.
Kendall FP, McCreary EK, Provance PG (2010) Muscles, testing and function: with posture and pain: Williams and Wilkins Baltimore, MD. 480 p.
- 31.
Oh SJ (2003) Clinical electromyography: nerve conduction studies. Philadelphia: Lippincott Williams and Wilkins. 848 p.
- 32. Devanne H, Cassim F, Ethier C, Brizzi L, Thevenon A, et al. (2006) The comparable size and overlapping nature of upper limb distal and proximal muscle representations in the human motor cortex. European Journal of Neuroscience 23: 2467–2476.
- 33. Nitsche M, Paulus W (2000) Excitability changes induced in the human motor cortex by weak transcranial direct current stimulation. The Journal of physiology 527: 633.
- 34. Walter S, Eliasziw M, Donner A (1998) Sample size and optimal designs for reliability studies. Statistics in Medicine 17: 101–110.
- 35.
Portney LG,Watkins MP (2009) Foundations of clinical research: applications to practice: Pearson/Prentice Hall. 892 p.
- 36. Hopkins WG (2000) Measures of reliability in sports medicine and science. Sports medicine 30: 1–15.
- 37. Harvill LM (1991) Standard error of measurement. Educational Measurement: Issues and Practice 10: 33–41.
- 38. Shrout PE (1998) Measurement reliability and agreement in psychiatry. Statistical methods in medical research 7: 301.
- 39. Patterson C (1955) The Interpretation of the Standard Error of Measurement. The Journal of Experimental Education 23: 247–252.
- 40. Ravnborg M, Dahl K (1991) Examination of central and peripheral motor pathways by standardized magnetic stimulation. Acta neurologica scandinavica 84: 491–497.
- 41. Wu L, Goto Y, Taniwaki T, Kinukawa N, Tobimatsu S (2002) Different patterns of excitation and inhibition of the small hand and forearm muscles from magnetic brain stimulation in humans. Clinical neurophysiology 113: 1286–1294.
- 42. Fuhr P, Cohen LG, Roth BJ, Hallett M (1991) Latency of motor evoked potentials to focal transcranial stimulation varies as a function of scalp positions stimulated. Electroencephalography and Clinical Neurophysiology/Evoked Potentials Section 81: 81–89.
- 43. Carroll TJ, Riek S, Carson RG (2001) Reliability of the input-output properties of the cortico-spinal pathway obtained from transcranial magnetic and electrical stimulation. Journal of neuroscience methods 112: 193–202.
- 44. Maeda F, Gangitano M, Thall M, Pascual-Leone A (2002) Inter-and intra-individual variability of paired-pulse curves with transcranial magnetic stimulation (TMS). Clinical neurophysiology 113: 376–382.
- 45. Wolf SL, Butler AJ, Campana GI, Parris TA, Struys DM, et al. (2004) Intra-subject reliability of parameters contributing to maps generated by transcranial magnetic stimulation in able-bodied adults. Clinical neurophysiology 115: 1740–1747.
- 46.
Hallett M, Chokroverty S (2005) Magnetic stimulation in clinical neurophysiology. 2nd ed. Philadelphia, Pennsylvania: Elsevier. 457 p.
- 47. Jung NH, Delvendahl I, Kuhnke NG, Hauschke D, Stolle S, et al. (2010) Navigated transcranial magnetic stimulation does not decrease the variability of motor-evoked potentials. Brain Stimulation 3: 87–94.
- 48.
Fleming MK, Sorinola IO, Newham DJ, Roberts-Lewis SF, Bergmann J (2012) The Effect of Coil Type and Navigation on the Reliability of Transcranial Magnetic Stimulation. IEEE Trans Neural Syst Rehabil Eng In press.
- 49. Ngomo S, Leonard G, Moffet H, Mercier C (2011) Comparison of transcranial magnetic stimulation measures obtained at rest and under active conditions and their reliability. Journal of neuroscience methods 205: 65–71.
- 50. Lefebvre R, Pépin A, Louis PF, Boucher JP (2004) Reliability of the motor evoked potentials elicited through magnetic stimulation at three sites. Journal of manipulative and physiological therapeutics 27: 97–102.