This paper is in the following e-collection/theme issue:

mHealth for Wellness, Behavior Change and Prevention (2707) Mobile Health (mhealth) (2719)

Published on in Vol 3, No 4 (2015): Oct-Dec

Dutch Young Adults Ratings of Behavior Change Techniques Applied in Mobile Phone Apps to Promote Physical Activity: A Cross-Sectional Survey

Dutch Young Adults Ratings of Behavior Change Techniques Applied in Mobile Phone Apps to Promote Physical Activity: A Cross-Sectional Survey

Dutch Young Adults Ratings of Behavior Change Techniques Applied in Mobile Phone Apps to Promote Physical Activity: A Cross-Sectional Survey

Authors of this article:

Laura S. Belmon1 Author Orcid Image ;   Anouk Middelweerd1 Author Orcid Image ;   Saskia J te Velde1 Author Orcid Image ;   Johannes Brug1 Author Orcid Image
Article Authors Cited by (30) Tweetations (23) Metrics

    Original Paper

    EMGO Institute for Health and Care Research, Department of Epidemiology and Biostatistics, VU Medical Center Amsterdam, Amsterdam, Netherlands

    Corresponding Author:

    Anouk Middelweerd, MSc

    EMGO Institute for Health and Care Research

    Department of Epidemiology and Biostatistics

    VU Medical Center Amsterdam

    F-building

    De Boelelaan 1089a

    Amsterdam, 1081 HV

    Netherlands

    Phone: 31 204445379

    Fax:31 204445287

    Email: a.middelweerd@vumc.nl


    Background: Interventions delivered through new device technology, including mobile phone apps, appear to be an effective method to reach young adults. Previous research indicates that self-efficacy and social support for physical activity and self-regulation behavior change techniques (BCT), such as goal setting, feedback, and self-monitoring, are important for promoting physical activity; however, little is known about evaluations by the target population of BCTs applied to physical activity apps and whether these preferences are associated with individual personality characteristics.

    Objective: This study aimed to explore young adults’ opinions regarding BCTs (including self-regulation techniques) applied in mobile phone physical activity apps, and to examine associations between personality characteristics and ratings of BCTs applied in physical activity apps.

    Methods: We conducted a cross-sectional online survey among healthy 18 to 30-year-old adults (N=179). Data on participants’ gender, age, height, weight, current education level, living situation, mobile phone use, personality traits, exercise self-efficacy, exercise self-identity, total physical activity level, and whether participants met Dutch physical activity guidelines were collected. Items for rating BCTs applied in physical activity apps were selected from a hierarchical taxonomy for BCTs, and were clustered into three BCT categories according to factor analysis: “goal setting and goal reviewing,” “feedback and self-monitoring,” and “social support and social comparison.”

    Results: Most participants were female (n=146), highly educated (n=169), physically active, and had high levels of self-efficacy. In general, we observed high ratings of BCTs aimed to increase “goal setting and goal reviewing” and “feedback and self-monitoring,” but not for BCTs addressing “social support and social comparison.” Only 3 (out of 16 tested) significant associations between personality characteristics and BCTs were observed: “agreeableness” was related to more positive ratings of BCTs addressing “goal setting and goal reviewing” (OR 1.61, 95% CI 1.06-2.41), “neuroticism” was related to BCTs addressing “feedback and self-monitoring” (OR 0.76, 95% CI 0.58-1.00), and “exercise self-efficacy” was related to a high rating of BCTs addressing “feedback and self-monitoring” (OR 1.06, 95% CI 1.02-1.11). No associations were observed between personality characteristics (ie, personality, exercise self-efficacy, exercise self-identity) and participants’ ratings of BCTs addressing “social support and social comparison.”

    Conclusions: Young Dutch physically active adults rate self-regulation techniques as most positive and techniques addressing social support as less positive among mobile phone apps that aim to promote physical activity. Such ratings of BCTs differ according to personality traits and exercise self-efficacy. Future research should focus on which behavior change techniques in app-based interventions are most effective to increase physical activity.

    JMIR mHealth uHealth 2015;3(4):e103

    doi:10.2196/mhealth.4383

    Keywords

    motor activity; self efficacy; exercise; behavior therapy; cell phones 


    Introduction

    Despite its well-known benefits, 31% of adults worldwide and 40% of Dutch adults do not engage in sufficient physical activity [1-3]. In early adulthood (18-30 years of age), levels of physical activity often decline from childhood levels [4-6]. Therefore, widely available, effective, and affordable public health interventions are needed to promote physical activity in this age group.

    In 2013, 59% of Dutch young adults owned a mobile phone [7]. As ownership and utilization of mobile phones increase, more people are accepting the use of mobile health apps and the popularity of physical activity apps is increasing [8,9]. In January 2015, the iTunes and Google Play stores contained 40,868 and 43,092 health and fitness apps, respectively [10,11]; such apps may be useful for promoting physical activity.

    There is, however, limited evidence on the effectiveness of app-based interventions; previous research shows that Web-based interventions grounded in behavior change theory are more likely to be effective [12], but most presently available apps aiming to promote physical activity are not theory-based and do not address the most important behavioral determinants [9,13,14]. Previous research also indicates that self-efficacy and social support are both associated with physical activity and should be addressed when aiming to increase physical activity behavior [15]. Furthermore, previous research suggests that individually tailored health messages may be more effective than nontailored generic messages [16-19].

    Behavior change techniques (BCTs) are systematic procedures included as an active component of an intervention designed to change behavior [20,21]. BCTs aim to address behavioral determinants such as self-efficacy. Michie et al [22] developed the Behavior Change Technique Taxonomy (v1) of 93 Hierarchically Clustered Techniques; they reported that self-regulation techniques (eg, self-monitoring, action planning, providing instruction, reinforcing effort toward behavior, goal setting, goal reviewing, and providing feedback on behavior) and planning social support or social change [23-26] appear to be mainly important to increase self-efficacy and social support for physical activity in individual, group, or community-based interventions. Middelweerd and colleagues [14] observed that the BCTs most frequently used in apps were self-regulation techniques (eg, goal setting, self-monitoring, and feedback on performance); furthermore, Direito et al [13] reported similar results.

    To design tailored and targeted app-based interventions, insight into the preferences of the target population for certain BCTs applied in physical activity apps is of importance. Dennison et al [27] conducted focus group discussions with young adults and found that mobile phone features to track behavior, set goals, review progress, and receive feedback were positively evaluated. Moreover, Middelweerd et al [28] found that students prefer apps that motivate them and provide tailored feedback to achieve their personal exercise goals. Rabin et al [29] combined a quantitative survey with qualitative interviews among adults and found that adults preferred automatic tracking of physical activity and receiving feedback on exercise achievements. However, these three studies were mainly qualitative and conducted with small samples. Ehlers and Huberty [30] took a more quantitative approach and also identified self-regulation techniques as valued features, but in a sample of middle-aged women; thus, quantitative information on BCT ratings in young adults is lacking.

    Thus far, studies have mainly focused on general preferences for BCTs. Because BCTs are targeting determinants of behavior, it is interesting to examine whether preferences for specific BCTs are associated with these determinants, such as self-efficacy. Furthermore, Verkooijen and De Bruijn reported [31] that the association between social comparison and physical activity is partly mediated by exercise self-identity in young adult women. Because social comparison is a BCT, the preference for this specific BCT and for other techniques might be associated with exercise self-identity. Moreover, Middelweerd et al [28] reported differences in preferences for goal setting and coaching features among participants meeting physical activity guidelines and those who did not meet guidelines. These results suggest that these preferences are associated with levels of physical activity. Lastly, personality traits are associated with physical activity [32,33], and this relationship may be mediated by behavioral determinants proposed in social cognitive models (eg, self-efficacy). As BCTs are techniques aimed at effectively changing behavioral determinants and subsequent behavior, it may be that personality influences the effectiveness of BCTs, probably due to differences in preferences and use of BCTs. Therefore, we explored the hypothesis that preferences for specific BCTs are associated with personality traits.

    The aim of this paper is to explore young adults’ ratings of BCTs applied in a mobile phone physical activity app targeting self-efficacy and social support as important correlates of physical activity, and to explore whether these ratings are associated with personality characteristics (ie, personality, exercise self-efficacy, and exercise self-identity) and levels of physical activity.


    Methods

    Design and Recruitment

    Apparently healthy (in this case, narrowly defined as the absence of physical impairments) young adults, aged 18-30 years, were recruited to voluntarily complete an open online cross-sectional survey via email, Web-based advertising (eg, websites, social media, notification via the Vrije Universiteit Amsterdam [VU University] online communication platform), printed flyers with a link to the questionnaire (eg, universities, fitness centers, cafes), and personal approaches (eg, asking participants personally to complete the questionnaire) at both VU University and several secondary vocational education schools. Participants were informed that they would receive an incentive for their participation (ie, an activity tracker worth 90 Euros). Participants were eligible for inclusion if they met the age criteria (18-30 years) and if they did not report physical impairments that limited their physical activity (eg, a doctor’s order to not participate in any sports or physical activities); incomplete surveys (n=78) were excluded (Figure 1). A total of 260 individuals agreed to participate, but only 182 completed the survey in April 2014 (a completion rate of 70%). Data for 3 participants who had physical impairments were removed as this most likely influenced their amount of physical activity, leaving data for 179 eligible participants for analyses. The Medical Ethical Committee of VU University Medical Center approved the study. All participants gave informed consent. Seventy-eight participants did not complete the questionnaire, probably due to time constraints or technical issues.

    ‎
    Figure 1. Data selection process for analyses.
    View this figure

    Procedures

    The questionnaire was primarily based on existing validated instruments [34-37]. When no Dutch version of a questionnaire existed, it was translated into Dutch and back-translated into English by different translators to ensure correct interpretation of questions. The survey was pilot tested among 10 master’s students at VU University who met the inclusion criteria of the study. The online survey was administered through Survey Monkey [38] and data were downloaded to SPSS 20.0 (IBM) and filtered for survey completion and eligibility criteria, according to the protocol for online questionnaires (Checklist for Reporting Results of Internet E-Surveys, CHERRIES) [39]. Personal data were deleted to prevent unauthorized access and to ensure privacy.

    Measures

    The 108-item questionnaire assessed demographics, personality traits [34], exercise self-efficacy [36], social support for physical activity [40], exercise self-identity [41-43], and physical activity levels [37]. Questions were included to indicate participants’ ratings of BCTs applied in a mobile phone physical activity app according to the 93-item taxonomy [22].

    Behavior Change Techniques

    Potentially effective BCTs to enhance self-efficacy and social support for physical activity were selected from the BCT taxonomy of Michie et al [22] and recent literature on potential effective BCTs [23-26,44-46].

    First, participants were asked to indicate their general preference for functionalities of an app: a personal coach, self-monitoring of physical activity, both, or neither. Second, ratings of specific BCTs were measured on a 5-point Likert scale (Table 1), for which stronger agreement meant a more positive rating of the BCT. Exploratory factor analysis—principal components analysis with orthogonal rotation—confirmed that the 16 BCTs could be grouped into 3 categories: “goal setting and goal reviewing” (goal setting for behavior, problem solving, goal setting for the outcome of behavior, action planning, reviewing behavior goals, discrepancies between current behaviors and goals, reviewing outcomes of goals, and graded tasks, with factor loadings ranging from .510 to .786), “feedback and self-monitoring” (feedback on behavior and the outcome of behavior, self-monitoring of behavior, and the outcome of behavior, with factor loadings ranging from .635 to .811), and “social support and social comparison” (unspecified practical and emotional social support and social comparison, with factor loadings ranging from .508 to .921). The Cronbach alphas of the newly created scales showed good internal consistency (.86, .81, and .83 for “goal setting and goal reviewing,” “feedback and self-monitoring,” and “social support and social comparison,” respectively). Furthermore, Harman’s single-factor test showed that a single factor did not account for the majority of the covariance, indicating that it was not necessary to adjust for bias due to common method variance. Multimedia Appendix 1 shows details of the factor analysis and Harman’s single-factor test. Because of a skewed distribution, the variables “goal setting and goal reviewing” and “feedback and self-monitoring” were dichotomized at the second tertile.

    Table 1. Selected behavior change techniques (BCTs) included in the online survey.
    Selected BCTaQuestion included in the survey
    Goal setting (behavior)It is important to me that I can set short-term goals in a PA app
    Problem solvingIt is important to me that I can solve a problem that holds me back from exercising in a PA app
    Goal setting (outcome)It is important to me that I can set long-term goals in a PA app
    Action planningIt is important to me that I can plan my exercise activities in a PA app
    Reviewing behavior goal(s)It is important to me that I have an overview of my exercise goals to improve my PA in the short-term and can review my progress in a PA app
    Discrepancies between current behaviors and goal(s)It is important to me that I can see the difference between my current exercise behavior and my goals in a PA app
    Reviewing outcome goal(s)It is important to me that I have an overview of my long-term PA goal and can review my long-term goal progress in a PA app
    Graded tasksIt is important to me that I can start with easy tasks and gradually make the exercise tasks more difficult in a PA app
    Feedback on behaviorIt is important to me that I get feedback on my level of PA in a PA app
    Self-monitoring of behaviorIt is important to me that I can monitor my exercise activities in a PA app
    Self-monitoring of the outcome(s) of behaviorIt is important to me that I can monitor my long-term results in a PA app
    Feedback on the outcome(s) of behaviorIt is important to me that I get feedback on my long-term results in a PA app
    Social support (unspecified)It is important to me that I can receive advice or support from friends, family, or colleagues in a PA app to exercise more
    Social support (practical)It is important to me that I can receive practical advice from friends, family, or colleagues in a PA app to exercise more
    Social support (emotional)It is important to me that I can be encouraged by friends, family, or colleagues in a PA app to exercise more
    Social comparisonIt is important to me that I can compare my exercise activities with that of others in a PA app

    aBehavior change techniques (BCTs) based on the 93-taxonomy of Michie et al [22].

    Personality

    Personality traits were measured with the Dutch version of the 10-item short form of the Big Five Inventory (BFI) and the Ten-Item Personality Inventory (TIPI). The original TIPI [47] was translated from the English language, back-translated to confirm the translation, and validated among Dutch university students by Hofmans et al [34]. We measured the five tendencies of personality traits: extraversion (E), agreeableness (A), conscientiousness (C), neuroticism (N), and openness (O) [35] using a 7-point Likert scale (1= totally disagree, 7= totally agree) [34,35]. Each TIPI subscale includes 2 items representing opposite poles of each Big Five personality trait and each has a subscale score ranging from 1 to 7 [34].

    Exercise Self-Efficacy

    Exercise self-efficacy was measured with 12 questions on a 5-point Likert scale (1=I know I cannot, 5=I know I can) based on the Self-efficacy for Exercise Scale [36]. Test-retest reliability for this scale was reported as .68 [36]. Moreover, this study also showed good internal consistency (Cronbach alpha of .90).

    Exercise Self-Identity

    Exercise self-identity was measured with 4 questions on a 7-point Likert scale (1=totally disagree, 7=totally agree): “Engaging in sufficient exercise is something that fits the way I want to live,” “Engaging in sufficient exercise is something that fits who I am,” “I see myself as someone who engages in sufficient exercise,” and “I am a typical person who engages in sufficient exercise” [34,42,43]. A sum score of these constructs was constructed (ie, range 4-28) and showed good internal consistency (Cronbach alpha of .88).

    Physical Activity

    Physical activity was assessed with the SQUASH (ie, Short QUestionnaire to ASsess Health-enhancing physical activity), a validated Dutch questionnaire that measures different types and intensity of physical activity [37]. A test-retest analysis (5-week period) showed reproducibility of .58 (95% CI 0.36-0.74), with better reproducibility for high-intensity activities, such as active commuting and leisure time sports, than low-intensity activities, indicating that the SQUASH is a fairly reliable measure [37]. Moreover, the validity of the SQUASH was fair to good, as indicated by a correlation of .45 (95% CI 0.17-0.66) between the SQUASH and activity counts derived from activity monitors [38]. Physical activity at work or school was assessed in hours/day instead of hours/week and subsequently transformed to scores per week. The scores that were used from the SQUASH questionnaire were total physical activity (min/week) and meeting the Dutch physical activity recommendation (yes or no).

    Mobile Phone and App Use

    Items were included to measure mobile phone use (“Do you use a mobile phone?” [yes or no]), past mobile phone app use (“Did you use mobile phone apps in the past?” [yes or no]), current mobile phone app use (“Do you use mobile phone apps at the moment?” [yes or no]), and physical activity app use (“Do you use mobile phone apps focused on sports and exercise?” [yes, often; yes, sometimes; yes, seldom; or no]).

    Demographics

    Age, gender, nationality (ie, Dutch or non-Dutch), current level of education (ie, secondary vocational education, higher education, university, other), current residence, study city, living situation (ie, own place or with parents/family), ability to exercise (ie, yes, yes despite physical activity impairments, no), height (m), and weight (kg) were collected.

    Statistical Analyses

    Multiple binary logistic regression analyses were used to estimate the association between the different personality characteristics (personality traits, exercise self-efficacy, exercise self-identity, and meeting the Dutch physical activity guidelines) and positive ratings (no, yes) of BCTs addressing “goal setting and goal reviewing” and “feedback and self-monitoring.” Multiple linear regression analyses were used to explore the association between personality characteristics and the preference for the BCTs addressing “social support and social comparison.” Potential effect moderation was evaluated for meeting the Dutch physical activity guidelines. The models were evaluated for potential confounds of total physical activity (min/week) and body mass index (BMI, kg/m2). For all associations, P≤.05 indicated a statistically significant association, except for the interaction terms, which were considered significant at P≤.10.


    Participant Characteristics

    Sample characteristics and mean scores of the independent and dependent variables for the total study population are presented in Table 2. Overall, most participants were female, highly educated, and physically active. Table 3 describes preferences for BCTs in physical activity apps, and Figure 2 describes the physical activity app functionalities desired by participants.

    ‎
    Figure 2. Physical activity app functionalities desired by participants.
    View this figure
    Table 2. Characteristics of participants.
    Demographic characteristicsN=179
    Gender, male, n (%)
    		33 (18.4%)
    Age (years), mean (SD)
    		24.33 (±2.76)
    Body mass index (kg/m2), mean (SD)
    		22.05 (±2.62)
    Dutch nationality, n (%)
    		152 (84.9%)
    Current level of education, n (%)


    		Secondary vocational education5 (2.8%)

    		Higher education33 (18.4%)

    		University136 (76.0%)

    		Other5 (2.8%)
    Student, n (%)
    		118 (65.9%)

    		Living situation, on their own, n (%)150 (83.8%)

    		Mobile phone use, yes, n (%)173 (96.6%)

    		Past mobile phone app use, yes, n (%)171 (95.5%)

    		Current mobile phone app use, yes, n (%)168 (93.9%)
    Physical activity app use, n (%)


    		Yes, often35 (19.6%)

    		Yes, sometimes56 (31.3%)

    		Yes, seldom25 (14.0%)

    		No63 (35.2%)
    Preference for BCTsa


    		Goal setting, goal reviewing (range 8-40), mean (SD)31.12 (±6.18)

    		Feedback, self-monitoring (range 4-20), mean (SD)16.60 (±2.75)

    		Social support, social comparison (range 4-20), mean (SD)10.65 (±3.95)
    Meet the Dutch physical activity recommendation of at least 30 minutes of moderate physical activity 5 days/week, n (%)
    		144 (80.4%)
    Physical activity hours/week, mean (SD)


    		Total48.03 (±21.57)

    		Moderate to vigorous16.60 (±17.64)
    Exercise self-efficacy (range 12-60), mean (SD)
    		44.74 (±8.79)
    Exercise self-identity (range 4-28), mean (SD)
    		21.64 (±5.00)
    Personality (range 1-7), mean (SD)


    		Extraversion (E)4.74 (±1.47)

    		Agreeableness (A)5.49 (±0.84)

    		Conscientiousness (C)4.86 (±1.40)

    		Neuroticism (N)3.05 (±1.24)

    		Openness (O)4.88 (±1.24)

    aBehavior Change Technique.

    Table 3. Mean preferences for behavior change techniques (BCTs) in a physical activity appa.
    BCT
    		Mean (±SD)
    Goal setting and goal reviewing


    		Goal setting for behavior3.84 (±1.13)

    		Problem solving3.46 (±1.31)

    		Goal setting for the outcome of behavior4.18 (±0.93)

    		Action planning3.55 (±1.20)

    		Review of behavior goals3.85 (±1.01)

    		Discrepancy between current behavior/goal4.12 (±1.02)

    		Review of the outcome of behavior goals4.04 (±1.01)

    		Graded tasks4.07 (±0.98)
    Feedback and self-monitoring


    		Feedback on behavior3.93 (±0.95)

    		Self-monitoring of behavior4.41 (±0.75)

    		Self-monitoring of the outcome of behavior4.22 (±0.83)

    		Feedback on the outcome of behavior4.03 (±0.90)
    Social support and social comparison


    		Social support unspecified2.37 (±1.11)

    		Social support practical2.52 (±1.18)

    		Social support emotional2.63 (±1.30)

    		Social comparison3.13 (±1.26)

    aRated on a scale from 1 (strongly disagree) to 5 (strongly agree).

    Associations With Ratings of BCTs Addressing Goal Setting and Goal Reviewing

    Table 4 shows that few personality characteristics were significantly associated with high ratings of the BCTs addressing goal setting and goal reviewing. Meeting the Dutch physical activity guidelines did not significantly moderate the association. “Agreeableness” was significantly positively associated with high ratings of the BCTs addressing goal setting and goal reviewing (OR 1.60, 95% CI 1.06-2.41), indicating that respondents who scored 1 point higher on agreeableness (range 1-7) were 1.60 times more likely to rate this BCT category as important.

    Table 4. Association between personality traits and a high preference for behavior change techniques addressing goal setting and goal reviewinga.
    Characteristic
    		Unadjusted odds ratio (95% CI)PNagelkerke R2Adjusted odds ratio (95% CI)PNagelkerke R2
    Personality traits







    		Extraversion (E)1.08 (0.86-1.36).519.0661.06 (0.84-1.34)b.636.066

    		Agreeableness (A)1.61 (1.07-2.43).0221.60 (1.06-2.41)b.026

    		Conscientiousness (C)0.86 (0.68-1.08).1830.86 (0.68-1.10)b.237

    		Neuroticism (N)1.07 (0.82-1.39).6261.04 (0.80-1.37)b.755

    		Openness (O)1.09 (0.84-1.42).5131.09 (0.84-1.43)b.514
    Exercise self-efficacy
    		1.00 (0.96-1.03).827<.0011.00 (0.96-1.03)b.823.007
    Exercise self-identity
    		0.99 (0.93-1.05).649.0020.99 (0.93-1.06)b.773.007
    Meeting the Dutch physical activity guidelines
    		0.83 (0.39-1.78).636.0020.88 (0.40-1.92)c.747.006

    aCategorized on the 2nd tertile (sum score of 8 questions on a 5-point Likert scale; 8-33 considered low and 34-40 considered high preference).

    bAdjusted for total physical activity (min/week) and body mass index (kg/m2)

    cAdjusted for body mass index (kg/m2)

    Associations With Ratings of BCTs Addressing Feedback and Self-Monitoring

    Table 5 shows that no significant associations were found between BCT feedback and self-monitoring and exercise self-identity and meeting Dutch physical activity guidelines. A significant negative association was found with “neuroticism” (OR 0.76, 95% CI 0.58-1.00) and a significant positive association was found with exercise self-efficacy (OR 1.06, 95% CI 1.02-1.11), indicating that respondents who scored 1 point higher on neuroticism (range 1-7) were 1.32 times less likely to rate this BCT category as important, and respondents who scored 1 point higher on the 60-point exercise self-efficacy scale were 1.06 times more likely to rate “feedback and self-monitoring” as important BCTs. Meeting the Dutch physical activity guidelines did not moderate the associations.

    Table 5. Association between personality traits and a high preference for behavior change techniques addressing feedback and self-monitoringa.
    Characteristic
    		Unadjusted Odds Ratio (95% CI)PNagelkerke R2Adjusted Odds Ratio (95% CI)PNagelkerke R2
    Personality traits







    		Extraversion (E)1.10 (0.88-1.39).407.0611.07 (0.84-1.35)b.585.073

    		Agreeableness (A)1.10 (0.74-1.61).6451.08 (0.73-1.60)b.705

    		Conscientiousness (C)0.86 (0.69-1.08).1880.84 (0.70-1.06)b.141

    		Neuroticism (N)0.80 (0.61-1.04).1010.76 (0.58-1.00)b.054

    		Openness (O)1.12 (0.86-1.46).3821.12 (0.87-1.46)b.414
    Exercise self-efficacy
    		1.06 (1.02-1.10).003.0711.06 (1.02-1.11)c.003.088
    Exercise self-identity
    		1.04 (0.98-1.10).241.0101.05 (0.98-1.12)c.157.029
    Meeting the Dutch PA guidelines
    		0.99 (0.46-2.12).983<.0011.07 (0.49-2.32)d.867.007

    aCategorized on the 2nd tertile (sum score of 4 questions on a 5-point Likert scale, 4-17 low and 18-20 high preference).

    bAdjusted for total physical activity (min/week)

    cAdjusted for total physical activity (min/week) and body mass index (kg/m2)

    dAdjusted for body mass index (kg/m2)

    Associations With Ratings of BCTs Addressing Social Support and Social Comparison

    Data obtained from the linear regression analysis between personal characteristics and ratings of BCTs addressing social support and social comparison (range 4-20) are presented in Table 6. No significant associations were found and meeting the Dutch physical activity guidelines was not a significant moderator.

    Table 6. Association between personality characteristics and preference for behavior change techniques addressing social support and social comparison.
    Characteristic
    		Standardized B (95% CI)P Nagelkerke R2Adjusted standardized B (95% CI)P Nagelkerke R2
    Personality traits







    		Extraversion (E)0.08 (-0.08 to 0.23).329.0460.07 (-0.10 to 0.23)a.430.049

    		Agreeableness (A)0.10 (-0.06 to 0.25).2170.09 (-0.06 to 0.24)a.254

    		Conscientiousness (C)-0.13 (-0.28 to 0.02).087-0.14 (-0.30 to 0.03)a.103

    		Neuroticism (N)-0.01 (-0.16 to 0.15).907-0.02 (-0.18 to 0.14)a.821

    		Openness (O)0.09 (-0.07 to 0.24).2800.08 (-0.07 to 0.24)a.299
    Exercise self-efficacy
    		0.08 (-0.07 to 0.23).308.0060.09 (-0.06 to 0.24)a.266.015
    Exercise self-identity
    		-0.04 (-0.19 to 0.11).605.002-0.03 (-0.18 to 0.12)b.696.005
    Meeting the Dutch physical activity guidelines
    		0.08 (-0.07 to 0.22).310.0060.09 (-0.06 to 0.24)b.229.013

    aAdjusted for total physical activity (min/week) and body mass index (kg/m2).

    bAdjusted for body mass index (kg/m2).


    Discussion

    Principal Findings

    This study examined young adults’ ratings of BCTs applied in a mobile phone physical activity app aimed at improving self-efficacy and social support for physical activity. Furthermore, a number of possible correlates of such ratings were explored. It should be noted that participants were asked to rate BCTs based on their experiences and wishes or requirements of a hypothetical mobile phone physical activity app and not of an existing app. In this study, the ratings of all BCTs addressing self-efficacy were relatively high, but the BCTs addressing social support were not. Respondents who scored higher on agreeableness were more likely to rate BCTs addressing “goal setting and goal reviewing” positively. Furthermore, respondents who scored higher on neuroticism were less likely to rate BCTs addressing “feedback and self-monitoring” positively, while higher scores on self-efficacy were associated with more positive ratings of “feedback and self-monitoring.”

    Ratings of Behavior Change Techniques

    This study’s finding that BCTs addressing “goal setting and goal reviewing” and “feedback and self-monitoring” were positively rated is in line with previous research, in which app features for (automatic) tracking of behavior, setting goals, monitoring behavior, and receiving feedback were evaluated positively in different studies [27,29]. In this study, the most preferred BCTs by young adults were “goal setting on the outcome of behavior,” “self-monitoring of behavior,” and “self-monitoring of the outcome of behavior.” The study of Ehlers and Huberty [30] supports this finding, by indicating that self-regulation techniques (eg, tracking physical activity, goal setting, and receiving feedback) are valuable features of health behavior apps. Middelweerd et al [28] pointed out that participants, overall, preferred a combination of a (virtual) coach with goal setting and that participants would like to receive personal feedback. This study provides further support for positive ratings of BCTs, including goal setting and receiving personal feedback. Earlier findings that social support features were less appreciated among middle-aged women were replicated for young adults, based on the lower preference for social support techniques in apps found in this study [30]. It may be that the high physical activity and exercise self-efficacy levels of the participants in this study caused them to perceive social support as unnecessary. By contrast, about half of the participants preferred a personal coach, which could be seen as another form of social support. Additional analyses (not shown) indicated that those preferring a personal coach did not significantly differ with respect to their preferences for social support from those who did not prefer a personal coach.

    Personal Characteristics and Ratings of Behavior Change Techniques

    The association between personality traits and BCT categories has not been previously reported or investigated. This study found a significant positive association for agreeableness and BCTs addressing “goal setting and reviewing.” Agreeableness is characterized by having the tendency to be kind, cooperative, and trustworthy [37]; thus, participants who were categorized as being cooperative and trustworthy were more likely to be open to app features like goal setting and goal reviewing. This study found an inverse association between neuroticism and BCTs addressing “feedback and self-monitoring.” Neuroticism is characterized by negative affect and emotional instability [48]. Rhodes and Smith [32] noted that avoidance of physical activity or cancelling physical activity plans may be a logical extension of this personality trait, which can also make them less likely to use app features like goal setting, goal reviewing, receiving feedback, and self-monitoring of physical activity behavior. These preliminary results indicate that personality traits could be considered when designing app-based interventions. Previous research showed that tailoring advertising messages to respondents’ personality traits increased their motivation to use a product. Thus, tailoring BCTs to participants may increase the effectiveness of an app-based intervention. However, future research is needed to examine how BCTs should be tailored.

    Furthermore, this study found an association between exercise self-efficacy and BCTs addressing “feedback and self-monitoring.” It may be that when a person perceives that one can successfully engage in physical activity, monitoring physical activity and receiving feedback on physical activities affirm and ratify a positive feeling toward physical activity behavior. Moreover, when participants’ exercise self-efficacy is low, monitoring their physical activity behavior may elicit unpleasant feelings and, therefore, generate less appreciation for self-monitoring app features. This suggests that app developers should consider designing app-based interventions tailored to personality and exercise self-efficacy.

    Although this study did not find any associations between participants meeting the Dutch physical activity guidelines and ratings of potential effective BCTs, Middelweerd and colleagues [28] found some differences in ratings of app features between young adults who met and who did not meet these guidelines. For example, the latter preferred a goal setting feature and a personal coach, whereas participants meeting the physical activity guidelines reported goal setting as unnecessary and preferred highly detailed training information [28]. Furthermore, differences may also exist between men and women, as men appear to have a preference for team-based, competitive activities, while women do not [49]. The lack of association with participants’ physical activity level could also be explained in terms of a high overall level of physical activity in this study, as more than 80% of participants met the guidelines; thus, this study may not have had sufficient power to detect differences in preferences for BCTs between those meeting and not meeting the Dutch guidelines.

    Strengths and Limitations

    This is the first study to explore associations between personality characteristics and ratings of BCTs applied in mobile phone physical activity apps. Given the current lack of adequate physical activity and preference for apps to support and monitor physical activity, scientific evidence to inform app-based interventions is needed.

    Several limitations need to be considered in the interpretation of the findings of this study. The first important limitation is the cross-sectional design, so no causal inferences can be made. Second, the sample was rather homogeneous in gender, physical activity level, and education level; therefore, the results cannot be generalized to more heterogeneous samples. The fact that participants were highly active and had high levels of self-efficacy may have influenced their preferences for certain BCTs. Reasons for the homogenous sample in this study could be that the participants comprised a convenience sample, and the study’s topic (physical activity and apps) and the activity tracker incentive may have attracted more physically active participants. An additional incentive to participate in the study was a prize draw in which one activity tracker could be won. Such an incentive was probably more attractive to participants who already were physically active and who may already have had a preference for tracking their behavior. This may have influenced their preferences for certain BCTs. Consequently, the high levels of preferences for self-monitoring BCTs might be somewhat biased. The time and effort needed to complete the survey may have led to lower participation of less educated participants [50], despite efforts to actively recruit participants at secondary vocational education schools to reach participants with lower education. However, it is well-known that those with lower education and who are physically inactive are hard to reach. Furthermore, men are less likely to participate in lifestyle-related research [51-55]. The fact that our sample was mainly female, with higher education, and more likely to be physically active than the general population of Dutch young adults may have biased the results, and the BCTs identified may not be reflective of the population at large. Furthermore, this study examined a relatively large number of correlations, but only 3 associations were found to be significant, resulting in increased risk of Type 1 error. These associations should, thus, be interpreted with caution and regarded as exploratory findings. Finally, the participants were asked to rate BCTs based on a one-sentence description, and not on actual experience. Consequently, for some participants, past experiences might have positively or negatively influenced their ratings, whereas for others the ratings remained hypothetical.

    Future Research

    Future research should focus further on indicating potential differences in the ratings of BCTs between active and inactive participants and using more representative samples. Self-regulation BCTs are potentially effective and were highly appreciated among the young adults in this study. Therefore, these techniques may be considered by physical activity app developers, who should implement these BCTs correctly; the apps should be subsequently tested for their effectiveness in improving physical activity motivation, self-efficacy, and behavior [56]. Although the literature indicates social support as an important correlate of physical activity, young adults in this study did not appreciate this in a mobile phone app. This may indicate that social support should be provided through different or traditional interventions. In addition, this study suggests the value of studying in detail the tailoring of BCTs to participants’ personality characteristics.

    Future research should examine the effectiveness of BCTs applied in apps. In previous research, it has been shown that the BCTs included in this study can effectively change behavior; however, because of lack of evaluation research, little is known about their effectiveness in apps [14]. Even if BCTs have been found to be effective in other intervention methods, effectiveness in app operationalization should be tested, as effectiveness of BCTs may be dependent on the actual intervention.

    Conclusion

    To conclude, ratings of various self-regulation BCTs in a mobile phone app were high in a selected group of highly educated and physically active young adults. BCTs addressing social support were less appreciated. Differences in ratings of BCTs due to differences in personality and exercise self-efficacy between young adults should be taken into account.

    Acknowledgments

    The authors are grateful to the participants of this study. The authors thank Shereen Khodabaks for her contribution to the project. This research was supported by the Philips and Technology Foundation STW and Nationaal Initiatief Hersenen en Cognitie NIHC under the Partnership Program Healthy Lifestyle Solutions (Grant no 12014).

    Authors' Contributions

    LSB designed the survey, collected data, performed the analyses, drafted the manuscript, and incorporated all feedback. AM designed the survey, provided intellectual input and feedback, and approved the final version of the manuscript. StV designed the survey, provided intellectual input and feedback, and approved the final version of the manuscript. JB provided intellectual input to the design and execution of the review and to the manuscript, provided feedback, and approved the final version of the manuscript.

    Conflicts of Interest

    None declared.

    ‎

    Multimedia Appendix 1

    Summary of exploratory factor analysis results for the behavior change techniques (N=179).

    PDF File (Adobe PDF File), 352KB
    1. Hallal PC, Andersen LB, Bull FC, Guthold R, Haskell W, Ekelund U, Lancet Physical Activity Series Working Group. Global physical activity levels: Surveillance progress, pitfalls, and prospects. Lancet 2012 Jul 21;380(9838):247-257. [CrossRef] [Medline]
    2. Hildebrandt VH, Ooijendijk WTM, Hopman-Rock M. TNO Kwaliteit van Leven. 2008. Trendrapport Bewegen en Gezondheid 2006/2007   URL: http://www.nasb.nl/nasb-checklist-gemeenten/trendrapporttno2006-2007_1_.pdf [accessed 2015-01-28] [WebCite Cache]
    3. Kemper HGC, Ooijendijk WTM, Stiggelbout M. Consensus over de Nederlandse norm voor gezond bewegen (NNGB). Tijdschr Soc Gezondheidsz 2000;78:180-183.
    4. Allender S, Hutchinson L, Foster C. Life-change events and participation in physical activity: A systematic review. Health Promot Int 2008 Jun;23(2):160-172 [FREE Full text] [CrossRef] [Medline]
    5. Dowda M, Ainsworth BE, Addy CL, Saunders R, Riner W. Correlates of physical activity among U.S. young adults, 18 to 30 years of age, from NHANES III. Ann Behav Med 2003 Aug;26(1):15-23. [Medline]
    6. Kwan MY, Cairney J, Faulkner GE, Pullenayegum EE. Physical activity and other health-risk behaviors during the transition into early adulthood: A longitudinal cohort study. Am J Prev Med 2012 Jan;42(1):14-20. [CrossRef] [Medline]
    7. Ward S, Korf F, Sethi G, Storojev A. Deloitte. 2013 Nov. Global Mobile Consumer Survey 2013. Addicted to Connectivity: the Dutch Mobile Consumer Perspective   URL: http://www.iabeurope.eu/files/1913/8574/2118/deloitte-nl-global-mobile-consumer-survey.pdf [accessed 2015-02-02] [WebCite Cache]
    8. Boulos MN, Wheeler S, Tavares C, Jones R. How smartphones are changing the face of mobile and participatory healthcare: An overview, with example from eCAALYX. Biomed Eng Online 2011;10:24. [Medline]
    9. Cowan LT, Van Wagenen SA, Brown BA, Hedin RJ, Seino-Stephan Y, Hall PC, et al. Apps of steel: Are exercise apps providing consumers with realistic expectations?: A content analysis of exercise apps for presence of behavior change theory. Health Educ Behav 2013 Apr;40(2):133-139. [CrossRef] [Medline]
    10. Pocketgamer.biz. 2014. App Store Metrics   URL: http://www.pocketgamer.biz/metrics/app-store/categories/ [accessed 2015-02-02] [WebCite Cache]
    11. AppBrain. 2014. Android statistics; top categories   URL: http://www.appbrain.com/stats/android-market-app-categories [accessed 2015-02-02] [WebCite Cache]
    12. Webb TL, Joseph J, Yardley L, Michie S. Using the internet to promote health behavior change: A systematic review and meta-analysis of the impact of theoretical basis, use of behavior change techniques, and mode of delivery on efficacy. J Med Internet Res 2010;12(1):e4 [FREE Full text] [CrossRef] [Medline]
    13. Direito A, Dale LP, Shields E, Dobson R, Whittaker R, Maddison R. Do physical activity and dietary smartphone applications incorporate evidence-based behaviour change techniques? BMC Public Health 2014;14:646 [FREE Full text] [CrossRef] [Medline]
    14. Middelweerd A, Mollee JS, Van der Wal CN, Brug J, Te Velde SJ. Apps to promote physical activity among adults: A review and content analysis. Int J Behav Nutr Phys Act 2014 Jul;11:97 [FREE Full text] [CrossRef] [Medline]
    15. Conn VS, Hafdahl AR, Mehr DR. Interventions to increase physical activity among healthy adults: Meta-analysis of outcomes. Am J Public Health 2011 Apr;101(4):751-758 [FREE Full text] [CrossRef] [Medline]
    16. De Vries H, Kremers SP, Smeets T, Brug J, Eijmael K. The effectiveness of tailored feedback and action plans in an intervention addressing multiple health behaviors. Am J Health Promot 2008;22(6):417-425. [CrossRef] [Medline]
    17. Lustria ML, Noar SM, Cortese J, Van Stee SK, Glueckauf RL, Lee J. A meta-analysis of web-delivered tailored health behavior change interventions. J Health Commun 2013;18(9):1039-1069. [CrossRef] [Medline]
    18. Neville LM, O'Hara B, Milat A. Computer-tailored physical activity behavior change interventions targeting adults: A systematic review. Int J Behav Nutr Phys Act 2009;6:30 [FREE Full text] [CrossRef] [Medline]
    19. Smeets T, Brug J, De Vries H. Effects of tailoring health messages on physical activity. Health Educ Res 2008 Jun;23(3):402-413 [FREE Full text] [CrossRef] [Medline]
    20. Michie S, Abraham C, Eccles MP, Francis JJ, Hardeman W, Johnston M. Strengthening evaluation and implementation by specifying components of behaviour change interventions: A study protocol. Implement Sci 2011;6:10 [FREE Full text] [CrossRef] [Medline]
    21. Michie S, Johnston M. Behavior change techniques. In: Gellman MD, Turner JR, editors. Encyclopedia of Behavioral Medicine. New York: Springer; 2011:182-187.
    22. Michie S, Richardson M, Johnston M, Abraham C, Francis J, Hardeman W, et al. The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: Building an international consensus for the reporting of behavior change interventions. Ann Behav Med 2013 Aug;46(1):81-95. [CrossRef] [Medline]
    23. Greaves CJ, Sheppard KE, Abraham C, Hardeman W, Roden M, Evans PH, et al. Systematic review of reviews of intervention components associated with increased effectiveness in dietary and physical activity interventions. BMC Public Health 2011;11:119 [FREE Full text] [CrossRef] [Medline]
    24. Michie S, Abraham C, Whittington C, McAteer J, Gupta S. Effective techniques in healthy eating and physical activity interventions: A meta-regression. Health Psychol 2009 Nov;28(6):690-701. [CrossRef] [Medline]
    25. Olander EK, Fletcher H, Williams S, Atkinson L, Turner A, French DP. What are the most effective techniques in changing obese individuals' physical activity self-efficacy and behaviour: A systematic review and meta-analysis. Int J Behav Nutr Phys Act 2013;10:29 [FREE Full text] [CrossRef] [Medline]
    26. Williams SL, French DP. What are the most effective intervention techniques for changing physical activity self-efficacy and physical activity behaviour--and are they the same? Health Educ Res 2011 Apr;26(2):308-322 [FREE Full text] [CrossRef] [Medline]
    27. Dennison L, Morrison L, Conway G, Yardley L. Opportunities and challenges for smartphone applications in supporting health behavior change: qualitative study. J Med Internet Res 2013;15(4):e86 [FREE Full text] [CrossRef] [Medline]
    28. Middelweerd A, Van der Laan DM, Van Stralen M, Mollee J, Stuij M, Te Velde SJ, et al. What features do Dutch university students prefer in a smartphone application for promotion of physical activity? A qualitative approach. Int J Behav Nutr Phys Act 2015;12:31 [FREE Full text] [CrossRef] [Medline]
    29. Rabin C, Bock B. Desired features of smartphone applications promoting physical activity. Telemed J E Health 2011 Dec;17(10):801-803. [CrossRef] [Medline]
    30. Ehlers DK, Huberty JL. Middle-aged women's preferred theory-based features in mobile physical activity applications. J Phys Act Health 2014 Sep;11(7):1379-1385. [CrossRef] [Medline]
    31. Verkooijen KT, De Bruijn GJ. Exercise self-identity: Interactions with social comparison and exercise behaviour. Psychol Health Med 2013;18(4):490-499. [CrossRef] [Medline]
    32. Rhodes RE, Smith NE. Personality correlates of physical activity: A review and meta-analysis. Br J Sports Med 2006 Dec;40(12):958-965 [FREE Full text] [CrossRef] [Medline]
    33. Rhodes RE, Dickau L. Moderators of the intention-behaviour relationship in the physical activity domain: A systematic review. Br J Sports Med 2013 Mar;47(4):215-225. [CrossRef] [Medline]
    34. Hofmans J, Kuppens P, Allik J. Is short in length short in content? An examination of the domain representation of the Ten Item Personality Inventory scales in Dutch language. Pers Individ Dif 2008 Dec;45(8):750-755. [CrossRef]
    35. Rammstedt B, John OP. Measuring personality in one minute or less: A 10-item short version of the Big Five Inventory in English and German. J Res Pers 2007 Feb;41(1):203-212. [CrossRef]
    36. Sallis JF, Pinski RB, Grossman RM, Patterson TL, Nader PR. The development of self-efficacy scales for health-related diet and exercise behaviors. Health Educ Res 1988;3(3):283-292. [CrossRef]
    37. Wendel-Vos GCW, Schuit AJ, Saris WHM, Kromhout D. Reproducibility and relative validity of the short questionnaire to assess health-enhancing physical activity. J Clin Epidemiol 2003 Dec;56(12):1163-1169. [Medline]
    38. SurveyMonkey. 2014. Survey software   URL: https://nl.surveymonkey.com/ [accessed 2015-02-02] [WebCite Cache]
    39. Eysenbach G. Improving the quality of Web surveys: The Checklist for Reporting Results of Internet E-Surveys (CHERRIES). J Med Internet Res 2004 Sep 29;6(3):e34 [FREE Full text] [CrossRef] [Medline]
    40. Sallis JF, Grossman RM, Pinski RB, Patterson TL, Nader PR. The development of scales to measure social support for diet and exercise behaviors. Prev Med 1987 Nov;16(6):825-836. [Medline]
    41. De Bruijn GJ, Van den Putte B. Exercise promotion: An integration of exercise self-identity, beliefs, intention, and behaviour. Eur J Sport Sci 2012 Jul;12(4):354-366. [CrossRef]
    42. De Bruijn GJ, Verkooijen K, De Vries NK, Van den Putte B. Antecedents of self identity and consequences for action control: An application of the theory of planned behaviour in the exercise domain. Psychol Sport Exerc 2012 Nov;13(6):771-778. [CrossRef]
    43. Sparks P, Shepherd R. Self-identity and the theory of planned behavior: Assessing the role of identification with "green consumerism". Social Psych Quart 1992;55(4):388-399.
    44. Abraham C, Michie S. A taxonomy of behavior change techniques used in interventions. Health Psychol 2008 May;27(3):379-387. [CrossRef] [Medline]
    45. Ashford S, Edmunds J, French DP. What is the best way to change self-efficacy to promote lifestyle and recreational physical activity? A systematic review with meta-analysis. Br J Health Psychol 2010 May;15(Pt 2):265-288. [CrossRef] [Medline]
    46. Normand MP. Increasing physical activity through self-monitoring, goal setting, and feedback. Behav Intervent 2008 Nov;23(4):227-236. [CrossRef]
    47. Gosling SD, Rentfrow PJ, Swann Jr WB. A very brief measure of the Big-Five personality domains. J Res Pers 2003 Dec;37(6):504-528. [CrossRef]
    48. John OP, Srivastava S. The Big Five trait taxonomy: History, measurement, theoretical perspectives. In: Pervin LA, John OP, editors. Handbook of Personality: Theory and Research. 2nd edition. New York: Guilford Press; 1999.
    49. George ES, Kolt GS, Duncan MJ, Caperchione CM, Mummery WK, Vandelanotte C, et al. A review of the effectiveness of physical activity interventions for adult males. Sports Med 2012 Apr 1;42(4):281-300. [CrossRef] [Medline]
    50. Van Loon AJ, Tijhuis M, Picavet HS, Surtees PG, Ormel J. Survey non-response in the Netherlands: Effects on prevalence estimates and associations. Ann Epidemiol 2003 Feb;13(2):105-110. [Medline]
    51. Boshuizen HC, Viet AL, Picavet HSJ, Botterweck A, Van Loon AJM. Non-response in a survey of cardiovascular risk factors in the Dutch population: Determinants and resulting biases. Public Health 2006 Apr;120(4):297-308. [CrossRef] [Medline]
    52. Deeks A, Lombard C, Michelmore J, Teede H. The effects of gender and age on health related behaviors. BMC Public Health 2009;9:213 [FREE Full text] [CrossRef] [Medline]
    53. Short CE, Vandelanotte C, Dixon MW, Rosenkranz R, Caperchione C, Hooker C, et al. Examining participant engagement in an information technology-based physical activity and nutrition intervention for men: The manup randomized controlled trial. JMIR Res Protoc 2014;3(1):e2 [FREE Full text] [CrossRef] [Medline]
    54. Waters LA, Galichet B, Owen N, Eakin E. Who participates in physical activity intervention trials? J Phys Act Health 2011 Jan;8(1):85-103. [Medline]
    55. Wijnstok NJ, Hoekstra T, Van Mechelen W, Kemper HCG, Twisk JWR. Cohort profile: The Amsterdam Growth and Health Longitudinal Study. Int J Epidemiol 2013 Apr;42(2):422-429 [FREE Full text] [CrossRef] [Medline]
    56. Peters GJY, De Bruin M, Crutzen R. Everything should be as simple as possible, but no simpler: Towards a protocol for accumulating evidence regarding the active content of health behaviour change interventions. Health Psychol Rev 2015;9(1):1-14 [FREE Full text] [CrossRef] [Medline]

    ‎
    BCT: behavior change technique
    BFI: big five inventory
    TIPI: ten-item personality inventory

    Edited by G Eysenbach; submitted 27.02.15; peer-reviewed by L Yardley, A Direito, S Langrial, A DeSmet; comments to author 27.07.15; revised version received 04.09.15; accepted 22.09.15; published 12.11.15

    Copyright

    ©Laura Shanna Belmon, Anouk Middelweerd, Saskia J te Velde, Johannes Brug. Originally published in JMIR Mhealth and Uhealth (http://mhealth.jmir.org), 12.11.2015.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR mhealth and uhealth, is properly cited. The complete bibliographic information, a link to the original publication on http://mhealth.jmir.org/, as well as this copyright and license information must be included.