Skip to main content
Download PDF
  • Research article
  • Open access
  • Published:

Generic medicines: an evaluation of the accuracy and accessibility of information available on the internet

BMC Medical Informatics and Decision Making volume 13, Article number: 115 (2013) Cite this article

Abstract

Background

Internationally, generic medicines are increasingly seen as a key strategy to reduce healthcare expenditure, therefore awareness and knowledge transfer regarding generic medicines are valid areas of research. Although the Internet is a frequently used source of medical information, the accuracy of material found online is variable. The aim of this study was to evaluate information provided on the Internet regarding generic medicines in terms of quality of information and readability.

Methods

Internet searches for information regarding generic medicine were completed, with a pre-defined search term, using the Google search engine, in five English-speaking geographical regions (US, UK, Ireland, Canada and Australia). Search results likely to be looked at by a searcher were collated and assessed for the quality of generic medicine-related information in the websites, using a novel customised Website Quality Assessment (WQA) tool; and for readability, using existing methods. The reproducibility of the tools between two independent reviewers was evaluated and correlations between WQA score, readability statistics and Google search engine results page ranking were assessed.

Results

Wikipedia was the highest-ranking search result in 100% of searches performed. Considerable variability of search results returned between different geographical regions was observed, including that websites identified in the Australian search generated the highest number of country specific websites; searches performed using computers with Irish, British, American and Canadian IP addresses appear to be more similar to each other than the google.com search performed in Australia; and the Canadian google.ca results show a notable difference from any of the other searches. Of the 24 websites assessed, none scored a perfect WQA score. Notably, strong correlation was seen between WQA and readability scores and ranking on google.com search results.

Conclusions

This novel evaluation of websites providing information on generic medicines showed that, of the websites likely to be seen by a searcher, none demonstrated a combination of scoring highly on quality of information (as evinced by WQA score) and readability. Therefore, there is a gap in online knowledge provision on this topic which, if filled by a website designed using the WQA tool developed in this study, has an improved likelihood of ranking highly in google.com search results.

Peer Review reports

Background

The Internet has become a source of medical information for patients and healthcare professionals alike. However, the accuracy of information found online may not always necessarily be relied on, and concerns have been raised about the quality of information that may be found, by patients, on the Internet [1–3]. With healthcare costs soaring, many governments are increasingly making use of generic medicines to constrain expenditure. Additionally, many commonly used proprietary medicines have recently, or will in the near future, hit the so-called “patent cliff” – thus enabling generic competition [4–6]. As a result, patients are increasingly likely to be prescribed generic medicines, possibly in place of more familiar proprietary brands. When a patient has medical or healthcare queries, such as questions about generic medicines, the Internet is likely to be one of the first places they will seek information [7]. Therefore, the question should be asked: Is information available on the Internet regarding generic medicines accurate, accessible and of good quality? (For the purposes of this study, the term “accessibility” is used in the context of how readable and understandable the information provided is to the lay reader).

Studies have assessed the use, quality and/or availability of medical/healthcare information available on the Internet in areas as diverse as: inflammatory bowel disease [8], orthodontistry, [9, 10] pain, [11] cancer, [12–14] and mental health, [15, 16] amongst many others. Such studies often limit themselves to assessing available information in particular countries [17–20]. As many misconceptions exist about generic medicines, and given that healthcare professionals have expressed poor opinions of generics in the past, [21] there is a challenge in ensuring that accurate and relevant information is communicated to the general public. This challenge includes not only the necessity to provide accurate information, to dispel myths and to counter misinformation, but also to present material in a manner that is accessible to the intended audience. It has been reported that, in the case of patients particularly, myths and questions remain about generic medicines, and that accurate information can be difficult to source [22].

The aim of this study was to evaluate the availability of information on the Internet regarding generic medicines. This study additionally assessed whether the information in websites likely to be looked at by patients is accurate (as measured by use of a website quality assessment (WQA) tool) and accessible (as determined by readability and understandability statistics). While much information exists on research into the provision of medical information on the Internet, to the authors’ knowledge, no evaluation has been published specifically regarding quality and accessibility of information on generic medicines. This study aimed to bridge that knowledge gap while evaluating availablity and accessibility of that information in several English-speaking countries.

Methods

Choice of search engine

StatCounter, a web analytics company, reported in their “GlobalStats graph” that - for the 12 month period from Jan 2012 to Jan 2013 - Google was the most commonly used search engine globally, holding approximately 90% of the worldwide search engine market [23]. Therefore, as Google is the search engine of choice globally, Google was the search engine used for this study.

Choice of search term

A patient wishing to make an Internet enquiry about a generic medicine is likely to use either the term “generic drug”, or “generic medicine” as their search term. To accommodate both of these, the search term used for this study was “generic medicine OR drug” (without the quotation marks, and with the “OR” capitalised).

The reasoning for this is that Google’s default behaviour is to consider all the words in a search. In order to allow either of the words “drug” or “medicine” to be searched for, the “OR” operator can be used (the OR must be in CAPS). With this search, Google will return SERP (search engine results page) hits that contain the word “generic” and either of the words “drug” or “medicine”. Without the “OR” operator, Google would only return pages that have both the words “drug” and “medicine” on the page, as the “AND” operator is the default [24].

All searches were performed during March and April of 2012.

Inclusion of web sites

A study from 2008 showed that 68% of search engine users click a search result within the first page of results (the default for Google is 10 results per page), and are unlikely to go to the second page of results [25, 26]. Therefore, following a search using the defined search term, the results on the first SERP returned that met the following inclusion criteria were assessed: (i) web site written in English; (ii) web site not being a portal providing links to third party sites; (iii) web site not a news story (e.g., as found by Google news search); (iv) web site not a sales website and (v) website not spurious and being related to the topic of generic medicines.

Determination of global variability

To assess global variability, searches were performed in regional Google search engines, google.ie (Ireland), google.co.uk (United Kingdom), google.ca (Canada), and google.com.au (Australia) in additional to the main US site: google.com.

To assess if Internet Protocol (IP) addresses have any impact on the results obtained, searches were also performed using google.com, on computers in the following five regions: Ireland, United States, Great Britain, Australia, and Canada.

IP stands for “Internet Protocol”. Every device (e.g., computer, tablet, printer etc.) on a computer network has a unique, numeric identifier called an IP address. Similarly to how someone sending a letter would write the intended address on the envelope, a computer’s IP address is used to identify and locate that specific device on a computer network, or on the Internet [27].

Overall, two searches (that is: on the local and .com sites) were performed on computers with an IP address in each of the five regions above, meaning that a total of nine searches were completed.

Assessment of quality of information

The questions in Table 1 – Website Quality Assessment (WQA) Questions for Website Information were asked in relation to each website. The WQA tool was developed for this study as, to the authors’ knowledge, no previous assessment of websites providing information about generic medicines had been published. The WQA tool consists of 22 yes/no type questions, with a point awarded for positive or correct information. No points are awarded where information was lacking, or for inaccurate information. Questions that could not be answered were designated “not applicable” (N/A) and no score awarded. An overall WQA score for each website was totalled from the scores given to each assessment question. (In some cases, just the initial page linked to in the Google search was assessed, however, in the cases where clear and relevant links to other pages containing information of interest within the same website were obvious to the searcher, these were also assessed).

Table 1 Website quality assessment (WQA) questions for assessing generic medicine website information
Full size table

The WQA questions were designed to account for all of the information that a patient might need in order to accurately answer any questions they may have about generic drugs, for example: an explanation as to what a generic drug is and how it differs from a proprietary drug – including price, appearance etc.; explanation of bioequivalence; examples of generic drugs and their proprietary counterparts; information regarding when generic substitution may not be appropriate – e.g., in the case of narrow therapeutic index drugs and any pros or cons of generic medicines.

Assessment of website accessibility

A minimum of a 100-word sample of continuous text from each of the websites was extracted and pasted into Microsoft Word. This text was then analysed using the Flesch Reading Ease score [28] in the MS Word application.

MS Word’s Flesch Reading Ease score is based on a formula developed in 1948 by Rudolf Flesch and determines readibility [28]. It is computed using the average number of syllables per word and words per sentence. Syllables-per-word is a measure of word difficulty. Words-per-sentence is an indicator of syntactic complexity.

The Flesch Reading Ease scale ranges from zero to 100. Zero to 50 is very difficult to difficult reading. Eighty and above is easy to very easy reading. Flesch set the minimum score for plain English at 60 [28]. Microsoft’s documentation encourages authors of standard documents to aim for a score of 60 to 70 [29, 30].

Additionally, the Flesch-Kincaid Grade Level was used to determine the understandability of each website. The Flesch-Kincaid Grade Level, which was developed in 1975, measures the readability of a document based on the minimum education level required for a reader to understand it [31]. Microsoft recommends aiming for a Flesch-Kincaid score of 7.0 to 8.0 for most documents. According to a 1993 study, the average adult in the U.S. reads at the seventh- grade level and the authors of that study recommended that materials for the public be written at a fifth- or sixth-grade reading level [29].

Statistical analyses

Two reviewers rated each selected website independently and their scores were compared to assess reproducibility of the WQA tool and the readability assessments. Using Statistical Packages for the Social Sciences (version 20.0), the intra-class correlation coefficient (ICC) was used to measure reproducibility. Spearman’s correlation coefficient (rs) was used to measure the association between the ranking of websites with WQA scores and readability assessments. Absolute values of rs > 0.3 were considered to represent moderate correlations, > 0.5 were considered strong correlations. The scores from the developer of the assessment tool (SD) were used in the correlation analyses. The correlation between ranking of websites and WQA scores was also used to demonstrate the predictive validity of this newly developed assessment tool.

Results

Determination of websites for assessment

Thirty-eight (38) unique hits (i.e. individual search results) were identified from the first SERPs of the nine searches performed. Of these, 15 hits were discarded for the reasons described in the methodology or were amalgamated with another hit. (For example, the website entitled: EGA - Basics of generic medicines was a hit on both of the IE searches. Additionally, the main EGA website was a hit on the google.co.uk search. As both relate to the same website, the results were combined into one and the EGA website assessed as a single site, rather than individual pages).

An additional website – entitled Generics Are The Same - was added during the rating exercise as it was directly referred to in the Canadian Generic Pharmaceutical Association website and is also published by the Canadian Generic Pharmaceutical Association. As the Generics Are The Same website is the explanatory arm of the Canadian Generic Pharmaceutical Association website it was decided to also assess this website as a patient accessing the first website is very likely to follow links through to the second. This was the only example of an associated website being assessed.

Overall, a total of 24 individual websites were assessed using the WQA tool. Results of the assessments for each of the 24 websites are displayed in Table 2, which additionally shows the ranking on the Google search results page for each website assessed, in each of the individual domain searches.

Table 2 Websites assessed with their rankings on the different google searches and website quality assessment (WQA) score
Full size table

Analysis of websites from search results

Visual analysis of the search results (Table 2), including comparison of the international searches, showed that Wikipedia (a collaboratively edited, multilingual, free Internet encyclopedia supported by the non-profit Wikimedia Foundation) was the number one ranked search result in all searches completed. This is consistent with findings in other studies [32, 33] including a study reporting that Wikipedia is the 6th most accessed website on the Internet globally [34] and, therefore, likely to be visited by those seeking medical information.

After Wikipedia, the following five websites were the most likely to be used by searchers, based on the search terms used in this study:

  • About.com’s page entitled Generic Drugs: Know the Benefits and Differences of Generic Drugs

  • MedicineNet.com’s page: Generic Drugs, Are They as Good as Brand Names?

  • The US Food and Drug Administration (FDA)’s page entitled Understanding Generic Drugs

  • NetDoctor.co.uk’s page entitled Branded and generic medicines

  • The World Health Organisation’s page: Generic Drugs

These six websites (Wikipedia and the five others above that appear most often) all appear in at least six of the nine searches completed (Table 2).

SERPs returned to searchers during this study demonstrate that a search, using identical search terms and performed in the local Google search engine, compared to that performed on the same computer (i.e., same IP address) but in the google.com domain, can provide substantially different results (Table 2). Other notable observations from Table 2 include that the European Generic Medicines Association (EGA) website was a hit in three of the four searches conducted in Europe (it was not a result in the google.com UK search) but was not seen in any of the other searches. This could indicate a possible regional variance. However, the FDA website (an American website) was a hit in all searches, with the exception of the Canadian google.ca search (it was a hit in the Canadian google.com search). Additionally, it was noted that the results of the Australian searches had the highest level of country/domain specific websites with six unique hits observed between the Australian google.com and google.com.au searches that were not seen elsewhere.

The google.com searches performed using computers with Irish, British, American and Canadian IP addresses appear to be more similar to each other than the google.com search performed in Australia. The Australian google.com profile is noticeably different from the other search results with two unique websites not present in the other google.com searches.

Interestingly, the Canadian google.ca results show a distinct difference from any of the other searches due to the absence of most of the websites seen in other regional searches, with the exception of Wikipedia and Canadian websites.

WQA scores

The WQA tool (Table 1) employed 22 yes/no type questions to assess the quality of information contained in each website. From a maximum available score of 22, the highest score awarded was 17 - awarded to two websites: (i) Netdoctor.co.uk – Branded and generic medicines and (ii) The Irish National Information Centre’s publication - Generic Prescribing (websites numbered 5 and 9 respectively in Table 3). However, only the Netdoctor.co.uk site was also in the top six sites indicated by the Google search rankings. The Irish National Information Centre’s publication was a result only in the google.ie (Irish IP address) search, and its likelihood of being seen outside Ireland considered small.

Table 3 WQA assessed website titles and associated URLs
Full size table

WQA scores of 16 (the second highest WQA score awarded) were given to three websites: (i) Wikipedia’s Generic drug page, the highest ranking website by Google search result, (ii) About.com’s page entitled Generic Drugs: Know the Benefits and Differences of Generic Drugs and (iii) the FDA’s Understanding Generic Drugs (websites numbered 1, 2, and 4 respectively in Table 3). All three websites were situated in the top six websites most observed in the Google SERPs obtained.

The remaining two sites seen in the top six most highly returned websites scored WQA scores of 11 (MedicineNet page, website number 3 in Table 3) and 10 (WHO page, website number 6 in Table 3), indicating that the extent and quality of information in these websites is less than the other four top results, and considerably lower than some of the other websites assessed in this study. This indicates that some websites likely to be seen by searchers contain the relatively poorer or less accurate information on generic medicines.

The association between WQA score and Google search ranking was investigated and a moderate to strong correlation (defined as an absolute value of Spearman’s correlation coefficient > 0.3) was found for searches done in the google.com domain (Figure 1 and Table 4). The most commonly identified websites, i.e., ranked 1, 2 etc., tended to have higher WQA scores. No such correlation was found in the local searches (i.e., google.ie/.co.uk/.ca and .com.au).

Figure 1
figure 1

Scatterplots of WQA score, Reading Ease score and Grade level against website ranking on US google.com search.

Full size image
Table 4 Correlation between WQA, reading ease score and grade level with ranking using Spearman’s correlation coefficient (r s )
Full size table

Accessibility scores

A Flesch Reading Ease score of 60 or greater and a Flesch Kinkaid Grade Level of less than 8 are recommended for general ease of reading.

Three of the websites assessed had a Reading Ease score of greater than or equal to 60: (i) Rx List – Facts about Generic Drugs, (ii) Generic Drugs – The same Medicine for Less Money and (iii) Generic vs Brand Name Medicines (numbered 7, 19, and 13 respectively, in Table 3).

Five of the assessed websites had Grade Level scores of 8 or less: (i) RxList – Facts About Generic Drugs, (ii) Generic Drugs – The Same Medicine for Less Money, (iii) Benefiting from Generic Drug Competition in Canada: The Way Forward, (iv) Generic vs Brand Name Medicines, and (v) Generic Drugs: Know the Benefits and Differences of Generic Drugs – about.com (numbered 7, 19, 18, 13, and 2 respectively, in Table 3).

Therefore, as the three websites with the best Reading Ease scores (numbered 7, 19 and 13, respectively, in Table 3) also have appropriate Grade Level scores, it can be determined that those three websites would be the easiest for a member of the public, without a scientific background, to read and understand. However, as those three websites scored relatively low with respect to quality of information they contained - with WQA scores of 9, 10, and 9 respectively (Figure 2) – our study could not assess a site with good readability statistics and containing high quality information. However, analogously to what was demonstrated for WQA scores, Reading Ease scores also demonstrated a relationship with ranking on Google searches. Results from this study indicated that easier to read websites rank higher in Google.com search rankings (Figure 1 and Table 4). Finding statistically significant correlations was limited by the small sample sizes (at most 10 websites in each domain) but a statistically significant correlation was found for the US google.com search (rs = −0.64, p = 0.048). The top ranked sites in all domains also had lower Flesch Kinkaid Grade Level scores (Figure 1 and Table 4).

Figure 2
figure 2

Scatterplots of readability assessments against WQA score (n = 24 websites). Note: the numbers refer to website titles in Table 3.

Full size image

Reproducibility

Comparing scores of two independent reviewers (SD and NC) show that, for WQA assessments, almost perfect agreement was seen on average (ICC = 0.94). Similar analysis of readability of the websites using Flesch Reading Ease score and Flesch-Kinkaid Grade Level showed moderate to strong levels of agreement between the two reviewers (ICC value = 0.71 and 0.63, respectively).

Readability scores were assessed by taking a section of text from the website and calculating readability statistics using MS Word. As each rating was independent, different sections of text were likely to be selected from each of the websites assessed. This variation is likely to account for the lower levels of agreement for the reading assessments, compared to the WQA tool. Given the subjectivity of this type of readability assessment, it is reasonable that a moderate consistency was observed throughout the websites assessed.

Overall, the WQA and readabilty scores demonstrate acceptable reproducibilty between two reviewers.

Discussion

This novel study is the first to assess the websites most likely to be read by a patient searching the Internet for information about generic medicines. More specifically, using the WQA tool developed here, we determined that those websites were all lacking at least some of the information that the authors considered appropriate and relevant for inclusion. However, notably, none of the websites appeared to contain purposefully inaccurate information (as determined by the WQA tool); rather they lacked information that was considered important and that would have gained the website a higher score in our assessments.

Use of Wikipedia as a primary source of information is prevalent and increasing worldwide, [33, 34] despite known shortcomings and criticisms, [2, 35], including bias and the potential for the information it contains to be corrupted. With use of Wikipedia by clinicians as well as medical students increasing, [35] (and ease of access and ease of understanding being the main reasons cited for its usage amongst medical students), [36] it is reasonable to expect that patients also access this this resource when searching for medical information. Very pertinent to this, is the fact that Wikipedia is available in both English and Simple English – where the Simple version is intended to be more accessible by use of simplified language and limited vocabulary. Indeed, guidelines provided by Wikipedia on writing of Simple information may be useful to those interested in distributing medical information to the general public [37, 38].

Recognition of Wikipedia’s prevalence has sparked debate as to whether clinicians should engage in editing Wikipedia to help provide accurate information to patients [39, 40]. As the results of this study indicate that patients searching for information on generic medicines in each of the subject countries are likely to find Wikipedia as the first result (Table 2), there appears to be an onus on governments or government-provided healthcare systems to engage with Wikipedia in order to ensure that the information contained therein is impartial as well as accurate. Indeed, given the prevalence of internet –derived information and social networking associated with “web 2.0”, [41] this is an area likely to increase in importance in the future.

Of the other five websites which were most likely to be accessed by a searcher (see Table 2), about.com is a resource website containing articles and other information organized into “channels” on various topics. Freelance writers, referred to as “Guides”, author the articles. About.com differs from Wikipedia in that it does not allow editing by anyone, and it makes use of advertising. The about.com website pages assessed in this study were written by a “patient empowerment guide” without, according to the website, a scientific or medical background. In addition, this website contained frequent, prominent advertising placed in close proximity to the article information, making it possible for searchers to confuse actual information provided with advertising content. The MedicineNet website contained similar levels of advertising to those seen in about.com. However, the author and editor of this page held MD and PhD degrees, respectively, which may endow more credibility. Nonetheless, this website was ranked in the lowest two of the six websites most likely to be seen by searchers, with a WQA score of 11 (see Table 2). The FDA’s page Understanding Generic Drugs is a resource likely to be trusted by patients as it is written by the US pharmaceutical regulator. The lack of advertisements also lends the website a more professional, and possibly trustworthy, appearance than some of the other websites assessed during this study. The netdoctor.co.uk information on generic medicines, awarded the highest WQA score calculated, was written by a pharmacist. This, as with MedicineNet, may add weight to the website’s content content in a searcher’s opinion. While there are a small number of adverts on this site, they are not as close to the information or as obvious as in other websites discussed above. Finally, the WHO website, while being a reputable source which is likely to be recognised, trusted and possibly even sought out by searchers, unfortunately contains relatively little information useful to the general public when seeking information on generic medicines. Indeed, this was the lowest WQA scoring website of the six most likely to be viewed by searchers. Moreover, it scored low for readability, again reducing the likelihood of it being used by the general public. Interestingly, 7 of the 15 websites that were discarded (i.e., not assessed by WQA) were sales websites. This suggests strongly that a searcher looking for information about generics may encounter a high number of websites selling generic medicines, representing a potential patient safety/public health risk given current concerns with counterfeit medicines being sold online [42]. Only one other website received the highest awarded WQA score (of 17) – a bulletin published by the National Medicines Information Centre at St. James’s hospital in Dublin, Ireland. While the information in this article was of high quality, its readability scores were relatively low. This is probably because the intended audience for this bulletin was healthcare professionals and, thus, the language used in the article would have been appropriate for them. However, while the bulletin provided high quality information, it would have been of little use to a non-scientist. In summary, for websites providing medical information to the general public, quality of information must be allied to language and syntax that matches the reading and comprehension abilities of the intended audience.

In the UK, about 16% of adults are described as “functionally literate”, meaning that they have the literacy levels at or below those expected of an 11-year old [43]. In the Republic of Ireland, the International Adult Literacy Survey revealed that one in four adults have problems with even the simplest of literacy tasks [44], with similar rates being seen in the US [45] and Canada [46]. A key finding of this study was that there is a correlation between good readability statistics and higher ranking on google.com searches (Table 4), indicating that more readable websites are more likely to be found by searchers. However, as the top scoring websites investigated during this study for Reading Ease scored relatively poorly for WQA, we were not able to investigate a website with both good information and good readability. Importantly, the implication is that a searcher looking for information on generic medicines is unlikely to identify a website that is both readable and contains high quality information (as evidenced by a high WQA score). Therefore, there appears to be a gap in knowledge provision that could be filled by a website with high quality information, explaining to the general public specifically what generic medicines are (including dispelling any myths about generic drugs) which is also designed and written to maximize readability. Given the correlations between WQA score and readability statistics and ranking on google.com SERPs evinced by this study, it could reasonably be suggested that (general popularity of sites such as Wikipaedia and the FDA site excepted) such a website would return an enhanced score on a google.com search (across varying IP regions). However, the finding of statistically significant correlations in this study was limited by the small sample sizes, as the study was designed to mimic how a typical searcher would use results of a Google search (i.e., not going beyond the first page of results) [47]. An interesting question arising from this is: who is responsible for provision of such a website? Is it the responsibly of the State to provide good quality, readable medical information to its citizens? Or should it fall to private stakeholders to provide such a service?

Conclusions

Recommendations from a 2010 report on the proposed model for introduction of generic substitution and reference pricing in Ireland stated that communication of information about generic medicines to the general public would be key for the success of the proposed changed in the Irish healthcare system [48]. Whatever the answer, many patients using the Internet for medical information do not differentiate between high- and low-credibility sources of information when perceiving the quality of the information provided [49] and, therefore, it is clear that medical information websites need to be assessed for quality of information and readability by the intended audience before they are published on the Internet. The WQA tool developed during this evaluation of generic medicine-related site proved effective and relatively easy-to-use in that context, and may, if adapted, be suitable for assessment of other types of medical/healthcare information websites [50].

Abbreviations

AU:

Australia

CA:

Canada

EGA:

European generic medicines association

FDA:

Food and drug administration

ICC:

Intraclass correlation coefficient

IE:

Ireland

IP:

Internet protocol

SERP:

Search engine results page

UK:

United Kingdom

US:

United States

WHO:

World health organisation

WQA:

Website quality assessment.

References

  1. Showghi NN, Williams AC: Information about male chronic pelvic and urogenital pain on the internet: an evaluation of internet resources. Pain Med. 2012, 13 (10): 1275-1283. 10.1111/j.1526-4637.2012.01466.x.

    Article  PubMed  Google Scholar 

  2. Adams SA: Revisiting the online health information reliability debate in the wake of “web 2.0”: an inter-disciplinary literature and website review. Int J Med Inform. 2010, 79 (6): 391-400. 10.1016/j.ijmedinf.2010.01.006.

    Article  PubMed  Google Scholar 

  3. Wong LM, Yan H, Margel D, Fleshner NE: Urologists in cyberspace: a review of the quality of health information from American urologists’ websites using three validated tools. Can Urol Assoc J. 2013, 7 (3–4): 100-107.

    PubMed  PubMed Central  Google Scholar 

  4. Cahn L: Focus on the patent cliff to maximize generic savings. Manag Care. 2012, 21 (11): 28-32.

    PubMed  Google Scholar 

  5. Schommer JC: Going over the patent cliff. Minn Med. 2011, 94 (10): 42-43.

    PubMed  Google Scholar 

  6. Harrison C: Patent watch: the patent cliff steepens. Nat Rev Drug Discov. 2011, 10 (1): 12-13.

    Article  CAS  PubMed  Google Scholar 

  7. Diaz J, Griffith R, Ng J, Reinert S, Friedmann P, Moulton A: Patients’ use of the internet for medical information. J Gen Intern Med. 2002, 17 (3): 180-185. 10.1046/j.1525-1497.2002.10603.x.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Langille M, Bernard A, Rodgers C, Hughes S, Leddin D, van Zanten SV: Systematic review of the quality of patient information on the internet regarding inflammatory bowel disease treatments. Clin Gastroenterol Hepatol. 2010, 8 (4): 322-328. 10.1016/j.cgh.2009.12.024.

    Article  PubMed  Google Scholar 

  9. Livas C, Delli K, Ren Y: Quality evaluation of the available Internet information regarding pain during orthodontic treatment. Angle Orthod. 2013, 83 (3): 500-506. 10.2319/052512-435.1. doi: 10.2319/052512-435.1

    Article  PubMed  Google Scholar 

  10. Fraval A, Ming Chong Y, Holcdorf D, Plunkett V, Tran P: Internet use by orthopaedic outpatients - current trends and practices. Australasian Med J. 2012, 5 (12): 633-638.

    Article  Google Scholar 

  11. Colon Y: Searching for pain information, education, and support on the internet. J Pain Palliat Care Pharmacother. 2013, 27 (1): 71-73. 10.3109/15360288.2012.758218. doi: 10.3109/15360288.2012.758218

    Article  PubMed  Google Scholar 

  12. Peterson MW, Fretz PC: Patient use of the internet for information in a lung cancer clinic. Chest J. 2003, 123 (2): 452-457. 10.1378/chest.123.2.452.

    Article  Google Scholar 

  13. Helft PR, Eckles RE, Johnson-Calley CS, Daugherty CK: Use of the internet to obtain cancer information among cancer patients at an urban county hospital. J Clin Oncol. 2005, 23 (22): 4954-4962. 10.1200/JCO.2005.09.621.

    Article  PubMed  Google Scholar 

  14. Vordermark D, Kölbl O, Flentje M: The internet as a source of medical information investigation in a mixed cohort of radiotherapy patients. Strahlenther Onkol. 2000, 176 (11): 532-535. 10.1007/PL00002322.

    Article  CAS  PubMed  Google Scholar 

  15. Powell J, Clarke A: Internet information-seeking in mental health: population survey. Br J Psychiatry. 2006, 189 (3): 273-277. 10.1192/bjp.bp.105.017319.

    Article  PubMed  Google Scholar 

  16. Lissman TL, Boehnlein JK: A critical review of internet information about depression. Psychiatr Serv. 2001, 52 (8): 1046-1050. 10.1176/appi.ps.52.8.1046.

    Article  CAS  PubMed  Google Scholar 

  17. Alsaadi MM: Evaluation of internet use for health information by parents of asthmatic children attending pediatric clinics in Riyadh, Saudi Arabia. Ann Saudi Med. 2012, 32 (6): 630-636.

    PubMed  Google Scholar 

  18. Agricola E, Gesualdo F, Pandolfi E, Gonfantini MV, Carloni E, Mastroiacovo P, Tozzi AE: Does googling for preconception care result in information consistent with international guidelines? A comparison of information found by Italian women of childbearing age and health professionals. BMC Med Inform Decis Mak. 2013, 13 (1): 14-10.1186/1472-6947-13-14.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Gondim AP, Weyne DP, Ferreira BS, Gondim AP, Weyne DP, Ferreira BS: Quality of health and medication information on Brazilian websites. Einstein (Sao Paulo, Brazil). 2012, 10 (3): 335-341. 10.1590/S1679-45082012000300014.

    Article  Google Scholar 

  20. Del Giglio A, Abdala B, Ogawa C, Amado D, Carter D, Gomieiro F, Salama F, Shiroma M, Del Giglio A: Quality of internet information available to patients on websites in Portuguese. Rev Assoc Med Bras. 2012, 58 (6): 645-649.

    Article  PubMed  Google Scholar 

  21. Dunne S, Shannon B, Dunne C, Cullen W: A review of the differences and similarities between generic drugs and their originator counterparts, including economic benefits associated with usage of generic medicines, using Ireland as a case study. BMC Pharmacol Toxicol. 2013, 14 (1): 1-10.1186/2050-6511-14-1.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Baumgärtel C: Myths, questions, facts about generic drugs in the EU. Gen Biosimilars Initiat J. 2012, 1 (1): 34-38. 10.5639/gabij.2012.0101.009.

    Article  Google Scholar 

  23. StatCounter Global Stats: http://gs.statcounter.com/ - search_engine-ww-monthly-201201-201301 archived at: http://www.webcitation.org/6HRUtfKkg

  24. Operators and more search help. http://www.google.com/support/websearch/bin/answer.py?answer=136861 - exceptions Archived at: http://www.webcitation.org/6HRbOiNNf

  25. Eysenbach G, Kohler C: How do consumers search for and appraise health information on the world wide web? Qualitative study using focus groups, usability tests, and in-depth interviews. BMJ. 2002, 324 (7337): 573-577. 10.1136/bmj.324.7337.573.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Hansen DL, Derry HA, Resnick PJ, Richardson CR: Adolescents searching for health information on the Internet: an observational study. J Med Internet Res. 2003, 5 (4): e25-10.2196/jmir.5.4.e25.

    Article  PubMed  PubMed Central  Google Scholar 

  27. What is an IP address?. http://www.howstuffworks.com/internet/basics/question549.htm Archived at: http://www.webcitation.org/6HRVBXxMe

  28. Flesch R: A new readability yardstick. J Appl Psychol. 1948, 32 (3): 221-233.

    Article  CAS  PubMed  Google Scholar 

  29. Using Microsoft Word’s Readability Program. http://www.michbar.org/journal/pdf/pdf4article1467.pdf; Archived at: http://www.webcitation.org/6FBcYBYCa

  30. Test your document’s readability. http://office.microsoft.com/en-us/word-help/test-your-document-s-readability-HP010148506.aspx Archived at: http://www.webcitation.org/6FBcwjzei

  31. Kincaid JP, Fishburne RP, Rogers RL, Chissom BS: Derivation of New Readability Formulas (Automated Readability Index, Fog Count and Flesch Reading Ease Formula) for Navy Enlisted Personnel. 1975, Springfield, Virginia: National Technical Information Service, 22151-

    Google Scholar 

  32. Law MR, Mintzes B, Morgan SG: The sources and popularity of online drug information: an analysis of top search engine results and web page views. Ann Pharmacother. 2011, 45 (3): 350-356. 10.1345/aph.1P572.

    Article  PubMed  Google Scholar 

  33. Laurent MR, Vickers TJ: Seeking health information online: does Wikipedia matter?. J Am Med Inform Assoc. 2009, 16 (4): 471-479. 10.1197/jamia.M3059.

    Article  PubMed  PubMed Central  Google Scholar 

  34. Top 500 Global Sites. http://www.alexa.com/topsites Archived at: http://www.webcitation.org/6FBdafLXI

  35. Judd T, Kennedy G: Expediency-based practice? Medical students’ reliance on Google and Wikipedia for biomedical inquiries. Br J Educ Technol. 2011, 42 (2): 351-360. 10.1111/j.1467-8535.2009.01019.x.

    Article  Google Scholar 

  36. Allahwala UK, Nadkarni A, Sebaratnam DF: Wikipedia use amongst medical students – new insigh1ts into the digital revolution. Med Teach. 2013, 35 (4): 337-doi: 10.3109/0142159X.2012.737064

    Article  PubMed  Google Scholar 

  37. Wikipedia: How to write Simple English pages. [http://simple.wikipedia.org/wiki/Wikipedia:How_to_write_Simple_English_pages Archived at: http://www.webcitation.org/6FBdd9Tea]

  38. Yasseri T, Kornai A, Kertesz J: A practical approach to language complexity: a Wikipedia case study. PloS one. 2012, 7 (11): e48386-10.1371/journal.pone.0048386.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  39. Kint M, Hart DP: Should clinicians edit Wikipedia to engage a wider world web?. BMJ. 2012, 345: e4275-10.1136/bmj.e4275. doi: 10.1136/bmj.e4275

    Article  CAS  PubMed  Google Scholar 

  40. Heilman JM, Kemmann E, Bonert M, Chatterjee A, Ragar B, Beards GM, Iberri DJ, Harvey M, Thomas B, Stomp W, Martone MF, Lodge DJ, Vondracek A, de Wolff JF, Liber C, Grover SC, Vickers TJ, Mesko B, Laurent MR: Wikipedia: a key tool for global public health promotion. J Med Internet Res. 2011, 13 (1): e14-10.2196/jmir.1589.

    Article  PubMed  PubMed Central  Google Scholar 

  41. Chou WY, Prestin A, Lyons C, Wen KY: Web 2.0 for health promotion: reviewing the current evidence. Am J Public Health. 2013, 103 (1): e9-e18. 10.2105/AJPH.2012.301071.

    Article  PubMed  PubMed Central  Google Scholar 

  42. Mackey TK, Liang BA: The global counterfeit drug trade: patient safety and public health risks. J Pharm Sci. 2011, 100 (11): 4571-4579. 10.1002/jps.22679.

    Article  CAS  PubMed  Google Scholar 

  43. How many illiterate adults are there in England?. http://www.literacytrust.org.uk/adult_literacy/illiterate_adults_in_england Archived at: http://www.webcitation.org/6FBdF9w4m

  44. Literacy in Ireland. http://www.nala.ie/literacy/literacy-in-ireland Archived at: http://www.webcitation.org/6FBdJlGwy

  45. IALS Results. http://nces.ed.gov/surveys/all/results.asp Archived at: http://www.webcitation.org/6FBdNgMBd

  46. Adult Literacy in OECD Countries: Technical Report on the First International Adult Literacy Survey. http://nces.ed.gov/pubs98/98053.pdf Archived at: http://www.webcitation.org/6FBdTjIDu

  47. iProspect: Blended Search Results Study. 2008, iProspect website: iProspect,http://www.herramientas-seo.com/pdf/estudio-buscadores-iprospect.pdf,

    Google Scholar 

  48. Proposed Model for Reference Pricing and Generic Substitution. http://www.dohc.ie/publications/pdf/reference_pricing_generic_substitution.pdf?direct?=?1 Archived at: http://www.webcitation.org/6FD1WRh1e

  49. Bates BR, Romina S, Ahmed R, Hopson D: The effect of source credibility on consumers’ perceptions of the quality of health information on the internet. Med Inform Internet Med. 2006, 31 (1): 45-52. 10.1080/14639230600552601.

    Article  PubMed  Google Scholar 

  50. Dunne S, Cummins N, Hannigan A, Shannon B, Dunne C, Cullen W: A Method for the Design and Development of Medical or Health Care Information Websites to Optimize Search Engine Results Page Rankings on Google. Journal of medical Internet research. 2013, 15 (8):

Pre-publication history

Download references

Acknowledgements

The authors would like to thank Ms. YT Chueh and Dr. Phil Hensche for their help in performing the US and Australian searches, respectively.

This work was supported in part by a scholarship from the Faculty of Education and Health Sciences, University of Limerick, Ireland.

Author information

Authors and Affiliations

  1. Graduate Entry Medical School, University of Limerick, Limerick, Ireland

    Suzanne S Dunne, Niamh M Cummins, Ailish Hannigan, Bill Shannon, Colum Dunne & Walter Cullen

  2. Centre for Interventions in Infection, Inflammation and Immunity (4i), Graduate Entry Medical School, University of Limerick, Limerick, Ireland

    Ailish Hannigan, Colum Dunne & Walter Cullen

Authors
  1. Suzanne S Dunne
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Niamh M Cummins
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ailish Hannigan
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Bill Shannon
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Colum Dunne
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Walter Cullen
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Suzanne S Dunne.

Additional information

Competing interests

All authors declare that they have no competing interests.

Authors’ contributions

SD conceived of the idea for the research, designed and conducted the analysis, gathered and interpreted the data and drafted, revised and finalised the manuscript. NC aided in data gathering and interpretation and provided critical review of the manuscript. AH completed statistical analysis of the data, provided critical review of the manuscript and final approval of the version to be published. BS provided critical review of the manuscript and final approval of the version to be published. CD provided critical review of the manuscript and final approval of the version to be published. WC provided critical review of the manuscript and final approval of the version to be published. All authors read and approved the final manuscript.

Authors’ original submitted files for images

Below are the links to the authors’ original submitted files for images.

Authors’ original file for figure 1

Authors’ original file for figure 2

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Dunne, S.S., Cummins, N.M., Hannigan, A. et al. Generic medicines: an evaluation of the accuracy and accessibility of information available on the internet. BMC Med Inform Decis Mak 13, 115 (2013). https://0-doi-org.brum.beds.ac.uk/10.1186/1472-6947-13-115

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/1472-6947-13-115

Keywords

BMC Medical Informatics and Decision Making

ISSN: 1472-6947

Contact us