Skip to main content
Asian Pacific Journal of Cancer Prevention : APJCP logoLink to Asian Pacific Journal of Cancer Prevention : APJCP
. 2016;17(12):5237–5242. doi: 10.22034/APJCP.2016.17.12.5237

Readability Comparison of Pro- and Anti-Cancer Screening Online Messages in Japan

Tsuyoshi Okuhara 1,*, Hirono Ishikawa 1, Masahumi Okada 1, Mio Kato 1, Takahiro Kiuchi 1
PMCID: PMC5454664  PMID: 28125867

Abstract

Background:

Cancer screening rates are lower in Japan than those in western countries. Health professionals publish pro-cancer screening messages on the internet to encourage audiences to undergo cancer screening. However, the information provided is often difficult to read for lay persons. Further, anti-cancer screening activists warn against cancer screening with messages on the Internet. We aimed to assess and compare the readability of pro- and anti-cancer screening online messages in Japan using a measure of readability.

Methods:

We conducted web searches at the beginning of September 2016 using two major Japanese search engines (Google.jp and Yahoo!.jp). The included websites were classified as “anti”, “pro”, or “neutral” depending on the claims, and “health professional” or “non-health professional” depending on the writers. Readability was determined using a validated measure of Japanese readability. Statistical analysis was conducted using two-way ANOVA.

Results:

In the total 159 websites analyzed, anti-cancer screening online messages were generally easier to read than pro-cancer screening online messages, Messages written by health professionals were more difficult to read than those written by non-health professionals. Claim × writer interaction was not significant.

Conclusion:

When health professionals prepare pro-cancer screening materials for publication online, we recommend they check for readability using readability assessment tools and improve text for easy comprehension when necessary.

Keywords: Cancer screening, readability, anti-cancer screening online messages, pro-cancer screening online messages

Introduction

Cancer screening rates in Japan are lower than those in western countries. The screening rates in 2013 for breast cancer in women aged 50–69 years and for cervical cancer in women aged 20–69 years were 80.8% and 84.5% in the United States, and 75.9% and 78.1% in the United Kingdom, but 41.0% and 42.1% in Japan, respectively (OECD, 2013). Other cancer screening rates in Japan are similarly low: gastric cancer is 39.6%, lung cancer is 42.3%, and colorectal cancer is 37.9% in men and women aged 40–69 years (National Cancer Center, 2013).

Low health literacy (HL) has been recognized as one barrier to cancer screening, and is associated with low cancer screening rates (Oldach and Katz, 2014). HL is the ability to understand health information and to use that information to make good decisions about one’s health and healthcare (Nielsen-Bohlman et al., 2004). HL is determined based on interactions between an individual’s skills and the societal demands in which the individual lives, including the manner in which health information is communicated in society (Institute of Medicine, 2009). Accordingly, health information needs to be communicated in a manner that allows easy access for those with low HL.

In the field of health literacy, health communication accessibility has generally been discussed in terms of readability (Nielsen-Bohlman et al., 2004). “Readability” is defined as “the determination by systemic formulae of the reading comprehension level a person must have to understand written materials” (Albright et al., 1996). Text that is ‘‘readable’’ makes information more accessible and useful by improving comprehension, learning, and retention (Klare, 2000). Further, easy-to-read text is more liked and trusted (Schwarz, 2004; Alter and Oppenheimer, 2009), and generates a more favorable reader attitude (Claypool et al., 2015) than difficult-to-read text. Therefore, cancer screening information should be easy to read.

The internet is an important media to disseminate cancer related information and education (Shahrokni et al., 2014; Tuna et al., 2014; Mohammadzadeh et al., 2016). Approximately 91% of Japanese are regular users of the Internet (Internet World Stats, 2015), and the internet is the one of main sources of cancer screening information in Japan (Tokyo Metropolitan Government Bureau of Social Welfare and Public Health, 2013). To encourage audiences to obtain cancer screening, Ministry of Health, Labour and Welfare, cancer research centers, municipalities and individual physicians publish pro-cancer screening messages on websites, news sites and blogs. However, studies indicate that health professionals often use jargon that are unfamiliar to lay persons (Byrne and Edeani, 1984; Ley, 1998; Castro et al., 2007), and that health information written by health professionals is often written at readability levels that are too high for the majority of the intended recipients (Rudd et al., 2000; Berland, 2001). Further, regrettably, anti-cancer screening activists, who are physicians or self-proclaimed specialists lacking specialized knowledge, propagate on the internet that cancer screening has little or no efficacy, but has a high risk of side effects by radiation exposure, and warn audiences not to obtain cancer screening (e.g., Kondo, 2015; Funase, 2016; Utsumi, 2016).

Considering that over half of Internet users believe that “almost all” or “most” information on health websites is credible (Rice, 2006), the anti-cancer screening online messages can be a barrier to cancer screening. Additionally considering the importance of readability mentioned earlier, it is desirable that pro-cancer screening online messages are easier to read than anti-cancer screening online messages.

Studies have investigated readability of printed cancer materials (Friedman et al., 2004; Grewal and Alagaratnam, 2013), including in Asia-Pacific region (Montazeri and Sajadian, 2004; Akansel and Aydin, 2011; Kim and Lee, 2014; Okuhara et al., 2015). However, no study has assessed readability of cancer screening online messages. In the present study, we aimed to assess and compare the readability of pro- and anti-cancer screening online messages using a measure of readability. We proposed two hypotheses. Hypothesis 1: anti-cancer screening online messages are easier to read than pro-cancer screening online messages. Hypothesis 2: cancer screening online messages written by health professionals are more difficult to read than cancer screening online messages written by non-health professionals.

Materials and Methods

Material collection

We conducted web searches at the beginning of September 2016 using a search formula in Japanese input into Google.jp and Yahoo!.jp (the Japanese version of the search engine); “cancer screening”; “cancer screening” AND (meaningful OR meaningless); “cancer screening” AND (efficacious OR inefficacious); “cancer screening” AND (obtain OR “not obtain”); “cancer screening” AND (danger OR dangerous); “cancer screening” AND (“don’t obtain” OR “you’d better not obtain”); “cancer screening” AND “you must not obtain”. The terms “danger”, “dangerous”, “don’t obtain”, “you’d better not obtain”, and “you must not obtain” were included in these formulae for gathering anti-cancer screening online messages because only the first three formulae did not gather a sufficient number of anti-messages for examination. Google and Yahoo! were chosen because they are the most popular search engines in Japan, accounting for approximately 66% and 29%, respectively, of all Internet searches in August 2016 (StatCounter Global Stats, 2016).

The top 100 results were reviewed for each search formula. Duplications were excluded. Results about prostate cancer screening and positron emission tomography were excluded because they were not recommended as public health services by the Ministry of Health, Labor and Welfare in Japan. Results about gastric, lung, colorectal, breast, and cervical cancer screening were included for analysis if they did not meet any of the following exclusion criteria: (1) bulletin board system or listserv or newsgroup pages or twitter; (2) pages solely containing brief notices about other website content; (3) video results; (4) non-Japanese websites; (5) inactive links; (6) online messages exclusively explaining about cancer screening (e.g., Wikipedia); (7) presentation slides (e.g., Microsoft PowerPoint); (8) online messages without any claims of anti- or pro-cancer screening (e.g., exclusively about time, place and expenses for obtaining cancer screening). The URLs of the included materials were recorded in a Microsoft Excel 2016 spreadsheet.

Material classification

The included materials were classified as “pro” or “anti” depending on the claims: materials that recommended readers to obtain cancer screenings were classified as “pro”, and materials that objected to readers’ obtaining one or more of gastric, lung, colorectal, breast, and cervical cancer were classified as “anti”. Materials that referred to both claims of anti- and pro-cancer screening but did not state their own assertion were classified as “neutral”.

Additionally, materials were classified as “health professional” if they were written by physicians, nurses, pharmacists, and researchers, or were published by pharmaceutical companies, health-care companies, research centers, and hospitals. Conversely, materials were classified as “non-health professional” if they were written by alternative therapists, journalists, and lay individuals. When the materials were published by non-health professionals but their content were exclusively reprinted from articles written by health professionals, they were classified as “health professional”.

Readability assessment

Before readability assessment, materials were edited by removing any URLs and quotations written in English to ensure accurate measurement of Japanese readability. When the included materials comprised multiple pages and included topics other than cancer screening, only the relevant messages were assessed by using a measure of readability.

A validated measure of Japanese readability called the “Japanese text readability measurement system” (JTRMS) (Lee and Hasebe, 2013) was used in the present study. The JTRMS is the most authentic validated measure of Japanese readability. The JTRMS calculates Japanese readability on the basis of average length of sentences, difficulty level of words, and proportion of grammatical parts of speech and types of characters per sentence (Lee, 2011). Scores range from 0.5 to 6.4. A high score indicates that the text is relatively easy to read; 5.5–6.4, very easy; 4.5–5.4, easy; 3.5–4.4, neutral; 2.5–3.4, a little difficult; 1.5–2.4, difficult; 0.5–1.4, very difficult. Scores were determined by using the JTRMS online tool (Lee and Hasebe, 2013). Score results were recorded in a Microsoft Excel 2016 spreadsheet.

Statistical analysis

Distributions and mean readability scores for “anti”, “pro”, “neutral”, “health professional”, and “non-health professional” materials were calculated. Two-way ANOVA was conducted with readability as the dependent variable, and Claim (i.e., pro or anti) and Writer (i.e., health professional or non-health professional) as the two independent variables. Additionally, readability of “pro” materials were compared with that of “anti” materials on the first 10 search results of all search formulae using the two-sample t test, because online health information seekers usually examine the first 10 search results (Eysenbach and Kohler, 2002). P-values were set at 0.05 for all statistical tests. All statistical analyses were performed using SPSS version 21.0 (Chicago, IL, USA).

Results

Characteristics of materials

Collected materials comprised websites or blogs and three independent Facebook pages, collectively labeled as “websites”. Of the 159 total websites that were evaluated, the number of sentences varied from 11 to 953, and the number of letters varied from 232 to 19,986. The numbers of websites by cancer types were as follows; gastric cancer screening, 3; colorectal cancer screening, 9; gastric and colorectal cancer screening, 2; breast cancer screening, 23; cervical cancer screening, 20; breast and cervical cancer screening, 3; breast and colorectal cancer screening, 1; gastric, lung, colorectal, breast and cervical cancer screening, 98.

Distribution by category

Table 1 shows the distribution of websites by category. Up to 75 websites (47.2%) propagated pro-cancer screening messages, 81 websites (50.9%) propagated anti-cancer screening messages, and three websites (3%) were “neutral”. Of the 75 pro-cancer screening websites, 46 were written by health professionals, and 29 were written by non-health professionals. Of the 81 anti-cancer screening websites, 30 were written by health professionals, and 51 were written by non-health professionals.

Table 1.

Distribution of Websites by Category of Claim and Writer

n (%)
Pro-cancer screening Anti-cancer screening Neutral Total
Health professional 46 (29.0) 30 (18.8) 2 (1.3) 78 (49.1)
Non-health professional 29 (18.2) 51 (32.1) 1 (0.6) 81 (50.9)
Total 75 (47.2) 81 (50.9) 3 (1.9) 159 (100)

Readability

Table 2 and Figure 1 show mean readability of websites by category; “neutral” was excluded because its distribution was small. The mean readability of all 159 websites was 2.7 (SD=0.52). ANOVA revealed a main effect of Claim, F (1,152)=24.9, p<.001, MSE=0.201, indicating that anti-cancer screening online messages were easier to read than pro-cancer screening online messages (M=2.9 VS M=2.4). ANOVA also revealed a main effect of Writer, F (1,152)=18.1, p<.001, indicating that cancer screening online messages written by health professionals were more difficult to read than those written by non-health professionals (M=2.4 VS M=2.8). Claim × Writer interaction was not significant, F (1,152)=0.229, p=0.633. Table 3 shows mean readability of websites on higher search results. When the websites that were included from the first 10 search results of all search formulae were measured, anti-cancer screening messages were found to be significantly easier to read than pro-cancer screening messages (M=2.91 VS M=2.27, p=0.003).

Table 2.

Mean Readability of Websites by Category of Claim and Writer

Pro-cancer screening Anti-cancer screening Total
M SD M SD M SD
Health professional 2.29 0.42 2.69 0.44 2.45 0.47
Non-health professional 2.64 0.54 2.97 0.42 2.85 0.49
Total 2.42 0.5 2.87 0.44 2.66 0.52

* A high score indicates that the text is relatively easy to read.

Figure 1.

Figure 1

Mean Readability of Websites by Category of Claim and Writer

Table 3.

Mean Readability of Websites with the First 10 Search Results

Pro-cancer screening Anti-cancer screening
(n=7) (n=15)
M SD M SD p
2.3 0.4 2.9 0.4 0.003*

*, p<0.05; *, A high score indicates that the text is relatively easy to read

Discussion

In the present study, we found that, in Japan, anti-cancer screening online messages were easier to read than pro-cancer screening online messages. Additionally, cancer screening online messages written by health professionals were found to be more difficult to read than those written by non-health professionals. Thus, our hypotheses were supported by the study results.

Studies indicate that easy to read text is more accessible and acceptable than difficult to read text (Klare, 2000; Schwarz, 2004; Alter and Oppenheimer, 2009; Claypool et al., 2015). Therefore, ease of readability of anti-cancer screening online messages that was indicated in the present study may contribute to their acceptance by some audiences. The present study also found that, on the first 10 search results, anti-cancer screening online messages were significantly easier to read than pro-cancer screening ones. The ease of reading of anti-cancer screening messages may influence judgement of reader from the beginning of their web searches. Considering that over half of Internet users believe that “almost all” or “most” information on health websites is credible and state that the information they encounter online influences their treatment decisions (Rice, 2006), anti-cancer screening messages on the Internet and their ease of readability might increase the number of people not obtaining cancer screenings, thereby decreasing cancer screening rates.

Our result was consistent with previous studies indicating that health information written by health professionals was often difficult to read for lay persons (Rudd et al., 2000; Berland, 2001), including in Asia-Pacific region (Akansel and Aydin, 2011; Kim and Lee, 2014). Pro-cancer screening messages may tend to be difficult to read partly because technical terms are often written in Chinese characters such as saibousin (cytodiagnosis) and musakuika hikaku taishousiken (randomized controlled trial) in Japan. However, health professionals can improve pro-cancer screening online messages for easy reading using measures of readability. The JTRMS (Lee and Hasebe, 2013) shows the difficulty level for each word that is used in texts by using colored lettering on a screen. Users can improve the texts and make them easier to read by rewriting difficult words into easy ones. Additionally, long sentences are found at a glance because the JTRMS display all sentences individually in parallel. Users can improve the texts by shortening long sentences.

Of pro-cancer screening online messages, the proportion of messages written by health professionals was larger than that of messages written by non-health professionals. When non-health professionals write pro-cancer screening online messages, they may refer to pro-cancer screening websites written by health professionals. Thus, pro-cancer screening online messages written by health professionals are considered to be influential both in quantity and in quality. If pro-cancer screening online messages written by health professionals become easier to read, those written by non-health professionals may also become easier to read and therefore more easily accepted by audiences. Health professionals are recommended to make efforts to write easier-to-read pro-cancer screening online messages.

The present study has limitations. First, the measures of readability used measure only word difficulty and sentence length and complications. They do not assess impact of factors such as font type, font size, color, white space, and illustrations, which may influence processing fluency.

Second, although an extensive number of websites (n=159) were selected for analysis, it was not feasible to examine the universe of sites for reasons of availability, access, and time. This is especially difficult considering that new websites are created each day, while old ones become inaccessible.

Third, only Japanese-language websites were included in the study. To generalize the results of this study to other countries, the study should be replicated for websites written in languages other than Japanese. Finally, future study is recommended to investigate whether readability of cancer screening online messages influences readers’ attitudes, intentions, and behaviors regarding obtaining cancer screening.

Despite these limitations, this is the first study to assess and compare anti- and pro-cancer screening online messages, with significant implications as mentioned previously.

Readability of written information can be easily assessed by using measures of readability. When health professionals prepare cancer screening materials for publication online, we recommend they check message readability using measures of readability, and improve the text for easy reading if necessary. Writing and disseminating easy-to-read pro-cancer screening online messages is one means of fighting against anti-cancer screening activists for health professionals.

Abbreviation

JTRMS: Japanese text readability measurement system

Funding sources

This study was supported by a JSPS KAKENHI Grant (Number 167100000384).

Conflict of interests

None declared

References

  1. Akansel N, Aydin N. Suitability of Turkish written patient educational materials related to breast cancer. Asian Pac J Cancer Prev. 2011;12:1543–7. [PubMed] [Google Scholar]
  2. Albright J, de Guzman C, Acebo P, et al. Readability of patient education materials: Implications for clinical practice. Appl Nurs Res. 1996;9:139–43. doi: 10.1016/s0897-1897(96)80254-0. [DOI] [PubMed] [Google Scholar]
  3. Alter AM, Oppenheimer DM. Uniting the tribes of fluency to form a metacognitive nation. Pers Soc Psychol Rev. 2009;13:219–35. doi: 10.1177/1088868309341564. [DOI] [PubMed] [Google Scholar]
  4. Berland GK, Elliott MN, Morales LS, et al. Health information on the Internet: Accessibility, quality, and readability in English and Spanish. JAMA. 2001;285:2612–21. doi: 10.1001/jama.285.20.2612. [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. Biermann JS, Golladay GJ, Greenfield ML, Baker LH. Evaluation of cancer information on the Internet. Cancer. 1999;86:381–90. [PubMed] [Google Scholar]
  6. Byrne T, Edeani D. Knowledge of medical terminology among hospital patients. Nurs Res. 1984;33:178–81. [PubMed] [Google Scholar]
  7. Castro C, Wilson C, Wang F, Schillinger D. Babel babble: Physicians’ use of unclarified medical jargon with patients. Am J Health Behav. 2007;31:85–95. doi: 10.5555/ajhb.2007.31.supp.S85. [DOI] [PubMed] [Google Scholar]
  8. Claypool H, Mackie D, Garcia-Marques T. Fluency and attitudes. Soc Personal Psychol Compass. 2015;9:370–82. [Google Scholar]
  9. Eysenbach G, Diepgen TL. Towards quality management of medical information on the internet: Evaluation, labelling, and filtering of information. BMJ. 1998;317:1496–500. doi: 10.1136/bmj.317.7171.1496. [DOI] [PMC free article] [PubMed] [Google Scholar]
  10. Eysenbach G, Kohler C. How do consumers search for and appraise health information on the world wide web? Qualitative study using focus groups, usability tests, and in-depth interviews. BMJ. 2002;324:573–8. doi: 10.1136/bmj.324.7337.573. [DOI] [PMC free article] [PubMed] [Google Scholar]
  11. Eysenbach G, Powell J, Kuss O, Sa ER. Empirical studies assessing the quality of health information for consumers on the world wide web: A systematic review. JAMA. 2002;287:2691–700. doi: 10.1001/jama.287.20.2691. [DOI] [PubMed] [Google Scholar]
  12. Flavell J. Metacognition and cognitive monitoring: A new area of cognitive-developmental inquiry. Am Psychol. 1979;34:906–11. [Google Scholar]
  13. Funase S. Funase HP all over the world. 2016. [Accessed 5 December 2016]. http://funase.net/
  14. Fox S, Duggan M. Health online 2013. Information Triage. 2013. [Accessed 5 September 2016]. http://www.pewinternet.org/2013/01/15/information-triage/
  15. Friedman DB, Hoffman-Goetz L, Arocha JF. Readability of cancer information on the Internet. J Cancer Educ. 2004;19:117–22. doi: 10.1207/s15430154jce1902_13. [DOI] [PubMed] [Google Scholar]
  16. Grewal P, Alagaratnam S. The quality and readability of colorectal cancer information on the internet. Int J Surg. 2013;11:410–13. doi: 10.1016/j.ijsu.2013.03.006. [DOI] [PubMed] [Google Scholar]
  17. Gustafson DH, Robinson TN, Ansley D, Adler L, Brennan PF. Consumers and evaluation of interactive health communication applications. The science panel on interactive communication and health. Am J Prev Med. 1999;16:23–9. doi: 10.1016/s0749-3797(98)00104-4. [DOI] [PubMed] [Google Scholar]
  18. Hellawell GO, Turner KJ, Le Monnier KJ, Brewster SF. Urology and the Internet: An evaluation of Internet use by urology patients and of information available on urological topics. BJU Int. 2000;86:191–4. doi: 10.1046/j.1464-410x.2000.00831.x. [DOI] [PubMed] [Google Scholar]
  19. Hesse BW, Nelson DE, Kreps GL, et al. Trust and sources of health information: The impact of the Internet and its implications for health care providers: Findings from the first health information national trends survey. Arch Intern Med. 2005;165:2618–24. doi: 10.1001/archinte.165.22.2618. [DOI] [PubMed] [Google Scholar]
  20. Institute of Medicine (US) Roundtable on Health Literacy. Measures of health literacy: workshop summary. Washington DC: National Academies Press; 2009. [PubMed] [Google Scholar]
  21. Kim YJ, Lee GE. Evaluation of readability of health leaflets and health literacy of elderly inpatients in a medical center. J Korean Gerontol Nurs. 2014;16:9–17. [Google Scholar]
  22. Klare GR. The measurement of readability: useful information for communicators. ACM J Comput Doc. 2000;24:107–21. [Google Scholar]
  23. Kondo M. Health checkup and cancer screening are useless!The famous Dr. Kondo warns. Shu pre news. 2015. [Accessed 5 December 2016]. http://wpb.shueisha.co.jp/2015/02/20/43779/
  24. Lee JH. The utility of corpora for composing reading comprehension questions for large-scale tests. Teaching Jpn. 2011;148:84–98. [Google Scholar]
  25. Lee JH, Hasebe Y. Japanese text readability measurement system. 2013. [Accessed 5 September 2016]. http://jreadability.net/
  26. Ley P. The use and improvement of written communication in mental health care and promotion. Psychol Health Med. 1998;3:19–53. [Google Scholar]
  27. Lustria MLA. Can interactivity make a difference? Effects of interactivity on the comprehension of and attitudes toward online health content. J Assoc Inf Sci Technol. 2007;58:766–76. [Google Scholar]
  28. Mohammadzadeh Z, Davoodi S, Ghazisaeidi M. Online social networks - opportunities for empowering cancer patients. Asian Pac J Cancer Prev. 2015;17:933–6. doi: 10.7314/apjcp.2016.17.3.933. [DOI] [PubMed] [Google Scholar]
  29. Montazeri A, Sajadian A. Do women read poster displays on breast cancer in waiting rooms? J Public Health. 2004;26:355–8. doi: 10.1093/pubmed/fdh178. [DOI] [PubMed] [Google Scholar]
  30. National Cancer Center Japan. Cancer statistics in Japan, center for cancer control and information services. [Accessed 5 September 2016]. http://ganjoho.jp/reg_stat/statistics/dl/index.html .
  31. Nielsen-Bohlman L, Panzer AM, Kindig DA, editors. Health literacy: a prescription to end confusion. Washington DC: National Academies Press; 2004. [PubMed] [Google Scholar]
  32. OECD Health Statistics. [Accessed 5 September 2016]. http://stats.oecd.org/Index.aspx?DatasetCode=HEALTH_STAT# .
  33. Okuhara T, Ishikawa H, Okada H, Kiuchi T. Readability, suitability and health content assessment of cancer screening announcements in municipal newspapers in Japan. Asian Pac J Cancer Prev. 2014;16:6719–27. doi: 10.7314/apjcp.2015.16.15.6719. [DOI] [PubMed] [Google Scholar]
  34. Oldach BR, Katz ML. Health literacy and cancer screening: a systematic review. Patient Educ Couns. 2014;94:149–57. doi: 10.1016/j.pec.2013.10.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
  35. Rice RE. Influences, usage, and outcomes of Internet health information searching: Multivariate results from the Pew surveys. Int J Med Inform. 2006;75:8–28. doi: 10.1016/j.ijmedinf.2005.07.032. [DOI] [PubMed] [Google Scholar]
  36. Rudd RE, Moeykens BA, Colton TC. Health and literacy: A review of medical and public health literature. In: Comings JP, Garner B, Smith C, editors. In ‘The Annual Review of Adult Learning and Literacy’. San Francisco: Jossey-Bass Publishers; 2000. pp. 158–99. [Google Scholar]
  37. Shahrokni A, Mahmoudzadeh S, Lu BT. In whom do cancer survivors trust online and offline? Asian Pac J Cancer Prev. 2013;15:6171–76. doi: 10.7314/apjcp.2014.15.15.6171. [DOI] [PubMed] [Google Scholar]
  38. Schwarz N, Clore G.L. Feelings and phenomenal experiences. In: Higgins ET, Kruglanski A, editors. In ‘Social psychology: Handbook of basic principles. second edition. New York: Guilford; 2007. pp. 385–407. [Google Scholar]
  39. Schwarz N. Metacognitive experiences in consumer judgment and decision making. J Consum Psychol. 2004;14:332–48. [Google Scholar]
  40. Shon J, Musen MA. The low availability of metadata elements for evaluating the quality of medical information on the World Wide Web. Proc AMIA Symp. 1999:945–9. [PMC free article] [PubMed] [Google Scholar]
  41. StatCounter Global Stats. 2016. [Accessed 5 September 2016]. http://gs.statcounter.com/#all-search_engine-JP-monthly-201608-201608-bar .
  42. Tokyo Metropolitan Government Bureau of Social Welfare and Public Health. Tokyo cancer prevention and examination factual survey report 2013. Tokyo: Tokyo Metropolitan Government Bureau of Social Welfare and Public Health; 2013. [Google Scholar]
  43. Tuna A, Avdal EU, Yucel SC, et al. Effectiveness of online education in teaching breast self-examination. Asian Pac J Cancer Prev. 2014;15:3227–31. doi: 10.7314/apjcp.2014.15.7.3227. [DOI] [PubMed] [Google Scholar]
  44. Tversky A, Kahneman D. Availability: A heuristic for judging frequency and probability. Cogn Psychol. 1973;5:207–32. [Google Scholar]
  45. Utsumi S. Facebook of Utsumi Satoru. 2016. [Accessed 5 December 2016]. https://www.facebook.com/satoru.utsumi .

Articles from Asian Pacific Journal of Cancer Prevention : APJCP are provided here courtesy of West Asia Organization for Cancer Prevention

RESOURCES