title: Evaluation of Internet Social Networks using Net scoring Tool: A Case Study in Adverse Drug Reaction Mining.
abstract: OBJECTIVE
  Suspected adverse drug reactions (ADR) reported by patients through social media can be a complementary tool to already existing ADRs signal detection processes. However, several studies have shown that the quality of medical information published online varies drastically whatever the health topic addressed. The aim of this study is to use an existing rating tool on a set of social network web sites in order to assess the capabilities of these tools to guide experts for selecting the most adapted social network web site to mine ADRs.
  
  
  METHODS
  First, we reviewed and rated 132 Internet forums and social networks according to three major criteria: the number of visits, the notoriety of the forum and the number of messages posted in relation with health and drug therapy. Second, the pharmacist reviewed the topic-oriented message boards with a small number of drug names to ensure that they were not off topic. Six experts have been chosen to assess the selected internet forums using a French scoring tool: Net scoring. Three different scores and the agreement between experts according to each set of scores using weighted kappa pooled using mean have been computed.
  
  
  RESULTS
  Three internet forums were chosen at the end of the selection step. Some criteria get high score (scores 3-4) no matter the website evaluated like accessibility (45-46) or design (34-36), at the opposite some criteria always have bad scores like quantitative (40-42) and ethical aspect (43-44), hyperlinks actualization (30-33). Kappa were positives but very small which corresponds to a weak agreement between experts.
  
  
  CONCLUSIONS
  The personal opinion of the expert seems to have a major impact, undermining the relevance of the criterion. Our future work is to collect results given by this evaluation grid and proposes a new scoring tool for Internet social networks assessment.
authors.affiliation: INSERM, UMR_S 1138, équipe 22, Centre de Recherche des Cordeliers, F-75006, Paris, France.
authors.forename: Sandrine
authors.initials: S
authors.lastname: Katsahian
authors.affiliation: AP-HP, HEGP, Département d'Informatique Hospitalière, Paris, France.
authors.forename: Erica
authors.initials: E
authors.lastname: Simond Moreau
authors.affiliation: INSERM, U1142, LIMICS, F-75006, Paris, France.
authors.forename: Damien
authors.initials: D
authors.lastname: Leprovost
authors.affiliation: INSERM, U1142, LIMICS, F-75006, Paris, France.
authors.forename: Jeremy
authors.initials: J
authors.lastname: Lardon
authors.affiliation: INSERM, U1142, LIMICS, F-75006, Paris, France.
authors.forename: Cedric
authors.initials: C
authors.lastname: Bousquet
authors.affiliation: CISMeF, Rouen University Hospital, Cour Leschevin, Rouen, Cedex, France.
authors.forename: Gaétan
authors.initials: G
authors.lastname: Kerdelhué
authors.affiliation: Kappa Santé, Paris, France.
authors.forename: Redhouane
authors.initials: R
authors.lastname: Abdellaoui
authors.affiliation: Kappa Santé, Paris, France.
authors.forename: Nathalie
authors.initials: N
authors.lastname: Texier
authors.affiliation: INSERM, UMR_S 1138, équipe 22, Centre de Recherche des Cordeliers, F-75006, Paris, France.
authors.forename: Anita
authors.initials: A
authors.lastname: Burgun
authors.affiliation: INSERM, UMR_S 1138, équipe 22, Centre de Recherche des Cordeliers, F-75006, Paris, France.
authors.forename: Abdelali
authors.initials: A
authors.lastname: Boussadi
authors.affiliation: Kappa Santé, Paris, France.
authors.forename: Carole
authors.initials: C
authors.lastname: Faviez
mesh_terms: D016907:Adverse Drug Reaction Reporting Systems / Q000458:organization & administration*; D057225:Data Mining / Q000379:methods*; D064420:Drug-Related Side Effects and Adverse Reactions / Q000145:classification* / Q000453:epidemiology*; D006801:Humans; D011159:Population Surveillance / Q000379:methods*; D015203:Reproducibility of Results; D012680:Sensitivity and Specificity; D061108:Social Media / Q000706:statistics & numerical data*; D012984:Software