title: Effects on Text Simplification: Evaluation of Splitting Up Noun Phrases.
abstract: To help increase health literacy, we are developing a text simplification tool that creates more accessible patient education materials. Tool development is guided by a data-driven feature analysis comparing simple and difficult text. In the present study, we focus on the common advice to split long noun phrases. Our previous corpus analysis showed that easier texts contained shorter noun phrases. Subsequently, we conducted a user study to measure the difficulty of sentences containing noun phrases of different lengths (2-gram, 3-gram, and 4-gram); noun phrases of different conditions (split or not); and, to simulate unknown terms, pseudowords (present or not). We gathered 35 evaluations for 30 sentences in each condition (3 × 2 × 2 conditions) on Amazon's Mechanical Turk (N = 12,600). We conducted a 3-way analysis of variance for perceived and actual difficulty. Splitting noun phrases had a positive effect on perceived difficulty but a negative effect on actual difficulty. The presence of pseudowords increased perceived and actual difficulty. Without pseudowords, longer noun phrases led to increased perceived and actual difficulty. A follow-up study using the phrases (N = 1,350) showed that measuring awkwardness may indicate when to split noun phrases. We conclude that splitting noun phrases benefits perceived difficulty but hurts actual difficulty when the phrasing becomes less natural.
authors.affiliation: a Management Information Systems Department , University of Arizona , Tucson , Arizona , USA.
authors.forename: Gondy
authors.initials: G
authors.lastname: Leroy
authors.affiliation: b Computer Science Department , Pomona College , Claremont , California , USA.
authors.forename: David
authors.initials: D
authors.lastname: Kauchak
authors.affiliation: c Department of Linguistics , University of Arizona , Tucson , Arizona , USA.
authors.forename: Alan
authors.initials: A
authors.lastname: Hogue
mesh_terms: D057220:Health Literacy / Q000706:statistics & numerical data*; D006801:Humans; D007802:Language; D010353:Patient Education as Topic / Q000379:methods*