Content validation of an instrument to measure listening effort
Validação de conteúdo de um instrumento para mensuração do esforço auditivo
Purpose: To validate the content of an instrument to measure listening effort for hearing-impaired individuals. Method: This is a validation study, developed in two stages, which the Stage 1 is the planning and development of the first version of the instrument, and Stage 2 the investigation of the evidences of validity based on the content and development of the final version of the instrument to measure listening effort. Ten professionals with expertise in the field of audiology, with more than five years of clinical experience participated in this study. The instrument to be validated was composed of three parts: I - “speech perception of logatomes and listening effort”; II - “listening effort and working memory” and; III - “speech perception of meaningless sentences and working memory” and they were presented monoaurally, in quiet and in the signal-to-noise ratios + 5dB, 0dB and -5dB. It was conducted a descriptive analysis regarding the suggestions of the committee judge audiologists and the analysis of the individual and scale content validity index. Results: The results showed that parts I and III which constitute the proposed instrument reached a scale content validity index above 0.78, which means that the presented items did not need modification in their construct. Conclusion: The evidences of validity studied allowed relevant modifications and made this instrument adequate to its construct.
Wingfield A. The evolution of models of working memoryand cognitive resources. Ear Hear. 2016;37(1):35S-43S.
Fraser S, Gagné JP, Alepins M, Dubois P. Evaluating the effort expended to understand speech in noise using a dual-task paradigm: The effects of providing visual speech cues. J Speech Lang Hear Res. 2010;53(1):18-33.
Picou EM, Ricketts TA, Hornsby BW. How hearing aids, background noise, and visual cues influence objective listening effort. Ear Hear. 2013;34(5):52-64.
Pichora- Fuller MK, Kramer SE, Eckert MA, Edwards B, Hornsby BW, Humes LE. Hearing impairment and cognitive energy: The Framework for Understanding Effortful Listening (FUEL). Ear Hear. 2016;37:5S-27S.
McGarrigle R, Munro KJ, Dawes P, Stewart AJ, Moore DR, Barry JG. Listening effort and fatigue: What exactly are we measuring? A British Society of Audiology Cognition in Hearing Special Interest Group 'white paper'. Int J Audiol. 2014;53(7):433-40.
Pals C, Sarampalis A, Başkent D. Listening effort with cochlear implant simulations. J Speech Lang Hear Res. 2013;56(4):1075-84.
Koelewijn T, Zekveld AA, Festen JM, Kramer SE. Pupil dilation uncovers extra listening effort in the presence of a single-talker masker. Ear Hear. 2012;33(2):291-300.
Anderson-Gosselin PA, Gagné JP. Use of a Dual-Task Paradigm to Measure Listening Effort. Can J Speech Lang Pathol Audiol. 2010;34(1):43-51.
Wu YH, Aksan N, Rizzo M, Stangl E, Zhang X, Bentler R. Measuring listening effort: Driving simulator vs. simple dual-task paradigm. Ear Hear. 2014;35(6):623-32.
Rönnberg J., Lunner T, Zekveld A, Sörqvist P, Danielsson H, Lyxell B. The Ease of Language Understanding (ELU) model: theoretical, empirical, and clinical advances. Front Syst Neurosc. 2013;7(31):1-17.
Rudner M, Lunner T, Behrens T, Thorén ES, Rönnberg J. Working memory capacity may influence perceived effort during aided speech recognition in noise. J Am Acad Audiol. 2012;23(8):577-89.
Ma WJ, Husain M, Bays PM. Changing concepts of working memory. Nat neurosci. 2014;17(3):347-56.
Alexandre NMC, Coluci MZO. Validade de conteúdo nos processos de construção e adaptação de instrumentos de medidas. Ciênc. Saude Colet. 2011;16(7):3061-8.
Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL. The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. J Clin Epidemiol. 2010;63(7):737-45.
Roach KE. Measurement of health outcomes: reliability, validity and responsiveness. J Prosthet Orthot. 2006;18(1S):8-12.
Polit DF. Assessing measurement in health: beyond reliability and validity. Int J Nurs Stud. 2015;52(11):1746-53.
Haynes SN, Richard DCS, Kubany ES. Content validity in psychological assessment: a functional approach to concepts and methods. Psychol Assess. 1995;7(3):238-47.
Lynn MR. Determination and quantification of content validity. Nurs Res. 1986;35(6):382-5.
Grant JS, Davis LL. Selection and use of content experts for instrument development. Res Nurs Health. 1997;20(3):269-74.
Polit DF, Beck CT. The content validity index: are you sure you know what's being reported? Critique and recommendations. Res Nurs Health. 2006;29(5):489-97.
Mackersie CL, Cones H. Subjective and Psychophysiological Indexes of Listening Effort in a Competing-Talker Task. J Am Acad Audiol. 2011;22(2):113-22.
Koelewijn T, Zekveld AA, Festen JM, Kramer SEl. Pupil dilation uncovers extra listening effort in the presence of a single-talker masker. Ear Hear. 2012;33(2):291-300.
Giangiacomo MCPB, Navas ALGP. A influência da memória operacional nas habilidades de compreensão de leitura em escolares de 4ª série. Rev Soc Bras Fonoaudiol. 2008;13(1):69-74.
Ng HNE, Rudner M, Lunner T, Pederson MS, Ronnberg J. Effects of noise and working memory capacity on memory processing of speech for hearing-aid users. Int J Audiol. 2013;52(7):433-41.
Rönnberg N, Stenfelt S, Rudner M. Testing listening effort for speech comprehension using the individuals' cognitive spare capacity. Audiol Res. 2011;1(1):1-8.
Brannstrom KJ, Karlsson E, Waechter S, Kastberg T. Listening Effort: Order Effects and Core Executive Functions. J Am Acad Audiol. 2017;29(8):1-13.
Peelle JE. Listening Effort: How the Cognitive Consequences of Acoustic Challenge Are Reflected in Brain and Behavior. Ear Hear. 2018;39(2):204-14.
Heinrich A, Schneider BA, Craik FI. Investigating the influence of continuous babble on auditory short-term memory performance. Q J Exp Psychol. 2008;61(5):735-51.
Sarampalis A, Kalluri S, Edwards B, Hafter E. Objective measures of listening effort: effects of background noise and noise reduction. J Speech Lang Hear Res. 2009;52(5):1230-40.
McCoy SL, Tun PA, Cox LC, Colangelo M, Stewart RA, Wingfield A. Q J Exp Psychol. 2005;58(1):22-33.