Abstracts
Résumé
Peu de mesures permettent d’examiner globalement les fonctions exécutives (FE) chez l’enfant d’âge préscolaire en contextes éducatifs. Elles constituent pourtant un prédicteur de réussite éducative. Les composantes des FE (p. ex. l’inhibition) sont habituellement mesurées par des tâches standardisées et des mesures rapportées, amenant une divergence entre les résultats. On observe aussi une prédominance de l’utilisation de tâches mesurant une seule composante des FE. Ainsi, la création d’un instrument d’observation systématique semble nécessaire, de même que la validation du contenu de celui-ci, pour pouvoir brosser un portrait représentatif et global des FE de l’enfant en classe. Dans cette étude, le contenu d’une grille d’observation nouvellement élaborée sur les FE a été validé auprès d’un panel d’experts à l’aide de la méthode Delphi. Cet article, qui présente notamment l’application de la procédure de validation et les résultats qui en découlent, discute des retombées et des limites de la méthode Delphi, qui est de plus en plus exploitée dans les études en éducation.
Mots-clés :
- Delphi,
- fonctions exécutives,
- outil d’observation,
- validité de contenu
Abstract
There are few measures to globally examine the executive functions (EFs) of preschool children in educational contexts, which nevertheless constitute a predictor of their educational success. Indeed, the components of EFs (e.g., inhibition) are usually measured by standardized tasks and reported measures, leading to a discrepancy between the results. We also observe a predominance for the use of tasks measuring a single component of EFs. Thus, the creation of a systematic observation instrument seems necessary, as well as the validation of its content, in order to have a representative and global portrait of the child’s EF in the classroom. In this study, the content of a newly developed observation grid on EFs was validated with a panel of experts using the Delphi method. This article, which presents the application of the validation procedure and the resulting outcomes, discusses the effects and limits of the Delphi method, which is increasingly used in educational studies.
Keywords:
- content validity,
- Delphi,
- executive functions,
- observation tool
Resumo
Poucas medidas permitem examinar globalmente as funções executivas (FE) em crianças em idade pré-escolar em contextos educativos, embora sejam um preditor de sucesso educacional. As componentes das FE (por exemplo, a inibição) são normalmente medidas por tarefas padronizadas e medidas reportadas, levando a uma divergência entre os resultados. Observa-se também uma predominância do uso de tarefas que medem uma única componente das FE. Assim, a criação de uma ferramenta de observação sistemática parece necessária, bem como a validação do conteúdo desta, para poder traçar um retrato representativo e global das FE da criança em sala de aula. Neste estudo, o conteúdo de uma grelha de observação recém-elaborada sobre as FE foi validado junto a um painel de especialistas usando o método Delphi. Este artigo, que apresenta especialmente a aplicação do procedimento de validação e os resultados decorrentes, discute os impactos e os limites do método Delphi, que é cada vez mais utilizado em estudos na área da educação.
Palavras chaves:
- Delphi,
- ferramenta de observação,
- funções executivas,
- validade de conteúdo
Appendices
Liste de références
- Anderson, P. J. & Reidy, N. (2012). Assessing Executive Function in Preschoolers. Neuropsychology Review, 22, 345-360. http://dx.doi.org/10.1007/s11065-012-9220-3 .
- Arborio, A. -M. & Fournier, P. (2005). L’enquête et ses méthodes : l’observation directe, Population, 55(4/5). doi : 10.2307/1534705.
- Bahadir, F. & Tuncer, M. (2020). Determining the Standards of Teaching and Learning Process as a Component of Curriculum. International Journal of Progressive Education, 16(3), 34-52.
- Bakeman, R. & Quera, V. (2011). Sequential Analysis and Observational Methods for the Behavioural Sciences. Cambridge University Press.
- Barros, P. & Hazin, I. (2013). Avaliaça~o das funções executivas na infância: Revis~ao dos conceitos e instrumentos [Assessment of executive functions in childhood: Review of concepts and instruments]. Psicologia Em Pesquisa, 7(1), 13-22. https://doi.org/10.5327/Z19821247201300010003
- Barros, P., Metta, L., Peralba, C., Vilar, C., Guerra, A., Paula, A., Argollo, N. & Hazin, I. (2016). Perfil desenvolvimental das funções executivas utilizando o NEPSY-II em crianças de 5 a 8 anos [Developmental profile of executive functions using the NEPSY-II in 5- to 8-year-old children]. Revista de Neuropsicologia Latinoamericana, 8(2), 1-15. https://doi.org/10.5579/rnl.2016.0295
- Berquez, A. E., Cook, F. M., Millard, S. K. & Jarvis, E. (2011). The Stammering Information Programme: a Delphi study. Journal of Fluency Disorders, 36(3), 206-221. doi: 10.1016/j.jfludis.2011.02.007.
- Bjorklund, D. F. & Causey, K. (2018). Children’s thinking: Cognitive development and individual differences. SAGE Publications.
- Blair, C., Granger, D. & Razza, R. P. (2005). Cortisol reactivity is positively related to executive function in preschool children attending Head Start. Child Development, 76, 554-567.
- Blair, C. & Razza, R. P. (2007). Relating effortful control, executive function, and false belief understanding to emerging math and literacy ability in kindergarten. Child Development, 78(2), 647–663. https://doi-org.acces.bibl.ulaval.ca/10.1111/j.1467-8624.2007.01019.x
- Cadavid-Ruiz, N. & del Río, P. (2018). An Observational Analysis of Executive Performance in School Children. Psychology in Russia: State of the Art, 11(3). doi: 10.11621/PIR.2018.0314
- Carlson, S. M. (2005). Developmentally sensitive measures of executive function in preschool children. Developmental neuropsychology, 28(2), 595–616. https://doi.org/10.1207/s15326942dn2802_3
- Ciptono, A., Setiyono, S., Nurhidayati, F. & Vikaliana, R. (2019). Fuzzy Delphi method in education: A mapping. Journal of Physics Conference Series, 1360(1). doi:10.1088/1742-6596/1360/1/012029
- Colquitt, J. A., Sabey, T. B., Rodell, J. B. & Hill, E. T. (2019). Content validation guidelines: Evaluation criteria for definitional correspondence and definitional distinctiveness. Journal of Applied Psychology, 104(10), 1243. https://doi.org/10.1037/apl0000406
- Corbière, M. & Fraccaroli, F. (2014) La conception, la validation, la traduction et l’adaptation transculturelle d’outils de mesure : des exemples en santé mentale et travail. Dans M. Corbière & N. Larivière (dir.), Méthodes qualitatives, quantitatives et mixtes : dans la recherche en sciences humaines, sociales et de la santé (p. 577-624). Presses de l’Université du Québec.
- Creswell, J. & Poth, C. (2017) Qualitative Inquiry and Research Design: Choosing among Five Approaches. SAGE Publications.
- Davidson, M. C., Amso, D., Anderson, L. C. & Diamond, A. (2006). Development of cognitive control and executive functions from 4 to 13 years: Evidence from manipulations of memory, inhibition, and task switching. Neuropsychologia, 44(11), 2037-2078. https://doi-org.acces.bibl.ulaval.ca/10.1016/j.neuropsychologia.2006.02.006
- Davis, H. L. & Pratt, C. (1995). The development of children’s theory of mind: The working memory explanation. Australian Journal of Psychology, 47(1), 25–1. https://doi-org.acces.bibl.ulaval.ca/10.1080/00049539508258765
- Denckla, M. (2002). The behavior rating inventory of executive function: Commentary. Child Neuropsychology, 8(4), 304-306. https://doi.org/10.1076/chin.8.4.304.13512
- Désormeaux-Moreau, M., Naud-Lepage, G. & Drolet, M. -J. (2020). Assurer la validité de contenu lors du développement d’un outil d’évaluation : Soutenir l’ergothérapeute pas à pas. Revue Francophone de Recherche en Ergothérapie, 6(2), 75-97. Doi :10.13096/rfre.v6n2.178
- Diamond, A. (2013). Executive functions. Annual Review of Psychology, 64, 135–168. https://doi-org.acces.bibl.ulaval.ca/10.1146/annurev-psych-113011-143750
- Doebel, S. (2020). Rethinking Executive Function and Its Development. Perspectives on psychological science: a journal of the Association for Psychological Science, 15(4), 942–956. https://doi.org/10.1177/1745691620904771
- Duval, S., Bouchard, C., Matte-Gagné, C. & Brault-Foisy, L.-M. (2020-2023). Validation d’une grille d’observation des FE chez les enfants âgés de trois à cinq ans en contextes éducatifs. Projet subventionné par le CRSH, Développement Savoir. Gouvernement du Canada.
- Duval, S. & Montminy (2021). Grille d’observation des fonctions exécutives en contextes éducatifs de la petite enfance. Document inédit de recherche. Université Laval, Québec.
- Duval, S., Montminy, N., Brault-Foisy, L.-M., Arapi, E. & Vézina, S.-A. (2023). Examining the relation between adult scaffolding of make-believe play and children’s executive functions: an observational study conducted in a natural educational setting. Early Child Development and Care, 193(8), 1022-1040. https://doi.org/10.1080/03004430.2023.2216891
- Duval, S., Montminy, N. & Gaudette-Leblanc, A. (2018). Perspectives théoriques à l’égard des fonctions exécutives en contexte éducatif préscolaire, Neuroéducation, 5(2), 93-108.
- Ekionea, B. J. P., Bernard, P. & Plaisent, M. (2011). Consensus par la méthode Delphi sur les concepts clés des capacités organisationnelles spécifiques de la gestion des connaissances. Recherches qualitatives, 29(3), 168-192. https://doi.org/10.7202/1085878ar
- Escolano-Pérez, E., Herrero-Nivela, M. L., Blanco-Villaseñor, A. & Anguera, M. T. (2017). Systematic Observation: Relevance of This Approach in Preschool Executive Function Assessment and Association with Later Academic Skill. Frontiers in Psychology, 8. https://www.frontiersin.org/journals/psychology/articles/10.3389/fpsyg.2017.02031
- Fleer, M., Veresov, N. & Walker, S. (2017). Re-conceptualizing executive functions as social activity in children’s playworlds. Learning, Culture and Social Interaction, 14, 1–11. https://doi.org/10.1016/j.lcsi.2017.04.003
- Foy, J. & Mann, V. (2012). Executive function and early reading skills. Reading and Writing, 26. https://doi.org/10.1007/s11145-012-9376-5
- Gioia, G. A., Espy, K. A. & Isquith, P. K. (2002). Behavior Rating Inventory of Executive Function, Preschool Version (BRIEF-P). Odessa: Psychological Assessment Resources.
- Goodman, C. M. (1987). The Delphi technique: a critique. Journal of Advanced Nursing, 12, 729–734. http://dx.doi.org/10.1111/j.1365-2648.1987.tb01376.x
- Green, R. A. (2014). The Delphi Technique in Educational Research. SAGE Open, 4(2). https://doi-org.acces.bibl.ulaval.ca/10.1177/2158244014529773
- Haidari, S. M. & Uzun, N. B. (2019). Content validity and confirmatory factor analysis of Cooperative Learning Attitude Scale (CLAS) for the EFL students. International Journal of Social Sciences and Education Research, 5(4), 418-433.
- Hasson, F., Keeney, S. & McKenna, H. (2000). Research guidelines for the Delphi survey technique. Journal of advanced nursing, 32(4), 1008–1015.
- Haynes, S. N., Richard, D. C. S. & Kubany, E. S. (1995). Content validity in psychological assessment: A functional approach to concepts and methods. Psychological Assessment, 7, 238-247.
- Heyman, R. E., Lorber, M. F., Eddy, J. M. & West, T. V. (2014). Behavioral observation and coding. Dans H. T. Reis & C. M. Judd (dir.), Handbook of research methods in social and personality psychology (p. 345–372). Cambridge University Press.
- Hohmann, E., Brand, J. C., Rossi, M. J. & Lubowitz, J. H. (2018). Expert Opinion Is Necessary: Delphi Panel Methodology Facilitates a Scientific Approach to Consensus Arthroscopy: the journal of arthroscopic & related surgery: official publication of the Arthroscopy Association of North America and the International Arthroscopy Association, 34(2), 349–351. https://doi.org/10.1016/j.arthro.2017.11.022
- Holey, E. A., Feeley, J. L., Dixon, J. & Whittaker, V. J. (2007). An exploration of the use of simple statistics to measure consensus and stability in Delphi studies. BMC Medical Research Methodology, 7(1), 52. https://doi.org/10.1186/1471-2288-7-52
- Hoyt, C. R., Fernandez, J. D., Varughese, T. E., Grandgeorge, E., Manis, H. E., O’Connor, K. E., Abel, R. A. & King, A. A. (2020). The Infant Toddler Activity Card Sort: A Caregiver Report Measure of Children’s Occupational Engagement in Family Activities and Routines. Occupational Therapy Journal of Research, 40(1), 3641. https://doi.org/10.1177/1539449219852030
- Hsu, C. & Sandford, B. (2007). The Delphi Technique: Making Sense of Consensus. Practical Assessment, Research & Evaluation, 12, 1-8. http://pareonline.net/pdf/v12n10.pdf
- Isquith, P., Gioia, G. & Espy, K. (2004). Executive Function in Preschool Children: Examination Through Everyday Behavior. Developmental neuropsychology, 26, 403422. https://doi.org/10.1207/s15326942dn2601_3
- Jones, J., Belcher, G. & Elliott, K. (2021). Identifying Technical Competencies for Architecture and Construction Education Using the Delphi Method. Career and Technical Education Research, 46(1), 3-15. https://doi.org/10.5328/cter46.1.3
- Kazemi, A. S. & Mohammadi, Z. (2019). The Effect of Working Memory Training on Executive Function of Children with Attention Deficit/Hyperactivity Disorder. BRAIN. Broad Research in Artificial Intelligence and Neuroscience, 10(3), 134-141. https://lumenpublishing.com/journals/index.php/brain/article/view/2175
- Keeney, S., Hasson, F. & McKenna, H. P. (2001). A critical review of the Delphi technique as a research methodology for nursing. International journal of nursing studies, 38(2), 195–200. https://doi.org/10.1016/s0020-7489(00)00044-4
- Keeney, S., Hasson, F. & McKenna, H. (2006). Consulting the oracle: ten lessons from using the Delphi technique in nursing research. Journal of advanced nursing, 53(2), 205–212. https://doi.org/10.1111/j.1365-2648.2006.03716.x
- Kovács, Á. M. & Mehler, J. (2009). Flexible Learning of Multiple Speech Structures in Bilingual Infants. Science, 325(5940), 611–612. https://doi.org/10.1126/science.1173947
- Laveault, D. & Grégoire, J. (2014). Introduction aux théories des tests en psychologie et en sciences de l’éducation (3e éd.). De Boeck Université.
- Leigh, H. (2020). Signature Pedagogies for Art Therapy Education: A Delphi Study. Art Therapy, 38, 18. https://doi.org/10.1080/07421656.2020.1728180
- Lynn, M. R. (1986). Determination and quantification of content validity. Nursing Research, 35, 382-385.
- McClelland, M. M. & Cameron, C. E. (2012). Self-regulation in early childhood: Improving conceptual clarity and developing ecologically valid measures. Child Development Perspectives, 6(2), 136–142. https://doi.org/10.1111/j.1750-8606.2011.00191.x
- McKenna, H. P. (1994). The essential elements of a practitioners’ nursing model: a survey of psychiatric nurse managers. Journal of Advanced Nursing, 19, 870-877. https://doi.org/10.1111/j.1365-2648.1994.tb01163.x
- Ministère de l’Éducation du Québec. (2021). Programme de formation de l’école québécoise. Programme-cycle de l’éducation préscolaire. Gouvernement du Québec.
- Miyake, A., Friedman, N., Emerson, M., Witzki, A., Howerter, A. & Wager, T. (2000). The unity and diversity of executive functions and their contributions to complex “frontal lobe” tasks: A latent variable analysis. Cognitive Psychology, 41(1), 49–100. https://doi.org/10. 1006/cogp.1999.0734
- Mulcahy, C., Day Hess, C. A., Clements, D. H., Ernst, J. R., Pan, S. E., Mazzocco, M. M. M. & Sarama, J. (2021). Supporting Young Children’s Development of Executive Function Through Early Mathematics. Policy Insights from the Behavioral and Brain Sciences, 8(2), 192–199.
- Nasa, P, Jain, R. & Juneja, D. (2021). Delphi methodology in healthcare research: How to decide its appropriateness. World Journal of Methodology, 11(4), 116-129. doi: 10.5662/wjm.v11.i4.116
- Nieto, M., Ros, L., Medina, G., Ricarte, J. J. & Latorre, J. M. (2016). Assessing executive functions in preschoolers using shape school task. Frontiers in Psychology, 7(1489). https://doi-org.acces.bibl.ulaval.ca/10.3389/fpsyg.2016.01489
- Nigg, J. T. (2017). Annual Research Review: On the relations among self-regulation, self-control, executive functioning, effortful control, cognitive control, impulsivity, risk-taking, and inhibition for developmental psychopathology. Journal of child psychology and psychiatry, and allied disciplines, 58(4), 361–383. https://doi.org/10.1111/jcpp.12675
- Nworie, J. (2011). Using the Delphi Technique in Educational Technology Research. TechTrends, 55, 24–30. https://doi.org/10.1007/s11528-011-0524-6
- Parrish, A. H. & Sadera, W. A. (2020). Teaching Competencies for Student-Centered, One-to-One Learning Environments: A Delphi Study. Journal of Educational Computing Research, 57(8), 1910–1934. https://doi.org/10.1177/0735633118816651
- Polit, D. F., Beck, C. T. & Owen, S. V. (2007). Is the CVI an acceptable indicator of content validity appraisal and recommendations. Research in Nursing & Health, 30(4), 459-467. https://doi.org/10.1002/nur.20199
- Powell, A., Bennett, N. & Lamm, K. (2021). Expanding 4-H alumni life perspectives: An experiential and programmatic evaluation. Journal of Agricultural Education, 62(2), 185-200. http://doi.org/10.5032/jae.2021.02185
- Puertas-Aguilar, M.-Á., Álvarez-Otero, J. & de Lázaro-Torres, M.-L. (2021). The Challenge of Teacher Training in the 2030 Agenda Framework Using Geotechnologies. Education Sciences, 11(8), 381. http://dx.doi.org/10.3390/educsci11080381
- Ribner, A. D., Willoughby, M. T. & Blair, C. B. (2017). Executive Function Buffers the Association between Early Math and Later Academic Skills. Frontiers in Psychology, 8(869). https://doi.org/10.3389/fpsyg.2017.00869
- Rubio, D. M., Berg-Weger, M., Tebb, S. S., Lee, E. S. & Rauch, S. (2003). Objectifying content validity: Conducting a content validity study in social work research. Social Work Research, 27(2), 94-104. https://doi.org/10.1093/swr/27.2.94
- Rusticus, S. (2014). Content Validity. Dans A. C. Michalos (dir.), Encyclopedia of Quality of Life and Well-Being Research. Springer, Dordrecht. https://doi-org.acces.bibl.ulaval.ca/10.1007/978-94-007-0753-5_553
- Sablatzky, T. (2022). The Delphi Method. Hypothesis: Research Journal for Health Information Professionals, 34(1). https://doi.org/10.18060/26224 .
- Sekayi, D. & Kennedy, A. (2017). Qualitative Delphi Method: A Four Round Process with a Worked Example. Qualitative Report, 22, 2755‑2763. https://doi.org/10.46743/2160-3715/2017.2974
- Silva, C., Sousa-Gomes, V., Fávero, M., Oliveira-Lopes, S., Merendeiro, C. S., Oliveira, J. & Moreira, D. (2022). Assessment of preschool-age executive functions: A systematic review. Clinical Psychology & Psychotherapy, 29(4), 1374‑1391. https://doi.org/10.1002/cpp.2718
- Sireci, S. G. (1998). Gathering and analyzing content validity data. Educational Assessment, 5(4), 299-321. https://doi.org/10.1207/s15326977ea0504_2
- Skelton, H. & Leclair, L. (2019). The Early Development Instrument – Creation of a Fine Motor/Visual Motor Index. Journal of Occupational Therapy, Schools, & Early Intervention, 12(3), 284297. https://doi.org/10.1080/19411243.2019.1590753
- Streiner, D. L. (2014) Measurement. Dans K. Bassil & D. Zabkiewicz (dir.), Health Research Methods: A Canadian Perspective (p. 119-142). Oxford University Press.
- Toplak, M. E., West, R. F. & Stanovich, K. E. (2013). Practitioner review: do performance-based measures and ratings of executive function assess the same construct ? Journal of child psychology and psychiatry, and allied disciplines, 54(2), 131–143. https://doi.org/10.1111/jcpp.12001
- Walker, A. M. & Selfe, J. (1996). The Delphi method: A useful tool for the allied health researcher. British Journal of Therapy and Rehabilitation, 3. https://doi.org/10.12968/bjtr.1996.3.12.14731
- Waltz, C. F., Strickland, O. & Lenz, E. R. (2017). Chapter 6. Validity of Measures. Measurement in Nursing and Health Research (5th ed.). Springer Publishing Company
- Wechsler, D. (2003). Wechsler Intelligence Scale for Children (4th ed.). PsychCorp.
- Wiebe, S., Sheffield, T., Nelson, J., Clark, C., Chevalier, N. & Espy, K. (2011). The structure of executive function in 3-year-olds. Journal of Experimental Child Psychology, 108(3), 436–452. https://doi.org/10. 1016/j.jecp.2010.08.008
- Willoughby, M. T., Blair, C. B. & Family Life Project Investigators. (2016). Measuring executive function in early childhood: A case for formative measurement. Psychological Assessment, 28(3), 319–330. https://doi.org/10.1037/pas0000152
- Young, A. R., Gurm, M. K. & O’Donnell, K. A. (2017). Assessing executive functions in young children. Dans M. J. Hoskyn, G. Iarocci & A. R. Young (dir.), Executive functions in children’s everyday lives: A handbook for professionals in applied psychology (p. 21–37). Oxford University Press. https://doi.org/10.1093/acprof:oso/9780199980864.003.0003
- Yusoff, M. S. B. (2019). ABC of content validation and content validity index calculation. Education in Medicine Journal, 11(2), 49-54. https://doi.org/10.21315/eimj2019.11.2.6
- Zamanzadeh, V., Ghahramanian, A., Rassouli, M., Abbaszadeh, A., Alavi-Majd, H. & Nikanfar, A. R. (2015). Design and Implementation Content Validity Study: Development of an instrument for measuring Patient-Centered Communication. Journal of caring sciences, 4(2), 165–178. https://doi.org/10.15171/jcs.2015.017
- Zelazo, P. D., Blair, C. B. & Willoughby, M. T. (2016). Executive Function: Implications for Education (NCER 2017-2000) National Center for Education Research, Institute of Education Sciences, U.S. Department of Education. http://ies.ed.gov/.