Résumés
Résumé
Les enquêtes par questionnaire auto-administré sont un des principaux instruments de cueillette de données utilisés par les chercheurs en éducation et en sciences sociales en général. Or, il peut être difficile de créer une question qui sera interprétée de la même façon par tous les répondants et qui répondra ainsi aux objectifs des chercheurs. Un changement de mots peut avoir un impact sur la signification d’un item, mais il est aussi possible qu’il n’y ait pas d’impact ; tout dépend du changement apporté. Par ailleurs, depuis les premières études portant sur la formulation des items dans les enquêtes par questionnaire, de nouveaux modèles de mesure ont été élaborés. C’est le cas, notamment, de la famille des modèles de Rasch. L’objectif de cet article est d’illustrer comment les développements entourant un modèle de mesure de la famille des modèles de Rasch, notamment le modèle polytomique de Andrich, peuvent être mis à contribution pour étudier la portée relative de la formulation des items sur les réponses obtenues à l’aide de questionnaires d’enquête.
Mots-clés :
- Questionnaire,
- formulation des items,
- modèle de Rasch,
- données polytomiques
Abstract
Self-administered survey questionnaires are a primary source of data collection in education and in the social sciences in general. It is often difficult to create a question which will be interpreted in the same way by all respondents and then meet the researcher’s goals. A change of wording can influence the meaning of an item, but it is also possible that there would be no influence at all; it all depends on the changes made. Besides, since the first studies related to items’ wording in survey questionnaires, new measurement models were developed. This is the case notably for measurement models from the Rasch family. The goal of this paper is to illustrate how the developments surrounding a measurement model from the Rasch family, namely Andrich’s model for polytomous data, can be put at contribution to study the relative impact of items’ wording on the responses obtained in survey questionnaires.
Keywords:
- Questionnaires,
- items’ wording,
- Rasch model,
- polytomous data
Resumo
Os inquéritos por questionário auto-administrados são um dos principais instrumentos de recolha de dados utilizados pelos investigadores em educação e nas ciências sociais em geral. Ora, é difícil conceber uma questão que seja interpretada da mesma maneira por todos os respondentes e que, desse modo, responda aos objectivos dos investigadores. Uma mudança de palavras pode ter um impacto sobre o significado de um item, mas também pode acontecer que não tenha impacto nenhum, tudo dependendo da mudança realizada. de resto, depois dos primeiros estudos sobre a formulação de itens nos inquéritos por questionário, foram elaborados novos modelos de medida, como é o caso da família de modelos de Rasch. O objectivo deste artigo é ilustrar como os desenvolvimentos em torno de um modelo de medida da família de modelos de Rasch, designadamente o modelo politómico de Andrich, pode dar um contributo no estudo do impacto relativo da formulação de itens sobre as respostas obtidas com a ajuda de inquéritos por questionário.
Palavras chaves:
- Questionário,
- formulação de itens,
- modelo de Rasch,
- dados politómicos
Veuillez télécharger l’article en PDF pour le lire.
Télécharger
Parties annexes
Références
- Abelson, r. P. (1992). Opportunities in survey measurement of attitudes. In J. M. Tanur (dir.), Questions about questions (pp. 173-176). NY: Russel Sage Foundation.
- Andrich, D. (1978). A rating formulation for ordered response categories. Psychometrika, 43 (4), 561-573.
- Andrich, D. (1982). An index of person separation in latent trait theory, the traditional Kr-20 index, and the Guttman scale response pattern. Education Research and Perspectives, 9 (1), 95-104.
- Blais, A. (1992). Le sondage. In B. Gauthier (dir.), Recherche sociale: de la problématique à la collecte des données (2e éd., pp. 367-398). Sillery, Québec: Presses de l’université du Québec.
- Blais, J.-G., & Ajar, D. (1992). Théorie des réponses aux items et modélisation. Mesure et évaluation en éducation, 14 (4), 5-18.
- Blais, J.-G., & Grondin, J. (2008, mars). A study of the influence of labels associated with anchor points of Likert-type response scales in survey questionnaires. communication présentée lors du congrès de l’international objective Measurement workshop (IOMW), New York.
- Blais, J.-G., & Grondin, J. (soumis). The influence of labels associated with anchor points of likert-type response scales in survey questionnaires. Journal of Applied Measurement.
- Blais, J.-G., Grondin, J., Loye, N., & Raîche, G. (2007, april). A transverse study of items’ word ing impact with Rasch’s rating scale model. Communication présentée à la réunion annuelle de l’american educational research association (AERA), Chicago, IL.
- Bond, T. G., & Fox, C. M. (2001). Applying the Rasch model: Fundamental measurement in the human sciences. Mahwah, NJ: Lawrence Erlbaum associates.
- Borg, G. (1982). A category scale with ratio properties for intermodal and interindividual comparisons. In H.-G. Geissler & P. Petzold (dir.), Psychophysical judgment and the
- process of perception (pp. 25-34). amsterdam: north-holland Publishing company. Bradburn, N. M., & Sudman, S. (1979). Improving interview method and questionnaire design: Response effects to threatenning questions in survey research. San Francisco, CA : Jossey-Bass Publications.
- Clark, H. H., & Schober, M. F. (1992). Asking questions and influencing answers. In J. M. Tanur (dir.), Questions about questions (pp. 15-48). NY: Russel Sage Foundation.
- cools, W., Hofmans, J., & Theuns, P. (2006). Context in category scales: is fully agree equal to twice agree? Revue européenne de psychologie appliquée, 56, 223-229.
- Curtis, D. D. (2003). The influence of person misfit on measurement in attitude surveys. dissertation non publiée, Flinders University, Adelaide.
- Curtis, D. D., & Boman, P. (2004, July). The identification of misfitting response patterns to, and their influence on the calibration of, attitude survey instruments. communication présentée lors du 12e international objective Measurement workshop (IOMW), Cairns, Australia.
- Dawes, R. M., & Smith, T. L. (1985). Attitude and opinion measurement. In G. Lindzey & E. Aronson (dir.), Handbook of social psychology (3e éd., vol. 1: theory and method, pp. 509-566). New York: Random House.
- Grondin, J., & Blais, J.-G. (2010, mai). A Rasch analysis on collapsing categories in item’s response scale of survey questionnaire: Maybe it’s not one size fits all. Communication présentée lors du congrès de l’american educational research association (AERA), Denver, CO.
- Groves, R. M., Fultz, N. H., & Martin, E. (1992). Direct questioning about comprehension in a survey setting. in J. M. tanur (dir.), Questions about questions (pp. 49-61). NY: Russel Sage Foundation.
- Hambleton, R. K., Swaminathan, H., & Rogers, H. J. (1991). Fundamentals of item response theory. Newbury Park, CA: Sage Plublications.
- Jackson, T. R., & Popovich, N. G. (2006). The development, implementation, and evaluation of a self-assessment instrument for use in a pharmacy student competition. American Journal of Pharmaceutical education, 67 (2), article 57.
- Kahneman, D., & Tversky, A. (1982). On the psychology of prediction. In D. Kahneman, P. Slovic & A. Tversky (dir.), Judgment under uncertainty: Heuristics and biases (pp. 48-68). Cambridge, UK: Cambridge University Press.
- Krosnick, J. A., & Abelson, R. P. (1992). The case for measuring attitude strength in surveys. in J. M. tanur (dir.), Questions about questions (pp. 177-203). NY: Russel Sage Foundation.
- Lawton, G., Bhakta, B. B., Chamberlain, M. A., & Tennant, A. (2004). The Behçet’s disease activity index. Rheumatology, 43 (1), 73-78.
- Lee, O. K. (1992). Variance in Mathematics and reading across Grades. Rasch Measurement Transcations, 6 (2), 222-223.
- Li, M.-N. F., & Olejnik, S. (1997). The power of Rasch person-fit statistics in detecting unusual response patterns. Applied Psychological Measurement, 21 (3), 215-231.
- Linacre, J. M. (1994). Sample size and item calibration stability. Rasch Measurement Transactions, 7 (4), 328.
- Linacre, J. M. (1996). The rasch model cannot be disproved! Rasch Measurement Transactions, 10 (3), 512-514.
- Linacre, J. M. (2006a). Aide en ligne du logiciel winsteps Rasch Measurement (version 3.60.1). consulté à partir de [www.winsteps.com].
- Linacre, J. M. (2006b). winsteps® Rasch Measurement (version: 3.60.1). Consulté à partir de [www.winsteps.com].
- Linacre, J. M., & Wright, B. D. (1994). Dichotomous infit and outfit mean-square fit statistics. Rasch Measurement Transactions, 8 (2), 350-360.
- Ng, S. H., Pipe, M.-E., Beath, B., & Holton, D. (1999). Framing the problem: effects of wording on children’s statistical inferences. educational Psychology, 19 (4), 489-499.
- Park, T. (2004). An investigation of an esl placement test of writing using many-facet Rasch measurement. Working papers in TeSOL & applied linguistics, 4 (1).
- Rohrmann, B. (2003). Verbal qualifiers for rating scales: Sociolinguistic considerations and psychometric data. Melbourne, australia: university of Melbourne.
- Rugg, d. (1941). Experiments in wording questions: ii. Public opinion quarterly, 5 (1), 91-92.
- Schaeffer, N. C., & Presser, S. (2003). The science of asking questions. Annual Review of Sociology, 29, 65-88.
- Schuman, H., & Kalton, G. (1985). Survey methods. In G. lindzey & E. Aronson (dir.), Handbook of social psychology (3e éd., vol. 1: Theory and method, pp. 635-697). New York: Random House.
- Schwarz, N. (1999). Self-reports: how the questions shape the answers. American Psychologist, 54 (2), 93-105.
- Smith, R. M. (1996). Polytomous mean-square fit statistics. Rasch Measurement Transactions, 10 (3), 516-517.
- Smith, R. M. (2004). Fit analysis in latent trait measurement models. In E. V. Smith Jr. & R. M. Smith (dir.), Introduction to Rasch measurement: theory, models and applications (pp. 73-92). Maple Grove, Mn: JAM Press.
- Smith, R. M., Schumacker, R. E., & Bush, M. J. (1998). Using item mean squares to evaluate fit to the rasch model. Journal of Outcome Measurement, 2 (1), 66-78.
- Smith, R. M., & Suh, K. K. (2003). Rasch fit statistics as a test of the invariance of item parameter estimates. Journal of Applied Measurement, 4 (2), 153-163.
- Smith, T. W. (1980). The 75 % solution: an analysis of the structure of attitudes on gun control, 1959-1977. The Journal of Criminal Law & Criminology, 71 (3), 300-316.
- Tejada, A. J. R., Gómez, A. G., García, J. L. P., & Meléndez, C. P. (2002). Two strategies for fitting real data to rasch polytomous models. Journal of Applied Measurement, 3 (2), 129-145.
- Thissen, D., & Wainer, H. (2001). Test scoring. Mahwah, NJ: Lawrence Erlbaum associates.
- Tourangeau, R., & Rasinski, K. A. (1988). Cognitive processes underlying context effects in attitude measurement. Psychological Bulletin, 103 (3), 299-314.
- Tourangeau, R., Rips, L. J., & Rasinski, K. (2000). The psychology of survey response. Cambridge, UK: cambridge University Press.
- Wang, W.-C., & Chen, C.-T. (2005). Item parameter recovery, standard error estimates, and fit statistics of the winsteps program for the family of Rasch models. educational and Psychological Measurement, 65 (3), 376-404.
- Wright, B. D., & Mok, M. M. C. (2004). An overview of the family of rasch measurement models. In E. V. Smith Jr. & R. M. Smith (dir.), Introduction to Rasch measurement: Theory, models and applications (pp. 1-24). Maple Grove, Mn: JAM Press.