Abstracts
Abstract
Education dashboards are a means to present various stakeholders with information about learners, most commonly regarding the learners’ activity in online learning environments. Typically, an education dashboard for teachers will include some type of visual aids that encourage teachers to reflect upon learner behavior patterns and to act in accordance to it. In practice, this tool can assist teachers to make data-driven decisions, thus supporting their professional growth, however, so far, the use of education dashboards by teachers has been greatly understudied. In this research we report on two studies related to the associations between the use of education dashboards by elementary school teachers and the teachers’ professional growth. We used the framework defined by the International Society for Technology in Education’s (ISTE) Standards for Educators. In the first study, we took a quantitative approach (N=52 teachers), using an online self-report questionnaire, and found that the use of dashboards is positively associated with professional growth in the dimensions of facilitator, analyst, designer, and citizen. In the second study, we took a qualitative approach (N=9 teachers), using semi-structured interviews, to shed light on the mechanisms through which teachers benefit from the use of education dashboards.
Keywords:
- teachers,
- education dashboard,
- professional development,
- data-driven decision-making,
- elementary school
Appendices
Bibliography
- Allen, I. E., & Seaman, J. (2017). Digital learning compass: Distance education enrollment report 2017. Babson Survey Research Group. https://doi.org/10.1108/IJEM-02-2014-0018
- Annerstedt, C., & Larsson, S. (2010). ‘I have my own picture of what the demands are...’: Grading in Swedish PEH — problems of validity, comparability and fairness. European Physical Education Review, 16(2), 97-115. https://doi.org/10.1177/1356336X10381299
- Avidov-Ungar, O. (2016). A model of professional development: teachers’ perceptions of their professional development. Teachers and Teaching, 22(6), 653-669. https://doi.org/10.1080/13540602.2016.1158955
- Charleer, S., Klerkx, J., Duval, E., De Laet, T., & Verbert, K. (2016). Creating effective learning analytics dashboards: Lessons learnt (pp. 42-56). In K. Verbert M. Sharples & T. Klobučar (Eds.) Adaptive and adaptable learning, Springer, Cham. https://doi.org/10.1007/978-3-319-45153-4_4
- Collinson, V., Kozina, E., Kate Lin, Y. H., Ling, L., Matheson, I., Newcombe, L., & Zogla, I. (2009). Professional development for teachers: A world of change. European Journal of Teacher Education, 32(1), 3-19. https://doi.org/10.1080/02619760802553022
- Danielson, C. (2011). Enhancing Professional Practice (2nd ed.). Association for Supervision and Curriculum Development. Received from http://www.ascd.org/Publications/Books/Overview/Enhancing-Professional-Practice-A-Framework-for-Teaching-2nd-Edition.aspx
- Darling-Hammond, L., & McLaughlin, M. W. (1995). Policies that support professional development in an era of reform. Phi Delta Kappan, 92(6), 81-92. https://doi.org/10.1177/003172171109200622
- Demmans Epp, C., Phirangee, K., & Hewitt, J. (2019). User-centered dashboard design: Iterative design to support teacher informational needs in online learning contexts. American Educational Research Association Annual Meeting. Toronto: Canada. Received from https://www.researchgate.net/publication/332380972
- Ez-zaouia, M., Tabard, A., & Lavoué, E. (2020). EMODASH: A dashboard supporting retrospective awareness of emotions in online learning. International Journal of Human Computer Studies, 139, 102411. https://doi.org/10.1016/j.ijhcs.2020.102411
- Faria, A.-M., Greenberg, A., Meakin, J., Bichay, K., & Heppen, J. (2014). Replicating the relationship between teachers’ data use and student achievement: The urban data study and the data dashboard usage study. Society for Research on Educational Effectiveness, 1-8. Retrieved from https://files.eric.ed.gov/fulltext/ED562866.pdf
- Ferreira, J., Ryan, L., & Tilbury, D. (2007). Mainstreaming education for sustainable development in initial teacher education in Australia: a review of existing professional development models. Journal of Education for Teaching, 33(2), 225-239. https://doi.org/10.1080/02607470701259515
- Gillet, D., Holzer, A., Schwendimann, B. A., Boroujeni, M. S., Vozniuk, A., Prieto, L. P., & Rodríguez Triana, M. J. (2017). Monitoring, awareness and reflection in blended technology enhanced learning: A systematic review. International Journal of Technology Enhanced Learning, 9(2/3), 126. https://doi.org/10.1504/ijtel.2017.10005147
- Grossi, M. G. R., Oliveira, E. S., Barbosa, A. C., & Oliveira, P. H. de. (2016). People with disabilities and the formation of the basic education teacher: A study of Brazilian reality. Journal of Education and Human Development, 5(4), 2334-2978. https://doi.org/10.15640/jehd.v5n4a14
- Lang, C., Siemens, G., Wise, A., & Gašević, D. (Eds.) (2017), Handbook of learning analytics. Society for Learning Analytics Research (SoLAR). https://doi.org/10.18608/hla17
- Hargreaves, A. (2005). Educational change takes ages: Life, career and generational factors in teachers’ emotional responses to educational change. Teaching and Teacher Education, 21(8), 967-983. https://doi.org/10.1016/j.tate.2005.06.007
- Hay, P. J., & Macdonald, D. (2008). (Mis)appropriations of criteria and standards‐referenced assessment in a performance‐based subject. Assessment in Education: Principles, Policy & Practice, 15(2), 153-168. https://doi.org/10.1080/09695940802164184
- Hershkovitz, A. & Karni, O. (2018). Borders of change: A holistic exploration of teaching in one-to-one computing programs. Computers & Education, 125, 429-443.
- Hershkovitz, A., Merceron, A., & Shamaly, A. (2019). The role of pedagogy in one-to-one computing lessons: a quantitative observational study of teacher-student interactions. Revista Española de Pedagogía, 77(274), 487-515.
- Holstein, K., McLaren, B. M., & Aleven, V. (2017). Intelligent tutors as teachers’ aides. Proceedings of the Seventh International Learning Analytics & Knowledge Conference on - LAK ’17, 257-266. https://doi.org/10.1145/3027385.3027451
- Hsieh, H.-F. & Shannon, S.E. (2005). Three approaches to qualitative content analysis. Qualitative Health Research, 15(9), 1277-1288.
- Hung, M.-L. (2016). Teacher readiness for online learning: Scale development and teacher perceptions. Computers & Education, 94, 120-133. https://doi.org/10.1016/J.COMPEDU.2015.11.012
- Khan, M., & Khan, S. (2011). Data and information visualization methods, and interactive mechanisms: A survey. International Journal of Computer Applications, 34(1), 1-14. https://doi.org/10.5120/4061-5722
- Light, D., Wexler, D. H., & Heinze, J. (2005). Keeping teachers in the center: A framework for data-driven decision-making. Proceedings of Society for Information Technology & Teacher Education International Conference 2005, Secada 2001, 128-133. Retrieved from https://www.learntechlib.org/primary/p/18964/
- Mandinach, E. B. (2012). A perfect time for data use: using data-driven decision making to inform practice. Educational Psychologist, 47(2), 71-85. https://doi.org/10.1080/00461520.2012.667064
- Mandinach, E. B., & Gummer, E. S. (2013). A systemic view of implementing data literacy in educator preparation. Educational Researcher, 42(1), 30-37. https://doi.org/10.3102/0013189X12459803
- Mann, H. B., & Whitney, D. R. (1947). On a test of whether one of two random variables is stochastically larger than the other. The Annals of Mathematical Statistics, 18(1), 50-60. https://doi.org/10.1214/aoms/1177730491
- Tissenbaum, Matuk, C., M., Berland, M., Lyons, L., Cocco, F., Linn, M., ... & Dillenbourg, P. (2016). Real-time visualization of student activities to support classroom orchestration (symposium). In C.-K. Looi, J. Polman, U. Cress, & P. Reimann (eds.), Transformin learning, empowering learners: The international conferences of the learning sciences: Volume 2 (pp. 1120-1127). Singapore: International Society of the Learning Sciences. https://www.isls.org/icls/2016/docs/ICLS2016_Volume_2.pdf
- Molenaar, I., & Knoop-van Campen, C. (2018). How teachers make dashboard information actionable. IEEE Transactions on Learning Technologies, 12(3), 347-355. https://doi.org/10.1109/TLT.2018.2851585
- Nabhani, M., & Bahous, R. (2010). Lebanese teachers’ views on “continuing professional development.” Teacher Development, 14(2), 207-224. https://doi.org/10.1080/13664530.2010.494502
- Reeves, T. D., & Honig, S. L. (2015). A classroom data literacy intervention for pre-service teachers. Teaching and Teacher Education, 50, 90-101. https://doi.org/10.1016/J.TATE.2015.05.007
- Richardson, J. W., McLeod, S., Flora, K., Sauers, N. J., Kannan, S., & Sincar, M. (2013). Large-scale 1:1 computing initiatives: An open access database. International Journal of Education and Development Using Information and Communication Technology, 9(1), 4-18. https://doi.org/http://ijedict.dec.uwi.edu/
- Rienties, B., Herodotou, C., Olney, T., Schencks, M., & Boroowa, A. (2018). Making sense of learning analytics dashboards: A technology acceptance perspective of 95 teachers. International Review of Research in Open and Distance Learning, 19(5), 187-202. https://doi.org/10.19173/irrodl.v19i5.3493
- Schifter, C. et al. (2014). Data-driven decision making: Facilitating teacher use of student data to inform classroom instruction. Contemporary Issues in Technology and Teacher Education, 14(4), 419-432. Retrieved from https://www.learntechlib.org/p/148436/
- Schwendimann, B. A., Rodríguez-Triana, M. J., Vozniuk, A., Prieto, L. P., Shirvani Boroujeni, M., Holzer, A., ... & Dillenbourg, P. (2017). Perceiving learning at a glance: A systematic literature review of learning dashboard research. IEEE Transactions on Learning Technologies, 10(1), 30-41. https://doi.org/10.1109/TLT.2016.2599522
- Tissenbaum, M., & Slotta, J. (2019). Supporting classroom orchestration with real-time feedback: A role for teacher dashboards and real-time agents. International Journal of Computer-Supported Collaborative Learning, 14(3), 325-351. https://doi.org/10.1007/s11412-019-09306-1
- Trust, T. (2018). 2017 ISTE Standards for educators: From teaching with technology to using technology to empower learners. Journal of Digital Learning in Teacher Education, 34(1), 1-3. https://doi.org/10.1080/21532974.2017.1398980
- Vanlommel, K., Van Gasse, R., Vanhoof, J., & Van Petegem, P. (2017). Teachers’ decision-making: Data based or intuition driven? International Journal of Educational Research, 83, 75-83. https://doi.org/10.1016/J.IJER.2017.02.013
- Wishart, J. (2017). Mobile learning in schools. In J. Wishart (Ed.) Mobile learning in schools. London, Routledge. https://doi.org/10.4324/9781315536774
- Xhakaj, F., Aleven, V., & McLaren, B. M. (2016). How teachers use data to help students learn: Contextual inquiry for the design of a dashboard. Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 9891 LNCS, 340-354. https://doi.org/10.1007/978-3-319-45153-4_26
- Xhakaj, F., Aleven, V., & McLaren, B. M. (2017). Effects of a teacher dashboard for an intelligent tutoring system on teacher knowledge, lesson planning, lessons and student learning. Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 10474 LNCS, 315-329. https://doi.org/10.1007/978-3-319-66610-5_23
- Yoo, Y., Lee, H., Jo, I. H., & Park, Y. (2015). Educational dashboards for smart learning: Review of case studies. In G. Chen, V. K. Kinshuk, R. Huang, & S. C. Kong (Eds.), Lecture Notes in Educational Technology (Issue 9783662441879, pp. 145-155). Springer-Verlag. https://doi.org/10.1007/978-3-662-44188-6_21
- Yurtseven Avci, Z., & O’Dwyer, L. (2016). Effective technology professional development: A systematic review. Society for Information Technology & Teacher Education International Conference, 2016(1), 2455-2460. Retrieved from https://www.learntechlib.org/p/172038/