Abstracts
Abstract
Prior to undertaking a descriptive study on attrition and retention of students in two online undergraduate health administration and human service programs, a pilot test was conducted to assess the procedures for participant recruitment, usability of the survey questionnaire, and data collection processes. A retention model provided the conceptual framework for this investigation to identify and organize various factors that influenced students’ decisions to either discontinue or continue their educational programs. In an attempt to contribute to the body of research in this area and to enrich pedagogical practices, the authors describe the pilot testing processes and feasibility issues explored, and the improvements made to the instrument and methodology before commencing the main research study on attrition and retention.
Keywords:
- pilot testing,
- feasibility study,
- attrition,
- retention,
- model,
- health administration,
- human service,
- online,
- undergraduate,
- students,
- distance education
Appendices
Bibliography
- Ackerman, W. B., & Lohnes, P. R. (1981). Research methods for nurses. New York, NY: McGraw-Hill Book Company.
- Algase, D. L. (2009). To publish or not: that is not the real pilot study question? Research and Theory for Nursing Practice, 23(2), 83-84.
- Arain, M., Campbell, M. J., Cooper, C. L., & Lancaster, G. A. (2010). What is a pilot or feasibility study? A review of current practice and editorial policy. BMC Medical Research Methodology, 10(67). doi: 10.1186/1471-2288-10-67
- Beebe, L. H. (2007). What can we learn from pilot studies? Perspectives in Psychiatric Care, 43(4), 213- 8. doi: 10.1111/j.1744-6163.2007.00136.x
- Berge, Z. L., & Huang, Y. P. (2004). A model for sustainable student retention: A holistic perspective on the student dropout problem with special attention to e-learning. DEOSNEWS, 13(5). Retrieved from https://www.researchgate.net/profile/Zane_Berge/publication/237429805_A_Model_for_Sustainable_Student_Retention_A_Holistic_Perspective_on_the_Student_Dropout_Problem_with_Special_Attention_to_e-Learning/links/0deec52f30b93d72a1000000.pdf
- Bowen, D. J., Kreuter, M., Spring, B., Cofta-Woerpel, L., Linnan, L., Weiner, D., … Fernandez, M. (2009). How we design feasibility studies. American Journal of Preventive Medicine, 36(5), 452-457.
- Brink, P. J., & Wood, M. J. (1983). Basic steps in planning nursing research. Monterey, CA: Wadsworth.
- Bugge, C., Williams, B., Hagen, S., Logan, J., Glazener, C., Pringle, S., & Sinclair, L. (2013). A process for decision-making after pilot and feasibility trials (ADePT): development following a feasibility study of a complex intervention for pelvic organ prolapse. Trials, 14(1), 353.
- Burns, N., & Grove, S. K. (1987). The practice of nursing research conduct, critique and utilization. Philadelphia, PA: W. B. Saunders Company.
- Chu, S-Y. (2013). Teacher efficacy beliefs toward serving culturally and linguistically diverse students in special education: Implications of a pilot study. Education and Urban Society, 45(3), 385-410.
- Cohen, L., Manion, L., & Morrison, K. (2007). Research methods in education (6th ed.). London: Routledge/Falmer.
- Collins English Dictionary. (2014). Pilot study. Retrieved from http://www.thefreedictionary.com/pilot+study
- Conn, V. S., Algase, D. L, Rawl, S. M., Zerwic, J. J., & Wyman, J. F. (2010). Publishing pilot intervention work. Western Journal of Nursing Research, 32(8), 994-1010. doi: 10.1177/0193945910367229
- Connelly, L. M. (2008). Pilot studies. Medsurg Nursing, 17(6), 411-413.
- Constant Contact. (2015). Constant contact email marketing software. Retrieved from https://www.constantcontact.com/index.jsp
- Cook, C., Heath, F., & Thompson, R. L. (2000). A meta-analysis of response rates in web- or internet-based surveys. Educational and Psychological Measurement, 60(6), 821-836.
- Cope, D. G. (2015). Conducting pilot and feasibility studies. Oncology Nursing Forum. 42(2), 196-197. doi: 10.1188/15.ONF.196-197
- Dobkin, B. H. (2009). Progressive staging of pilot studies to improve Phase III trials for motor interventions. Neurorehabilitation & Neural Repair, 23(3), 197-206.
- Doody, O., & Doody, C. M. (2015). Conducting a pilot study: Case study of a novice researcher. British Journal of Nursing, 24(21), 1074-1078.
- Eldridge, S. M., Lancaster, G. A., Campbell, M. J., Thabane, L., Hopewell, S., Coleman, C. L., & Bond, C. M. (2016). Defining feasibility and pilot studies in preparation for randomised controlled trials: Development of a conceptual framework. PLoS One, 11(3). doi: 10.1371/journal.pone.0150205
- Fan, W., & Yan, Z. (2010). Factors affecting response rates of the web survey: A systematic review. Computers in Human Behavior, 26(2), 132-139. doi: 10.1016/j.chb.2009.10.015
- Friedman, H. H., & Amoo, T. (1999). Rating the rating scales. Journal of Marketing Management. 9(3), 114-123.
- Friedman, H. H., Friedman, L. W., & Gluck, B. (1988). The effects of scale-checking styles on responses to a semantic differential scale. Journal of the Market Research Society, 30(4), 477-482.
- Gitlin, L. N. (2013). Introducing a new intervention: An overview of research phases and common challenges. The American Journal of Occupational Therapy, 67(2), 177-184.
- Gudmundsdottir, G. B., & Brock‐Utne, B. (2010). An exploration of the importance of piloting and access as action research. Educational Action Research, 18(3), 359-372.
- Heyman, E. (2010, Winter). Overcoming student retention issues in higher education online programs. Online Journal of Distance Learning Administration, 13(4). Retrieved from http://www.westga.edu/~distance/ojdla/winter134/heyman134.html
- Hinds, P. S., & Gattuso, J. S. (1991). Measuring hopefulness in adolescents. Journal of Pediatric Oncology Nursing 8(2), 92-94.
- Jairath, N., Hogerney, M., & Parsons, C. (2000). The role of the pilot study: A case illustration from cardiac nursing research. Applied Nursing Research, 13(2), 92-96.
- Kim, Y (2011). The pilot study in qualitative inquiry: Identifying issues and learning lessons for culturally competent research. Qualitative Social Work, 10(2), 190-206. doi: 10.1177/1473325010362001
- Koskey, K. L. K., Cain, B., Sondergeld, T. A., Alvim, H. G., & Slager, E. M. (2015). A mixed-methods investigation of factors and scenarios influencing college students' decision to complete surveys at five mid-western universities. Mid-Western Educational Researcher, 27(1). Retrieved from http://www.mwera.org/MWER/volumes/v27/issue1/v27n1-Koskey-et-al-FEATURE-ARTICLES.pdf
- Lancaster, G. A. (2015). Pilot and feasibility studies come of age! Pilot and Feasibility Studies, 1(1), 1.
- Lancaster, G. A., Dodd, S., & Williamson, P. R. (2004) Design and analysis of pilot studies: recommendations for good practice. Journal of Evaluation in Clinical Practice, 10(2), 307-12.
- Lee, E. C., Whitehead, A. L., Jacques, R. M., & Julious, S. A. (2014). The statistical interpretation of pilot trials: Should significance thresholds be reconsidered? BMC Medical Research Methodology, 14(1), 41.
- Leon, A.C., Davis, L. L., & Kraemer, H. C. (2011). The role and interpretation of pilot studies in clinical research. Journal of Psychiatric Research, 45(5), 626-629. doi: 10.1016/j.jpsychires.2010.10.008
- Lieswiadomy, R. M. (1987). Foundations of nursing research. Norwalk, CT: Appleton & Lange.
- Moore, C. G., Carter, R. E., Nietert, P. J., & Stewart, P. W. (2011). Recommendations for planning pilot studies in clinical and translational research. Clinical and Translational Science, 4(5), 332-337.
- Morin, K.H. (2013). Value of a pilot study. Journal of Nursing Education, 52(10), 547-548. doi: 10.3928/0148483420130920-10
- O'Cathain, A., Hoddinott, P., Lewin, S., Thomas, K., Young, B., Adamson, J., … Donovan, J. (2015). Maximising the impact of qualitative research in feasibility studies for randomised controlled trials: Guidance for researchers. Pilot and Feasibility Studies 1(1), 32. Retrieved from http://tinyurl.com/owaskpe
- Orsmond, G. I., & Cohn, E. S. (2015). The distinctive features of a feasibility study: Objectives and guiding questions. Occupational Therapy Journal of Research. Advance online publication. doi: 10.1177/1539449215578649
- Polit, D. F., & Beck, C. T. (2004). Nursing research: Principles and methods. Philadelphia, PA: Lippincott Williams & Wilkins.
- Polit, D. F., & Hungler, B. P. (1987). Essentials of nursing research. (3rd ed.). Philadelphia, PA: J. B. Lippincott.
- Prescott, P. A., & Soeken, K. L. (1989). The potential uses of pilot work. Nursing Research, 38(1), 60.
- Randolph, J. J., & Crawford, L. M. (2013). Factorial validity and reliability of the sense of community in online courses scale. Journal of Interactive Online Learning, 12(2), 54-71.
- Rintala, U, Andersson, S. & Kairamo, A. K. (2012). How to retain students in higher engineering education? Findings of the ATTRACT project. Structural Engineering Forum of India Annual Conference. Retrieved from http://www.attractproject.org/sites/default/files/document/WP8_SEFI_2012%20present.pdf
- Robichaud, W. (2016). Orientation programs to increase retention in online community college courses. Distance Learning, 13(2), 52-64.
- Snow, K. (2016). Opting in or opting out: The role of hybrid learning course design on student persistence decisions in an indigenous pre-nursing transitions program. International Journal of E-Learning & Distance Education, 32(1). Retrieved from http://www.ijede.ca/index.php/jde/article/view/948/1610
- Thabane, L., Ma, J., Chu, R., Cheng, J., Ismaila, A., Rios, L. P.,... Goldsmith, C. H. (2010). A tutorial on pilot studies: The what, why and how. BMC Medical Research Methodology, 10(1), 1. doi: 10.1186/1471-2288-10-1
- Tickle-Degnen, L. (2013). Nuts and bolts of conducting feasibility studies. American Journal of Occupational Therapy, 67(2), 171-176. doi: 10.5014/ajot.2013.006270
- Tinto, V. (1975). Dropouts from higher education: A theoretical synthesis of the recent literature. A Review of Educational Research, 45, 89-125.
- Tinto, V. (1982). Limits of theory and practice in student attrition. The Journal of Higher Education, 53, (6), 687-700. doi: 10.2307/1981525
- Tyler-Smith, K. (2006). Early attrition among first time e-learners: A review of factors that contribute to drop-out, withdrawal and non-completion rates of adult learners undertaking elearning programmes. Journal of Online Learning and Teaching, 12(2). Retrieved from http://jolt.merlot.org/Vol2_No2_TylerSmith.htm
- van Teijlingen E, R., & Hundley, V. (2002) The importance of pilot studies. Nursing Standard, 16(40), 33-36.
- Walston, J. T., Lissitz, R. W., & Rudner, L. M. (2006). The influence of web-based questionnaire presentation variations on survey cooperation and perceptions of survey quality. Journal of Official Statistics, 22, 271-91.
- Williams, M. (2016). Feasibility and pilot studies: A guide for advisors. NIHR Research Design Service. National Institute for Health Research. Retrieved from http://www.rds-eastmidlands.nihr.ac.uk/resources/Guide%20to%20Supporting%20Feasibility%20and%20Pilot%20Studies%20MAY%202016%20FIANAL.pdf
- Wolfe, B.E. (2013). The value of pilot studies in clinical research: A clinical translation of the research article titled ‘In search of an adult attachment stress provocation to measure effect on the oxytocin system'. Journal of American Psychiatric Nurses Association, 19(4), 192-194. doi: 10.1177/1078390313493248