Your teammate just sent you a new message!The effects of using telegram on individual acquisition of teamwork competence

  1. Miguel Á. Conde 1
  2. Francisco J. Rodríguez-Sedano 1
  3. Ángel Hernández-García 2
  4. Alexis Gutiérrez Fernández 1
  5. Ángel M. Guerrero-Higueras 1
  1. 1 Universidad de León
    info

    Universidad de León

    León, España

    ROR https://ror.org/02tzt0b78

  2. 2 Universidad Politécnica de Madrid
    info

    Universidad Politécnica de Madrid

    Madrid, España

    ROR https://ror.org/03n6nwv02

Revista:
IJIMAI

ISSN: 1989-1660

Año de publicación: 2021

Volumen: 6

Número: 6

Páginas: 225-233

Tipo: Artículo

DOI: 10.9781/IJIMAI.2021.05.007 DIALNET GOOGLE SCHOLAR lock_openDialnet editor

Otras publicaciones en: IJIMAI

Resumen

Students’ acquisition of teamwork competence has become a priority for educational institutions. The development of teamwork competence in education generally relies in project-based learning methodologies and challenges. The assessment of teamwork in project-based learning involves, among others, assessing students’ participation and the interactions between team members. Project-based learning can easily be handled in small-size courses, but course management and teamwork assessment become a burdensome task for instructors as the size of the class increases. Additionally, when project-based learning happens in a virtual space, such as online learning, interactions occur in a less natural way. This study explores the use of instant messaging apps (more precisely, the use of Telegram) as team communication space in project-based learning, using a learning analytics tool to extract and analyze student interactions. Further, the study compares student interactions (e.g., number of messages exchanged) and individual teamwork competence acquisition between traditional asynchronous (e.g., LMS message boards) and synchronous instant messaging communication environments. The results show a preference of students for IM tools and increased participation in the course. However, the analysis does not find significant improvement in the acquisition of individual teamwork competence.

Referencias bibliográficas

  • R. Colomo-Palacios, C. Casado-Lumbreras, P. Soto-Acosta, F. J. GarcíaPeñalvo, and E. Tovar-Caro, “Competence gaps in software personnel: A multi-organizational study,” Computers in Human Behavior, vol. 29, pp. 456-461, March 2013 2013, doi: 10.1016/j.chb.2012.04.021.
  • D. E. Leidner and S. L. Jarvenpaa, 265-291., “The use of information technology to enhance management school education: A theoretical view.,” MIS quarterly, vol. 19, no. 3, pp. 265-291, 1995.
  • D. R. Vogel, R. M. Davison, and R. H. Shroff, “Sociocultural learning: A perspective on GSS-enabled global education,” Communications of the Association for Information Systems, vol. 7, no. 1, 2001.
  • Á. Fidalgo-Blanco, M. L. Sein-Echaluce, F. J. García-Peñalvo, and M. Á. Conde, “Using Learning Analytics to improve teamwork assessment,” Computers in Human Behavior, vol. 47, no. 0, pp. 149-156, 2015, doi: 10.1016/j.chb.2014.11.050.
  • M. A. Rosen et al., “Tools for evaluating team performance in simulationbased training,” Journal of emergencies, trauma, and shock, vol. 3, no. 4, pp. 353-359, Oct-Dec 2010, doi: 10.4103/0974-2700.70746.
  • D. J. Dwyer, R. L. Oser, and E. Salas, “Event-Based Approach to Training (EBAT),” The International Journal of Aviation Psychology, vol. 8, no. 3, pp. 209-221, 1998, doi: 10.1207/s15327108ijap0803_3.
  • N. E. Lane, E. Salas, T. Franz, and R. Oser, “Improving the Measurement of Team Performance: The TARGETs Methodology,” Military Psychology, vol. 6, no. 1, pp. 47-61, 1994, doi: 10.1207/s15327876mp0601_3.
  • D. Schwab, H. G. Heneman Iii, and T. A. DeCotiis, Behaviorally anchored rating scales: A review of the literature. 2006, pp. 549-562.
  • A. Frankel, R. Gardner, L. Maynard, A. J. T. J. C. J. o. Q. Kelly, and P. Safety, “Using the communication and teamwork skills (CATS) assessment to measure health care team performance,” vol. 33, no. 9, pp. 549-558, 2007.
  • P. H. Hackbert, “Building Entrepreneurial Teamwork Competencies in Collaborative Learning via Peer Assessments,” vol. 1, no. 12, pp. 39-52, 2004.
  • I. d. l. Ríos-Carmenado, B. Figueroa-Rodríguez, and F. Gómez-Gajardo, “Methodological Proposal for Teamwork Evaluation in the Field of Project Management Training,” Procedia - Social and Behavioral Sciences, vol. 46, pp. 1664-1672, 2012, doi: https://doi.org/10.1016/j.sbspro.2012.05.358.
  • K. Tasa, S. Taggar, and G. H. Seijts, “The development of collective efficacy in teams: a multilevel and longitudinal perspective,” Journal of Applied Psychology, vol. 92, no. 1, pp. 17-27, 2007.
  • Á. Fidalgo-Blanco, D. Lerís, M. L. Sein-Echaluce, and F. J. García-Peñalvo, “Monitoring Indicators for CTMTC: Comprehensive Training Model of the Teamwork Competence in Engineering Domain,” International Journal of Engineering Education (IJEE), vol. 31, no. 3, pp. 829-838, 2015.
  • D. Lerís, Á. Fidalgo, and M. L. Sein-Echaluce, “A comprehensive training model of the teamwork competence,” International Journal of Learning and Intellectual Capital, vol. 11, no. 1, pp. 1-19, 2014.
  • F. J. García-Peñalvo, A. Corell, V. Abella-García, and M. Grande, “Online assessment in higher education in the time of COVID-19,” Education in the Knowledge Society, vol. 21, Art no. 12, 2020, doi: 10.14201/eks.23013.
  • F. J. García Peñalvo and A. Corell, “La COVID-19:¿ enzima de la transformación digital de la docencia o reflejo de una crisis metodológica y competencial en la educación superior?,” Campus Virtuales, vol. 9, no. 2, pp. 83-98, 2020.
  • C. Lewis and B. Fabos, “Instant messaging, literacies, and social identities,” vol. 40, no. 4, pp. 470-501, 2005, doi: doi:10.1598/RRQ.40.4.5.
  • D. Carnevale, “Email is for old people,” The Chronicle of Higher Education, vol. 53, no. 7, 2006.
  • R. Junco and J. Mastrodicasa, Connecting to the Net.generation: What Higher Education Professionals Need to Know about Today’s Students. US: NASPA, National Association of Student Personnel Administrators, Student Affairs Administrators in Higher Education, 2007.
  • Statista. “Most popular global mobile messenger apps as of October 2020, based on number of monthly active users.” https://www.statista. com/statistics/258749/most-popular-global-mobile-messenger-apps/ (accessed 03/02/2020).
  • M. Á. Conde, F. J. Rodríguez-Sedano, F. J. Rodríguez-Lera, A. GutiérrezFernández, and Á. M. Guerrero-Higueras, “Assessing the individual acquisition of teamwork competence by exploring students’ instant messaging tools use: the WhatsApp case study,” Univ Access Inf Soc, 2020/11/01 2020, doi: 10.1007/s10209-020-00772-1.
  • M. Á. Conde, F. J. Rodríguez-Sedano, F. J. Rodríguez-Lera, A. GutiérrezFernández, and Á. M. Guerrero-Higueras, “Analyzing Students’ WhatsApp Messages to Evaluate the Individual Acquisition of Teamwork Competence,” in Learning and Collaboration Technologies. Ubiquitous and Virtual Environments for Learning and Collaboration. HCII 2019. Lecture Notes in Computer Science, Z. P. and I. A. Eds., (Learning and Collaboration Technologies. Ubiquitous and Virtual Environments for Learning and Collaboration, P. Zaphiris and A. Ioannou, Eds. Cham: Springer International Publishing, 2019, pp. 26-36.
  • T. Sutikno, L. Handayani, D. Stiawan, M. A. Riyadi, and I. M. I. Subroto, “WhatsApp, viber and telegram: Which is the best for instant messaging?,” International Journal of Electrical & Computer Engineering (2088-8708), vol. 6, no. 3, 2016.
  • M. Á. Conde, F. J. Rodríguez-Sedano, C. Fernández, A. GutiérrezFernández, L. Fernández-Robles, and M. C. Limas, “A Learning Analytics tool for the analysis of students’ Telegram messages in the context of teamwork virtual activities,” presented at the Eighth International Conference on Technological Ecosystems for Enhancing Multiculturality, Salamanca, Spain, 2020. [online]. Available: 10.1145/3434780.3436601.
  • M. Á. Conde, Á. Hernández-García, F. J. García-Peñalvo, Á. FidalgoBlanco, and M. Sein-Echaluce, “Evaluation of the CTMTC Methodology for Assessment of Teamwork Competence Development and Acquisition in Higher Education,” in Learning and Collaboration Technologies: Third International Conference, LCT 2016, Held as Part of HCI International 2016, Toronto, ON, Canada, July 17-22, 2016, Proceedings, P. Zaphiris and A. Ioannou Eds. Cham: Springer International Publishing, 2016, pp. 201-212.
  • J. L. Green, G. Camilli, and P. B. Elmore, Handbook of Complementary Methods in Education Research. American Educational Research Association by Lawrence Erlbaum Associates, Inc, 2006.
  • AEIPRO-IPMA. “NCB.- Bases para la competencia en dirección de proyectos.”http://www.lpzconsulting.com/images/CP_Trabajo_en_ Equipo.pdf (accessed 28/02/2014).
  • A. Fidalgo, D. Leris, M. L. Sein-Echaluce, and F. J. García-Peñalvo, “Indicadores para el seguimiento de evaluación de la competencia de trabajo en equipo a través del método CTMT,” presented at the Congreso Internacional sobre Aprendizaje Innovación y Competitividad - CINAIC 2013, Madrid, Spain, 2013.
  • M. Á. Conde, F. J. Rodríguez-Sedano, L. Sánchez-González, C. FernándezLlamas, F. J. Rodríguez-Lera, and V. Matellán-Olivera, “Evaluation of teamwork competence acquisition by using CTMTC methodology and learning analytics techniques,” presented at the Proceedings of the Fourth International Conference on Technological Ecosystems for Enhancing Multiculturality, Salamanca, Spain, 2016.
  • M. L. Séin-Echaluce, Á. Fidalgo-Blanco, F. J. García-Peñalvo, and M. Á. Conde, “A Knowledge Management System to Classify Social Educational Resources Within a Subject Using Teamwork Techniques,” in Learning and Collaboration Technologies: Second International Conference, LCT 2015, Held as Part of HCI International 2015, Los Angeles, CA, USA, August 2-7, 2015, Proceedings, P. Zaphiris and A. Ioannou Eds. Cham: Springer International Publishing, 2015, pp. 510-519.
  • M. L. Sein-Echaluce, Á. Fidalgo-Blanco, and F. J. García-Peñalvo, “Students’ Knowledge Sharing to improve Learning in Engineering Academic Courses.,” International Journal of Engineering Education (IJEE), vol. 32, no. 2B, pp. 1024-1035, 2016.
  • M. A. Conde, R. Colomo-Palacios, F. J. García-Peñalvo, and X. Larrucea, “Teamwork assessment in the educational web of data: A learning analytics approach towards ISO 10018,” Telematics and Informatics, vol. 35, no. 3, pp. 551-563, 2018, doi: 10.1016/j.tele.2017.02.001.
  • A. Álvarez-Arana, M. Larrañaga-Olagaray, and M. Villamañe-Gironés, “Mejora de los procesos de evaluación mediante analítica visual del aprendizaje,” Education in the Knowledge Society, vol. 21, Art no. 9, 2020, doi: 10.14201/eks.21554.
  • A. Martínez-Monés et al., “Achievements and challenges in learning analytics in Spain: The view of SNOLA,” Revista Iberoamericana de Educación a Distancia, vol. 23, no. 2, pp. 187-212, 2020, doi: 10.5944/ ried.23.2.26541.
  • Ggstatsplot: “ggplot2” based plots with statistical details. (2018). Zenodo.
  • M. B. Miles and A. M. Huberman, Qualitative Data Analysis: An Expanded Sourcebook. Sage Publications, 1994.
  • M. Seufert, A. Schwind, T. Hoßfeld, and P. Tran-Gia, “Analysis of GroupBased Communication in WhatsApp,” Cham, 2015: Springer International Publishing, in Mobile Networks and Management, pp. 225-238.
  • A. Rosenfeld, S. Sina, D. Sarne, O. Avidov, and S. Kraus, “A study of WhatsApp usage patterns and prediction models without message content,” arXiv preprint arXiv:1802.03393, 2018.
  • T. Iiyoshi, M. J. Hannafin, and F. Wang, “Cognitive tools and student‐ centred learning: rethinking tools, functions and applications,” Educational Media International, vol. 42, no. 4, pp. 281-296, 2005.
  • Á. F. Agudo-Peregrina, S. Iglesias-Pradas, M. Á. Conde-González, and Á. Hernández-García, “Can we predict success from log data in VLEs? Classification of interactions for learning analytics and their relation with performance in VLE-supported F2F and online learning,” Computers in Human Behavior, vol. 31, no. 0, pp. 542-550, 2// 2014, doi: 10.1016/j. chb.2013.05.031.
  • C. M. Tavani and S. C. Losh, “Motivation, self-confidence, and expectations as predictors of the academic performances among our high school students,” Child study journal, vol. 33, no. 3, pp. 141-152, 2003.
  • A. Edman, F. Andersson, T. Kawnine, and C.-A. Soames, “Informal math coaching by instant messaging: Two case studies of how university students coach K-12 students AU - Hrastinski, Stefan,” Interactive Learning Environments, vol. 22, no. 1, pp. 84-96, 2014/01/02 2014, doi: 10.1080/10494820.2011.641682.
  • O. E. Cifuentes and N. H. Lents, “Increasing student-teacher interactions at an urban commuter campus through instant messaging and online office hours,” Electronic Journal of Science Education, vol. 14, no. 1, 2010.
  • I. Smit and R. Goede, “WhatsApp with BlackBerry; can messengers be MXit? A philosophical approach to evaluate social networking sites.” [online]. Available: https://repository.nwu.ac.za/handle/10394/13628
  • S. M. Sweeny, “Writing for the instant messaging and text messaging generation: Using new literacies to support writing instruction,” Journal of Adolescent & Adult Literacy, vol. 54, no. 2, pp. 121-130, 2010.
  • S. Lauricella and R. Kay, “Exploring the use of text and instant messaging in higher education classrooms,” Research in Learning Technology, vol. 21, 2013.
  • A. Z. Klein, J. C. d.-S.-F.-. Junior, J. V. Vieira-Mattiello-Mattiello-da-Silva, J. L. Victoria-Barbosa, and L. Baldasso, “The Educational Affordances of Mobile Instant Messaging MIM: Results of Whatsapp Used in Higher Education,” International Journal of Distance Education Technologies, vol. 16, no. 2, pp. 51-64, 2018, doi: 10.4018/ijdet.2018040104.
  • A. B. Fox, J. Rosen, and M. Crawford, “Distractions, Distractions: Does Instant Messaging Affect College Students’ Performance on a Concurrent Reading Comprehension Task?,” vol. 12, no. 1, pp. 51-53, 2009, doi: 10.1089/cpb.2008.0107.
  • R. Junco and S. R. Cotten, “Perceived academic effects of instant messaging use,” Computers & Education, vol. 56, no. 2, pp. 370-378, 2011/02/01/ 2011, doi: 10.1016/j.compedu.2010.08.020.
  • Alttop9. “6 Telegram Features that WhatsApp Does Not Have (Updated 2021).” https://cutt.ly/HkfvQaB (accessed 03/02/2021.
  • MVWConsulting. “Telegram VS Signal, With WhatsApp Comparison Table.” https://meganvwalker.com/telegram-vs-signal-with-whatsappcomparison-table/ (accessed 03/02/2021).
  • Y. Fernández. “Telegram vs WhatsApp: en qué se parecen y en qué se diferencian ambas aplicaciones.” https://www.xataka.com/basics/ telegram-vs-whatsapp-en-que-se-parecen-y-en-que-se-diferencianambas-aplicaciones (accessed 03/02/2021).
  • E. E. Gallardo-Echenique, L. Marqués-Molías, M. Bullen, and J.-W. Strijbos, “Let’s talk about digital learners in the digital era,” International Review of Research in Open and Distributed Learning, vol. 16, no. 3, pp. 156-187, 2015, doi: 10.19173/irrodl.v16i3.2196.
  • T. Gonzalez et al., “Influence of COVID-19 confinement on students’ performance in higher education,” PLOS ONE, vol. 15, no. 10, p. e0239490, 2020, doi: 10.1371/journal.pone.0239490.
  • S. Iglesias-Pradas, Á. Hernández-García, J. Chaparro-Peláez, and J. L. Prieto, “Emergency remote teaching and students’ academic performance in higher education during the COVID-19 pandemic: A case study,” Computers in Human Behavior, vol. 119, p. 106713, 2021/06/01 2021, doi: 10.1016/j.chb.2021.106713.
Fuente de los datos: Dialnet