Open-source Infrastructure for the Remote Delivery of Synchronous and Highly Interactive

  1. Jose Quiroga 1
  2. Miguel Garcia 1
  3. Francisco Ortin 1
  1. 1 Universidad de Oviedo
    info

    Universidad de Oviedo

    Oviedo, España

    ROR https://ror.org/006gksa02

Actes de conférence:
ENASE 2022 Final Program and Book of Abstracts

Éditorial: SCITEPRESS - Science and Technology Publications

Année de publication: 2022

Pages: 20-21

Congreso: ENASE 2022, 17th International Conference on Evaluation of Novel Approaches to Software Engineering, online streaming, 25-26 april 2022.

Type: Communication dans un congrès

GOOGLE SCHOLAR

Résumé

Ever since the COVID-19 pandemic, there has been an increase in the use of Web conferring tools such as Zoom, Abobe Connect, and Google Meet. Besides online meetings, these tools have been used to deliver online lectures over the Internet. Teamwork communication platforms (e.g., Microsoft Teams, Slack, and Webex Teams), provide additional features, such as persistent chat rooms, channels, third-party application integration, direct messaging, and private groups. Finally, Virtual classroom packages (e.g., BigBlueButton, Adobe Connect, and Blackboard Collaborate) are customizations of the previous tools for online learning. Although these systems are used for the synchronous delivery of lectures, they lack an important requirement for those labs and seminars where strong lecturer–student interaction is required: instructors cannot see the students’ work in real-time, so immediate feedback cannot be given while they are working. In common face-to-face scenarios, instructors analyze the work of each student, correct their mistakes, give particular explanations for that student, and even propose improvements and extensions for their solutions. To this aim, we created an open-source infrastructure that supports this kind of online synchronous sessions. Our open-source distributed infrastructure consists of the following elements. First, a modification of the Veyon open-source monitoring system to see all the students’ screens in a distributed session. We added the support of recording sessions and some features to comply with the EU regulation 2016/679. To allow students to connect to the sessions from home, we deployed a customized instance of the SoftEther open-source VPN server. We also implemented a collection of Windows and Linux scripts to install, start, stop, and create the remote sessions for both instructors and students. The BigBlueButton opensource software is used for the delivery of lessons, audio and chat interaction, and document sharing. We used our infrastructure for the remote labs of a programming course. After answering an anonymous Likert-scale questionnaire, the students showed a high level of satisfaction (4.28 out of 5) regarding the simplicity, performance, privacy, security, intrusiveness, and utility of the infrastructure. In the final evaluation of the course, no significant difference with the previous years was detected (p-value < 0.05), for the student’s grades, pass and fail rates, and the number of students taking the exam. The student configuration consumes 784 MBs of RAM, 2.56% CPU (3.6 GHz i7, 16 GB, Windows 10), and 504.7 Kbps (download) / 161 Kbps (upload) bandwidth. These values for the instructor were 963 MBs, 3.35% CPU, and 1360/514 Kbps. The bandwidth requirements for the instructor depend on the number of students connected: 90.8/0.37 Kbps per student. Therefore, for a session with 100 students, a 9.08/0.037 Mbps bandwidth connection is required, showing good scalability. Therefore, our open-source infrastructure provides the synchronous remote delivery of sessions, following the traditional face-to-face approach. Its features make it appropriate to deliver synchronous classes where strong lecturer–student interaction is required, and all the student work can be done with a computer. It provides an easy installation and configuration, and shows affordable resource consumption. Our infrastructure can be freely downloaded from https://www.reflection.uniovi.es/download/2020/tlt/

€ Voir financement

Information sur le financement

This project has been funded by the University of Oviedo under the public call for the development of teaching innovation projects (project number 124180)

Financeurs

Références bibliographiques

  • R. Singh and R. Adhikari, “Age-structured impact of social distancing on the COVID-19 epidemic in India,” 2020, arXiv:2003.12055.
  • E. Nordmann, C. Horlin, J. Hutchison, J. A. Murray, L. Robson, M. Seery, and J. MacKay, “10 simple rules for supporting a temporary online pivot in higher education,” PLOS Comput. Biol., vol. 16, no. 10, pp. 1–18, Oct. 2020, doi: 10.1371/journal.pcbi.1008242.
  • F. Ortin, J. M. Redondo, and J. Quiroga, “Design and evaluation of an alternative programming paradigms course”, Telematics Inform., vol. 34, no. 6, pp. 813–823, Sep. 2017, doi: 10.1016/j.tele.2016.09.014.
  • F. Ortin, J. M. Redondo, and J. Quiroga, “Design of a programming paradigms course using one single programming language”, in Proc. World Conf. Inf. Syst. Technol., Recife, Brazil, 2016, pp. 179–188, doi: 10.1007/978-3-319-313078_18.
  • M. Asadullah and Shibli Nisar, “An automated technique for cheating detection,” in Proc. Int. Conf. Innov. Comput. Technol., Dublin, Ireland, 2016, pp. 251–255, doi: 10.1109/INTECH.2016.7845069.
  • J. Prieto-Blázquez, J. Herrera-Joancomartí, and A. E. Guerrero-Roldán, “A virtual laboratory structure for developing programming labs,” Int. J. Emerg. Technol. Learn., vol. 4, pp. 47–52, 2009, doi: 10.3991/ijet.v4s1.789.
  • M. Cardoso, A. V. de Castro, and A. Rocha, “Integration of virtual programming lab in a process of teaching programming EduScrum based,” in Proc. Iberian Conf. Inf. Syst. Technol., Caceres, Spain, 2018, pp. 1–6, doi: 10.23919/CISTI.2018.8399261.
  • H. Wang and D. Philips, “Implement virtual programming lab with cloud computing for Web-based distance education,” in Cloud Computing for Teaching and Learning: Strategies for Design and Implementation. Hershey, PA, USA: IGI Global, 2012, pp. 95–110, doi: 10.4018/978-1-4666-0957-0.ch007.
  • K. M. Ala-Mutka, “A survey of automated assessment approaches for programming assignments,” Comput. Sci. Educ., vol. 15, no. 2, pp. 83–102, Feb. 2007, doi: 10.1080/08993400500150747.
  • T. Alkhaldi, I. Pranata, and R. I. Athauda, “A review of contemporary virtual and remote laboratory implementations: Observations and findings,” J. Comput. Educl, vol. 3, pp. 329–351, Jun. 2016, doi: 10.1007/s40692-016-0068-z.
  • A. Böhne, K. Rütters, and B. Wagner, “Evaluation of tele-tutorial support in a remote programming laboratory,” Learn. Lab Lower Saxony (L3S), Hanover, Germany, 2004.
  • “VNC, secure and reliable screen sharing,” 2021. [Online]. Available: https://www.realvnc.com
  • A. Böhne, N. Faltin, and B. Wagner, “Synchronous tele-tutorial support in a remote laboratory for process control,” in Proc. World Innov. Eng. Educ. Res., Valencia, Spain, 2004, pp. 317–329.
  • C. A. Jara, R. Heradio, L. Torre, J. Sanchez, S. Dormido, F. Torres, and F. A. Candelas, “Synchronous collaboration with virtual and remote labs in Moodle,” in Proc. Symp. Adv. Control Educ., Novgorod, Russia, 2012, pp. 270–275, doi: 10.3182/20120619-3-RU-2024.00030.
  • “EJS, Easy Java/JavaScript Simulations,” 2021. [Online]. Available: https://fem.um.es/Ejs
  • N. Popović and M. B. Naumović, “Virtual laboratory and learning management system in optimal control theory education,” Int. J. of Elect. Eng. Educ., vol. 53, no. 4, pp. 357–370 , Apr. 2016, doi: 10.1177/0020720916639321.
  • T. Junghans, “Veyon – cross-platform computer monitoring and classroom management,” 2021. [Online]. Available: https://veyon.io
  • V. Bakonyi, Z. Illés, and C. Verma, “Towards the real-time analysis of talks,” in Proc. Int. Conf. Comput., Automat. Knowl. Manage., Dubai, United Arab Emirates, 2020, pp. 322–327, doi: 10.1109/ICCAKM46823.2020.9051507.
  • T.M. Alkhaldi, “Design and evaluation of a technological-enhanced lab environment for a systems and network administration course,” Ph.D. dissertation, Univ. Newcastle, Newcastle , UK, 2019.
  • “Virtual programming lab,”, 2021. [Online]. Available. http://vpl.athabascau.ca
  • J. C. Rodríguez-del-Pino, E. Rubio-Royo, and Z. H. Figueroa, “A virtual programming lab for Moodle with automatic assessment and anti-plagiarism features,” in Proc. of the Int. Conf. on e-Learn., e-Bus., Enterprise Inf. Syst., eGovernment, Las Vegas, USA, 2012, pp. 1–6.
  • J.C. Rodríguez-del-Pino, “VPL jail system’s documentation,” 2021. [Online]. Available: https://vpl.dis.ulpgc.es/documentation/vpl-jail-system-2.6.0
  • D. Thiébaut, “Automatic evaluation of computer programs using Moodle's virtual programming lab (VPL) plug-in,” J. Comput. Sci. Colleges, vol. 30, no. 6, pp. 141–151, Jun. 2015.
  • J.C., Rodríguez-del-Pino, “Integridad académica en la docencia universitaria actual con énfasis en el plagio del código fuente: modelo, propuesta de intervención y herramientas,”, Ph.D. dissertation, Univ. Palmas Gran Canaria, Spain, 2016.
  • M. G. Helander and R. Emami, “Engineering eLaboratories: Integration of remote access and eCollaboration,” Int. J. Eng. Educ., vol. 24, no 3, pp. 466–479, 2008.
  • M. A. Tedesco and R. Emami, “A modular and turn-key remote-access hardware-in-the-loop platform for testing electric motors,” J. Adv. Mech. Des., Syst., Manuf., vol. 8, no.1, pp. 1–8, Mar. 2014, doi: 10.1299/jamdsm.2014jamdsm0008.
  • J. Cao, A. Chan, W. Cao, and C. Yeung, “Virtual programming lab for online distance learning,” in Proc. Int. Conf. on Adv. Web-based Learn., 2002, pp. 216–227, doi: 10.1007/3-540-45689-9_18.
  • M. N. Demaidi, M. Qamhieh, and A. Afeefi, “Applying blended learning in programming courses,”, IEEE Access, vol. 7, pp. 156824–156833, Oct. 2019, doi: 10.1109/access.2019.2949927.
  • “UNITWIN/UNESCO Chair Holders Institutional Responses to COVID-19,” 2021. [Online]. Available: https://apa.sdg4education2030.org/sites/apa.sdg4education2030.org/files/202005/HED%20UNITWIN%20_COVID19_SURVEY%20REPORT%2002.04.20.pdf
  • S. Cornelius, “Facilitating in a demanding environment: Experiences of teaching in virtual classrooms using web conferencing,” Brit. J. Educ. Technol., vol. 45, no. 2, pp. 260–271, Mar. 2014, doi: /10.1111/bjet.12016.
  • X. Zhang, Y. Meng, P. Ordóñez de Pablos, and Y. Sunc, “Learning analytics in collaborative learning supported by Slack: From the perspective of engagement,” Comput. Human Behav., vol. 92, Mar. 2019, pp. 625–633, doi: 10.1016/j.chb.2017.08.012.
  • R. Glassey, “Adopting Git/Github within teaching: A survey of tool support,” in Proc. Conf. Global Comput. Educ., Chengdu, China, 2019, pp. 143–149, doi: 3300115.3309518.
  • M. Garcia, J. Quiroga, and F. Ortin, “Veyon Fork to comply with the EU general data protection regulation and record remote lab sessions,” 2021. [Online]. Available: https://github.com/ComputationalReflection/veyon
  • Official journal of the European Union, (2016, Apr. 27). Regulation (EU) 2016/679 of the European Parliament and of the Council, on the protection of natural persons with regard to the processing of personal data and on the free movement of such data, and repealing Directive 95/46/EC (general data protection regulation). [Online]. Available: https://eur-lex.europa.eu/legal-content/EN/TXT/PDF/?uri=CELEX:32016R0679
  • T. Junghans, “Veyon documentation, release 4.3.5,” 2021. https://github.com/veyon/docs/releases/download/v4.3.5/veyon-admin-manual-en_4.3.5.pdf [Online]. Available:
  • D. Nobori, T. Sugiyama, G. Hatakeyama, and C. Smith, “SoftEther VPN project, ” 2021. [Online]. Available: https://www.softether.org
  • M. Bower, “Synchronous collaboration competencies in Web‐conferencing environments – their impact on the learning process,” Distance Educ., vol. 32, no.1, pp. 63–83, May 2011, doi: 10.1080/01587919.2011.565502.
  • “OOKLA, the global broadband speed test,” 2021. [Online]. Available: https://www.speedtest.net
  • L. J. Cronbach, “Coefficient alpha and the internal structure of tests,” Psychometrika, vol. 16, pp. 297–334, Sep. 1951, doi: 10.1007/BF02310555.
  • J. R. Warmbrod, “Reporting and interpreting scores derived from Likert-type scales,” J. Agricultural Educ., vol. 55, no. 5, pp. 30–47, 2014, doi: 10.5032/jae.2014.05030.
  • M. M. Mukaka, “Statistics corner: A guide to appropriate use of correlation coefficient in medical research,” Malawi Med. J, vol. 24, no. 3, pp. 69–71, Sep. 2012.
  • A. Georges, D. Buytaert, and L. Eeckhout, “Statistically rigorous Java performance evaluation,” in Proc. Annu. Conf. Object-Oriented Program. Syst. Appl., New York, USA, 2007, pp. 57–76, doi: 10.1145/1297105.1297033.
  • M. Garcia, J. Quiroga, and F. Ortin, “An infrastructure to deliver synchronous remote programming labs (support material website),” 2021. [Online]. Available: http://www.reflection.uniovi.es/download/2020/tlt
  • “Microsoft TraceEvent library,” 2021. [Online]. Available: https://github.com/Microsoft/perfview/blob/master/documentation/TraceEvent/TraceEventLibrary.md
  • J. M. Redondo and F. Ortin, “Efficient support of dynamic inheritance for class- and prototype-based languages,” J. Syst. Softw., vol. 86, no. 2, pp. 278–301, Feb. 2013, doi: 10.1016/j.jss.2012.08.016.
  • “Microsof event tracing for Windows,” 2021. [Online]. Available: https://docs.microsoft.com/enus/windows/win32/etw/event-tracing-portal
  • M. A. Marques, M. C. Viegas, M. C. Costa-Lobo, A. V. Fidalgo, G. R. Alves, J. S. Rocha, and I. Gustavsson, “How remote labs impact on course outcomes: Various practices using VISIR,” IEEE Trans. Educ., vol. 57, no. 3, pp. 151159, Aug. 2014, doi: 10.1109/TE.2013.2284156.
  • Z. Hossain, X. Jin, E. W. Bumbacher, A. M. Chung, S. Koo, J. D. Shapiro, C. Y. Truong, S. Choi, N. D. Orloff, P. Blikstein, and I. H. Riedel-Kruse, “Interactive cloud experimentation for biology: An online education case study,” in Proc. Annu. Conf. Human Factors in Comput. Sys., Seoul, Korea, 2015, pp. 3681–3690, doi: 10.1145/2702123.2702354.
  • B. F. Woodfield, H. R. Catlin, G. L. Waddoups, M. S. Moore, R. Swan, R. Allen, and G. Bodily, “The virtual ChemLab project: A realistic and sophisticated simulation of inorganic qualitative analysis,” J. Chem. Educ., vol. 81, no. 11, pp. 1672–1678, Nov. 2004, doi: 10.1021/ed081p1672.
  • Y. Ding and H. Fang, “Using a simulation laboratory to improve physics learning: A case exploratory learning of diffraction grating,” in Int. Workshop Educ. Technol. Comput. Sci., Wuhan, China, 2009, pp 3–6, doi: 10.1109/ETCS.2009.523.
  • F. Ortin, D. Zapico, and J. M. Cueva, “Design patterns for teaching type checking in a compiler construction course,” IEEE Tran. Educ., vol. 50, no. 3, pp. 273–283, Aug. 2007, doi: 10.1016/j.chb.2017.08.012.
  • A. Arinaldi and M. I. Fanany, “Cheating video description based on sequences of gestures,” in Proc. Int. Conf. Inf. Commun. Technol., Malacca City, Malaysia, 2017, pp. 1–6, doi: 10.1109/ICoICT.2017.8074679.
  • F. Ortin, O. Rodriguez-Prieto, N. Pascual, and M. Garcia, “Heterogeneous tree structure classification to label Java programmers according to their expertise level,” Future Gener. Comput. Syst., vol. 105, pp. 380–394, Apr. 2020, doi: 10.1016/j.future.2019.12.016.
  • O. Rodriguez-Prieto, A. Mycroft, and F. Ortin, “An efficient and scalable platform for Java source code analysis using overlaid graph representations,” IEEE Access, vol. 8, pp. 72239–72260, Dec. 2020, doi: 10.1109/access.2020.2987631.