While many institutions provide centralized technology support for faculty, there is a lack of centralized professional development opportunities that focus on simultaneously developing instructors’ technological, pedagogical, and content knowledge (TPACK) in higher education. Additionally, there are few professional development opportunities for faculty that continue throughout the practice of teaching with technology. We propose a model of continuing professional development that provides instructors with the ability to meaningfully integrate technology into their teaching practices through centralized support for developing TPACK. In doing so, we draw upon several theoretical frameworks and evidence based practices.

In this paper we discuss the use of automated assessment in a variety of computer science courses that have been taught at Israel Academic College by the authors. The course assignments were assessed entirely automatically using Checkpoint, a web-based automated assessment framework. The assignments all used free-text questions (where the students type in their own answers). Students were allowed to correct errors based on feedback provided by the system and resubmit their answers. A total of 141 students were surveyed to assess their opinions of this approach, and we analysed their responses. Analysis of the questionnaire showed a low correlation between questions, indicating the statistical independence of the individual questions. As a whole, student feedback on using Checkpoint was very positive, emphasizing the benefits of multiple attempts, impartial marking, and a quick turnaround time for submissions. Many students said that Checkpoint gave them confidence in learning and motivation to practise. Students also said that the detailed feedback that Checkpoint generated when their programs failed helped them understand their mistakes and how to correct them.

The use of blended learning is well suited for classes that involve a high level of experiential inquiry such as internship courses. These courses allow students to combine applied, face-to-face fieldwork activities with a reflective academic component delivered online. Therefore, the purpose of this article is to describe the pedagogical design and implementation of a pilot blended learning format internship course. After implementation, the pilot class was assessed. Results of the survey and focus group revealed high levels of student satisfaction in the areas of course structure, faculty-student interaction, and application of theory to the “real-world” experience undertaken by students during the internship. Lower levels of satisfaction with the course’s academic rigor and a sense of community were also reported. Notably, students with experience in blended learning expressed lower levels of overall satisfaction, but reported higher levels of satisfaction with the course’s rigor and sense of community. The paper concludes by offering implications for instructors seeking to implement blended learning approaches.

Many parents, educators, and policy makers see great potential for leveraging tools like laptop computers, tablets, and smartphones in the classrooms of the world. Although increasing students’ technology access may be associated with increased student achievement, there is little research directly investigating objective measures of student achievement. This study addresses the short-term and long-term quantitative impacts of one of the world’s first school efforts to provide Kindergarten through 3rd grade classrooms with 1:1 iPad access and a range of English Language Arts (ELA) and math Apps. This report summarizes two investigations conducted during this iPad implementation. First, a 9-week pre/post randomized control trial was conducted in which 8 Kindergarten classes used literacy and numeracy apps while another 8 Kindergarten classes used their traditional (non-iPad) resources. At the end of this short implementation period, slightly stronger literacy performance gains were observed in the iPad settings. In a second longitudinal study, three years of assessment data were explored before and after the 1:1 iPad implementation in grades K to 2. Results from the longitudinal study provide emerging evidence of potential increases in ELA achievement, but no consistent results in math achievement. This paper adds to the sparse literature in this area and provides a springboard for further research.

As both the frequency and the severity of network breaches have increased in recent years, it is essential that cybersecurity is incorporated into the core of business operations. Evidence from the U.S. Bureau of Labor Statistics (Bureau of Labor Statistics, 2012) indicates that there is, and will continue to be, a severe shortage of cybersecurity professionals nationwide throughout the next decade. To fill this job shortage we need a workforce with strong hands-on experience in the latest technologies and software tools to catch up with the rapid evolution of network technologies. It is vital that the IT professionals possess up-to-date technical skills and think and act one step ahead of the cyber criminals who are constantly probing and exploring system vulnerabilities. There is no perfect security mechanism that can defeat all the cyber-attacks; the traditional defensive security mechanism will eventually fail to the pervasive zero-day attacks. However, there are steps to follow to reduce an organization’s vulnerability to cyber-attacks and to mitigate damages. Active security tests of the network from a cyber-criminal’s perspective can identify system vulnerabilities that may lead to future breaches. “If you know yourself but not the enemy, for every victory gained you will also suffer a defeat. But if you know the enemy and know yourself, you need not fear the result of hundred battles” (Sun, 2013). Penetration testing is a discipline within cybersecurity that focuses on identifying and exploiting the vulnerabilities of a network, eventually obtaining access to the critical business information. The pentesters, the security professionals who perform penetration testing, or ethical hackers, break the triad of information security - Confidentiality, Integrity, and Accountability (CIA) - as if they were a cyber-criminal. The purpose of ethical hacking or penetration testing is to know what the “enemy” can do and then generate a report for the management team to aid in strengthening the system, never to cause any real damages. This paper introduces the development of a penetration testing curriculum as a core class in an undergraduate cybersecurity track in Information Technology. The teaching modules are developed based on the professional penetration testing life cycle. The concepts taught in the class are enforced by hands-on lab exercises. This paper also shares the resources that are available to institutions looking for teaching materials and grant opportunities to support efforts when creating a similar curriculum in cybersecurity.

An online Moodle Workshop was evaluated for peer assessment effectiveness. A quasi-experiment was designed using a Seminar in Professionalism course taught in face-to-face mode to undergraduate students across two campuses. The first goal was to determine if Moodle Workshop awarded a fair peer grader grade. The second objective was to estimate if students were consistent and reliable in performing their peer assessments. Statistical techniques were used to answer the research hypotheses. Although Workshop Moodle did not have a built-in measure for peer assessment validity, t-tests and reliability estimates were calculated to demonstrate that the grades were consistent with what faculty expected. Implications were asserted to improve teaching and recommendations were provided to enhance Moodle.

Immigrant students face a multitude of problems, among which are poor social adaptation and school integration. On the other hand, although digital narrations are widely used in education, they are rarely used for aiding students or for the resolution of complex problems. This study exploits the potential of digital narrations towards this end, by examining how the development and presentation of an autobiographical digital narration can assist immigrant students in overcoming their adaptation difficulties. For that matter, a female student presenting substantial problems was selected as the study’s subject. Data was collected from all the participating parties (subject, teacher, classmates) using a variety of tools, before, during, and after the intervention. It was found that through the digital narration she was able to externalize her thoughts and feelings and this, in turn, helped her in achieving a smoother integration in the school environment. In addition, the attitudes and perceptions of the other students for their foreign classmate were positively influenced. The intervention was short in duration and it did not require special settings. Hence, it can be easily applied and educators can consider using similar interventions. On the other hand, further research is recommended to establish the generalizability of the study’s findings.

Mobile devices are the constant companions of technology users of all ages. Studies show, however, that making calls is a minimal part of our engagement with today’s smart phones and that even texting has fallen off, leaving web browsing, gaming, and social media as top uses. A cross-disciplinary group of faculty at our university came together in the mLearning Scholars group to study the potential for using mobile devices for student learning. The group met bi-weekly throughout a semester and shared thoughts, ideas, resources, and examples, while experimenting with mobile learning activities in individual classes. This paper summarizes student perceptions and adoption intent for using mobile devices for learning, and discusses implementation issues for faculty in adding mobile learning to a college course. Outcomes reflect that mobile learning adoption is not a given, and students need help in using and understanding the value in using personal devices for learning activities.

Aim/Purpose: As smartphones proliferate, many different platforms begin to emerge. The challenge to developers as well as IS educators and students is how to learn the skills to design and develop apps to run on cross-platforms. Background: For developers, the purpose of this paper is to describe an alternative to the complex native app development. For IS educators and students, the paper provides a feasible way to learn and develop fully functional mobile apps without technical burdens. Methodology: The methods used in the development of browser-based apps is prototyping. Our proposed approach is browser-based, supports cross-platforms, uses open-source standards, and takes advantage of “write-once-and-run-anywhere” (WORA) concept. Contribution: The paper illustrates the application of the browser-based approach to create a series of browser apps without high learning curve. Findings: The results show the potentials for using browser app approach to teach as well as to create new apps. Recommendations for Practitioners : Our proposed browser app development approach and example would be useful to mobile app developers/IS educators and non-technical students because the source code as well as documentations in this project are available for downloading. Future Research: For further work, we discuss the use of hybrid development framework to enhance browser apps.

Aim/Purpose: The aims of this study were to investigate the feasibility of automatic assessment of programming tasks and to compare manual assessment with automatic assessment in terms of the effect of the different assessment methods on the marks of the students. Background: Manual assessment of programs written by students can be tedious. The assistance of automatic assessment methods might possibly assist in reducing the assessment burden, but there may be drawbacks diminishing the benefits of applying automatic assessment. The paper reports on the experience of a lecturer trying to introduce automated grading. Students’ solutions to a practical Java programming test were assessed both manually and automatically and the lecturer tied the experience to the unified theory of acceptance and use of technology (UTAUT). Methodology: The participants were 226 first-year students registered for a Java programming course. Of the tests the participants submitted, 214 were assessed both manually and automatically. Various statistical methods were used to compare the manual assessment of student’s solutions with the automatic assessment of the same solutions. A detailed investigation of reasons for differences was also carried out. A further data collection method was the lecturer’s reflection on the feasibility of automatic assessment of programming tasks based on the UTAUT. Contribution: This study enhances the knowledge regarding benefits and drawbacks of automatic assessment of students’ programming tasks. The research contributes to the UTAUT by applying it in a context where it has hardly been used. Furthermore, the study is a confirmation of previous work stating that automatic assessment may be less reliable for students with lower marks, but more trustworthy for the high achieving students. Findings: An automatic assessment tool verifying functional correctness might be feasible for assessment of programs written during practical lab sessions but could be less useful for practical tests and exams where functional, conceptual and structural correctness should be evaluated. In addition, the researchers found that automatic assessment seemed to be more suitable for assessing high achieving students. Recommendations for Practitioners: This paper makes it clear that lecturers should know what assessment goals they want to achieve. The appropriate method of assessment should be chosen wisely. In addition, practitioners should be aware of the drawbacks of automatic assessment before choosing it. Recommendation for Researchers: This work serves as an example of how researchers can apply the UTAUT theory when conducting qualitative research in different contexts. Impact on Society: The study would be of interest to lecturers considering automated assessment. The two assessments used in the study are typical of the way grading takes place in practice and may help lecturers understand what could happen if they switch from manual to automatic assessment. Future Research: Investigate the feasibility of automatic assessment of students’ programming tasks in a practical lab environment while accounting for structural, functional and conceptual assessment goals.

Aim/Purpose: The goal of this paper is to examine whether having female robotics teachers positively impacts girls’ performance on programming and robotics tasks Background: Women continue to be underrepresented in the technical STEM fields such as engineering and computer science. New programs and initiatives are needed to engage girls in STEM beginning in early childhood. The goal of this work is to explore the impact of teacher gender on young children’s mastery of programming concepts after completing an introductory robotics program. Methodology: A sample of N=105 children from six classrooms (2 Kindergarten, 2 first grade, and 2 second grade classes) from a public school in Somerville, Massachusetts, participated in this research. Children were taught the same robotics curriculum by either an all-male or all-female teaching team. Upon completion of the curriculum, they completed programming knowledge assessments called Solve-Its. Comparisons between the performance of boys and girls in each of the teaching groups were made. Findings: This paper provides preliminary evidence that having a female instructor may positively impact girls’ performance on certain programming tasks and reduce the number of gender differences between boys and girls in their mastery of programming concepts. Recommendations for Practitioners: Practitioners should expose children to STEM role-models from a variety of backgrounds, genders, ethnicities, and experiences. Future Research: Researchers should conduct future studies with larger samples of teachers in order to replicate the findings here. Additionally, future research should focus on collecting data from teachers in the form of interviews and surveys in order to find out more about gender-based differences in teaching style and mentorship and the impact of this on girls' interest and performance in STEM.

Aim/Purpose: This paper provides a general-purpose categorization scheme for assessing the utility of new and emerging three-dimensional interactive digital environments (3D-IDEs), along with specific pedagogic approaches that are known to work. It argues for the use of 3D-IDEs on the basis of their ludic appeal and ability to provide intrinsic motivation to the learner, and their openness that allows the learner to gain a more holistic understanding of a topic. Background: Researchers have investigated the affordances, benefits, and drawbacks of individual 3D-IDEs, such as virtual worlds, but teachers lack a general-purpose approach to assessing new 3D-IDEs as they appear and applying them to teaching practice. Methodology: The categorization scheme is based on the analysis, reflection, and comprehension of the research on limitations, challenges, and opportunities for teaching in virtual environments by Angel Rueda, Valdes Godines and Guzmán Flores; the scheme is discussed in terms of an experiment to trial virtual genetics labs in Second Life. Contribution: The paper describes a general-purpose approach to applying existing and new 3D virtual spaces to education, shows a worked example of the use of the categories, and describes six approaches to consider in applying these technologies. Findings: 3D-IDEs are categorized in terms of the way in which they interface with the user’s senses and their ability to provide ‘immersion’; two forms of immersion are examined: digital perceptual immersion – the generated sense of reality – and ludic narrative immersion – a less cognitive and more emotional engagement with the learning environment. Recommendations for Practitioners: Six specific forms of pedagogy appropriate for 3D-IDEs are examined and discussed, in terms of the affordances and technology required, as assessed by the categorization scheme. More broadly, the paper argues for a change in the assessment of new digital technologies from the technology’s features to its affordances and the pedagogies it can support. Recommendation for Researchers: The paper offers a practical approach to choosing and using 3D-IDEs for education, based upon previous work. The next step is to trial the scheme with teachers to ascertain its ease of use and effectiveness. Impact on Society: The paper argues strongly for a new approach to teaching, where the learner is encouraged to use 3D-IDEs in a ludic manner in order to generate internal motivation to learn, and to explore the topic according to their individual learning needs in addition to the teacher’s planned route through the learning material. Future Research: The categorization scheme is intended to be applied to new technologies as they are introduced. Future research is needed to assess its effectiveness and if necessary update the scheme.

Aim/Purpose: This study investigates the variations in student participation patterns across different types of instructional activities, learning modes, and with different instructional guidance approaches. In the current study, different variables, modes of learning (guided versus unguided), and types of guidance (social versus cognitive) were manipulated in a series of microblogging-supported collaborative learning tasks to examine to what extent and in which aspects instructional guidance affects the effectiveness and student perception of microblogging-supported learning. Background: Despite the overwhelming agreement on the importance of instructional guidance in microblogging-supported learning environments, very few studies have been done to examine the specificity of guidance, such as how to structure and support microblogging activities, as well as what types of guidance are appropriate in what learning contexts. Methodology: This semester-long study utilized a case-study research design via a multi-dimensional approach in a hybrid classroom with both face-to-face and online environments. Tweets were collected from four types of activities and coded based on content within their contextual setting. Twenty-four college students participated in the study. Contribution: In response to the call to improve social media learning environments under-scored in contemporary education, the current case study took an initial step aiming at deepening the understanding of the role of instructional guidance in microblogging-supported learning environments. Findings: This study showcases that with instructor facilitation, students succeeded in being engaged in a highly participatory and interactive learning experience across a variety of tasks and activities. This study indicates that students’ perspectives of social media tools rely heavily on what instructors do with the tool and how the instructional activities are structured and supported. Instructors’ scaffolding and support is instrumental in keeping students on task and engaging students with meaningful events, thus ensuring the success of microblogging-based learning activities. Meanwhile, students’ perception of usefulness of instructional guidance is closely related to their own pre-perception and experience. Recommendations for Practitioners: When incorporating social media tools, it is important to examine learner’s prior knowledge and comfort level with these tools and tailor the design of instructional activities to their attributes. It is also vital to monitor student progress, adjust the type and amount of guidance and scaffolding provided as they progress, and eventually remove the scaffolding until students can demonstrate that they can perform the task successfully without assistance. Recommendation for Researchers: Due to many other potential factors in place that could potentially influence student learning, no conclusive remarks can be made regarding the superiority of either one type of guidance approach. Future researchers should continue to develop robust research methodologies to seek ways to better operationalize this variable and strive to understand its effect. Future Research: Future replication studies in other settings, with a larger sample size, and different populations will certainly provide further insights on the effects of instructional guidance in microblogging-based learning. Alternative coding methods may also shed light on differences in student interaction in terms of content diversity and depth of learning when analyzing the tweets. Advanced data collection techniques may be explored to ascertain the completeness of data collection.

Aim/Purpose: The aim of this article is to develop a tool to detect plagiarism in real time amongst students being evaluated for learning in a computer-based assessment setting. Background: Cheating or copying all or part of source code of a program is a serious concern to academic institutions. Many academic institutions apply a combination of policy driven and plagiarism detection approaches. These mechanisms are either proactive or reactive and focus on identifying, catching, and punishing those found to have cheated or plagiarized. To be more effective against plagiarism, mechanisms that detect cheating or colluding in real-time are desirable. Methodology: In the development of a tool for real-time plagiarism prevention, literature review and prototyping was used. The prototype was implemented in Delphi programming language using Indy components. Contribution: A real-time plagiarism detection tool suitable for use in a computer-based assessment setting is developed. This tool can be used to complement other existing mechanisms. Findings: The developed tool was tested in an environment with 55 personal computers and found to be effective in detecting unauthorized access to internet, intranet, and USB ports on the personal computers. Recommendations for Practitioners: The developed tool is suitable for use in any environment where computer-based evaluation may be conducted. Recommendation for Researchers: This work provides a set of criteria for developing a real-time plagiarism prevention tool for use in a computer-based assessment. Impact on Society: The developed tool prevents academic dishonesty during an assessment process, consequently, inculcating confidence in the assessment processes and respectability of the education system in the society. Future Research: As future work, we propose a comparison between our tool and other such tools for its performance and its features. In addition, we want to extend our work to include testing for scalability of the tool to larger settings.

Aim/Purpose: This research aims to describe and demonstrate the results of an intervention through educational robotics to improve the computational thinking of student teachers. Background: Educational robotics has been increasing in school classrooms for the development of computational thinking and digital competence. However, there is a lack of research on how to prepare future teachers of Kindergarten and Elementary School in the didactic use of computational thinking, as part of their necessary digital teaching competence. Methodology: Following the Design-Based Research methodology, we designed an intervention with educational robots that includes unplugged, playing, making and remixing activities. Participating in this study were 114 Spanish university students of education. Contribution: This research helps to improve the initial training of student teachers, especially in the field of educational robotics. Findings: The student teachers consider themselves digital competent, especially in the dimensions related to social and multimedia aspects, and to a lesser extent in the technological dimension. The results obtained also confirm the effectiveness of the intervention through educational robotics in the development of computational thinking of these students, especially among male students. Recommendations for Practitioners: Teacher trainers could introduce robotics following these steps: (1) initiation and unplugged activities, (2) gamified activities of initiation to the programming and test of the robots, (3) initiation activities to Scratch, and (4) design and resolution of a challenge. Recommendation for Researchers: Researchers could examine how interventions with educational robots helps to improve the computational thinking of student teachers, and thoroughly analyze gender-differences. Impact on Society: Computational thinking and robotics are one of the emerging educational trends. Despite the rise of this issue, there are still few investigations that systematize and collect evidence in this regard. This study allows to visualize an educational intervention that favors the development of the computational thinking of student teachers. Future Research: Researchers could evaluate not only the computational thinking of student teachers, but also their didactics, their ability to teach or create didactic activities to develop computational thinking in their future students.

Aim/Purpose: The current study examines the impact of an intervention program to train teachers to collaborate with their students while creating digital games. Background: Teachers seem unable to leverage the potential of ICT to present students with a rich learning environment. ICT integration is usually at a relatively simple and concrete level without changing the traditional teacher-student paradigm. Methodology: The study is both quantitative and qualitative. Participants were 63 active teachers studying in the M.Ed. program at a teacher education college. The teachers responded to a series of pre- and post-questionnaires and wrote a concluding reflection. Contribution: Teaching based on creating digital games, combined with teacher-class collaboration, is a viable and real alternative of constructivist teaching, adapted to different learners. Findings: The SEM path analysis showed that it was only after the intervention that the lower the teachers’ resistance to changing teaching patterns, the higher their intrinsic motivation to learn an innovative pedagogical-technological program and likewise the sense of mastery of 21st-century skills, resulting in a positive attitude towards classroom collaboration. The qualitative findings reveal eight categories dealing with two main themes: the first is professional development, including conceptual, behavioral and emotional change, and the second is the teachers’ perception of the learners. Recommendations for Practitioners: Teacher training should be ongoing in order to change teaching-learning processes and promote an active approach based on constructive principles, 21st-century skills and collaboration between teachers and students in a computer environment. Recommendation for Researchers: Future studies should start by sampling teachers and education professionals who have convenient access to technology in their teaching-learning environment. Impact on Society: Collaboration between teachers and students in creating learning games in a computer environment and teacher-class collaboration, in general, require very different training than that which exists today. Hence there should be some rethinking of teacher training. The proposed pedagogical model is one such idea in the right direction. Future Research: A larger study with a greater number of participants, including a control group, should be conducted.

Aim/Purpose: This paper reports on a case study project which had three goals; to develop a suite of original interactive digital skills e-tutorials to be embedded in undergraduate and postgraduate courses; to evaluate the students’ experience and engagement with the e-tutorials over one semester; and to explore their general attitudes towards online and blended learning. Background: Online and blended learning modes continue to grow in popularity in higher education, with the aim of streamlining and enhancing student learning, supporting collaboration and creativity, and equipping students with the skills they will require to work and live in an increasingly digitized world. This practice-based case study highlights factors which positively and negatively affect user engagement with digital learning objects and explores students’ perceptions of the role of online learning within their academic programs. Methodology: A suite of nine interactive e-tutorials, addressing essential digital literacy skills for university students, was developed through instructor and student peer collaboration using Articulate software, informed by best practice. The e-tutorials were embedded in the institutional Learning Management System for three undergraduate and postgraduate courses, in which digital literacy formed the core learning content, to complement classroom-based learning. Students in these courses were surveyed via SurveyMonkey about their specific experience of using the e-tutorials, as well as their general perceptions of digital literacy and online learning. Eighty-six students in total completed the questionnaire, which consisted of twenty-three closed- and open-ended questions. Contribution: Through highlighting both the positive and the challenging aspects of the students’ reported experience of online learning, this case study contributes useful insights to the body of literature on user engagement with digital learning objects in higher education, as well as students’ perceptions and experience of blended learning. Findings: The e-tutorials were perceived as valuable in reinforcing classroom learning, allowing respondents to revise concepts and materials covered in face-to-face classes, at their own pace and in their own time. Survey responses showed that the accessibility, ease-of-use, design and duration of the e-tutorials were deemed effective in terms of user engagement; however, several technological challenges were identified, such as browser incompatibility, uneven sound quality and general Internet connection issues, which disrupted their learning. Overall, students expressed enjoyment of the learning facilitated by the e-tutorials; however, rather than favoring online learning alone, they expressed a preference for a blended learning environment, with a combination of complementary learning approaches; survey respondents did not generally wish to forego face-to-face classes entirely. Recommendations for Practitioners: Instructors should seek to strategically embed interactive digital learning objects in their courses at defined points of need in a logical structure, e.g., to reinforce classroom-based learning, or to support specific skill development. Potential disruption to learning should be minimized by following best practice guidelines to ensure ease of access, a seamless user experience, and timely feedback, as well as providing adequate support for rapid resolution of technical glitches. Recommendation for Researchers: E-tutorials offer a useful means of exploring ways in which students acquire learning in the digital environment. A wider, collaborative exploration is needed to provide comparative studies which move beyond case studies. Impact on Society: Online learning mechanisms, such as e-tutorials, offer students different means of acquiring essential literacy skills and different ways to interact with content. E-tutorials constitute reusable learning objects, which can be accessed as just-in-time delivery modes, when students perceive they need to review particular skills or reinforce learning material. Future Research: This research is now expanding into different types of reusable learning objects. E-tutorials may be developed in multiple ways, and comparative research around e-tutorial models will deepen our understanding of how students interact with content in formal learning contexts. As the digital educational landscape continues to expand alongside traditional face-to-face and analogue learning modes, a key research focus will be student and instructor perceptions and experience of blended learning in different contexts.

Aim/Purpose: Although many computer science measures have been proposed, visualizing individual students’ capabilities is difficult, as those measures often rely on specific tools and methods or are not graded. To solve these problems, we propose a rubric for measuring and visualizing the effects of learning computer programming for elementary school students enrolled in computer science education (CSE), which is independent of the programming language being used. Background: In this research, we proposed a rubric based on existing CSE standards and criteria having a programming education-learning goal. We then applied this rubric to actual lessons to visualize the educational effects. Methodology: The proposed new rubric for teaching computer programming, based on existing standards and criteria, was applied to fourth- and sixth-grade students in Japan. We assessed which skills were cultivated through quizzes before and after the teaching. Contribution: This paper contributes on how to make and utilize a rubric for programming education in computer science. We evaluated and visualized the proposed rubric’s learning effects on children and found that our proposed rubrics are independent of any particular method or tool. Findings: The results of this survey are twofold: (1) we proposed a rubric of programming education in computer science, independent of the programming tools used and (2) we succeeded in visualizing students’ learning stages by applying the proposed rubric to programming education conducted in a Japanese elementary school. Recommendations for Practitioners: Evaluating educational effects in CSE is important. In particular, graded assessments of learner abilities can reveal individual characteristics. This research is useful for assessing CSE because it focuses specifically on programming education. Recommendation for Researchers: The rubric’s suggestions and quality improvements in CSE help learners assess their learning progress and will clarify the cultivated computer science skills. Impact on Society: This research evaluates CSE based on a rubric in the programming education field. Future Research: Future work is needed to improve the proposed rubric’s quality and relevance. Also, this rubric should be applied to many classes to increase the number of evaluations and analyses.

Aim/Purpose: This paper presents a study about changes in computer science and software engineering students’ perceptions of their soft skills during their progress through the Computer Science Soft Skills course. Background: Soft skills are often associated with a person’s social, emotional and cognitive capabilities. Soft skills are increasingly sought out and are well recognized by employers alongside standard qualifications. Therefore, high importance is attributed to soft skills in computer science and software engineering education. Methodology: Content analysis was applied to interpret, categorize and code statements from students’ course assignment answers. Data analysis was performed gradually at the three main stages of the course and by the two students’ study populations. Contribution: The paper highlights the variety of (a) soft skills that can be learnt in one course, both on the individual level and on the team level and (b) assignments that can be given to students to increase their awareness and motivation to practice and learn soft skills. Findings: Data analysis revealed the following: (a) five individual soft skills categories, with 95 skills, and five team-related soft skills categories, with 52 skills (in total, the students mentioned 147 soft skills); (b) course assignments and particularly team-based activities elicited student awareness of their individual soft skills, both as strengths and weaknesses; (c) students developed their reflection skills, particularly with respect to team-related soft skills; and (d) significant differences exist between the two groups of students in several categories. Recommendations for Practitioners: It is important to provide undergraduate students with opportunities to integrate soft skills during their training. Establishing a meaningful learning process, such as project-based learning, enables students to apply and develop soft skills when accompanied by reflective thought processes. Recommendation for Researchers: A similar course can be taught and be accompanied by similar analysis of students’ learning outcomes, to examine the influence of local culture on the characteristics of soft skills. Impact on Society: Increased awareness of soft skills in scientists and engineers’ undergraduate education. University graduates who will strengthen their variety of soft skills in their academic training process and will be more meaningful employees in the workplace and in society. Future Research: Our future research aims (a) to explore additional innovative ways to increase students’ learning processes, awareness and practices in relation to soft skills and (b) to research how students’ soft skills are developed during the entire undergraduate studies both on the individual level and the team level.

Aim/Purpose: The purpose of this study is to develop an efficient methodology that can assist the evaluators in assessing a variable number of individuals that are working in groups and guarantee that the assessment is dependent on the group members’ performance and contribution to the work developed. Background: Collaborative work has been gaining more popularity in academic settings. However, group assessment needs to be performed according to each individual’s performance. The problem rests on the need to distinguish each member of the group in order to provide fair and unbiased assessments. Methodology: Design Science Research methodology supported the design of a framework able to provide the evaluator with the means to distinguish individuals in a workgroup and deliver fair results. Hevner’s DSR guidelines were fulfilled in order to describe WebAVALIA. To evaluate the framework, a quantitative study was performed and the first results are presented. Contribution: This paper provides a methodological solution regarding a fair evaluation of collaborative work through a tool that allows its users to perform their own assessment and peer assessment. These are made accordingly to the user’s perspectives on the performance of each group member throughout the work development. Findings: The first analysis of the results indicates that the developed method provides fairness in the assessment of group members, delivering a distinction amongst individuals. Therefore, each group member obtains a mark that corresponds to their specific contribution to the workgroup. Recommendations for Practitioners: For those who intend to apply this workgroup assessment method, it is relevant to raise student awareness about the methodology that is going to be used. That is, all the functionalities and steps in WebAVALIA have to be thoroughly explained before beginning of the project. Then, the evaluators have to decide about the students’ intermediate voting, namely if the evaluator chooses or not to publish student results throughout the project’s development. If there is the decision to display these intermediate results, the evaluator must try to encourage collaboration among workgroup members, instead of competition. Recommendation for Researchers: This study explores the design and development of an e-assessment tool – WebAVALIA. In order to assess its feasibility, its use in other institutions or contexts is recommended. The gathering of user opinions is suggested as well. It would then be interesting to compare the findings of this study with the results from other experimentations Impact on Society: Sometimes, people develop a rejection of collaborative work because they feel exploited due to the biased evaluation results. However, the group members assessment distinction, according to each one’s performance, may give each individual a sense of fairness and reward, leading to an openness/willingness towards collaborative work. Future Research: As future work, there are plans to implement the method in other group assessment contexts – such as sports and business environments, other higher education institutions, technical training students – in other cultures and countries. From this myriad of contexts, satisfaction results would be compared. Other future plans are to further explore the mathematical formulations and the respective WebAVALIA supporting algorithms.

Aim/Purpose: In this paper, we present our experience in design and delivery of a graduate Information Systems Management (ISM) course in an online MBA program. Also presented are a detailed examination of the design and delivery of the online course, survey results of students’ perceptions and backgrounds, course evaluation results, best practices and lessons learned, and potential changes and future actions. Background: This graduate ISM course needs to not only cover a broad range of dynamic technology and business topics, but also strike a balance between the width and depth of the content. Effective course design and delivery are critical to improved teaching and learning, especially when the course is delivered online. Methodology: We provided a comprehensive review of the related literature to develop guidelines for the design and delivery of our ISM course; we collected survey data to evaluate the students’ backgrounds and their perceptions of the course; we used data analysis and content analysis methods to assess the course evaluation results. Contribution: A review of the related literature indicates that IS researchers and educators have not adequately studied online graduate education. Given the importance of the graduate ISM course in most MBA programs, and the lack of attention from the IS community, it is critical to address this gap in the research. We believe we have done so with this paper. Findings: The paper’s major findings are embedded in a detailed examination of the design and delivery of the online course, survey results of students’ perceptions and backgrounds, course evaluation results, best practices and lessons learned, and potential changes and future actions. Recommendations for Practitioners: Even though our experience may not be fully applicable to other institutions, we hope our IS colleagues can learn from the design and delivery of this online course, as well as our best practices and lessons learned to improve the teaching and learning effectiveness in IS online graduate education, in general. Furthermore, we provide instructors with an actionable framework onto which they can map their current course offering, and compare their current pedagogical offering to literature driven best practices for ISM courses, in particular. Recommendation for Researchers: It is our hope that the design and delivery of this online course, and our best practices and lessons learned can inspire our IS colleagues to search for innovative ways to improve the teaching and learning effectiveness in IS online graduate education. In addition, we distill a literature driven framework for ISM courses design and delivery that can help researchers frame their pedagogical research questions. Impact on Society: The online course in this study prepares students for more efficiently and effectively delivering IT systems in organizations. Many MBA students work for non-profits and other socially-focused organizations and are able to use the skills learned in the course for the betterment of society. Future Research: We will continue to monitor the impact of the changes on student learning effectiveness and attempt to identify additional innovative ways to improve the design and delivery of this online ISM course.

Aim/Purpose: Students tend to learn best when an array of learning styles is used by instructors. The purpose of this paper is to add, to introduce, and to apply the concepts of kinesthetic learning and learning structures to university and STEM education. Background: The study applies the concept of kinesthetic learning and a learning structure called Think-Pair-Share to an experiential exercise about Moore’s Law in an introductory MIS classroom. The paper details the exercise and each of its components. Methodology: Students in two classes were asked to complete a short survey about their conceptual understanding of the course material before and after the experiential exercise. Contribution: The paper details the benefits of kinesthetic learning and learning structures and discusses how to apply these concepts through an experiential exercise used in an introductory MIS course. Findings: Results indicate that the kinesthetic learning activity had a positive impact on student learning outcomes. Recommendations for Practitioners: University educators can use this example to structure several other learning activities that apply kinesthetic learning principles. Recommendation for Researchers: Researchers can use this paper to study more about how to incorporate kinesthetic learning into education, and about teaching technology concepts to undergraduate students through kinesthetic learning. Impact on Society: The results of this study may be extremely beneficial for the university and STEM community and overall academic business community. Future Research: Researchers should consider longitudinal studies and other ways to incorporate kinesthetic learning activities into education.

Aim/Purpose: The aim of this study is to understand student’s opinions and perceptions about e-assessment when the assessment process was changed from the traditional computer assisted method to a multiple-choice Moodle based method. Background: In order to implement continuous assessment to a large number of students, several shifts are necessary, which implies as many different tests as the number of shifts required. Consequently, it is difficult to ensure homogeneity through the different tests and a huge amount of grading time is needed. These problems related to the traditional assessment based on computer assisted tests, lead to a re-design of the assessment resulting in the use of multiple-choice Moodle tests. Methodology: A longitudinal, concurrent, mixed method study was implemented over a five-year period. A survey was developed and carried out by 815 undergraduate students who experienced the electronic multiple-choice questions (eMCQ) assessment in the courses of the IS department. Qualitative analyses included open-ended survey responses and interviews with repeating students in the first year. Contribution: This study provides a reflection tool on how to incorporate frequent moments of assessment in courses with a high number of students without overloading teachers with a huge workload. The research analysed the efficiency of assessing non-theoretical topics using eMCQ, while ensuring the homogeneity of assessment tests, which needs to be complemented with other assessment methods in order to assure that students develop and acquire the expected skills and competencies. Findings: The students involved in the study appreciate the online multiple-choice quiz assessment method and perceive it as fair but have a contradictory opinion regarding the preference of the assessment method, throughout the years. These changes in perception may be related to the improvement of the question bank and categorisation of questions according to difficulty level, which lead to the nullification of the ‘luck factor’. Other major findings are that although the online multiple-choice quizzes are used with success in the assessment of theoretical topics, the same is not in evidence regarding practical topics. Therefore, this assessment needs to be complemented with other methods in order to achieve the expected learning outcomes. Recommendations for Practitioners: In order to be able to evaluate the same expected learning outcomes in practical topics, particularly in technology and information systems subjects, the evaluator should complement the online multiple-choice quiz assessment with other approaches, such as a PBL method, homework assignments, and/or other tasks performed during the semester. Recommendation for Researchers: This study explores e-assessment with online multiple-choice quizzes in higher education. It provides a survey that can be applied in other institutions that are also using online multiple-choice quizzes to assess non-theorical topics. In order to better understand the students’ opinions on the development of skills and competencies with online multiple-choice quizzes and on the other hand with classical computer assisted assessment, it would be necessary to add questions concerning these aspects. It would then be interesting to compare the findings of this study with the results from other institutions. Impact on Society: The increasing number of students in higher education has led to a raised use of e-assessment activities, since it can provide a fast and efficient manner to assess a high number of students. Therefore, this research provides meaningful insight of the stakeholders’ perceptions of online multiple-choice quizzes about practical topics. Future Research: An interesting study, in the future, would be to obtain the opinions of a particular set of students on two tests, one of the tests using online multiple-choice quizzes and the other through a classical computer assisted assessment method. A natural extension of the present study is a comparative analysis regarding the grades obtained by students who performed one or another type of assessment (online multiple-choice quizzes vs. classical computer assisted assessment).