注册 / 登录
The focus of this paper is on the use of e-technologies to enable higher education to better assess aspects of learning that have proved difficult to assess using more conventional means. Higher education describes the knowledge and abilities it intends its graduates to have acquired before graduation, and it has a wide range of approaches to assess these. Higher education also seeks affective outcomes in the form of values, attitudes, behaviours and related attributes or dispositions, and these have consistently proved more difficult to assess by examination or assignment. After graduation, however, graduates are often assessed within the professions via portfolios, interview and peer or expert review. Assessment may focus on teamwork and networking skills, productivity, creativity and values fit to the profession. How can e-technologies help with these forms of assessment? This paper reviews some of the e-based approaches and explorations that have supported or could support assessment of affective attributes. At each stage, the paper seeks to establish the common elements of assessment in the different regimes and how e-assessment contributes, or may contribute in the future. The paper concludes that many of the strengths of e-assessment lend themselves to an evaluation paradigm rather than to conventional assessment for intended learning outcomes.
A natural language based system has been used to author and mark short-answer free-text assessment tasks. Students attempt the questions online and are given tailored and relatively detailed feedback on incorrect and incomplete responses, and have the opportunity to repeat the task immediately so as to learn from the feedback provided. The answer matching has been developed in the light of student responses to the questions. A small number of the questions are now in low-stakes summative use, alongside other e-assessment tasks and tutor-marked assignments, to give students instantaneous feedback on constructed response items, to help them to monitor their progress and to encourage dialogue with their tutor. The answer matching has been demonstrated to be of similar or greater accuracy than specialist human markers. Students have been observed attempting the questions and have been seen to respond in differing ways to both the questions themselves and the feedback provided. We discuss features of appropriate items for assessment of this type.
This paper presents an alternative application of e-portfolio in a university student assessment context. A concept based on student collaboration (called netfolio) is developed, that differs from the classical e-portfolio concept. The use of a netfolio, a network of student e-portfolios, in a virtual classroom is explained through an exploratory study. A netfolio is more than a group of e-portfolios because it offers students a better understanding of learning objectives and promotes self-revision through participation in assessment of other students' learning, as indicated through their portfolios. Class student e-portfolios are interconnected in a unique netfolio such that each student assesses their peers' work and at the same time is being assessed. This process creates a chain of co-evaluators, facilitating a mutual and progressive improvement process. Results about teachers' and students' mutual feedback are presented and the benefits of the process in terms of academic achievements are analysed.
Peer moderation of group work in higher education is rapidly advancing through the use of technological developments and is increasingly being informed by pedagogical research. The highly successful WebPA online assessment system has gone through a number of development phases over its 15-year history and has now evolved into a relatively mature and flexible tool for facilitating group work. This paper presents a case study of the approaches that have been used in the system's development from the technical perspective, and describes how the scope of the project has massively expanded and that the development has been continually backed by a sound and wide-ranging pedagogy. The benefits of using the online system are shown to be underpinned throughout by examples of good practice in the supervision of academic group work. A critical evaluation of the tool and surrounding pedagogical practices highlight future areas for technical expansion.
While supplementation of face-to-face (F2F) teaching with online engagement is increasingly common, the educators' challenge of teaching F2F personalities and facilitating online personalities has not been widely explored. In this paper, we report on a project in which 1st-year students attended F2F sessions and engaged with an anonymous online questioning environment. The differences between students' F2F and online behaviour led to intended and unintended consequences. The purpose of this paper is to explore these intended and unintended consequences of technology use. The project was undertaken over a 3-year period, starting in 2004. In 2004, a pilot project was conducted based on a class of 35 students studying a 1st-year programming course in information systems. The investigation was again conducted in 2005 for the same course, this time with 63 students. In 2006, the project was extended to a class of 610 1st-year commerce students studying an introductory information systems course. In all cases, students met F2F and when online, engaged with an anonymous Web/SMS collaborative tool. The intended consequence was that a blending of F2F with online interaction extended student engagement beyond the limitation of a classroom and provided a forum for further collaboration and consultation. The intended outcome was achieved. An unintended consequence was that the tool provided the lecturer with diagnostic information that was used to impact on pedagogical designs. This was often a result of students taking on an online personality that would very often be extremely frank and honest about the manner in which the course was conducted, and how learning was taking place. The findings show that students used the tool in ways that exceeded the envisaged intention, and student use of the tool positively impacted on the curriculum, pedagogy and general running of the course. The paper concludes that integration of online engagement with F2F teaching adds value to the teaching and learning experience.
e-Assessment cannot benefit learners, and so education, unless it supports them in doing something differently in future. What, however, are learners trying to do better? This paper adopts a perspective in which learners simultaneously self-regulate multiple variables that are relevant to learning, and develops a theoretical argument that a key issue is the ambiguity of feedback events (such as a failed task or a poor mark) as to which variable should be adjusted. A common tacit assumption is that the relevant loop is about technical expertise, but in reality, students must and do also adjust effort, learning methods and course choices. Two methods for helping learners by resolving this ambiguity are discussed: telling learners directly which interpretation is relevant, and structuring learning activities to focus on one variable. Which loops are most important to learners generally shifts in the transition from school to university, implying that the role of feedback also changes. e-Assessment needs a major rethink to address these needs, and to understand why feedback is so often apparently ignored by students. Conversely, attending to all these loops would be to open new dialogues with learners.
The supervision of undergraduate student dissertations is an area in need of research. Although some studies have already addressed this, these are primarily based on academic staff responses. This study contributes to knowledge by gathering the responses of students and focusing on formative electronic assessment. Data was collected using a student focus group and student questionnaire. Unsurprisingly, the findings suggest that good supervisor–student communication is crucial to the supervision process and a number of students felt unhappy with this aspect. However, to facilitate this communication, the perceived absolute necessity of regular supervisor–student meetings is being questioned and a combination of technology-enabled communication is advocated. It is suggested that to improve the undergraduate student dissertation experience, a combination of face-to-face and electronic formative assessment is used. In addition, the blended e-learning skeleton of conversation model provides a sound theoretical framework that could guide supervisors and students in the supervision process. This model is advocated for use in dissertation module design and in supervisor development.
While a number of studies have been conducted on the impact of online assessment and teaching methods on student learning, the field does not seem settled around the promised benefits of such approaches. It is argued that the reason for this state of affairs is that few studies have been able to control for a number of confounding factors in student performance. We report on the introduction of a regular (every 3 weeks) low-mark online assessment tool in a large, first-year business mathematics course at the University of New South Wales, a major Australian university. Using a retrospective regression methodology together with a very large and rich data set, we test the proposition that exposure to the online assessment instrument enhances student learning. Significantly, we are able to control for prior student aptitude, in-course mastery, gender and even effort via a voluntary class attendance proxy. Furthermore, the study incorporates two large, and statistically diverse cohorts as well as manipulations in the model tested to robustly examine the outcomes. Our central result is that higher exposure to the online instrument robustly leads to higher student learning, all else being equal. Various implications for online assessment design, implementation and targeting are also discussed.
创建一个新的学习元并添加到当前知识群
从平台上已有的学习元中，选择一个合适的学习元添加到当前知识群
知识群评论 (0条)