High-tech Assessment Presentation

High-Tech Assessment The tools to use

Objectives • Recognize some high-tech assessment technologies. • Understand how they can be used effectively. • Know where to go for more information.

Traditional Pedagogy and Traditional Assessment • • • •

Class lectures Assigned reading Individual projects Papers and presentations

• Tests, tests, tests • Class participation • Portfolios

Pedagogy and Assessment 2.0 • Online courses – Online quizzes – Online discussion forums • Group projects – ePortfolios – Online Discussion Forums • On-demand online training – Online quizzes – Response times for online tests

•

•

•

Course management systems – Online quizzes – ePortfolios – Online discussion forums – Audience response systems Podcasted lectures – Download rates – Online discussion forums Gaming/Simulation – Game scores – Response Times

On-Demand Online Tutorials • “Screencasts” • Recorded demonstrations of using computer programs. • Camtasia – Leading screencasting system. – Allows audio, video, highlights, mouse-clicks, etc. – Includes quiz function to assess learning.

Examples of tutorial w/quiz in Libraries • TILT • Park Library Online Tutorial • Colorado State

Online Quizzes • Course Management Systems (CMS) – Blackboard – Moodle

• Online survey systems – SurveyMonkey (base version is free)

• Online Tutorials – Camtasia

• Provides instant summaries of results.

• Can track respondents’: – – – –

Answers When started/completed Time on quiz Time on question (some, not all)

• Assessment Uses

– Pre-test/Post-tests – Knowledge retained – Longitudinal assessment

Online Quiz/Test Example

Learning Assessment

Audience Response Systems • “Clickers” • Enable anonymous or non-anonymous responses to ad-hoc questions during a lecture. • Can be used to assess learning and direct course of lecture. • Often integrated with MS Office programs – PowerPoint for presentation – Excel for reporting

• …and Class Management Systems

Demo of ARS and ARS in Libraries • Quizdom Remotes Demo • Lehigh University Library • Dickinson College

Learning Assessment

ePortfolios

• Digital repository of work completed by student. • Meant to assess progress “as a whole.” • Often included with CMS – Blackboard

• Other tools:

– Wikis (PBWiki – cheap and easy to use) – Blogs (MovableType) – Digital Archives (DSpace – campus-wide implementation)

Examples of ePortfolios

• Polaris (UT) • ePortfolio at LaGuardia • Valdosta State

– Assessment of instruction services – Article in Reference Services Review

• UNISA

– Research Information Skills in distance ed class – Article in Education for Information

Gaming/Simulation

• Simulation of real-world experiences • Good for assessing higher-ordered thinking skills • Formative assessment is better. – Based on choices made. – Can be used to compare with others.

• Other measures

– Completion time – Self-correction rates

Examples of Gaming in Libraries • UNC Greensboro (a Web-based board game) • Ohio State – set of games to assess learning. • Arizona State University – developing a simulation game – Quarantined

Learning Assessment

Online Discussion Forums • • • •

Similar to class participation Can be scheduled or unscheduled Better to be synchronous Assessment measures: – Quality of participation – Quantity of participation (minutes, lines, etc.) – Frequency of participation

Demo of Online Discussion Forum in Libraries

Tool Summary

• Online Quizzes/Tests

– Similar to paper-based. – CMS or SurveyMonkey – Good for “open-book” tests. No checks for “cheating”. – Better at assessing lower-ordered thinking skills

• Recorded Demonstrations – – – –

Good for short segments of training. Better for demonstrations. Include a quiz for assessment. Not good for difficult topics.

More Tools Summary

• ARS

– Useful for continuous feedback from students to guide lecture. – Good for assessing the class/course.

• Gaming/Simulation

– Better at assessing higher-order thinking skills. – Complex to create.

References • Wikipedia – ePortfolio

• EDUCAUSE – E-Portfolios (a bit old, but still has some good background) – Gaming – Screencasting – ARS

• E-Portfolios for Learning blog

• Proof of learning: Assessmen

• ePortfolios: Hi-Octane Asses • Bibliographic Gaming • Game on: Games in Libraries

More References

• Leach, Guy J and Tammy S. Sugarman. 2006. Play to win! Using game Research Strategies, v. 20(3):191-203. • Fourie, I. and van Niekerk, D. (1999). Using portfolio assessment in a module in research information skills. Education for Information, 17(4), pp. 333-352. • Chapman, J. M., Perrway, C., and White, M. (2001) The portfolio: an instruction program assessment tool . Reference Services Review, 29, 294-300 .[CrossRef]

Vendor List • Online Testing – Blackboard – SurveyMonkey

• Screencasting/Onli ne Tutorials – Camtasia – Adobe Captivate

• ePortfolios

– Blackboard – Dspace – OpenSource Portfolios (OS

• Audience Response Systems – TurningPoint – Quizdom