Evaluation Forms

e-Learning Evaluation __________________________________

Company

_________________________________

Course

Company Contact:

____________________________

S i z e : __________________________________

L o c a t i o n : ____________________________

# o f C o u r s e s : ________________________

We b S i t e : ____________________________

P r i c e : ________________________________

Phone:

K e y C u s t o m e r s : ______________________

______________________________

O t h e r : __________________________________________________________________________

Platform B r o w s e r : ____________________________

O p e r a t i n g S y s t e m s : __________________

C o n n e c t i o n S p e e d : __________________

______________________________________

P r o c e s s o r : ____________________________

S o u n d C a r d : __________________________

R A M : ________________________________

P l u g I n s : ______________________________

I T R e s o u r c e s : ________________________

______________________________________

______________________________________

______________________________________

O t h e r : __________________________________________________________________________

Course Duration L e n g t h : ______________________________

# o f K n o w l e d g e I n t e r a c t i o n s : ________

# o f S c r e e n s : ________________________

# o f S c e n a r i o I n t e r a c t i o n s : __________

O t h e r : __________________________________________________________________________

© Sage Learning Systems, 2001

1

e-Learning Evaluation Status

Comments

Core Presentational Strategy ➤ Screen text-driven ➤ Audio-driven ➤ Vi d e o - d r i v e n ➤ Audio supplementar y ➤ Vi d e o s u p p l e m e n t a r y

Learning System Elements ➤ Print materials ➤ Assessments re: job roles and experience ➤ Assessments re: knowledge and skills ➤ J o b A i d s / FA Q s ➤ Mentors ➤ Te c h s u p p o r t ( s e e c a t e g o r y ) ➤ Links to external content/internet resources/hubs ➤ Newsfeeds ➤ Chat rooms ➤ Synchronous training events ➤ Push e-mails/newsletters ➤ Company-specific policies and materials ➤ I LT c o u r s e s ➤ Customization (see categor y) ➤ Games

Performance ➤ Responsive ➤ Minimal initial set up ➤ Rapid screen changes ➤ Synchronization of media elements 2

e-Learning Evaluation Status

Comments

Course Structure ➤ Course/lesson/topic or similar 3 level structure ➤ 3 level structure consistently applied ➤ Smallest unit should be in 5 to 8 minute chunks at the most.

Navigation ➤ Essential for ward, back and options choices ➤ Complete/Partial Learner Control ➤ Lean and clean; 90% of space for learning presentation ➤ Progress indication within topic ➤ Bookmark functionality ➤ Options can include: return to menu, g l o s s a r y / k e y t e r m s , J o b A i d s , FA Q s , n o t e s ➤ Menu of lessons/modules record progress of completion ➤ Should always be clear “what the student does next”

Screen Design ➤ Full screen presentation for learning material ➤ Simple and clean; not cluttered with unneeded images or objects ➤ No scrolling ➤ Few colors that work well together ➤ A few different templates to provide variety for text and graphic presentation ➤ Judicious use of dif ferent fonts and colored text

3

e-Learning Evaluation Status

Comments

Media Elements and Graphics ➤ Part of a total graphic design ➤ Optimized for target specifications and screen settings ➤ Meaningful graphics that add value ➤ Specific and unique role for media elements ➤ Easy to navigate from one medium to the next ➤ Close caption option ➤ Audio production quality ➤ Vi d e o p r o d u c t i o n q u a l i t y ➤ Low and high bandwidth media options

Interactivity and Feedback ➤ Interactions throughout learning; not just at the end ➤ Initial thought-provoking interaction to establish relevance ➤ Frequency of interactions: lear ners should not go for more than 5 to 7 minutes without some for m of questioning or interactivity ➤ Type of interactions: including multiple choice, drag and drop, hot spot, simulations, and free response ➤ Level of interactions: include interactions at the knowledge, skill and application to job levels. ➤ Presentation interactions such as roll-overs and hot spots. ➤ Feedback: if learner is right or wrong; what the correct answer is; and why

4

e-Learning Evaluation Status

Comments

Instructional Structure ➤ An introduction describing what will be learned and why it is important. ➤ Many job-related examples ➤ Materials are targeted to reading level, depth and experience of the audience ➤ Summarize key learning points

Content ➤ Accurate ➤ Current ➤ Comprehensive ➤ Meaningful ➤ Link to objectives and course goals ➤ Easy to update and maintain ➤ Uniquely created ➤ Credibility of developers

Te s t i n g ➤ Pre-assessment to determine what learners “ d o n o t y e t k n o w. ” ( 2 0 t o 3 5 m i n u t e s ) ➤ A recommended study plan based on pre-assessment. ➤ A post-test or master y test to document learning outcomes. ➤ A l l t e s t i n g s h o u l d b e b a s e d o n a Ta b l e o f Specifications that links objectives to content to test items ➤ Te s t e n g i n e t h a t r a n d o m l y a s s i g n s t e s t questions to generated tests. ➤ Randomized distractors within each item (preferred) ➤ A test item pool that is at least two to three times the number of items in a par ticular test. 5

e-Learning Evaluation Status

Comments

Tr a c k i n g A i d s f o r S t u d e n t s ➤ Acknowledgement of registration ➤ Lesson completion e-mails ➤ Course completion e-mails ➤ Access to all courses attempted/completed ➤ In process e-mails

Industr y Standards ➤ Granular course structure ➤ Objective linked to content linked to assessment ➤ Essentially compatible with IEEE, SCORM. AICC standards

Repor ting and Record Keeping ➤ Simple and not overly complicated reports ➤ Data that can be transported to LMS or other applications ➤ Key activity and completion measures ➤ Key learning outcome measures ➤ Item analysis data on each item and the percentage of people choosing each possible answer. ➤ ROI data ➤ Vi s u a l r e p r e s e n t a t i o n s ( p i e c h a r t s o r b a r graphs) of key results

Unique Customization Features ➤ An initial company specific message ➤ Links within a course to company-specific examples, policies ➤ Links to external sources of content ➤ To o l s t o g e n e r a t e c u s t o m e r - s p e c i f i c m e s s a g e s 6

e-Learning Evaluation Status

Comments

Implementation Ser vices ➤ Print Guides/Aids ➤ To o l s a n d Te m p l a t e s ➤ Tr a i n i n g ➤ On-site Consulting Ser vices

Suppor t ➤ Free/Fee structure ➤ Hours available ➤ To l l - f r e e p h o n e ➤ Internet support ➤ Response time policy ➤ Single point of contact

7

Overall Evaluation Strengths 1 . ______________________________________ 2 . ______________________________________ 3 . ______________________________________ 4 . ______________________________________ 5 . ______________________________________

We a k n e s s e s 1 . ______________________________________ 2 . ______________________________________ 3 . ______________________________________ 4 . ______________________________________ 5 . ______________________________________

Industr y Positioning ■ Outstanding ■ Good ■ Av e r a g e ■ Fair ■ Poor

8