Developing a Health And Wellness Television Series for a Collegiate Population: Results of a pilot series evaluation Gina Blunt, Ph.D. Ann Andaloro, Ph.D. Ann Rathbun, Ph.D.
Go GREEN www.arathbunblog.blogspot.com
Introduction Grant
application (Fall 2007)
The
major goal of this project was to produce a 30-minute television show on fitness and wellness that promotes health and physical activity to the audience on the Morehead State University campus.
Strategy
session (10-07)
Identified
Began
experts on campus/community
Production (01-08)
The Health Communication Process
NCI, 2008
Why Pretesting Is Important? Shows
how well the program has met its goals/communication objectives What you might change or improve Justifies the program to funders or bosses
NCI, 2008
Why Pretesting Is Important? Provides
evidence of success or the need for additional resources Increases organizational understanding of and support for health communication Encourages ongoing cooperative ventures with other organizations
Conducting Pretesting What
do you want to evaluate? Decide on data collection methods. Intercept
interviewing Audience testing Choose
an instrument (The Pink Book). Collect and analyze data. Write and share evaluation report. NCI, 2008
Common Myths and Misconceptions About Pretesting It
costs too much It is too complicated It takes too long If it’s working we should see results automatically What if we find out it didn’t work…the boss won’t be happy. NCI, 2008
References National
Cancer Institute. (2005). Making Health Communication Programs Work. US Department of Health and Human Services. FREE text book available at www.nci.nih.gov
Get Fit: Mind Body Spirit
Video Production Process Model
Basic idea
Defined process message (Desired effect)
Medium requirements a) content elements b) production elements c) people Cause Desired effect
Preproduction Production Post production Cause
Evaluation (Degree of Success)
Actual process message (Real effect)
The IDEA
The desired effect The major goal of this project was to produce a 30-minute television show on fitness and wellness that promotes health and physical activity to the audience on the Morehead State University campus.
Medium requirements a) content elements b) production elements c) people
Content elements Spring Training
Dr. Gina Blunt
Just For the Health Of It
Dr. Ann Rathbun
Fitness Fun
Dr. Ann Andaloro
Transformation training
Shelly Sorg
Nutrinews
Melinda Mendez
Production Elements 2
Sony Video Cameras 2 Tripods 2 Microphones Mini DVD tapes
Studio Production Three
camera studio
Get Fit with Dr. Gina Blunt
People Gary
Cornett
Director Creative
Production Grant
Katie Hockenberry
Assistant Director/Editor Practicum
Andrea Falkner, Segment Producer
Directed Study
Jessica
Cole
Production Assistant /Senior project
Get started Resources Student
workers Interdisciplinary courses Grants Make
connections
Communication Local
Department
Cable University Webmaster Library YouTube
Evaluation
Goals Questions
from Making Health Communication Programs Work Evaluate current program for Overall
reaction Content/message Appeal Usefulness
Demographics MSU
students
n=91 4
UG classes in HPES Viewed 4 different segments of Get Fit 36.3%
male 63.7% female 96.7% 3.3%
Age (18-24) Age (25-34)
Overall reaction to the Program A great program, 60% would like to see it 50% again 40% b. A pretty good 30% program c. Just so-so, like a 20% million others 10% d. Another bad 0% program a.
Great Program Pretty Good Program Just so so
Overall reaction to the program
Another Bad Program
In your opinion, what type of person was this program talking to?
Someone
like me 71.4% Someone else, not me 15.4% Don’t know/not sure 13.2%
For each pair of words or phrases, please circle the one that you feel best describes the message.
Believable Not Believable
84.6% 12.1%
Well done Not well done
95.6% 1.1%
Convincing Not Convincing
62.6% 34.1%
Made its point 84.6% Didn’t make its point 11% Interesting Not interesting
91.2% 6.6%
Describe your feelings about the person giving the information in the video. Believable
91.2%
Not believable
6.6%
Appropriate to the message
94.5%
Not appropriate to the message
1.1%
Easy to understand
94.5%
Hard to understand
2.2%
How much, if any, of the information in the program was new to you? All of it Most of it Some of it None of it
2.2% 5.5% 35.3% 56%
Overall, how useful was the information? Very useful Somewhat useful Not very useful Not useful at all Don’t know/not sure
18.7% 50.5% 15.4% 9.9% 5.5%
Changes in Fall 2008 In
studio production On location for Just for the Health of It, and Transformation Training New production staff with specific roles in studio and on location
Comparison Data
Subjects n=25 Male
n=11 44% Female n=14 56% Ages
18-24 96%, Ages 25-24 4% Exercise
Science UG in Senior Level Class
Overall Reaction to the Program Show 1
Show 2
12%
16%
58%
52%
Just so-so, like a million others 27%
28%
Another bad program
0%
A great program, would like to see it again A pretty good program
2%
Overall, how useful was the information? Show 1
Show 2
Very useful
19%
12%
Somewhat useful
51%
67%
Not very useful
15%
17%
Not useful at all
10%
4%
Don’t know/not sure
5.5%
0%
Asked to Assess between Spring and Fall 08 Production
Quality Entertainment Value Relevance Would Recommend
1
2
Very Low
Low
Likert-type Scale 3 4 Moderate
High
5 Very High
Comparison Production Entertainment Relevance Recommend Overall
11% higher show 2 15% higher show 2 6% higher show 2 10% higher show 2
13% higher scores for show 2
Comments Show 2 More
interesting, fun to watch More useful More NEW information More appealing, looked like more time was spent on show 2 Liked the different scenes and shots, not just focused on one setting