Online Instruction Evaluation
In Session 2, we took a look at three rubrics that are used to evaluate the effectiveness and quality of an online course. In this session, I will be using the rubric that was developed by California State University Chico (CSU Chico). As was mentioned, this particular rubric contains 6 categories in which a score of 1) Baseline 2) Effective or 3) Exemplary is given.
The course that I have chosen to evaluate is accessible via the following link:
This course is available online for nurses who are seeking continuing education (CE) credits to meet the requirements of maintaining their professional license. I chose this particular course for evaluation as CE's are something I am required to obtain; and obtaining them online is something that is easily done. Unfortunately, not all CE courses are created equal, so it can be helpful to evaluate a course, utilizing the CSU Chico Rubric.
Let's take a look at the 6 categories of the rubric.
When looking at Category 1, we are assessing the support and resources that are available to the learner. Prior to beginning the course, links for resources and author information are easily accessible to the learner. There is a video of the course content with audio, in addition a pdf copy of the slide deck is available to those who would prefer that. I would score this course as being Exemplary in Category 1.
In Category 2, we take a look at online organization and design. This is where we get to assess whether or not the course design is appealing and conducive to learning. I would rate this course as being Effective in Category 2. There were some issues with accessibility on some of the links, and it was not clear on who to contact in regards to this. This is an area of improvement.
In Category 3, we look at instructional design and delivery. Here is where we assess the interaction between learners and instructor, activities if any, and whether or not the objectives of the course are clearly outlined. Effective is how I would evaluate this course. Essentially, the course was offered online with the opportunity for instructor to learner, and student-student interaction towards the end when a live Q & A session was held. This type of interaction helps engage the learner.
Category 4 helps us assess and evaluate student learning. In this course, a post test is given and a certain score has to be obtained in order to gain CE credit. Following the post test, the students are then asked to share feedback and evaluate various areas of the course. With these two components occurring, the course designers/instructors can evaluate whether or not the content is effectively being delivered to meet the course objectives. In addition, areas of opportunity are identified. I would rate this course as Effective in Category 4.
Category 5 takes a look at innovative teaching with technology. Are there various ways learners are being engaged? What types and how many different types of multimedia elements are seen? As time goes by, we can say that technology is constantly changing the way we do things in life. In this case, delivery of educational material online. I would rate this course as Effective under this category. In my opinion, in order for it to have received Exemplary, more multimedia elements would have been utilized instead of just a video or pdf of the presentation.
Lastly, Category 6 looks at how the faculty uses the student feedback. Here, we would assess whether or not areas of opportunity are being addressed. In this category, I would rate the course as Effective.
Based on my evaluation of this course, I can see various components that would need to be included in order for the course to be rated as effective at the minimum. For example, utilizing various technologies to help deliver the content in various formats, ensuring that there are areas for feedback, as well as keeping the content aligned with the course objectives.






Hi Billy,
ReplyDeleteI'm curious to know if you would use this rubric to assess/evaluate the course you developed, and what areas do you feel needs to be developed based on this assessment.
Hi Melissa,
DeleteI think I would use this rubric for sure on the course that was developed previously. One area I see that could be developed would be on adding more learner support and resources. One thing that was identified when we launched the module, was that many had access issues.
Hi! Billy:
ReplyDeleteI am happy to see someone use this rubric of CSU Chico, because I only facus on the field of QM. Thank your sharing that I can understand the Chico rubric deeply.
Tsai
Thank you for the feedback, Tsai.
DeleteBilly,
ReplyDeleteI really like how you were able to post in the pages that you used. I am glad that others also felt that CSU Chico was useful. I would like to know how you put those web pages into you blog. Good Job.
-Nicole Wobken
Hello Nicole,
DeleteFor the images, I used screenshots from the actual rubric. For an apple device, you would hold "command" "shift" "4" then select the item you wanted to capture. For PC based systems, I have used Jing, a free program, to obtain screenshots. Hope this helps.
Hi! Billy:
ReplyDeleteAfter I read your Online Instruction Evaluation article that including many good points such CSU Chico, I only focus on the field of QM so that can help me learn more what's different between QM and CSU Chico.
Chun Yi Huang
Tsai
Hello Chun-Yi,
DeleteI felt that the CSU Chico rubric was more fitting for me. The QM rubric is very analytical, in my opinion. It is a good match for certain social styles.