My comments on a "star-rated" system for online learning
I'm referring to Moodle here because that's what's used at Coventry University.I think that a "star-rated" system would be great and would be one way of rewarding those who do well. I agree that it could also be used as a method to encourage tutors who need to improve their online presence.
I think that a "star-rated" system, if supplied with the right criteria, push, leadership and rewards, could be made to work.
My thoughts on a rating system
I would prefer a system not to be based on crediting the complexity or number of different types of Moodle activities or resources there, but based on how they are being used. For example, a tutor using Forum in such a way that the students are really engaged in their learning should get more credit than someone using Quiz with ill-thought-out questions, even though Quiz is more complex than Forum to set up.So, if there is going to be a realistic way of rating tutors' use of Moodle, I think that you must include a consideration of the purpose of the activities that are used by a tutor. So this would include the pedagogic competencies of members of staff, although not be a "measurement".
Why would you want a rating system? I think that it could go much further internally rewarding and highlighting areas of good practice. I think that the best could also be used in marketing the University and crediting those who do well.
Analogy
A system will have a chance in working if there is some value seen in the way that it works. I looked at the Visit England Hotel Accommodation Quality Standard. This is the guide book for hotels to use when they are applying for star recommendation. Hotels don't have to apply for star ratings. They don't receive stars just for the facilities. It's more than that:http://www.qualityintourism.com/wp-content/uploads/2012/04/Hotel-Standard-INT1.pdf
"VisitEngland understands that quality is the key to success within the modern hospitality industry. In order for the English hotel industry to be successful both nationally and internationally it is important that quality standards are set high and continue to improve."
Replace 'VisitEngland' with 'xxx University' and Industry references with a similar reference to Higher Education. So this also can link with University quality standards.
Just a few questions that you might like to consider in view of assessment. You might use the hotel reference that I gave as an analogy...
Do you consider short courses in the same way as long courses or modules? (Hotel, Country House Hotel, Small Hotel, Town House Hotel, Metro Hotel)
Do you reward unusual or exceptional use of one particular activity in Moodle? (Breakfast awards.)
Do you have key requirements for each star level and then a separate list for other areas? (Cleanliness, Bedrooms, Bathrooms, Service & Efficiency, Food Quality, Hospitality & Friendliness)
How can you make the process open, simple to use and fair? ("This booklet explains in detail the standards expected at each star rating level, from one through to five star.")
Do you want to reward innovation? ("Do not be afraid to innovate: This standards book is a flexible guide to the minimum services required at each level.")
Do you make the process flexible? ("The hospitality industry is dynamic in the way it provides services to its customers. If your customers would benefit from, or appreciate a new way of doing things do not dismiss the idea because it is not included in this standards book.")
What about accessibility? Has a tutor taught someone who needed extra adjustments, or have they been made, to increase access to the learning? ("By making some small adjustments to your facilities, providing information on your accessibility and understanding the needs of disabled people, your business will appeal to a wider range of visitors and attract more business. Demand for accessible accommodation outstrips the current supply.")
Some more questions...
Do you consider all of a tutor's modules or just one?What about a module team?
Is there a clear reward system and is it fair?
Who would be doing the assessment?
Some suggestions and resources
1. Have you considered asking the students what they think of their tutor's module?I notice that there is a Moodle Course Awards plug-in system. It uses two blocks called Vote and Medal. It was highlighted in a May 2012 OFSTED Good Practice report. Tutors have the choice of displaying the blocks.
Details of the Moodle course awards are here:
https://github.com/vaughany/moodle-courseawards
https://moodle.org/plugins/browse.php?list=set&id=9
2. Have you considered the Moodle activities and the degree of difficulty that they are considered to have? They might provide some core requirements, for example responding to messages. ("24 hour room service, including cooked breakfast and full dinner during restaurant opening hours.")
Here's a copy of an older poster that we used some time ago, colour coding the Activities according to the degree of difficulty there was in setting it up and how appropriate it was for given activities:
Moodle Tool Guide for Teachers (original): http://www.cats-pyjamas.net/2010/05/moodle-tool-guide-for-teachers
As I thought, there are now Moodle 2 versions:
http://www.scribd.com/doc/88025373/Moodle-2-Activity-Tool-Guide-for-Instructors
Resource guide:
http://www.scribd.com/doc/84552674/Moodle-2-Resource-Tool-Guide-for-Instructors
