Evaluation Report

This online course was designed to improve participants' abilities to "access and take advantage of networked computer resources and to use and understand information as presented by computers." The course was offered for 1 month from 23 April - 19 May 2001 with two facilitators and 15 participants. Facilitators were based in Bangkok Thailand and participants were accessing the course materials and communication tools from Vietnam, Thailand, Australia, Japan, Malaysia and the Philippines. At the end of the course all participants were requested to fill in an online evaluation of the course. Below are the summarized results.

 

Number of Respondents 11
Number of hours participants required to complete all exercises range = 6.5 - 40 (min-max)

average = 13.8

 Number of hours participants felt would be required to complete all exercises range = 6 - 56 (min-max)

average = 18

 
Course Content -
 

The table below presents participants' perceptions of the quality of each of the course lessons. Columns 2-5 indicate the number of respondents choosing that reply.

 
   
 Lessons
 
Introduction to online learning 5 6 0 0
Tips for online learning success 6 5 0 0
Improving Internet connectivity 3 6 2 0
Email 4 3 4 0
Listserv (diglit) 4 6 1 0
Computer mediated conferencing 0 8 2 0
Internet relay chat 4 5 1 0
Listserv (as a search tool) 3 6 1 0
Indexes 2 6 2 0
Directories 2 6 2 0
Gateways 1 7 2 0
Online libraries 1 6 2 1
Course project 3 4 1 1
 

Specific recommendations:

  • In general, The attendants have a big gap of computer skill. So the summary with hyperlink (for details) explanation might be a good concept and do not require to read all for the one who already use to it.

  • Time line, 3-4 weeks should be good enough.

  • I found that the later sections, from Indexes through to Gateways, tended to be somewhat blurred due to the overlap that seems to exist in this area between the different topics.

  • The course project needs to be re-thought in my opinion. Within the time given.

Additional topics participants felt should be added to this course?

  • how to set up listserv

  • Little bit more structure/direction at the beginning might have helped to get more interaction earlier.

  • for short courses, topics are adequate

  • Too many E-mail may not fit some participant. Mail should come from facilitators to persuade participants to go to the web-board or the communication rather than everyone send mail to everyone.

  • I appreciated the feedback from Pipot on how to access emails by re-directing them automatically from the company email system (although I had problems).

  • Remote access to company systems is often an issue but due to the differences in system types may be difficult.
 

Facilitators

 

The table below presents participants' perceptions of the quality of the course facilitators. Columns 2-5 indicate the number of respondents choosing that reply.

 
 

 
 Qualities
 
Knowledge of subject area 9 2 0 0
Ability to communicate clearly and effectively 9 1 1 0
Skill in keeping the class motivated 5 5 1 0
Availability 8 3 0 0
Overall rating of the facilitators 7 4 0 0
         
 
General comments regarding the course facilitators.

  • Great job !! Hoo haaaa!!!

  • Impressed by professionalism

  • Thought you did a very hard job well. I'm sure 'real' students would be less slow off the mark, and more interactive.

  • Provided all assistance needed. However for distance courses, student has to be dependent on his interest and resources.

  • Good job for the course facilitators. The problem is the lack of time for the student side to keep up with the course. I feel that, I need to have continuous 3-4 hrs for each period. Not intermittence like what I have had for this course.

  • All facilitators are very enthusiastic and active in running this Training Course.

  • Seemed to work well as a team; 2 co-ordination and prompt feedback.

 

General

 

The table below presents participants' perceptions of the quality of various aspects of the course. Columns 2-5 indicate the number of respondents choosing that reply.

 
 

 

Course aspects
 
Course structure and navigation 0 8 3 0
Reliability (i.e. bug free) 2 6 3 0
Ease of access under your circumstances 3 6 2 0
Consistency of look 5 5 1 0
Attractiveness 4 5 2 0
Level of difficulty 0 8 3 0
Duration 1 4 6 0
Time required to complete all exercises 1 3 5 1
Assignments 3 5 3 0
Reading level of modules 5 4 2 0
Relevant to your needs 6 3 2 0
Amount of fun 2 5 4 0
Blackboard as a course management tool 2 6 2 0
Overall rating of the course 5 5 1 0
 
Do you feel that there is a need and/or demand for training on Digital Literacy among your colleagues? YES = 10     NO = 0
Do you think online learning is an appropriate for your colleagues? YES = 10     NO = 4
Would you be interested in participating in another online APRTC course? YES =  9      NO = 1
 
Specific recommendations ?

  • Specialised training for Blackboard

  • I think you will give enough time for the participants to complete the assignments.

  • The "firewalls" in the company LAN meant that accessing some of the communication tools was problematic.

Additional comments or suggestions on how this course could be improved?

  • Appreciate the flexibility re extended time period for final project, as will others due to travel/M&A commitments etc.

  • I think the course helps a lot especially that I am new in the field of Agriculture.

  • If you expect this course to be a very first introduction to digital literacy, you need to simplify some parts or give more detail instruction on how to do each exercise step by step. The problems of myself are as I mentioned before: the lack of continuous time periods to work on the course.

  • The topic in the course may adjust to participant's working type to reduce their time spending by the way still keep the course direction as the objective.

  • Everything provided from facilitators & courses is all 3. Results of individual achievement, however, depend on his/her dedication to the course. I gain a lot of knowledge & experience from this course, especially new tools like blackboard, icq, etc.

  • I have certainly learnt a number of useful skills which will help me in my work. The most important is probably the improvement in my ability to research topics.

  • I suggest that you indicate more clearly upfront the likely problems to be encountered with learning online and connectivity.
 
Conclusions

From the comments receive through the evaluation form, the course listserv and emails we are confident that the major objectives were achieved and that all participants found the course very useful and relevant to their needs. Moreover, they overwhelmingly indicated that their colleagues would benefit from participation in such a course and that the online format would be appropriate for delivery.

It does appear, however, that some modification should be made. Foremost of these are:

  • Shortening the course to allow participants time to fully complete all exercises.

  • Combining the lessons on the various search options.

  • More structure/guidance and step-by-step instructions particularly at the beginning of the course.

  • Training in the use of course management software (Blackboard)