Evaluation
Report
 
This course was designed to give agricultural professionals a basic reference on accepted safe use practices, a greater understanding of the principles and components of safe use programs and provide them with tools and skills useful for implementing such programs. The course was offered for 6 weeks from August 15 - September 28,2001 with 4 facilitators and 42 participants. Facilitators were based in the United Kingdom and Bangkok Thailand and the participants were accessing the course materials and communication tools from Australia, China, India, Indonesia, Korea, Malaysia, Pakistan, Philippines, Thailand and Vietnam. At the end of the course all participants were requested to fill in an online evaluation of the course. Below are the summarized results.

 

Number of Respondents 16
How did you most commonly access this course ? Company (office) LAN = 16
Hours you required per week to complete all lessons range = 1 - 40 (min-max)

average = 8.4

 Minimum time per week participants should expect to spend on this course range = 2 - 40 (min-max)

average = 8.7

   
Course Content - Quality and Usefulness
 

The most vital information required in order to make improvements in this course include your assessments of the Quality of the content of the various lessons as well as the Usefulness of the information they contain.  Quality is judged based primarily on the accuracy and completeness of the information.  Usefulness is judged based on the relevance and importance of the information to you in your work.  For each of these factors please indicate your opinions of the various lessons by clicking the circle most closely representing your assessment.

   
 

Quality

  

Usefulness

 Lessons
 		  
Module I. Knowledge of accepted safety practices associated with chemical use (overall) 1 13 2 0   5 10 0 0

General

 2 13 0 1   4 11 0 0

Absorption and Effects of Pesticides

 5 10 1 0   6 8 1 0

Personal Protection

 5 8 3 0   7 6 2 0

Protection According to Task

 0 13 3 0   2 12 1 0

Protection of Other People

 1 11 4 0   6 8 1 0

Protection of Other Organisms and the Environment

 1 10 5 0   3 12 0 0

Chemical Groups: Characteristics and Mode of Action

 2 10 3 1   4 9 2 0

Choice of Pesticide and Application Methods

 1 10 5 0   4 10 1 0

First Aid Treatment of Pesticide Poisoning

 1 10 4 1   4 8 3 0
                   
Module II. The issues and diverse viewpoints associated with the promotion of safe use (overall) 4 10 2 0   4 11 0 0

Issues

 5 8 3 0   8 9 0 0

What is being done - International Code of Conduct on the Distribution and Use of Pesticides

 4 9 3 0   5 10 0 0

Other major initiatives

 2 12 2 0   2 11 1 0
                   
Module III. Understanding when, what, why, how and if these products should be used (overall). 4 9 2 1   6 7 1 1

IPM Defined

 5 6 4 1   4 9 1 1

Why IPM

 4 7 4 1   4 9 1 1
                   
Module IV. The design and implementation of training courses and safety programmes (overall) 3 11 2 0   5 7 3 0

FAO Farmer Field School

 2 10 3 1   3 9 3 0

GCPF Safe Use Projects

 4 7 4 1   4 7 4 0

IRRI Mass Media

 3 9 3 1   4 4 7 0

Creating Behavioural Change: Designing Educational Activities

 4 10 1 1   6 7 2 0
                   
Module V: Monitoring and evaluation of safe use courses and programmes (overall) 3 11 2 0   4 9 1 0

Programme Evaluation

 3 11 2 0   3 9 2 0

Training Course Evaluation

 3 10 3 0   3 10 1 0
   

Are there any additional topics you feel we should add to this course?

  • none

  • No. To me, its content is almost covered enough the sprit of the course purpose. Very good, indeed.

  • Unwanted exposure of pesticides due to defective spraying equipment and spraying techniques is a major concern and information on proper spraying techniques is essential for any improvement in safe use. This information should be included in this module.

  • Stronger reflection of the European Legislation about sprayer certificates, checks, operator licenses, drift and border stripes

  • add new other chemicals

  • MRL (Max Residue Level) issue in vegetable, its control & implication to health

  • No

  • More real case study

  • Practicing : sprayers - nozzles - calibration

  • Guideline on MRL and residue monitoring system

  • Poisoning symptoms to human according to type of pesticide (with photo)

Any specific comments or recommendations on how to improve Module I. "Knowledge of accepted safety practices associated with chemical use".

  • In case of pesticide groups/classifications, application and poisoning. Do not restrict to insecticides only

  • sufficient for the length of time allotted to training course

  • This is a very big Module but also very interesting part. But it will be more attractive if: - More detail and practical: there are some new pesticide group in the market. First aid treatment should be more detailed. - More self evaluation assignments. - How to choose the right pesticides, more examples.

  • OK

  • Consistency of the information such as colour coding.

  • The questionnaire at the end of each topic is a good way of assessing one's understanding.

  • All are o.k.

  • To strengthen farmer education

  • No comment

Any specific comments or recommendations on how to improve Module II. "The issues and diverse viewpoints associated with the promotion of safe use".

  • International code of conduct is very important and essential topic each should know. More and practical inputs on how to implement with developing countries in mind will be of good help.

  • none

  • It is good and useful. But it will be fresher if we could quote or bold necessary issues. I love the major initiatives.

  • OK

  • Very well covered.

  • All are o.k.

  • use more clear picture

  • To strengthen regulation and mandatory implementation of the regulation

  • Include issues on suicide related with pesticide.

Any specific comments or recommendations on how to improve Module III. "Understanding when, what, why, how and if these products should be used".

  • It is very difficult to add pesticide industries views in governments' IPM programme. Major task is consensus on definition it self. More guidelines on how to develop IPM modules which are more practical will be helpful.

  • Include ecological relationships of biological control agents in pesticide use and crop yields.

  • I think it is the part of course to be able to shorten to relieve the pressure. We should have just selected the main points that reflect the opposite (if any) point of views.

  • It was more focused on IPM which is what was needed. But information on how to actually use pesticides should also have been given more emphasis in this module.

  • Harmonize the understanding of IPM with other approaches

  • Simple & easy to digest.

  • All are o.k.

  • To strengthen farmer and dealer education To produce technical brochure.

  • No comment.
Any specific comments or recommendations on how to improve Module IV. "The design and implementation of training courses and safety programmes".
  • In case of group assignments, criteria to prepare group need to be more clear. Better if one group contain people from different geographies but having some common problems or crop cultivation practices. Otherwise difficult to write common assignment on topic which you are not aware of.
  • none
  • This simple content provide the most difficult assignments of the courses. More instructions may be rescue some learners (and myself) from drowning in pool of confusion and worries. Sorry :-)
  • Too much material to read.
  • Team work grouping should be anticipated much earlier and/or number of the team should be higher than the minimum. So in case someone cannot join, the minimum number of group can still fulfill the assignment.
  • Good for people in EH&S position.
  • All are o.k.
  • To arrange specific training course by professional organization sponsored by GCPF or individual company for designated staff in this area and cascade through to all relevant staff by the trained designated staff
  • No comment.

Any specific comments or recommendations on how to improve Module V. "Monitoring and evaluation of safe use courses and programmes".

  • Good exercise. General comment and suggestion : When I enrolled for the course I was thinking - "Oh not very difficult". But when assignments started due I realized the pressure and time need to spend on training program. Since most of the participants are also working in field and keep traveling it is very difficult to meet due dates. Longer course duration will help to finish course and assignments peacefully. It will also help to really add more in assignments. I can understand the constraints of availability of outside facilitators. They may be engaged mid course. So that they will be available till the end of course. Overall course is excellent and very useful. I am sure it will add value to our efforts towards promoting safe and judicious use of agrochemicals. Thanks and Regards.
  • none
  • Also this need more time to do while time is running out.
  • OK
  • No comment.
  • All are o.k.
  • No comment.
   

Interactions - Quality and Usefulness

 

We firmly believe that it is through interactions that real learning takes place.  This course uses a number of mechanisms to encourage interactions.  Interactions between participants and the content, interactions among participants and interactions between the facilitators and the participants.  We are, therefore very interested in hearing your assessments of both the quality and usefulness of the various forms of interaction.  For each of the mechanisms listed below, please indicate your opinions about their quality and usefulness by clicking the circle most closely representing your opinion.

   
 

Quality

  

Usefulness

Interaction Mechanism

 

  
Self assessment quizzes in Module I 8 8 0 0   8 7 0 0
Discussion fora 0 11 4 1   0 11 3 0
Assignment 1. Identification of common unsafe behaviours and analysis of the major factors responsible. 2 13 1 0   4 11 0 0
Assignment 2. Report on the implications of the FAO Code of Conduct to you or the sector in which you are employed. 4 10 2 0   3 10 2 0
Assignment 3. Evaluation of other safe use initiatives. 2 11 3 0   3 10 2 0
Assignment 4. Presentation of your ideas about what you think you can do to maximise the benefits and minimise the negative consequences of IPM. 4 10 0 2   4 9 1 1
Assignment 5. Evaluation of the strengths and weaknesses of 3 programme approaches (Farmer Field School, GCPF Safe Use Projects, IRRI Mass Media Campaign). 2 11 2 1   2 9 4 0
Assignment 6. Design a change program or training course based on the design principles outlined in the course. 3 10 2 0   4 8 2 0
Assignment 7. Evaluate an existing safe use or IPM training activity or programme in your area based on what you learned about effective training or programme evaluation. 3 9 3 0   3 7 4 0
   

Facilitators

 

We believe that the key to success of any educational activity is the skill and commitment of the facilitators.  Your assessment of their qualities can provide valuable feedback on how to do the job better.  Below we have listed several important factors that define a good and effective facilitator.  Please give us your assessment of the facilitators involved in this course by clicking the circle most closely approximating your opinion.

   
 

Content / Subject Matter Facilitation
(Jerry, Hans, Bill)

  

Technical / IT Facilitation
(Pipot)

 Qualities
 		  
Knowledge of subject area 9 7 0 0   8 6 0 0
Ability to communicate clearly and effectively 8 6 2 0   8 5 1 0
Uses personal and professional examples to stimulate discussion 6 6 4 0   4 8 2 0
Interacts on a regular, timely basis 5 5 4 2   4 6 2 2
Skill in keeping the class motivated 4 4 5 3   4 6 2 3
Works with lurkers 3 4 6 2   2 6 4 2
Responds to student questions in a timely and consistent manner 6 6 4 0   6 7 2 0
Monitors student learning groups and encourages collaboration 3 5 5 3   5 4 4 2
Overall rating of the facilitators 7 7 2 0   8 6 1 0
                   
   
Additional comments regarding the course facilitators.
  • Timely feedback on assignments, quick response to doubts and time to time encouragement from facilitators help to keep my enthusiasm alive till course end. Otherwise due to some technical problems at the beginning and due to work pressure during mid course I was thinking to discontinue course. Thanks and hats off to all facilitators and all who were involving in successful implementation / completion of this course. Thanks and Regards.
  • There might be a need to lengthen the time duration for the course.
  • I would like to thanks to their patience and hearty, special to Ms. Pipot and Mr. Bill King, Mr. Hans Dobson.
  • Facilitators have done an excellent job. But the groups which were made to do some assignment didn't work. Need to see how the facilitator can help change/improve this during future programs. Like I didn't receive any response from my group members for the group assignment.
  • Reinforcement: very good, but a clear pro's or con's comment did not exist. All topics raised by student in the discussion board should be commented, if no comment from participant.
  • Excellent job done. Keep it up.
  • All facilitators do their excellent job for this course. Usefulness of the course to individual participant depends on interaction and response to the group as well as how he/she can apply to real practices.
  • Very sorry for having not enough commutation chance with facilitator.
  • Facilitator have to motivate other student to be more active.
   
Blackboard
This course has been designed to take advantage of the tools included in Blackboard – a learner management system software platform.  We are currently evaluating this product as a first step in choosing a permanent platform for managing all APRTC courses.  Your views will give us valuable information that will help us make a final decision about the suitability of this product.  Please give us your assessment of the following Blackboard features by clicking the circle in the column representing the response most closely representing your opinion.
   
 

 

Blackboard Features
 
Ease of use for submitting assignments 3 10 1 1
Ease of use for posting messages to discussion boards 4 7 4 0
Ease of use for sending emails 6 7 1 1
Ease of navigation 2 9 2 2
Speed of access 1 8 3 3
Appearance (user interface) 3 9 2 1
Compatibility with your computer and networking setup 3 9 3 0
Reliability (i.e. bug free) 6 8 1 0
         
   

General

In addition to content and facilitation there are several other factors that contribute to the overall quality of an online course.  Below we have listed some of the most important.  Please give us your assessment of these factors by clicking the circle in the column representing the response most closely representing your opinion.

   
 

 

Additional factors
 
Course structure 4 9 1 1
Ease of access under your circumstances 1 10 3 1
Duration of the course 0 5 6 4
Time required to complete all exercises 0 2 8 5
Difficulty of exercises 0 5 9 1
Reading level of lessons 1 8 5 1
Amount of fun 0 5 5 4
Overall rating of the course 1 10 2 2
         
   
Do you feel that there is a need and/or demand for training on Safe and Effective Use of Crop Protection Products among your colleagues? YES = 16     NO = 0
Do you think online learning is an appropriate way to provide Safe Use training for your colleagues? YES = 12     NO = 4
Would you be interested in participating in another online APRTC course? YES = 15     NO = 1
 
Please give us any specific comments or recommendations on how this course could be improved?
  • Due to work pressure, field traveling from where it was not possible for me to RAS. I failed to utilize black board properly. It is not fair to give any feedback on this. Sorry for that. Online learning on safe use is very good method of training and it adds lot of value. But still, I feel actual practical and class room training will be more effective. Online training should be used in addition to class room training. Thanks and Regards
  • Moving Gif's are highly recommended, or maybe you can use java for some topics like the one's with pix.
  • none
  • Some links are dead. - Less links (by just select the key ones to save time). - Improve much about navigation. - Schedule more strictly about time to participants. - May be less work group (?). - More fun.
  • Timings: For pesticides industry this is the busiest time in Asian countries. autumn/winter may be a better time.
  • More precise directions on use of blackboard facilities are needed by participants to fully benefit from this course.
  • Duration of the course should be 10-12 weeks.
  • The information should be more succinct, and adapt to everybody at all levels.
  • Balance shift from chemical towards mechanical features of pesticide application; Review of some definitions and proposed practices.
  • Stratify participants from the beginning on e.g.: access to internet, time availability, "mental"/personal condition for online course, in order to form the working group. Stratification can be obtained from questionnaire.
  • How about getting everyone together to complete the course over 1 week for everyone to stay focus rather than distance learning?
  • I observe that the weakest part of this course is the interaction between and among the participants. I think it would help if all the participants are properly introduced or introduce themselves properly. This would at least break the ice, so to speak.
  • Every thing in this course is very good and up to standard.
  • I 'd like to spend more time to attend , I have got stuck in contact with organisers to log in at the beginning of this course due to my password , been too late to reply & made me reluctant to this course .
  • All participants required quite specific knowledge and need more time to digest the course. Because of time limit and more effectiveness, I would like to recommend group participating from each individual company to share the course and time.
  • Safe use training must have practical training as well. Especially on method of delegating the information to the target group. Different target group may need different method or strategies therefore a segment of practical should be included in the course.

General comments sent through email:

  • Strengths of the course:(1) Good basic info on agrochemicals, safety and handling (2) Guidance to appropriate web-site further info. (3) The discussion board is a good interaction corner for participants. Weaknesses: (1) High drop out rates - probably due to design of the course. (2) Heavy reading is required e.g Module-1, one of the participants needed 5 hrs of reading time. (3) There are technical problems as lines are often too busy during peak hours. (4) It is difficult to organise their access time to the course. When there is time, they cannot proceed as they have to wait for others to catch up. (5) There are complaints that many participants did not submit their assignments which affected the progress of those who finished on time. (6) In the final module, the team/group assignment is a failure as the teams are often not active which resulted in assignments being not completed.
  • From the little that I saw of the course, I thought that the materials were good and quite complete. It struck me that the course would be very useful for those in the chemical industry and those doing extension work with the users of agricultural chemicals.
  • I think overall -with the limitations indicated in my comments and the evaluation, the course is an excellent exercise and well done. Perhaps the facilities were a bit overkill -  I saw the amount of discussions decreasing towards the later chapters and the personal presentation boards were hardly used. The only part which really worried me was the recommendation of the pit for wash water and spray residues - and apart from one very valid comment my concern raised on that remained without further discussion. I hope, this point is revised for future courses. In general I think it was worthwhile. I admit it hit me in the worst possible time but I hope I could still make some useful contribution.