Sunday, November 18, 2012

17-18 Nov E-learning weekend.

Since last I blogged we've been knocking out our webquest assignments. My webquest was about Fantasy Football. The overarching feeling that I had in regard to this assignment was a feeling of overwelming. I thought that this assignment was great. After looking at my classmates webquests, I truly realize that I could have done a better job. Morale of the story is that the work I put in was good but it could have been better.

How does training evaluation take place in your workplace?
When a new instructor arrives in our unit they are entered into what is termed "Phase One" training. During this period the intent is for each new member to accomlish all the tasks necessary to become instuctors. New instructors attended Acidemic Instructor Course in addition to initial unit level training. These individuals learn the basics of researching lesson plans and developing power points to support them. After completion of this phase one process, new instuctors are released from training and enter "Phase Two" training. This training cycle begins their practical On The Job Training (OJT) . This training is evaluated during Stan Eval and instructor evals. The evals are conducted by while an instructor is observed. This evaluates the instructors comprehension and retention of training they recieved during both phases of training.

How might you use evaluation tools outside of the workplace?
I use evalution tools with my seven year old and two year old. I also evaluate my ability to listen and respond to my wife.

What techniques might be used to evaluate performance of a team (as whole) and individual members? Include a unique, relevant link.
During the courses I teach at the USAF EC we teach several tasks. Some of these are called battle drills. These battle drills are taught to squads or groups of 9-13 people. These personnel are evaluated on their performance of the steps for each of the battle drills they're taught. Creating task performance checklists allow for students to evaluated on collective and individual tasks. Evaluating learner performance in this way allows for a practical evaluation of all members of team.

Create a brief scenario that illustrates Level 3 (Kirkpatrick) in your environment or a provide a hypothetical one.
Level 3 evaluations measure whether there was a transfer of learning to the actual work setting. This level of evaluation affects learners, managers, project stakeholders, subject matter experts (SMEs), and line supervisors. It also relates to mentoring programs, annual performance reports and development planning. After the courses in the USAF EC our students and their suppervisors recieve a Level Three feedback sheet. This feedback sheet asks both of these customers weither our training met the deployers needs.
 
Dr. Koller Video
Daphne Koller is enticing top universities to put their most intriguing courses online for free -- not just as a service, but as a way to research how people learn. With Coursera (cofounded by Andrew Ng), each keystroke, quiz, peer-to-peer discussion and self-graded assignment builds an unprecedented pool of data on how knowledge is processed.
With Coursera, Daphne Koller and co-founder Andrew Ng are bringing courses from top colleges online, free, for anyone who wants to take them.

Many of these courses are interesting. I would enjoy attending many of these courses.

This shows the potential of future e-learning. Much of this could be applied to the USAF EC. Our courses are more performance based, but many of the tasks taught in our courses could be completed prior to arrival through technologies like these.

Saturday, November 3, 2012

Reflections on Day One of our second weekend (3-4 Nov). These are my stream of conciousness notes for the day.

Discussion began with our ISD exercise and in particular Question #4.

Learner Performance is the focus of each stage  of the model.

Formatively Evaluate Each Design Stage

ADDIE
Revise as Required: The five phases are ongoing activities that continue throughout the life of a training program. After building a training program, the other phases do not end once the training program is implemented. The five phases work like a loop. They are continually repeated on a regular basis to see if further improvements can be made.

Always Track Performance for process improvement.

LL Bean was the bench mark for how inventory control is impotant to your bottom line.

Proctor and gamble discussed inventory control with WALMART. When the inventory of a product drops to a certain level a shipment will be sent to replenish that inventory.

What is your tolerance for any variance in training effectiveness.
Looking at ROI according to constant evaluation. Use spikes or dips in metrics as an opportunity to evaluate your program.

Discussion turned to the flipped classroom. Some of the pros and cons of this learning technique was discussed.
http://www.flippedclassroom.com/

-Rapid Prototyping. 50-60% is spent on analisys and design.
-Make prudent estimates with data.
Story Boards being used to present information.

Constant feedback from data collection allows course developers to focus on propper implimentation of training.

1hour of delivery can take 100-300 hours of development.

MOOC A massive open online course (MOOC) is a type of online course aimed at large-scale participation and open access via the web. MOOCs are a recent development in the area of distance education, and a progression of the kind of open education ideals suggested by open educational resources.

All this is based on collaberative learning.

Minimize test question avoidance. When developing questions and testing instruments, make sure that your questions meet your intent.

 Millers Magic Number.




Primacy Recency Effect

 File:Serial position.png
 

When you have the students’ focus, teach the new information. Don’t let prime-time get contaminated with wrong information.

Looking at the Seriel position effect.

Then we turned to the do they match exercise.
 
Day two dicussion was focused on our Webquest projects and question development.


The above question was posted and each member was directed to goto the individual page menu.

Student responses were reviewed and discussion focused the good bad good of each students questions.



HOTS and LOTS




The Above diagram was discussed. We looked at the importance of performance evaluation that all your performance can't be measured without having a control group to measure against.

Also discussion was turned to picking what 2 out of the three choices are the most important.

Pick2
Time
Quality
Cost.

Review of the E- Learning Weekend was conducted. First goto Assignments.

Webquest review directions:-Examine each webquest (see wiki discussion for links)
-Complete each wq QUIZ by using a name we recognize (if you want credit)
-For each wq review, post the following in review wiki discussions designated for each review and in the actual wq if you are logged into zunal (optional).
-Your recognizable name (often not wiki user name)
-Name of webquest you are reviewing
-2 unique observations about wq --refer to this wq rubric http://webquest.sdsu.edu/webquestrubric.html
-2 observations about the quiz (refer to our guidelines)
-2 recommendations/considerations for future revision/enhancement of this wq
As professionals, please state your reviews in a unique manner so they don’t appear as if you just made copies without careful consideration. The reviews should demonstrate that you examined the individual webquests.
Lots of creative approaches and application of 463 in terms of assessment and evaluation as well as this formative evaluation technique (review process). Congrats – AA