EDU623: The Development and Implementation Phase

This is the fourth and final blog post of a four part series for edu623 Designing Learning Environments.  Today’s blog post focuses on some of the key components of the development and implementation phase.

Development Phase: Authentic Assessment

Authentic Assessment relates to instructional design in that it allows for a clear measureable connection between objectives and learned outcomes.  Being able to demonstrate the intended skill is different than filling out a multiple choice test to verify understanding.  For example, the training I do with my teachers calls for, in many cases, to demonstrate what they have learned by creating an actual product or artifact.  More traditional assessment might stop at multiple choice or essay questions to check for understanding.

Ideally I would like to have teachers ‘test out’ of my Microsoft OneDrive training.  One way to do this is to create a video screencast of different aspects of OneDrive and embed questioning within the video.  Educanon is web based program that allows for this type of creation and it’s free too.  The questioning built in won’t allow a user to continue through the video training until they answer the question correctly.

A second way to assess what the teachers have learned would be to have them actually use OneDrive to deliver instruction or create an assignment with their students using different parts of OneDrive.  Perhaps they teach students how to share documents or collaborate simultaneously on the same document.  This would be more authentic assessment in comparison to more traditional methods referenced in my first example.

I think both would provide a balance of assessment and allow also for different types of learners.  Coupled together, I think it could be an effective and not overwhelming way to insure teachers are learning what’s intended.

Image

(picture used with permission from http://www.creativecommons.org)

Implementation Phase: Evaluation

Kirkpatrick’s first to levels of training evaluation are reaction and learning.  The reaction level is an initial response to the training experience and is the most common form of evaluation.  Since my training project will be delivered via a learning management system, it would be easy to obtain feedback from the learners at this level.  I envision harnessing the power of survey monkey to easily create my assessment and deliver it.  It would also be beneficial to analyze the results in the form of graphs and charts which survey monkey does rather well and easily.

Kirkpatrick’s second level of evaluation digs deeper and is primarily concerned with how learning occurs as it relates to the identified objectives. I think for my training I would like to be able to evaluate what the learners (teachers) produce or create as part of their training and attempt to align with the objectives we were trying to actually meet.  Ideally, what they produce should be in accordance with the objectives and it’s a good way for them to demonstrate what they have learned.  I need to make sure that what they are asked to produce actually aligns with what I want them to be able to do when they go back to their classrooms.

 

Reflection

Regarding the evaluation phase, I will most likely use Survey Monkey to gather feedback and information to enhance my training for the next time.  Survey Monkey is flexible in that it allows for multiple choice and or short answer responses.  I wouldn’t begin to develop the actual questions until I had the exact module in place the way I want it with the resources I want.  I might even wait until I have a few teachers/colleagues ‘test’ out the experience too prior to putting together any feedback questionnaire.

I’ve used Survey Monkey and a few other products before.  They have been very helpful in providing insight to the learner’s experience.  I believe the assessment should be short and to the point with no wiggle room for interpretation.  Each question must be very clear as to what it is asking.  I actually think the questions may end up being a combination of Kirkpatrick’s level 1 and 2 to provide me with the most appropriate information.  The greatest challenge with surveys like this, from my experience, is that not everyone fills them out or the ones that do don’t really care enough to really convey what they think or feel.  This is why it’s imperative to have support from administrators to ensure teachers take it a little more seriously.

Image

 

(picture used with permission from http://www.creativecommons.org)

References

Hodell, C. (2011). Isd from the ground up:  A no-nonsense approach to instructional design (3rd ed.). United States of America: American Society for Training & Development.

Mueller, J. (2014). Authentic assessment toolbox. Retrieved from http://jfmueller.faculty.noctrl.edu/toolbox/whatisit.htm

 

Additional Resources to consider

  1. A PD Plan that makes sense: https://ownupblog.files.wordpress.com/2013/11/teachingchannel_thejournalindustryperspective_transformingprofessionaldevelopment-2.pdf
  1. 2014 Horizon Report Emerging Technologies: http://www.nmc.org/pdf/2014-nmc-horizon-report-he-EN.pdf

 

Advertisements

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s