Wanna see something interesting?

I’m currently teaching a graduate course in instructional design, and this week’s learning community discussion asks the students to try their hand at writing objectives for one of several practice cases. (They’ll be writing objectives for their projects in the coming weeks, after the results of their needs analyses are in, and if I want them to be solid, I’ve learned practice is in order.)

This is one of those assignments that could be fudged by an artificial intelligence chat bot. (And possibly one of the ways AI can assist insturctional designers.) So, I decided to see what could be produced. I thought I’d post what I’m sharing with the students.

I asked Open AI’s ChatGPT to write learning objectives for a case where the client (Applewood) is a custom auto shop with serious safety problems that need to be addressed. (Yes, I know training is probably not the only/best solution, but it gives students room to play.)

First draft

Here’s where I started with ChatGPT:

CL: Write a set of learning objectives for a safety training program in an automotive repair shop.

ChatGPT:

Learning Objectives for Safety Training Program in an Automotive Repair Shop:

    1. Identify potential hazards and risks in an automotive repair shop and learn how to manage them effectively to prevent accidents and injuries.
    2. Understand the importance of personal protective equipment (PPE) and how to use it properly in a repair shop setting.
    3. Understand the importance of following safety guidelines, policies, and procedures to prevent accidents and injuries in the repair shop.
    4. Learn how to properly handle and dispose of hazardous materials, including chemicals, oils, and batteries, to prevent environmental contamination and health risks.
    5. Understand the basics of fire safety, including fire prevention, fire extinguisher use, and evacuation procedures.
    6. Learn how to properly use and maintain tools and equipment in the repair shop to prevent accidents and injuries.
    7. Understand the importance of proper lifting and handling techniques to prevent strains and other types of injuries.
    8. Learn about the dangers of working with electricity and how to safely perform electrical repairs.
    9. Understand the importance of maintaining a clean and organized workspace to prevent slips, trips, and falls.
    10. Learn about the importance of proper communication and teamwork in ensuring a safe and efficient work environment in the automotive repair shop.

One problem with this first set of objectives is that most of them are not measurable or observable. Word to the wise: NEVER use “understand” or “learn” in a learning objective for design – those words don’t mean anything in this context. We use them all the time when we communicate the aims of our projects to the learners, but for the purposes of learning objectives for design, you need more concrete verbs: list, define, explain, describe, demonstrate, synthesize, etc.

Rounds 2 and 3: Refining objectives

Okay, so I asked ChatGPT to rewrite the objectives without those verbs… better, but it missed one.

CL: Rewrite without the verbs understand and learn

ChatGPT:

    1. Recognize potential hazards and risks in an automotive repair shop and effectively manage them to prevent accidents and injuries.
    2. Utilize personal protective equipment (PPE) properly in a repair shop setting.
    3. Adhere to safety guidelines, policies, and procedures to prevent accidents and injuries in the repair shop.
    4. Handle and dispose of hazardous materials, including chemicals, oils, and batteries, properly to prevent environmental contamination and health risks.
    5. Demonstrate knowledge of fire safety, including fire prevention, fire extinguisher use, and evacuation procedures.
    6. Utilize tools and equipment in the repair shop properly to prevent accidents and injuries.
    7. Apply proper lifting and handling techniques to prevent strains and other types of injuries.
    8. Understand and implement safety measures for working with electricity and safely perform electrical repairs.
    9. Maintain a clean and organized workspace to prevent slips, trips, and falls.
    10. Collaborate effectively with coworkers and communicate clearly to ensure a safe and efficient work environment in the automotive repair shop.

I then tried to get it to comprehend that learning objectives describe what people will know, value, or be able to do at the end of the training program (there’s a difference between learning objectives and performance objectives), but alas, it didn’t get it (or I wasn’t precise enough in describing what I wanted).

CL: Limit verbs to actions that can be demonstrated by the end of training, that is, not on the job

ChatGPT:

    1. Identify potential hazards and risks in an automotive repair shop and demonstrate effective management techniques to prevent accidents and injuries.
    2. Properly use personal protective equipment (PPE) in a repair shop setting.
    3. Follow safety guidelines, policies, and procedures to prevent accidents and injuries in the repair shop.
    4. Demonstrate proper handling and disposal of hazardous materials, including chemicals, oils, and batteries, to prevent environmental contamination and health risks.
    5. Demonstrate knowledge of fire safety, including proper use of fire extinguishers and evacuation procedures.
    6. Properly use and maintain tools and equipment in the repair shop to prevent accidents and injuries.
    7. Apply proper lifting and handling techniques to prevent strains and other types of injuries.
    8. Implement safety measures for working with electricity in a safe and controlled training environment.
    9. Maintain a clean and organized workspace to prevent slips, trips, and falls.
    10. Collaborate effectively with coworkers and communicate clearly to ensure a safe and efficient work environment in the automotive repair shop.

And by the way, “demostrate knoweldge” is a no-no as well. How would people demonstrate knowledge? They would explain, describe, etc.

Commentary on these attempts

I would say that the last two sets of objectives are better characterized as performance objectives (what people will be able to do on the job) rather than learning objectives. If those were intended as learning objectives, then the program would have to ensure that learners were able to demonstrate that they could do all those things within the training’s space and time.

Let’s take a look at objective #6, for example, which wound up being: “Properly use and maintain tools and equipment in the repair shop to prevent accidents and injuries.” You can “use” tools in training, but you can’t “maintain” tools (at least with my interpretation of the word “maintain” which implies long term attention). Maybe a less intense learning objective might be: Explain the actions needed to properly maintain tools (but substitute the names of the tools or a category of tools rather than use generic “tools”). With that, I would know what we’re trying to ensure that the employees learn.

(Extra for experts: if you are writing objectives for a blended learning program that extends into the workplace, then saying that learners will be able to maintain tools by the end of training my indeed make sense.)

One of the things to note here is that these are generic objectives; they don’t address the concerns of a specific case. Your needs analysis will give you particulars that will lead you to identifying the clear knowledge and skill development needs for the people in your project. The cases I offered for this week don’t contain a lot of details, but they have enough to provide practice in writing objectives.

Results after giving ChatGPT a more detailed prompt

I wondered what ChatGPT might do with the full description given in the case.

CL:

Write a set of effective learning objectives for this case: Applewood Custom Auto is a small company with six locations in Philadelphia.  They install specialty car components and perform the kind of substantial customizations that are gaining in popularity since the advent of auto makeover shows.  Applewood employs only about 300 workers, and the vast majority are on the shop floors.

Unfortunately, Applewood has an abysmal safety record.  In the last six months alone, three employees have been taken to the hospital for serious injuries caused by careless use of tools and inadequate attention to basic safety rules (e.g. using protective gear, following lift operation rules).  The management team is aware of a number of close calls as well – incidents that could have caused injury, but luckily did not. 

Your task is to design a safety re-training program that will be given to all employees, even though they have all been given safety training in the past. Your program (intervention) should extend onto the shop floor so employees have constant, consistent reminders of safety protocols.

ChatGPT:

    1. Identify potential safety hazards and risks associated with installing specialty car components and performing customizations, and demonstrate effective management techniques to prevent accidents and injuries.
    2. Utilize personal protective equipment (PPE) properly and consistently in the shop floor to minimize risks of accidents and injuries.
    3. Follow safety guidelines, policies, and procedures to prevent accidents and injuries in the automotive repair shop.
    4. Demonstrate proper handling and use of tools to prevent accidents and injuries in the shop floor.
    5. Implement proper lifting and handling techniques to prevent strains and other types of injuries while working with heavy equipment.
    6. Apply safety measures to prevent fire hazards, including fire prevention, fire extinguisher use, and evacuation procedures.
    7. Maintain a clean and organized workspace to prevent slips, trips, and falls in the shop floor.
    8. Understand and implement safety measures for working with electricity, such as using grounded tools and equipment and checking for frayed cords.
    9. Recognize the importance of reporting close calls and incidents promptly to prevent future accidents and injuries.
    10. Collaborate effectively with coworkers and communicate clearly to ensure a safe and efficient work environment in the automotive repair shop.

Meh.

I wondered how different the results would be if I opened a new chat and gave ChatGPT the full case prompt. Intriguing.

ChatGPT:

Learning objectives for the safety re-training program at Applewood Custom Auto could include:

    1. Understand the importance of safety in the workplace: Employees will be able to describe the impact of workplace accidents on themselves, their coworkers, and the company.
    2. Identify potential safety hazards in the workplace: Employees will be able to identify hazards such as improper tool use, not wearing protective gear, and not following lift operation rules.
    3. Follow safety protocols: Employees will be able to describe and demonstrate the correct use of safety equipment and protocols, including proper use of personal protective equipment (PPE), use of safety switches, and proper use of lifting equipment.
    4. Practice effective communication: Employees will be able to communicate effectively with coworkers and management about safety concerns, including reporting unsafe conditions or hazards.
    5. Continuously monitor and improve safety: Employees will be able to describe how to continually monitor and improve safety in the workplace, including participation in safety inspections and hazard reporting.
    6. Understand the consequences of non-compliance: Employees will be able to describe the consequences of not following safety protocols, including disciplinary action, injury, and damage to the company’s reputation.
    7. Utilize positive reinforcement: Employees will be able to describe the benefits of positive reinforcement for safe behavior, including recognition and rewards for following safety protocols.
    8. Foster a culture of safety: Employees will be able to describe how to promote a culture of safety within the company, including setting safety goals, holding regular safety meetings, and encouraging employee involvement in safety initiatives.
    9. Implement safety practices consistently: Employees will be able to describe how to consistently implement safety practices, including through ongoing training and providing reminders and signage throughout the shop floor.
    10. Embrace a personal commitment to safety: Employees will be able to articulate their personal commitment to safety and how it contributes to their own well-being, as well as the well-being of their coworkers and the company.
Not a fair challenge for ChatGPT

Of course, we get that ChatGPT is not a thinking robot. Still, there is plenty of information on the internet that should guide it toward composing an effective learning objective (although, sadly, apparently there’s more internet data that would lead it to write an objective that is not effective).

When I asked ChatGPT to define the characteristics of a well-written, effective learning objective, I had to laugh at its response. Clearly, it “knows” what we’re looking for but doesn’t follow those criteria when it writes objectives. Truth be told, even experienced designers fall into that trap now and again. (And yes, I know ChatGPT doesn’t “know” anything.)

CL: What are the characteristics of a well-written and effective learning objective?

ChatGPT:

A well-written and effective learning objective should have the following characteristics:

    1. Clear and concise: The objective should be clear and concise, with no ambiguity or vagueness. It should clearly state what the learner is expected to achieve.
    2. Measurable: The objective should be measurable, which means it should be possible to evaluate whether the learner has achieved it or not. This can be done by defining specific criteria for success or by using assessments.
    3. Specific: The objective should be specific and focus on one specific skill or behavior that the learner needs to acquire or demonstrate.
    4. Relevant: The objective should be relevant to the learner’s needs, interests, and context. It should address a specific problem or challenge that the learner is facing.
    5. Time-bound: The objective should be time-bound, with a clear timeline for achievement. This helps the learner to stay motivated and focused on achieving the objective.
    6. Action-oriented: The objective should be action-oriented and describe what the learner will do, rather than what they will know or understand.
    7. Realistic: The objective should be realistic and achievable given the learner’s abilities and resources.

By incorporating these characteristics into a learning objective, trainers and learners can ensure that the objective is well-written, meaningful, and effective in helping learners acquire new skills and knowledge.

Some advice on writing objectives

All this is not to say I intend to make you crazy writing objectives, although I hope my feedback will guide you to writing solid objectives for your projects. My point is that we need to be careful in writing objectives for programs because they communicate to all stakeholders what we are trying to do. If they can be easily misinterpreted, you’ll wind up with programs that don’t achieve what you intend and clients who are disappointed with what you produced.

So okay, I’ll probably make you a little crazy while challenging you to write solid objectives. But please, please, please, do NOT write learning objectives for design that start with the words “know” or “understand” or “learn” or “demonstrate an understanding of” – I’ll hurt my head banging it on the desk.

Also on objectives if you’re interested: my 2009 (!) post, Objectives – Starting place for ID?