Mobile Pilot Scorecard




As described in my March 9 blog entry, Yes, You Can Deliver Mobile Learning, we recently completed our first mobile learning pilot with the gracious assistance of our vendor partner OnPoint Digital, using their CellCast platform.   The results are in:   as is typical of pilots we had some successes (hooray!) and we learned a few things (which always reminds us why we do pilots in the first place).

In terms of our success criteria, we fully achieved three out of four goals. Not too bad for a pilot.  We were even partially successful with our fourth goal.   So here is a look at our mlearning pilot scorecard:

1. Producing and converting content for mobile delivery: Success! - we were able to successfully deploy audio, video, .pdf documents, tests and surveys, and an interactive product placement map to our pilot audience.  Producing the learning content was the easy part.  After all, that is what my team is already good at.  For the pilot, we relied on OnPoint to convert the content to the format required mlearning.
2. Deploying content using a mobile platform - Success! - as previously stated, we used the CellCast app from OnPoint Digital.   It worked very well for us.  We had a few technical glitches that required some troubleshooting in the first few days of the pilot.  But doesn't that happen with all roll-outs that involve technology?   Once we got those glitches ironed out, it was pretty smooth sailing for the rest of the way.
3. Deploying content to a variety of mobile devices - Partial Success - We were able to successfully deploy to Android and iOS devices.  However, the majority of our pilot audience was equipped with older model Blackberries.  We knew going into the pilot that we were likely to hear grumblings from this group about the user experience. We were prepared to get that feedback, but there were two communication issues that made this a bigger challenge than I would have liked:  (1) Blackberry Enterprise Server (BES) software - this had to be unlocked so our users could download the app to their devices.  Nothing like this was required for either the Android or iOS devices.  (2) Lack of SD Cards - many of the users had never installed SD cards in their devices, so there was no place for their downloads to land.  This effectively put a good chunk of the pilot audience out of the game.   Many of the users without the SD cards, used personal devices to complete their training.  A handful of people went out and bought new SD cards and installed them so they could participate, but most just missed the opportunity.
4. Testing and recording participant completion results - Success! - one of the advantages of mobile devices that should not be overlooked is that they can be used for two-way communication.  Since this was our first pass at mlearning, we didn't go beyond receiving test scores and survey data back from our participants through their mobile devices, but it was encouraging to see the amount and type of data we could capture.   For example,  the image accompanying this blog entry is of a data processing unit.  It is a still capture from one of our videos that was viewed on average over six times by the pilot participants.  Most of the other videos averaged slightly less than three views each.  I'm interpreting that as telling us we need to beef up the DPU segment of our initial classroom training.  Great information, don't you think?

All in all, I would call our pilot a success.  We learned a few things about how to present our content, how to make downloading easier, and about what will work and what won't in terms of mobile learning.   And as far as our Blackberry device issue, well that has now been solved.  Reporting the results of our pilot to senior leaders gave them the last piece of information they needed to justify a device upgrade for our users.   How is that for a nice unintended outcome?

Creating WOW Learning Experiences in Compliance Training

One of the goals I share with my instructional design team this year is "to create WOW learning experiences." It is part of our 2013 continuous improvement effort.  Last year was our first year operating as an Enterprise Learning and Development group.   We spent most of the year building the team, introducing tools, and developing the processes we need to support the lines of business with learning services.  This year, we want to make the most of the capability we have created.  

An area in which it is especially challenging to find ways to create WOW learning experiences is in compliance training.   This is often considered the "necessary evil" of the learning world.  It poses the instructional designer with an uphill battle in that the content is usually not core to the target audience's work, and it is not generally compelling by nature.  It is certainly not easy to make "lock out, tag out procedures" or "record retention policies" come to life in an eLearning module, but there are ways to do it.   I have challenged my team to look for more opportunities to use story-based or game-like approaches, and to take advantage of our in-house graphic designer to include images, animations, or videos that can add visual interest and make learning points clearer.

I just came across this slideshare presentation from Cammy Bean at Kineo: Cammy Bean's Learning Visions: Compliance Makeover!   In this presentation, Cammy provides 10 tips for giving compliance training a makeover.  These tips represent the kind of things I'm asking my team to do to create WOW learning experiences.  Thanks Cammy!

Yes, You Can Deliver Mobile Learning

After sitting through so many mobile learning sessions at industry events, I got tired of being among the puzzled masses who couldn't figure out how to launch a mobile learning solution. I was determined to unravel this mystery and begin offering mobile learning in my company.   I started by asking myself, "What makes this so hard to do?"  I'm a reasonably intelligent guy.  I've got an iPad and an Android Smartphone.   I download apps.  I play Words with Friends on occasion.  This shouldn't be so hard for me and my team to figure out.  Then it hit me.   My team is made up of highly talented instructional designers.   We understand how to build learning solutions, but we aren't programmers or app developers.  We could design and develop learning content for mobile delivery, but we needed some help on the technology side.   Rather than try to create our own apps, we decided to find a partner that had a ready made platform we could use to help us get started.    Now, we are just finishing up our first mobile learning pilot.   We will be summarizing the completion and evaluation data next week.    It took a lot of research, self-education, and just plain work for us to get to this point.   But if I were to simplify it down to the key things that helped us move forward, it would be these five things:

1. Read Designing mLearning by Clark Quinn - If you do a literature search on mobile learning, all roads lead back to this book, so you might as well start here.   It covers mobile learning in a very comprehensive way.    As you read it, think about it in the context of your own situation so you can identify and plan how to overcome your own hurdles.
2. Form a Mobile Team - This is clearly a case where more heads are better than one.  The easy part of the work for us was designing and developing the content, but there are a lot of decisions to be made regarding network protocols, mobile security, audience analysis, and interface design before you can get to that point.
3. Partner with Your Information Technology Team -  You cannot do this without having IT support at the right level in your organization.   There are device, policy, security and protocol issues that have to be addressed.  These cannot be resolved by Learning & Development alone. 
4. Choose a Vendor Partner - This is the real jump starter.   We will likely get to a point where we are developing our own learning app, but that day is not here yet.  We chose to start by using a mobile platform that already exists and a partner who has done this before.  OnPoint Digital helped us conduct our pilot using their Cellcast App.  We also got great support and advice from the folks at Float Learning.
5. Choose the Right Pilot Project - Keep in mind, this is about learning, not just using a new medium.   It is important to choose a project that matters.  In our mobile learning pilot,  we delivered update training to a group of service technicians who had previously attended an installation  and repair class on a piece of equipment they must service.  There have been some hardware updates and changes to electrical specs on that equipment since the technicians completed their initial training.   Rather than bring them back into the classroom, or have them interrupt their work day to take time out for eLearning, we chose to prepare them to handle the differences they would encounter on service calls using mobile learning.  Their training consisted of twelve brief video segments focusing on the hardware differences (only the introductory video clip ran longer than one minute), three electrical diagrams for review, and an interactive map showing where the newer models had been placed.   We included a brief quiz asking a few key questions to check knowledge of the differences, but for the most part, what we really supplied them with were some brief, handy performance support tools they could use at the point of need.

This is just the beginning for us, but I feel great having done this pilot. Our goal was to test the end-to-end process.  Having done this, I feel I'm in a better position to garner stakeholder support for a longer term mobile learning strategy.   Best of all, the next time I attend a mobile session at a learning conference, and the speaker asks the audience, "How many of you are using mobile learning?"  I can raise my hand.   

Maintaining Relevance in Workplace Learning

Workplace Learning Professionals: join us today for a discussion of #relevance in an #astd_forum vSession today at 12:00 PM eastern time: http://tinyurl.com/ayra9qw

DevLearn 2012 Resources

Sadly,  I was not able to make it to DevLearn this year.   Like many others, I was sidelined by Hurricane Sandy.   Fortunately for me, I was able to send several of my team members, so we had good coverage at the conference.   When they returned they were excited by the greater understanding they gained on issues such as HTML5, Mobile Learning, Tin Can API and the latest trends in learning analytics.  They also met some great people through networking.   Now they face the daunting task of educating me!

But to aid in the process, once again we have the great treasure trove of resources from conference curator David Kelly aka @LnDDave.

The Perfect Storm: HTML5, Tin Can API and Mobile

Having just endured the powerful forces of Hurricane Sandy here in the northeastern United States, my heart goes out to the people who lost homes and loved ones during the storm. Meanwhile in the learning industry, another storm is brewing. If you haven’t been paying attention to topics such as HTML5, Tin Can API, Learning Records Stores, and developments on the mobile front, then you better batten down the hatches. These things are upon us now. They represent a climate change that can create super storms, ones that have ability to disrupt daily life for those of us in the workplace learning industry if we aren't prepared for them.

I work in a corporate learning department for a relatively large global company. We have been providing high quality learning services to our employees for years. I’m proud of the work my team does and the impact we have had on our organization’s success, particularly during the tough economic times of the last few years. We have never been what I would consider “cutting edge” but we have always managed to be creative and innovative in our approaches to learning. We have not only embraced change, but we have driven it through our organization. We are doing this once again as we have launched a project to introduce mobile learning as part of our mix. While I am excited by the possibilities, I feel like I’m walking through a storm. We seem to be in a time and place where so many things are swirling around us at once, so it is hard to know where to step next. Here are some of the challenges that we need to weather over the next few months:

Everybody’s Going Mobile – Smartphones and tablets are wonderful productivity tools, aren’t they? These days everyone has one…or two… or three. But they are all different. Yes, we have some company issued devices, but our learners are going to expect to be able to access learning content from their device of choice. This means designing and publishing multiple ways.

Gone in a Flash – I’m talking about Flash output. Up until now, all of the e-learning content we have produced has been published as Flash output. Of course we all know that that is coming to an end. To be able to publish engaging learning that can be accessed on a mobile device, we are going to have to produce HTML5 output now. Of course HTML5 Standards aren’t finalized yet, and none of our current course development software tools publish to HTML5, so there are those little things to deal with.

I’ll trade you an “M” for an “R” - That is as in LMS vs. LRS. We have thousands of learning objects on our Learning Management System (LMS). But of course, our LMS can’t handle content published for mobile devices (Yeah, I know that capability will be coming out in a future release of our LMS software… Q1 of 20xx). Our LMS is looking for SCORM standards, whereas mobile learning will mean using Tin Can API. (Yes, we are all learning about Tin Can.) If we want to record and track mobile learning, we’ll need a Learning Record Store (LRS).

As I said, I’m excited by this new direction we are taking. Mobile learning will be a real game changer for us. But I have to admit, figuring out how to fit all these things together is keeping me up at night almost as much as Hurricane Sandy did.

Capitalizing on 7 Learning Modalities

Last week I had the opportunity to get into a dialog with my company's learning council about the future direction of our approach to workplace learning.  My goal was to get them to support the idea of using tools and technologies to foster more informal learning opportunities. Our learning council is made up of a group of senior leaders from each of our business units and some key functional areas.  They are all savvy, successful business men and women in their areas of expertise, but their knowledge of what makes learning effective is uneven.   My approach was to write and present a white paper to them on how to capitalize on the learning modalities that are currently available for use in our organization - including mobile learning and learning through social media.

I wasn't sure how they would react to this.  Like many companies, our approach to workplace learning has mainly been focused on using traditional delivery methods such as classroom training, webinars, and self-paced elearning. To set the stage in the paper and in our discussion, I started by talking about the 70:20:10 Learning Framework.   This was a good choice as it comes across as rational, logical, and easy to understand.  Next, we talked about the proliferation of mobile devices and the explosion social media usage over the last few years, drawing the conclusion that our employees are already engaged in these arenas and that to provide effective learning support, we need to be in there with them.

After setting the stage, we moved the dialog into discussing how we would use each of the seven learning modalities I included in the paper.  I arranged them along a continuum from most formal to least formal (as shown in the image above).  You could argue with my sequencing, but this worked for the purposes of my discussion.  In the paper, I covered each modality by describing its current use, benefits, drawbacks, and recommendations for usage in our future learning offerings.

Here are the seven modalities we discussed, with a brief line about how we plan to optimize each:

Instructor-led training (ILT) - to optimize ILT we need to make sure our courses are learner-centered and discussion-oriented, offering ample opportunities for practice and feedback.

Virtual Instructor-led training (VILT) - to optimize VILT we need to design full, facilitated learning experiences that may include multiple sessions, pre-work, assessments, interactive exercises and post work (not just have a subject matter expert talking over PowerPoint slides).

eLearning (CBT or WBT) - to optimize elearning we need to use story-based, character-driven, and game-based approaches that are interactive and engaging to motivate our learners to stay with them through to completion.

Electronic Performance Support Systems (EPSS) - to optimize EPSS we need to provide relevant tools and place them (physically and contextually) where our learners are most likely going to look for them.

Podcasts and Videos - to optimize our use of podcasts and video we need to create short burst learning objects that address a single topic or specific objective.

Mobile Learning - to optimize mobile learning in the short term we need to post .pdf, audio and video files and take advantage of two-way communication opportunities; longer term we will work with an external partner and our IT team to create and support a mobile learning app.

Social Learning - to optimize social learning we need to create groups and/or topic archives based on areas of interest to our learners, focusing on information sharing, collaboration, and content co-creation.

All-in-all we had a great dialog.  Our learning council members were excited about the possibilities of mobile and social learning.   They recognize the power of embedding learning directly into the workstream: minimizing disruptions to productivity while our employees grow and develop their skills.