Alpha Testing
I did not conduct an alpha test because I was behind on this project.  Basically, I finished a fully-functional prototype, and moved straight into beta testing.

Beta Testing
For the beta test, I asked six people to provide me with feedback.  The tester sample had the following demographics:

• Four men, two women
• Four tennis players (all men): two past high school level players, two past collegiate and professional level
• Three people over the age of 50 (two men, and one woman), one woman, age 40, two men, age 19
• Three have Master’s degrees; two are currently in college; one has high school diploma as highest level of education completed (not counting the two college students)
• Two women are instructional designers (my co-workers)

 

Testers were provided link to course and feedback collection spreadsheet via e-mail. Testers were asked to comment, react, and provide suggestions to screen text, media, and feasibility of Challenge and Assessment questions (that is, whether or not they were able to get the questions correct).

Results and Findings
In general, there were three main problems needing attention as a result of the testing.

1. Text needing clarification so that those not as familiar with tennis could make connections between the text and the graphics that demonstrated the concept.
2. Graphics needing modifications to more strongly support the concept communicated in the text.
3. Content organization suggestions (due to supplementary content needing further clarification and limitations of development within the myudutu LMS web-based software).

In general, I made most of the text corrections, especially the text involving some of the Challenge and Assessment questions. Five of the six testers got all the questions correct. One learner provided a good comment about one question containing content that was not taught in the lesson. For this situation, I added a hint to the question text instead of adding additional new content screens. This question has some limitations within myudutu on the number of graphic elements.

I did not make any of the graphics/media changes due to scope creep and lack of time.  For media development, I had basically one photo/video shoot.  While some of the media comments were great suggestions, there is currently not enough time to implement them.  

Finally, I received great suggestions for developing additional screens to clarify content, and also to add topic designators because the myudutu LMS does not provide a left sidebar navigation of topics.  While these suggestions were valuable, based on design practices I use at my work, there is simply not enough time to implement them. Additionally, working within the myudutu LMS is one of my constraints, and it seems like “working around” the limitations would not be a good use of my time.

Here is a link to all the results and how I addressed the problems listed above.