People that have different levels of experience with operating software
Some users were male, some female
Diabetes patients and patients with minimal knowledge of Diabetes
User 1: Male, computer novice, diabetic patient, age 54
User 2: Female, expert computer knowledge, age 47
User 3: Male, intermediate computer knowlege, age 21
User 4: Female, intermediate computer knowledge, age 21
User 5: Female, intermediate computer knowledge, age 17
User 6: Male, expert computer knowledge, age 21
Test Structure
Each user was asked to perform 5 tasks as a patient and 5 as a physician
Users were asked to rate 10 aspects of the software on a scale from 1 to 100
Users were given a key for the meaning of 1 and 100 for each rating
Users were asked to give additional suggestions
Average scores were computed for each rating area
Test:
Physician Log in
In the following activity you will help us test our physician log-in feature by pretending to be a doctor. The following instructions involve making up a fictional Patient and adding them to the system. Please be reminded that this is not a timed procedure and it is the product itself that is being tested.
1)Log in as a Physician and view the information for Larry Lana
2)Go back to the home menu and add a made up patient to the system. Make sure you fill out all of the information. For the ratios make sure you enter a fraction (1/15).
3)Go back to the home menu and view the information of the patient you added.
4)Go back to the home menu and modify the Insulin/Blood Ratio of the Patient that you added to the system.
5)Go back to the home menu and verify the change you made by viewing the information for the patient you added.
Patient Log in
In the following activity you will help us test our patient log-in feature by pretending to be a patient (Patty Wins). You will perform tasks as the patient by viewing and adding information about your food intake and insulin taken. Please be reminded that this is not a timed procedure and it is the product itself that is being tested.
1)Log into the system as Patty Wins and view your readings.
2)View the reading for January 1, 2005 and note the sugar intake Patty had around 8:00 am.
3)Go back to the home menu and add a new reading for today's date. Enter values of 40-500 for the blood sugar level and a made up number for carbs eaten. Enter a value for units of insulin taken as 0 or 1. Enter in a meal into the meal field and submit the reading.
4)View the reading for January 3, 2005 and note the units of Insulin (bolus) taken around 4pm.
5)Log out of the system.
Please rate the following on a scale from 1 to 100. A key will be given for each question to tell you what the lowest and highest ratings mean.
1) Navigating around the program from screen to screen.
1 - It was very difficult
100 - It was very easy
2)Overall design and look and feel of the software (colors, alignment, structure)
1 - An eye sore
100 - very pleasing
3)How long would it take someone to learn to use the site?
1 - Very long, would need instruction and learning
100 - Someone could easily learn it on their own
4)How would you rate the graph used to show patient diet information
1 - Disorganized, difficult to understand
100 - Well organized, easy to understand
5)How would you rate the speed of the site (how long it took for items to be displayed once something was selected).
1 - It took nearly forever for items to load
100 - It was extremely fast
6)How difficult was it to find a patient's diet information for a particular date?
1 - Difficult
100 - Easy
7)How would you rate the amount of information presented on the graph (Please specify if too much or not enough information was shown if that is the case)?
1 - Too much/not enough information
100 - The perfect amount of information
8)How would you rate the comfort level of the software?
1 - Very stressful and aggravating
100 - Very comforting
9)How would you rate the overall idea of blood sugar level monitoring software.
1 - It is a complete waste of a patients time.
100 - It could greatly help patients and doctors manage patients' diabetes
10)Imagine yourself as a diabetes patient or a doctor. How likely are you to use this software if it was in a fully functioning state?
1 - I would never use this software
100 - I would consider purchasing it immediately
We would be delighted to hear any additional input you could give us about particular parts of the software you liked or places that need improvement:
Design of user interface
Login/Logout
Graph Display
Add/Edit Patient Information
Other: please list any other areas not mentioned above
Results
1) Navigating around the program 80
2) Overall design 93
3) Learning Curve 86
4) Graphing technique 51
5) Speed 99
6) Patient Information 83
7) Graph Information 77
8) Comfort level 91
9) Product Idea 96
10) Likelihood of purchase 75
Average Product Rating: 83
Some of the user suggestions:
The graph was a little small for all of the information in it.
Drop down Menus for the dates
Show the number of digits for the date input (DD/MM/YYYY)
More error checking for acceptable values
Tell us what fields are required
Some of the user comments:
Very Impressive!
Would definately consider buying