As per my Statement of Delivery, I tested the participants according to the following procedure:
- I will get players to face off against each other using the computer keyboard. The players will play the previous iteration of Tic-Pac-Toe
- While they are playing I will use a simple decibel meter to determine the amount of fun they are having while playing the game. This seems like a good measure of fun.
- After 3 games of the previous prototype, I will then repeat the process with the new prototype. This will allow a direct comparison and more accurately show how the players respond to the new feature.
- Upon completion of all 6 games, I will conduct a short survey to provide more details
- Which version of the game did you prefer?
- Why that version?
- Do you think the new feature could be improved upon?
- Did you find the new feature easy to understand?
The overall results were less than positive but were helpful which was of course the ultimate goal.
Decibel: There was no significant difference of decibel level between the two varieties of the game.
1. 100% of all participants said they preferred the version without the new feature.
2. When asked why they preferred the old version, they said that the new version was too difficult to play. Especially when the game pauses at a turn. You have to hit the correct key sequence but then the player won't turn at the moment when you want them to turn.
3. 50% of participants said that it could potentially be improved if the player was able to turn correctly at the correct spot. The other half were adamant it should simply be removed.
4. Yes, all participants understood what they had to do.
As you can see the results were not flattering for the new feature, but after all that was the point of this prototype. Based on feedback, if I had to continue this project I would likely remove the feature from the game. I cannot think of a good way to get around the players not turning at the correct spot.