Testing our product/prototype.
One of the final stages before either going back to scratch or going forward. We already knew that the idea of our idea was liked by laymen as we found this out during the Cultural Probes Exercise. So we created something awesome that we felt represented our idea to its full potential. The remade Canvas, more customizable than ever.
What did we want to accomplish with these tests?
Our main goal with this test run was simply wanting to know if our idea held water. We wanted to see if our product still held up to the positive feedback we got before. If we were still on the path we hoped to be or if we had stepped away from a product that people actually wanted and needed. We wanted to hold ourselves accountable if we had shifted too far away from what our feedback had given us previously.
We did the test on three different people. We wanted to present different students from different courses with different methods of presentation. We chose to present only the video to some, and both video and an on-site prototype for them to test live. We let them first have a look around before answering questions. Below are some premade questions we asked the students after presenting the prototype/video prototype.
The questions were as follows:
- Is this something you would use?
- Is there something you miss or you think could be improved?
- Do you register any obvious flaws with the product?
- What features do you like?
Person 1 ( Presented on-site demonstration of prototype + video prototype)
Currently studying Digital Media and Design Bachelor.
- I would absolutely use Canvas more if this was implemented. It removes a lot of the need to tab to other services and is a huge QoL improvement overall.
- Not at the time as I can think of, as much of what I can think of would easily be introduced through the plugins page.
- Maybe a short introduction walkthrough? But that said we don’t get that in the current Canvas either so.
- I really liked the plugin function. Being able to add stuff to the current Canvas reduces the need to switch apps and third-party sites to operate at a decently good pace. The built-in code editor was genius.
Person 2 ( Presented on-site demonstration of prototype + video prototype)
Currently studying Political Science (Second year, extra semester) + Language
- Yes, I would use this program. It seems like a much greater overall experience and looks a lot clearer and generally easier to use. Also, plus points for adaptability for people with weaker vision, etc. I would use this if Canvas manages to run it cleanly.
- Maybe some more customizable options when it comes to how Canvas looks? This is generally small things and could be implemented with the plugin and addon function. But would fit well with the whole customizable Canvas theme.
- A little clearer name maybe, like settings or edit(TM)? Not really a flaw as much as personal opinion on the overall product.
- I really like the possibilities to change font size and adapt canvas for Universal design-needs. I enjoy the possibility to edit the menus so that only things I feel is needed is there. The idea to implement plugins is also greatly favored as long as it doesn’t remove the stability of Canvas.
Person 3 ( Presented with only the video-prototype)
Currently studying Digital Media and Design.
- I would gladly use a better, customizable Canvas.
- Predesigned Canvas themes? It’s not a feature that’s necessary, but it could be nice to have some nice looking themes to choose from.
- I haven’t noticed any flaws. In my opinion, the rework looks pretty good.
- As it is now, Canvas isn’t well-organized, and it might be cumbersome to navigate through the website. Your Canvas rework solves those problems, as it is possible to choose which menus are supposed to be displayed on the main page (emneinfo, kunngjøringer, etc.) I also like the addon and plugins idea, especially the Outlook plugin.
What did this test tell us?
Overall what we learned from this test is that it actually seems like people want a new Canvas system. We wish we actually got some negative feedback in this test so we had something to work with and reflect on, but even when asked if there were any obvious flaws with the system, none of the questioned students had anything to say.
There were few differences in the answers from the students having a complete introduction to the test and the students having only a video preview. That allows us to come to the conclusion that they all got the overall theme of our product.
If we would have had a larger sample of test subjects (tens, if not hundreds, more) we would gain more room for both negative and constructive criticism and feedback. We would have used this to give us a further understanding of what people actually wanted, and we would be allowed to pinpoint it even further. But we take the feedback we have gotten as a sign that what we produced was a product that actually showed up, spiked interest and questions regarding our current Canvas. A function that was mentioned most was the plugin function, having the possibility to create your own learning platform.
That was what we wanted to create, it was what we wanted to prove. And according to our feedback, it is exactly what we managed to do.