2.1 | Defining our research questions

How we defined our research questions.

The cultural probes

In order to define the problem, we needed to synthesize the data we achieved through the cultural probes and the expert interview. We began with the cultural probes by laying all of the tasks from all five probes in five respective piles and go through all of the answers one pile at the time while systematizing them in a simple form:


Results from the Circle Around the Word task:
– Stupid, Confused, Annoyed
– Confused
– Stupid, Confused, Annoyed
– Boring
– Confused, Satisfied, Smart

Results from the Pick a Face task:
– Bad / sad
– Bad / sad
– Happy
– Happy
– Okay happy

Results from the Expectations while using Communication Platforms task:
– «That» everyone » is on the platform and that it works well. Will also use the one that people are most available on.»
– «That it works properly.»
– «That I get replies quickly and that the platform works well and quickly.»
– «The fact that the platform is fast, can send files, seldom downtime, easy to use, no restrictions on what to share.»
– “Possibility of a group chat, that they are easy to use, that no problems occur while using them. Also, the ability to send more than just text, such as pictures and files. »

Results from the Weekly Basis Communication Platforms task:
– Facebook, Snapchat, SMS, Discord, Instagram, Twitter.
– Discord, Messenger, Snapchat.
– Facebook, WhatsApp, Instagram, Email.
– Facebook, Steam, Discord, Instagram, Snapchat, Canvas, Email, YouTube.
– Facebook / Messenger, Instagram, Snapchat, Vipps chat, in game chat functions like League of Legends Client chat, Email, SMS, YouTube.

Results from the Statements task:
1. «I always know where and when I have lectures thanks to Canvas.»
– Agree
– Neutral
– Strongly disagree
– Agree
– Neutral

2. «It’s easy to organize for group work in Canvas.»
– Neutral
– Strongly disagree
– Disagree
– Neutral
– Strongly disagree

3. «It is easy to respond to messages from teachers / lecturers.»
– Neutral
– Agree
– Disagree
– Disagree
– Disagree

4. «I can find my grades and feedback from my professors in Canvas quickly.»
– Agree
– Strongly agree
– Neutral
– Neutral
– Neutral

Results from the Complete the Sentence task:
«What I wish it was possible to do in Canvas is…»
– “I want a neatly organized Canvas where all subjects have the same structure and name and are in the same language. Better and more explanatory titles would have been nice, too. »
– «Don’t use more than one scroll bar.»
– “Instant chat with teachers.”
– “Organize the website the way you want”
– “Chat functions with those you are working with on group projects + Opportunity for co-writing (better).”

 

When we had gone through all of the probes, we were able to see a few patterns emerging, so our next step was to categorize the probe answers by organizing them in clusters.

The results from the cultural probes, organized in clusters.

Canvas/LMS was the main cluster in the centre from which we derived the results into three sub-clusters; Communication, Emotions, and Wishes/Improvement suggestions.

From Communication, we divided the probe answers further. Many answers brought up features we usually find on social media platforms, such as chat, so obviously we had to have a SoMe sub-cluster, as well as an Expectation sub-cluster. From the probe answers, we noticed that the expectations the people were having to LMS was often connected to the ability to communicate, like file sharing and chatting. Other expectations were connected to the more technological aspect of LMS, such as user-friendliness and stability. Chat functions were also echoed in the Wishes/Improvement suggestions sub-cluster, but this cluster also brought up another exciting suggestion: The possibility to organize the LMS yourself.
For the Emotions cluster, we noticed that a majority of the probe answers were those of negativity when dealing with their current LMS (Canvas).

The expert interview

Trying to synthesize data from the expert interview was a more challenging task, but even here we saw a clear pattern emerging as we analysed the interview.

The expert interview organized in clusters.

We noticed that we could easily divide mr. Bisseberg’s main statements into two major sub-clusters: What is good with Canvas, and what is bad.

The good features are mostly technological, like constant bugfixes and updates, and little downtime, just to mention a few. Should the service be down for some reason, then Canvas can provide good support.
The bad features are often based on the user experience, such as a less than optimal user-friendly design, limitations in regards of co-operating and custom design the LMS for your own needs. «The «one size fits all» doesn’t fit all» statement sums up this aspect rather accurately.  It made us wonder, though: Would it be possible to hold on to everything that makes Canvas a good technical user experience, but simultaneously change and improve upon what makes it bad?

Legg igjen en kommentar