5. Test

Introduction

For the last phase in the design thinking process: 5. Testing, we decided to do a Concept test for our solution that we ended up with in the previous phases: 3. Ideate and 4. Prototype. In this phase, we are going to test the two prototypes we made in the last assignment.

Goals for testing 

The goal of this concept test, is to test the concept behind our solution. The concept of our solution, is to make it easier for the students to ask questions in a bigger sized lecture.

A description of our mockup can be found in 4. Prototype.

Participants

Four students and one lecturer at Østfold University College:

    • Subject 1: 22 year old male bachelor student.
    • Subject 2: 20 year old female bachelor student.
    • Subject 3: 23 year old male bachelor student.
    • Subject 4: 24 year old female bachelor student.
    • Subject 5: 45 year old male lecturer.

Roles – Host/players/observers.

Host:

  • Active, asking follow-up questions, directing the users through the tasks

Players:

  • Fellow bachelor students.

Observers:

  • Observe and note

Procedure

The tasks in the test are:

  1. Watch the video prototype(4. Prototype)
  2. Test out the high-fidelity prototype(Adobe Xd)
  3. Interview 

The one having the role of being the “Host” had the responsibility of conducting the test of these subjects. The test began by having the subjects watch the video prototype(4. Prototype), followed up by having them test the high fidelity prototype(Adobe Xd) and finally interviewing them. While the “Host” was conducting the test, the “Observers” main roles were to note down answers and comments by the subjects. We tested four students and only one lecturer, due to difficulty finding available lecturers to test.

Interview

For the interview we did a semi-structured one, were the group put together the questions in advance: 

  • Did you understand the concept? 
  • Is this something you could make use of in a lecture, if so to what degree? 
  • Do you have any suggestions as to changes/improvements to the concept?
  • Any other comments about the concept?

Results of the interview

Subject 1:

  • Yes, they did. Ease the communication between student teacher, concept was presented clearly throughout the testing.
  • Yes, definitely. Can be used for more nervous students. Easily asking the questions to the teacher, without a large involvement (raising hand). 
  • Maybe hard to engage the students to use the app?
  • Comments: Easy to use, video presented the concept clearly, 

Subject 2:

  • Yes, concept understood, ease the communication between the student and teacher.
  • Yes, easily asking question, makes it easier for more nervous people to ask questions in front of the whole class.
  • Liked the name of app “PowerChat”.
  • Comments: Concept is presented clearly throughout the test.

Subject 3:

  • Yes, ease the communication between student and lecturer, making asking questions easier, concept was presented clearly during the test.
  • Yes, maybe 50%, depending on the course, and class size.
  • How the teacher will answer the questions, when they pop up.
  • No comments.

Subject 4:

  • Yes, the concept is presented clearly throughout the video.
  • Yes, in quite a big degree considering this subject is hesitant on raising their hand and asking questions during bigger classes, and would rather leave the question unasked than asking in front of the whole class.
  • “Bulletproof” , concept seems thoughtful.
  • No comments.

Subject 5:

  • Yes, the concept is presented clearly throughout the video.
  • I think it can be very useful if the idea is done correctly. It is hard to make students participate and ask questions in the lectures.
  • Will I have to check the chat a lot during the lecture? Disturbance? Notification sound?

Conclusion

The concept was easy for every test subject to understand from our video and high-fidelity prototype. Though in various degrees, all five subjects thought the app could be useful for themselves in their lectures. The test subjects also gave us some questions/suggestions that can help us make the app even more useful for them. In conclusion, the concept test has shown us that our concept seems good and relevant for our target audience, in this case being students and lecturers in a lecture. Therefore, we decided to continue working on it moving forward.