Testing Evaluation Report

Introduction

There are two thing that needs to be tested for this idea, where at this stage one is more important than the other. The two things that will be done is a Concept testing, which is the most important one, because i need to know if this is regarded as a solution to the problem by the users. The second thing to test, while important but not as important as the concept testiong is the user experience of the prototype. This will involve testing the UX but also the functionality that is currently in the prototype.

The goal for this testing is to see if there actually is an interest in this type of solution, or if the tester thinks that this can be a solution to the problem definition in the first place.

How these will be tested:

Concept testing:
The Concept testing will be conducted with one Norwegian speaker and Two Foreign Exchange students. These participants are the people that would be using the app. Even though the topic is specific for Adult refugees any person wanting to learn Norwegian can use this app so these are good people to test the concept on.
The testing will be done by showing the participant the Video Prototype, after they have watched it i will give them some prepared questions which are meant to get an insight in their thoughts about the app.
These questions are:

For both types of testers:

  • What are your initial impression of the app?
  • Would you use it? Why \ why not?
  • Is there some functionality would you like it to have that is not currently planned to be included?

Specific for the foreign exchange students:

  • Do you think this app would help your Norwegian learning?
  • Would you want guidelines for what you are supposed to talk about, or keep it completely up to the two people in the conversation?

Specific for the Norwegian speaker:

  • Would you want to use this app to help someone learn Norwegian?

Results:

There were some interest in the solution, the foreign exhange students thought this app would be great if they did not have anyone that spoke Norwegian to talk to. The Norwegian tester however felt that there was not enough of an incentive for Norwegian speakers to use this app. He thought that the Norwegian speakers could easily just be «used» and they maybe needed more of a reward to use this app.

The users all agreed that there should be some guidelines to what you should talk about, this was commented on as they felt that giving some rules to a first encounter would maybe make the apps purpose more clear. This would also discourage people from not suing the app for its intended purpose.

Recommendations:

One of the testers recommended that for a first encounter there should be a clear question, or something specific that the Non Norwegian speaker wants help with. They basically wanted the first encounter to have a purpose so that the app wouldnt just become another chatting service. They also clarified that when you have added eachother as friends on the app you should be aple to talk about whatever you want.

One of the testers thought that maybe after each first encounter you should get a question if you want to add the person you just talked to as a friend. This was so that there would be more of a mutual agreement to be friends between the two people.

UX testing:

The user experience (UX) will be tested on two IT students which are studying for different bachelor degrees. The test will be done with the prototype made in adobe XD, which has been uploaded uploaded to adobe cloud so that the test can be done on a smartphone instead of on a computer screen. This will make the test be more natural as the app this is the platform the app is designed for.

The tester will be asked to perform three tasks that is going to get them through the entire functionality of the prototype. I Will also instruct the tester to think out loud every action he or she is doing when trying to complete the task. When evaluating how well the tester did these tasks i considered time but most importantly where they clicked in the time used. It is important to see if the icons or the placement of these icons resonate with the user so they understand what page they will be redirected to when they click on it.

These tasks are as followed:

  1. Connect to a Text chat.
  2. Add a user as a friend.
  3. Check the friendslist and see who is online.

Results:

The testers flew throught the app with no problem, completing each task without pressing wrong once and in no time. Since there was no problem i asked them «What functionality do you think could be added?» since i believe that the small amount of pages on the app is what made them have no problem with it, which is a good thing. There where ofcourse some comments about the overall design. It was noted that the bottom and top bars where too bulky and should be slimmed down.

Reccomendation:

Fine tune the design to that the top and bottom bar is not too bulky and is more similar in size as other apps.

Add an option to see how many people are in que to talk, this was recommended as there might be times of the day where there are less users on. This is important so that a user can see if they have time to wait for someone or not.

Conclusion:

The concept itself is desired, and is thought to be a good addition to the language learning methods of the testers. However the Norwegian speakers might have a lower amount of users than the non-Norwegian speakers. As for this an incentive should be presented. One initial idea is to advertise this app both ways, so that there is an emphasis on the ability to talk to people from different cultures for the Norwegian speaker.

As for the design and functionality, there are some functionality that should be added. For example the option to see how many people are online and searching should definetly be added. Also the notes about the design should be fixed and fine tuned so that it looks more like how a user would expect from an app on their smartphone.

As for future plans for this project the prototype should be more fleshed out and fine tuned with the functionality and the design that where recommended from the testing. Then there should be a second round of testing which includes more test subjects to find out what more people think about the whole idea. This should be done as three people is not enough opinions for justifying the start of developing an app. However its enough to not completely dismiss this as a solution for the problem definition and continue the developing.

 

Prototype

The prototype created is a high fidelity look and feel prototype. My goal was to illustrate how the app were look, what pages i wanted to implement and how these pages would work together. I wanted really to have a minimalistic look with as little steps as possible to get from A to B. Early on i chose a color palette which is used throughout the entire prototype, including logos and icons for the app.

The functionality of the app is simply a way for people to connect with someone, either through voice chat or text chat. One tap of the buttons on the main screen searches for a person to talk to. There is also a possibility to add this person as a friend after or during the conversation, this makes it so you can call this person directly. There is also overview pages for all the chats you have had and the friends you have added on the app.

The app has these following pages:

  • A home screen with buttons to serach for a random person to have a conversation with.
  • A text chat screen.
  • A voice chat screen.
  • A screen with an overview of all text chats.
  • A screen with all the people the user has added to their friends list and their status (online, offline or busy).

I wanted the home screen to be a gateway straight to the main functionality of the app, this is where the user will search for a random person to connect with. It was important that there where no steps to get to these two buttons. Theres always buttons available for the user to go back, for example it can cancel the search for a conversation easily, i did not want to trap the user. The whole point of the app is to have someone to talk to so you can practice the Norwegian language, so simplicity in user experience was a must. I don’t need to reinvent the wheel, people with smartphones have used text chat and called someone before so i didn’t want to make anything too complicated.

Overall i am happy with my prototype, however the apps functionality is very much up to the user. This app in simple terms works as a middle man for connecting two people, one with the goal of learning Norwegian and one who already knows the language and want to meet new people from other backgrounds, get a new friend or simply help.

Video Prototype:

https://hiof.instructuremedia.com/embed/7ca86e21-663b-457d-b52e-5f0c540b0256