UI Testing

This time, I got to experience creating a whole study with two other researchers from start to finish. I was in charge of the UI section.

Fellow Researchers: Carter Hoke and Ethan Volonte

Methodology

  • Convenience sample of 14

  • Participants were given, and signed, a consent form

  • Testing was done simultaneously on 3 machines in an open lab

  • Players were given a brief verbal tutorial before playing

  • Participants filled out a 30-question survey covering level design, UI, and NPC interaction

Skills

  • Data collection

  • Data analysis

  • Data presentation

  • Communication

Tools

  • Excel

  • Microsoft Forms

  • Word

  • Unreal

Limitations

  • Only one machine had headphones hooked up

  • The introduction and tutorials given varied between participants, leading to occasional researcher intervention

  • 30 survey questions produce a high cognitive load

Findings

  • All participants found the chat box to be readable

  • Participants found chat response time to be fast

  • 4 participants were unaware of the chatlog

  • About half of the participants did not know where the keyword menu was

Takeaways: Research with a Team

  • While comparing my work with my teammates, I found that my questions should have been more standardized

  • Experienced creating one report document with 3 researchers and 3 topics, and how chaotic that can be

  • Navigated scheduling to ensure no one was blocking anyone else