Games User Research

Have a standardized format for reporting issues. I have found it to be a good practice to write issues in a way that explains the full picture, such that, for example, an executive who is not closely involved with the game or product can have a full understanding. This may include a brief explanation of the current design and intent, followed by the behavior exhibited by participants, and finally the outcome of how participants interacted with design. It is important to make it clear how the intent is misaligned with how users actually perceived or interacted with the design.

Have a system for addressing and labeling the severity of issues. This allows you and your team to clearly establish the difference between an issue that needs to be fixed as soon as possible and something that was a minor nuisance. This may be some sort of labeling system, such as A, B, C, D, with A being the most critical issue, whereas D is a low priority. Similarly, you may use “Critical, Medium, and Low” or “1, 2, 3” to the same effect. For a visual example, see the picture below, which uses a “Critical, Serious, Medium, Low” severity scale (source: User Focus).

Use consistent language to communicate issues. Using a consistent language to communicate issues benefits the development team in terms of knowing what to expect and not needing to re-learn report language every time. It’s also beneficial to the research team as it helps report delivery become faster as there may be less debate about how to best communicate issues. Some useful additions I’ve found include heuristics (e.g.,
https://www.nngroup.com/articles/usability-heuristics-applied-video-games/) and AXP & Accessibility pattern language (https://accessible.games/accessible-player-experiences/).

Use mindful terminology for suggestions/recommendations. If the development team(s) you work with is receptive to recommendations or fixes, use terminology like “consider” and “might be beneficial” when communicating issues. This emphasizes that they are the design experts and you, as the researcher, are simply suggesting a solution and not saying “this is how it should be fixed and it’s the only possible way.” Generally, your main objective is to find and identify problems, and this can reiterate that.

Blame the design, not the participant. I think it’s important to emphasize that user research reports are aiming to improve the game design and that should be reflected through your writing. I’ve encountered numerous instances where developers would question whether an issue written in a report was actually an issue or if we simply had an outlier as a participant. With video games being enjoyed by so many people all over the world, one person encountering a usability issue in a lab setting translates to thousands, maybe even millions out in the wild. Therefore, try to avoid issue titles such as “participants did not understand,” but instead title it “feature X is not clearly communicated.” Not only is the former title seemingly placing blame on the participants as if they did not interact with the game correctly (spoiler: there is no wrong way to play a game), but people quickly reading through the report who only see titles will be left asking “why?” rather than knowing there is an issue with feature X. Additionally, not only is it not glance-able, but “participants did not understand” is the outcome, not the issue.

Incorporate further evidence of the issue. In addition to your written explanation, things such as a screenshot, video clip, or gif can paint a clearer picture of what the issue is and help provide more context. Which leads to the next tip…

Humanize your reporting. If your data collection allows for the recording of participants while they interact with your game or product, including some relevant clips can help development teams further visualize actual humans struggling with their design, which can help motivate them to find a solution to fix it.

Provide summaries that address how the experience is affecting the player rather than what features are not working well. Researchers generally have a good idea of the design intent before testing but, depending on the scale of the game, you may have a lot of stakeholders who have differing ideas of the intended experience should be. Further humanizing your reports by stating how participants’ motivations, behaviors, and perceptions are affected can help developers think more about it as an experience that’s impacting someone rather than a product with a set of features. It’s rarely as simple as “fixing feature X will help players feel more competent during gameplay” and a more holistic, rather than reductionist, view of the user experience can help get that point across.

Differentiate between participants in the study and the proverbial player. If you are speaking specifically about something observed during a study, make it clear that you are doing so by referring to them as “participants.” For example, “Several participants were observed struggling to navigate the mission menu.” If you are speaking hypothetically about a specific interaction or experience, use the proverbial player. For example, “Players may have difficulty navigating the mission menu due to the low discoverability of the [Continue] button.”

Implement a system to indicate if an issue has been observed and/or reported during a previous study. This may be an additional text tag, such as “reoccurring”, or some sort of iconography indicating that something has been an issue that has been observed before. This not only further validates findings from previous research but might also motivate the development team to more quickly take action if they become tired of seeing participants encounter the same issues. It’s also additional evidence that can be referenced over time to build a case for elevating the severity of an issue.

Incorporate iconography for greater legibility. Using different icons to indicate different severity levels or types of issues written in reports can help your team more quickly read through a report. For example, if you want to make the team aware of something that was not necessarily an issue but something worth noting, you might label it “Note” and/or include a pencil or notepad icon to indicate as such. Therefore, if someone is short on time and needs to skim the report for important information that is only relevant to them, they can use the icons as reference points.

For anyone interested in beginning or transitioning to a career in games user research, here are some tips and suggestions that might be useful. While obtaining a degree in a relevant discipline and lab experience is a helpful start, there are many additional steps you can take to help you break into the industry. Here are some of the ones I found to be effective: 

Play games and change how you think about them

This should be a no-brainer – you should play a lot of video games. When trying to professionally study game design and development for a living, playing many different types of games is beneficial. This can include games outside of your comfort zone, such as different genres. Even games that are just plain bad can expose you to various types of design and issues. Exposing yourself to different platforms (PC, console, mobile, handheld, VR, etc.) will help you develop a more versatile skill set as a games user researcher. If you’re passionate about video games, this likely won’t even seem like work (more like a learning experience). Comprehensive knowledge and exposure will make you a more attractive candidate for a multitude of positions and studios.

Furthermore, to learn more efficiently and make better use of your time while playing, it would be beneficial to change how you think about games and playing them. You’ll want to keep user experience at the forefront while playing at all times by thinking critically and analytically. Look for usability, flow and general design issues and inconsistencies. If a game has an oddly-designed mechanic compared to the industry standard, is it for a good reason? Or, was it just an oversight that could have been improved upon with iteration? Was the tutorial sufficient? How does the progression and balance feel? Do the controls feel intuitive? And the list goes on.

Work independently

In addition to having an academic background in a relevant discipline, it is important to collect resources to educate yourself. This can include books specifically about games user research (of which there are quite a few good ones) and psychology, which will provide a solid foundation for research skills and many relevant theories that drive the field. Check my resources page for some examples.

One way to culminate all of this collecting and learning is to start your own blog. This will allow you to apply what you have learned in a constructive way, which can show potential employers how serious you are about a career in games user research. It can also be a reference during interviews, as many will ask specifically for examples of user experience issues in games. Ultimately, your blog can highlight your strengths, help you strengthen your weaknesses, and be an excellent way to demonstrate your critical thinking, writing skills (for all those playtest reports you’ll eventually be writing), interests/individuality, and growth as a researcher.

Seek advice/feedback and/or obtain a mentor

Another way to collect resources is to become active on Twitter. Many researchers in the field have Twitter accounts and tweet useful advice/informative resources (especially the official GamesUR Twitter account) and have personal websites where they document their work. Everyone I know in the community is very approachable, receptive and happy to field questions from aspiring user researchers and anyone with a general interest in what they do. This can be a great way to seek advice and feedback.

There is also an official mentoring program through the IGDA Games User Research SIG with an impressive list of academic and industry researchers willing to discuss a wide range of topics. Find someone you think would be a good fit for you and reach out!

Volunteer/offer your services to independent game developers

Reach out to indie companies that interest you, even if you are unsure if they have user experience researchers or offer similar positions/internships. Let them know about you, your interests, what you’re looking to do, and what services you can offer them. You might get lucky and they could have an open position. Or, your pitch could open them up to the idea of adding such a position. They could offer to bring you on as a volunteer/intern, which is a low-overhead, high-reward opportunity for them. These companies can be local to you (if you’re seeking specifically hands-on experience) or not if you’re willing to work remotely. I recommend the former, if possible, because you’ll start new relationships and also develop an understanding of game development and culture in general. However, either instance will provide valuable experience.

Seek entry-level or contract positions

Many large publishers and studios have user experience researchers and often offer entry-level user research positions on a contract basis. These typically range from three months to one year. While some do not require any formal experience working in games and/or user experience, many see it advantageous that candidates have done some relevant work. Once you feel you’re up to snuff for such a position, throw an application out there!

Although these positions are not practical long-term solutions, they can be a great first formal experience in the industry. You’ll learn new things, meet new people, and (hopefully) work on awesome games. Of course, your geographical location in relation to your companies of interest is a major factor. However, even for short-term contract positions, some companies will offer some sort of relocation assistance to ease the burden of moving. It can be risky to uproot for such a position, but it can also bring great experience that will ultimately help you achieve your goals.

Continue to learn and grow

Never be satisfied. Continue to teach yourself new things, both on- and off-the-job, whether it be a new research method, way to report data, or statistical-analysis program. If you’re only experienced in qualitative research, learn/practice with quantitative data sets (or vice versa). Become familiar with industry standards as well as different types of design. Continue to gather useful resources, read books, attend conferences, and learn from others to help you hone your craft. Think of your career as an RPG with no level cap; grind the side quests for the extra XP that will help you level up to achieve long-term success during the main quest. Strive to be a multidisciplinary researcher!

Hopefully these tips are helpful to aspiring games user researchers!