Jobs: Usability Test Specialist

Are you passionate about conducting moderated usability testing?

Would you like to join a team of dedicated usability researchers, who analyze cutting-edge User Experience research? Producing UX research findings that will be used by thousands of web professionals, including some of the biggest brands in the world (including Nike, Sears, Lenovo, Etsy)? Are you passionate about conducting usability testing, and generating the key data points to provide the foundation for usability guidelines?

Then apply for the following remote full-time position at Baymard Institute.

About Your Job at Baymard

A sincere passion for, and demonstrated excellence in, usability test moderation and analysis is essential as you’ll be spending at least 80% of your time moderating and annotating usability test sessions.

In this position, you will join Baymard’s team of usability researchers and conduct moderated usability test sessions with hundreds of participants on the world’s top e-commerce sites. You’ll also take the video of those test sessions and break them down into the thousands of observed UX issues that are later used by our usability research writers to create usability guidelines. The guidelines go directly into our subscription platform Baymard Premium.

This job calls for someone extremely detail oriented, who enjoys working independently for long stretches. Over the course of a year at Baymard we’ll typically generate over 400, hour-long research test sessions, and each session typically takes a full workday to annotate. You’ll be responsible for annotating the majority of these test session videos.

Our Baymard Premium customers are eagerly waiting for our UX research insights, be it the UI designer at Nike or the e-commerce director at Lenovo, as they use it as direct input for their UX and UI design decisions.

In this role, you’ll need to enjoy UX test moderation and test session annotation, since testing with users and annotating the usability test session recordings will be at least 80–90% of what you’ll be doing all year round.

The bulk of testing is likely to be remote moderated, but in-person testing is also a possibility, depending on the research being conducted.

In this job, you’ll be directly shaping the future of e-commerce and providing the critical foundation for the UX research we do at Baymard.

This position is full-time permanent and 100% remote (note that you are expected to have at least 2 hours of daily overlap with Europe/US during traditional business hours).

Job Qualifications

You will help expand and strengthen Baymard’s research core, which is the foundation for all of our products and services.

While we will train you in Baymard’s testing and analysis processes, we expect that you have the following qualifications. The numbers in brackets indicate the weighted importance of each on a 7-point scale (higher = more important). These weights reflect how candidates are evaluated, so make sure your application illustrates your prowess in the highest-weighted skills and traits.

  • [7/7] Requirement: Strong reasoning and logical deduction skills. Specifically in relation to your ability to deconstruct user behavior and understand what can and cannot be concluded from our usability research data, with the goal of generating usable data points for researchers to use later in analysis and writing.
  • [7/7] ability to be self-motivated and and work independently on the task of doing video annotation for 2–4 weeks in a row.
  • [5/7] Experience with usability test session moderation, one-to-one think-aloud in-person and remote moderated testing (ideally with a focus in e-commerce).
  • [3/7] Ability to work simultaneously on multiple projects at once.
  • [3/7] Familiarity with the ‘web industry’ and especially its jargon (can be from experience with web development, design, research, writing, etc.).
  • [3/7] Good writing and communication skills, specifically with regards to documenting observed UX issues and communicating with the other members of the research team.

Salary: in accordance with qualifications, usually within the range USD 50,000 - 85,000 per year.
Start date: preferably early 2022

How to Apply

If you’re interested in this position, please send the following:

  1. A list describing relevant usability research experience.
  2. A cover letter that describes which of 6 above-listed job qualifications you meet and how you meet them.
  3. Other information you find relevant (hobbies, interests, work experience, CV, ..).

Deadline is December 6, 2021.

Send the above to: [application deadline have passed]. To be notified about future similar positions at Baymard, then sign up for our job notification email (1-click unsubscribe + only 1 text e-mail per job posting).

Note: Based on the applications, a few selected candidates will be assigned a paid UX moderation and analysis test which will be the main evaluation criterion for the position. This will also be a good way for you to get a feel for the primary task of this job. (The test will be performed remotely. You’ll moderate a test session and analyze a test session dataset within a 10-day deadline.)

Edward Scott, research team lead

Referral Bonus: If this job isn’t you, but you know someone who’ll be the perfect fit, please send them the link to this page. If we end up hiring the person you referred, we’ll give you one year of access to a Baymard Premium ‘Medium’ plan (a $1,560 value).

Key Work Values at Baymard

Our entire team works remotely, but once a year, we all get together for a meetup. The first image is from Iceland, where one of the activities was snowmobiling on glaciers. Second, is oyster hunting in a Danish tidal sea, catching 240 oysters in 12 minutes.

The following work values are central to us at Baymard and hopefully gives you an idea of our culture and what working at Baymard is like:

  • Flat organization – Baymard is a small organization of just ~30 people. This means zero management layers between you and the final decision. You’ll have direct access to and impact on decision making.
  • Lots of responsibility – From day 1 (OK, maybe day 2), you will be working on final products or services. We believe the best way to learn is to work on actual products and challenges, supplemented with rich early feedback.
  • Long-term focus – Decisions are always based on their long term impact. We’re not interested in hunting after the next “quick win” — we want to make a lasting impact on the e-commerce industry and usually adopt a 5-year perspective in our decisions and projects.
  • Remote from the ground up – 100% of the team works remotely. We’ve deliberately designed the organization around remote work. That said, we do bring the entire team together for a week once a year somewhere interesting in the world.
  • Team of ‘subject matter’ nerds – Everyone geeks out a bit on their work interests. We love that, and once a week someone from the team does a 20min presentation on their latest obsession — whether it’s quasi-quantum-worlds or the proper usage of hyphens, en dashes, and em dashes.
  • Founders engaged in the product – We believe it is essential that those orchestrating the work of the organization are keenly in tune with all aspects of it. The two founders of Baymard have therefore performed every type of task in the organization themselves (from programming to UX testing), and continue to work directly on the product.
  • Flexible hours – beyond ensuring availability for meetings and a few hours of daily overlap with your colleagues, you are largely free to plan your own workweek. E.g. we have some that take 2-hours break midday and then instead work in the evening, or only work half a Tuesday and then always work half a Saturday.