Usability Gov Study Methodology

(Adapted by me)

Schedule and participant background
Recruiting screener
Recruit participants (allow at least 2-3 weeks for this process)
Recruitment, confirmation, and reminder emails
Consent to record (to be included with confirmation email)
Send confirmation invitations (including consent to record) to participants and team members for:
Send out reminder email to test participants the day before the session; copy team

For in person tests

Create “Do Not Disturb” signs
Be sure screen capture/camera set up works properly
Check supplies for test room (pens, paper, refreshments for participants)
Print copies of all study materials
Ensure observer’s room screen cast works properly
Ensure observer room has adequate chairs, table space, office supplies, etc. for observers scheduled to take notes

Walkthrough and pilot test

Send out reminder email to walkthrough and pilot test participants the day before the session; copy team
Review test objectives, success measures, and areas of concern with note takers
Verify set up of testing environment
Conduct walkthrough (someone internal to the organization)
Revise test materials as needed based on walkthrough
Conduct pilot test (outside participant from target audience group)
Revise test materials as need based on pilot test
Check lab supplies and replenish as needed

Assemble materials for participants

Consent form to sign (in person only)
Pre-test questionnaires (in person only) or links to applicable surveys
Participant version of scenarios (so they can refer to them during the test) (in person only)

For remote tests

Set up in a quiet location
Use a land line and head set so your hands are free for taking notes
Print copies of all study materials
Participant names/emails/phone numbers (remote only)
URLs for surveys that you’ll need to place in the chat window (remote only)
Call in number for team to debrief after each session (if team is not collocated)

Facilitator should:

Put your cell phone on vibrate and within reach in case observers or the participant needs to reach you
Note taking form for facilitator
Have email open and minimized, in case you need to communicate with the participant
Get a glass of water

Note takers should:

Set up your workspace (2 monitors, or 2 computers - one with virtual meeting software and one with note taking spreadsheet)
Note taking spreadsheet for note takers
Get a stop watch and be sure it’s working.
Thank you notes and package honorariums for participants
Make arrangements for user participant gratuities

Usability test

Usability test (outside participants from target audience group)
Conduct tests
Debrief with team after each session and capture key positive findings and usability issues on the issue tracking spreadsheet
Debrief with observers
Post all videos to predetermined location
Post-study questions
Set up select post test questions in survey software (if necessary)
Post-test questionnaires (in person only) or links to applicable surveys

Data analysis

results matching ""