Access-Works is a service of Knowbility, Inc., in partnership with UserZoom and Loop11. This service connects organizations to persons with disabilities for the purpose of Web site usability testing. Our partners provide the platform for unmoderated testing; AccessWorks provides test participants, either from people already registered in our database, or on request for specialized recruitment of new participants.
Unmoderated testing is most effective when used as a quick, low-cost supplement to other techniques—for example, as a follow-up to a formal expert accessibility review, or a check of new material that has been added to an already-accessible site. It is not intended to be a stand-alone accessibility validation tool.
Frequently asked questions:
Q. What is unmoderated testing, and how does it differ from moderated testing?
A. Unmoderated testing means that the person testing the site is working alone online, using his or her own computer equipment (including assistive technology here), having no interaction with the person who has set up the test. Moderated testing always involves interaction with a trained usability professional, who may be working with the tester either via phone or in a dedicated laboratory setting. Unmoderated testing is clearly the least costly alternative; moderated lab testing is the most costly and the most consistent with advanced research techniques.
Q. What is the difference between usability testing and accessibility testing?
A. "Usability is a quality attribute that assesses how easy user interfaces are to use" (Jakob Nielsen, usability pioneer). "The power of the Web is in its universality. Access by everyone regardless of disability is an essential aspect" (Tim Berners-Lee, inventor of the World Wide Web). A Web site may be "usable" (or not) by most people who are fully sighted, hear well, and use a mouse or touchpad—but the same site might be difficult or impossible to use without all of those abilities. Testing for both usability and accessibility is essential.
Q. Isn't this kind of testing just for big commercial businesses?
A. No. AccessWorks testing can benefit any organization with a Web site: small businesses, non-profits, state and local government agencies, and academic institutions at all levels.
It is an especially good strategy for getting fast, useful feedback about your site, even with limited resources. We also recommend AccessWorks testing as a follow-up check for sites that have undergone formal accessibility evaluation and remediation. see: Why Access-Works?
Q. Do I have to be a usability or accessibility expert to use AccessWorks?
A. Although some AccesssWorks clients do have staff members trained in usability, many others simply rely on their existing Web development team for this testing. Yes, that team does need to understand accessible development techniques; we can help you get started.
Q. What kind of tests can I run with this system?
A. Most tests will ask the participant (tester) to perform a task or series of tasks on your Web site; for example: starting at the home page, select and complete an order for a specific product, enroll in a specific class, or request a service from your organization. This will generally be followed by a series of questions to determine what kind of difficulties, if any, the participant has encountered during the process. You may need to provide information such as fictitious logins or credit card numbers. If this is new to you, we can help you get started.
Q. How does the system work?
A. In sequence:
- Testing organization sets up the test with UserZoom or Loop11. We have developed a tutorial to guide you through the Loop11 test setup, and both companies may also be able to provide help with the process.
- Testing organization and/or platform partner notifies AccessWorks of tester requirement (disability/technology and number of each).
- AccessWorks system administrator selects elegible testers from database, activates test in our system, notifies testers by email
- Testers log in to their AccessWorks dashboard, take elegibility survey if required, proceed to take test. When the quota for each requirement has been filled, the test will no longer be available on the dashboard. (First come, first served.)
- Testing organization reviews results on UserZoom or Loop11 (also see our Loop11 results tutorial); Knowbility bills testing organization and reimburses testers; platform partner bills testing organization separately according to selected plan.
Q. How many participants (testers) do I need?
A. It depends on the test and how you will use the results. For many tests, four or five can give useful descriptive feedback at very low cost. If results are to be statistically analyzed, the number will need to be much greater. Due to variable individual skills, we recommend choosing more than one tester in each category that you wish to examine (e.g., blind/voice reader, motor disability/keyboard only).
Q. What kinds of disabilities and assistive technology use are available?
A. There are five major disability categories of registered testers in our database: vision, hearing, motor, cognitive, and neurological. Each of these are sub-categorized: for example, vision disabilities include blindness, low vision, color blindness, and light sensitivity.
Assistive technologies are characterized similarly; our list includes the most widely used adaptations for each of the disabilities.
Our largest number of currently registered testers are blind, using one or more of the most popular screen readers. We are always recruiting more testers, so exact numbers will change frequently. Please contact us for the latest information. Contact Us
Q. What other participant characteristics can I ask for?
A. Also in our database is information about registered testers' gender, age, and residence (by country, U.S. State, or U.S. Zip Code range. So, for example, we can find low vision women over 50 years of age who use a mobile device and live in the United States. (This one is a fairly short list, though.)
For information not in the database, we can survey potential testers before they become eligible for the test. Typical questions might include amount of Internet use (by years and/or hours per week), types of activity performed on the Web (shopping, making travel arrangements, etc.), or use of technology even more specific than we have recorded (Windows 10; iPhone 5 or newer).
Q. What if there are too few (or no) testers in the AccessWorks database who meet my requirements?
A. Knowbility has access to numerous disability organizations around the world. We will contact these organizations to recruit more testers as needed; this service will be done at additional charge to the testing organization.
Q. How do we protect the testers' privacy?
A. Only the AccessWorks system administrator—who selects or recruits testers according to your specifications—has access to our full database. Participants are identified to our testing platform partners only by an arbitrary ID number; neither they nor you (the testing organization) will know their name, email, or any other personal information about any individual tester.
Q. What does it cost?
A. Most tests are designed to take one hour or less for a user with disabilities to complete.
For these, Knowbility bills $75 per tester, of which we reimburse $50 to the person taking the test. Custom tester recruitment, described above, will be billed at an additional charge to be determined by the extent and complexity of the requirement.
UserZoom and Loop11 bill the testing organization separately. Each of them offers a variety of payment plans, based on customer needs such as frequency of testing and amount of support required. Please contact them directly for details.