• Background
• Test Developers
• Test Publishers
• Technological Issues
• Quality Issues
• Control Issues
• Security/Privacy Issues
• Test Users
• Official Translations
• Acknowledgements
• References
• Appendix
• Glossary

International Test Commission

International Guidelines on Computer-Based and Internet Delivered Testing

Give due regard to technological issues in Computer-based (CBT) and Internet Testing

1. Verify the documented minimum hardware, software or browser requirements to ensure that they are communicated clearly to the user. Ensure that other technical and operational requirements for the test are explained to the user.
2. Confirm that adequate testing of the system has been completed and documented on the appropriate delivery platforms stated to be suitable.
3. Use only software or hardware features that are essential for measuring the construct and that are likely to be available on systems used by the intended test users and test-takers.
4. Ensure that the test will be as easy as possible to support and maintain in light of likely developments in hardware and software (operating systems etc).
5. Test and document any new features added to the program after publication.

1. Confirm the robustness of the system has been checked across a range of suitable platforms.
2. Provide sufficient redundancy on all systems throughout the testing site (including incoming and outgoing communications) to allow the site to operate even if one of its components fails.
3. Check the degree to which the test prevents user errors from causing administration problems. Provide users with guidance on what to do in the event that ‘bugs’ occur during testing (e.g. a test user should be able to report bugs and problems that may be experienced during the testing process).
4. Provide users with contact details (e.g., telephone number, internet address) for technical support.
5. Confirm that the CBT/Internet test responds in a timely manner when taking the test. Where this does not occur, inform test developers and discontinue use of the test until the problem is solved.
6. For Internet testing, put procedures in place to deal fairly with the impact of hang-ups, lost connections and slow downloads. Where download or other technical problems occur, advise the test user/taker of alternatives (e.g., using alternative media or an alternative venue).
7. Document and disseminate relevant technical support to test users. Where appropriate, offer technical support services with trained staff.

1. Verify that screen design issues have been taken into account in the development of the CBT/Internet test. Where problems are noticed, provide clear and detailed information about the problems to the test developer.
2. Verify that item presentation is consistent throughout the test.
3. Verify that appropriate and informative error messages are presented when necessary.

1. Confirm that the hardware/software features of the CBT/Internet test facilitate the participation of test-takers with disabilities and those with special needs (e.g., those who need larger page font).
2. Inform test users about the types of accommodations and modifications that can be made for test-takers with disabilities and those with special needs.
3. Inform test users of the acceptable limits to which tests can be modified or accommodations provided to test-takers.
4. Ensure that test modification and accommodations provided to test users are consistent with legislation regarding individuals with disabilities and special needs.

1. Provide technical support documentation at a level appropriate for test users. Where appropriate, provide additional customer support services.
2. Disseminate instructions on how to set-up the system to test users. For Internet testing, inform, where appropriate, test users on how to log a test-taker on and off the system.
3. Provide clear and sufficient on-screen instructions.
4. Where appropriate, verify that suitable practice items and tutorials are available. For Internet testing , provide procedures to verify whether a test-taker has accessed practice items and tutorials. Often a test cannot be started until certain practice items have been completed.