Template Training

Basics of Testing

Overview

  • Teaching: 5 min
  • Exercises: 0 min

Questions

  • What are tests?

Objectives

  • Understand what a test does.
  • Understand the place of testing in a scientific workflow.
  • Understand that testing has many forms.

The first step toward getting the right answers from our programs is to assume that mistakes will happen and to guard against them. This is called defensive programming and the most common way to do it is to add alarms and tests into our code so that it checks itself.

Testing should be a seamless part of scientific software development process. This is analogous to experiment design in the experimental science world:

  • At the beginning of a new project, tests can be used to help guide the overall architecture of the project.
  • The act of writing tests can help clarify how the software should be perform when you are done.
  • In fact, starting to write the tests before you even write the software might be advisable. (Such a practice is called test-driven development, which we will discuss today brieflt today but is covered in greater detail in this episode.

There are many ways to test software, such as:

  • Assertions
  • Exceptions
  • Unit Tests
  • Integration Tests
  • Regresson Tests
  • Exceptions and Assertions: While writing code, exceptions and assertions can be added to sound an alarm as runtime problems come up. These kinds of tests, are embedded in the software iteself and handle, as their name implies, exceptional cases rather than the norm.

  • Unit Tests: Unit tests investigate the behavior of units of code (such as functions, classes, or data structures). By validating each software unit across the valid range of its input and output parameters, tracking down unexpected behavior that may appear when the units are combined is made vastly simpler.

  • Integration Tests: Integration tests check that various pieces of the software work together as expected.

  • Regression Tests: Regression tests defend against new bugs, or regressions, which might appear due to new software and updates.

Key Points

  • Tests check whether the observed result, from running the code, is what was expected ahead of time.
  • Tests can be written before the code they are testing is written (Test Driven Development), however some tests must be written after the code is written (e.g. Regression testing).
  • Assertions and exceptions are like alarm systems embedded in the software, guarding against exceptional bahavior.
  • Unit tests try to test the smallest pieces of code possible, usually functions and methods.
  • Integration tests make sure that code units work together properly.
  • Regression tests ensure that everything works the same today as it did yesterday.