CoachA tape is the record, made during the forward evaluation, of each elementary operation’s inputs and local partial derivatives. Checkpointing stores only some intermediate states during the forward pass and recomputes the operations between them during the reverse pass, trading computation for memory.
Quantitative Finance · Glossary
What is Tape, checkpointing?
Also known as: tape · checkpointing