Utils

General-purpose helpers, not specific to reinforcement learning. Unlike Reinforcement learning utils, nothing here knows about agents, environments or datasets: these are the mathematical, plotting, recording and simulator-side utilities the rest of the library is written on top of.

The last three pages are the helpers used to write an environment on a given simulator, and are needed when subclassing MuJoCo, PyBullet or IsaacSim rather than when using one of the environments already implemented.