For all the engine configuration set by mlagents-learn please see this doc. FYI, this graph might give you more information about how time works in Unity. FixedUpdate guarantee that physics are ...