Abstract: This paper presents an innovative auto batching scheme designed to optimize Long Short-Term Memory (LSTM) inference on Field-Programmable Gate Array (FPGA) platforms. Existing block batching ...

As a user I want the auto-batching feature to have the same behavior as if it wasn't enabled and the updates would have been processed one by one, the auto-batching ...

breaking change The related changes are breaking for the users v1.0.0 PRs/issues solved in v1.0.0 released on 2023-02-06 ...