Adding changes to support MNIST e2e inference #42

sdjordjevicTT · 2024-08-07T15:45:10Z

Adding necessary changes to support MNIST e2e inference:

With the current metal version, float32 data format isn't supported, hence adding the ability to override data format to bfloat16 (https://github.com/tenstorrent/tt-forge/issues/46)
During lowering to MLIR reordered the inputs and parameters correctly (https://github.com/tenstorrent/tt-forge/issues/47)
Rewrote the runtime code to pass the parameters along with inputs (https://github.com/tenstorrent/tt-forge/issues/48)
Rewrote MNIST inference test to avoid the broadcasting case (https://github.com/tenstorrent/tt-forge/issues/49)

E2E test that works with this change:
pytest -svv pybuda/test/mlir/mnist/test_inference.py

pybuda/pybuda/compile.py

pybuda/csrc/buda_passes.cpp

sdjordjevicTT requested review from nvukobratTT, nsmithtt and pilkicTT August 7, 2024 15:45

sdjordjevicTT self-assigned this Aug 7, 2024

pilkicTT reviewed Aug 7, 2024

View reviewed changes

pybuda/pybuda/compile.py Show resolved Hide resolved

sdjordjevicTT force-pushed the sdjordjevic/run_mnist_inference_e2e branch from 1573bd1 to e0de1b9 Compare August 7, 2024 16:59

pilkicTT approved these changes Aug 8, 2024

View reviewed changes

nvukobratTT reviewed Aug 8, 2024

View reviewed changes

pybuda/csrc/buda_passes.cpp Show resolved Hide resolved

nvukobratTT mentioned this pull request Aug 8, 2024

Data format passes in TT-Forge #45

Closed

nvukobratTT approved these changes Aug 8, 2024

View reviewed changes

Adding changes to support MNIST e2e inference

7808c2c

sdjordjevicTT force-pushed the sdjordjevic/run_mnist_inference_e2e branch from e0de1b9 to 7808c2c Compare August 9, 2024 09:42

sdjordjevicTT merged commit 48db3d3 into main Aug 9, 2024
1 check failed

sdjordjevicTT deleted the sdjordjevic/run_mnist_inference_e2e branch September 5, 2024 09:05

Provide feedback