feat: add inference_speed benchmark with throughput score#148

lwalew wants to merge 2 commits into

developinstadeepai/mlipaudit:developfrom

feat/scaling-benchmark-revampinstadeepai/mlipaudit:feat/scaling-benchmark-revampCopy head branch name to clipboard