justinchuby

/

BirdNET-onnx

like 1

enchmarking ONNX model (10 warmup + 100 test runs)...
Benchmarking TFLite model (10 warmup + 100 test runs)...

================================================================================
BENCHMARK RESULTS
================================================================================

ONNX Model:
  Mean:   16.641 ms
  Median: 16.084 ms
  Std:    4.481 ms
  Min:    15.964 ms
  Max:    61.037 ms

TFLite Model:
  Mean:   25.158 ms
  Median: 25.163 ms
  Std:    0.079 ms
  Min:    24.878 ms
  Max:    25.298 ms

Comparison:
  ONNX Runtime is 1.51x faster than TFLite
  Difference: 8.518 ms
================================================================================