Engineering Resources

A measurement setup that makes power, inference speed and thermal behaviour comparable: under which conditions, with which method and which tools. Put hardware selection on a measurable footing.

A method note on speeding up the inference pipeline while reducing CPU load: INT8 quantisation with the HailoRT SDK, PCIe bandwidth management, moving pre- and post-processing into the NPU data path, and avoiding thermal throttling in an IP67 enclosure.