shouxieai/infer

This is stars and forks stats for /shouxieai/infer repository. As of 25 Apr, 2024 this repository has 220 stars and 43 forks.

New tensorrt package, easy to integrate many tasks Easily implement producer-consumer models for various tasks and perform high-performance inference No complex packaging, no coupling! For the Yolo-Demo Currently supports Yolo series 3/4/5/x/7/8 YoloV8-Segment is supported 🚀 Pre-processing about 1ms 🚀 Post-processing about 0.5ms Description cpm.hpp Producer-consumer model For direct inference tasks, cpm.hpp can be turned into an automatic multi-batch producer-consumer model infer.hpp A repackaging...