A Torch-style simplified Python API for OpenVINO Toolkit.
- Load/save model
- Move to device and apply inference options
- Lower precision to FP16 (GPU inference)
- Infer asynchcrounously to improve the throughput.
See "examples" folder for usage details.
python setup.py install
python examples/simple_example.py
For more information about API, please refer to API documentation.