File size: 7,797 Bytes
6c7aece
 
a695d8a
6c7aece
c8b7f48
6c7aece
 
 
 
 
 
 
 
17b449d
6c7aece
 
 
0e0ad49
1d1e587
17b449d
 
 
 
 
1d1e587
17b449d
 
 
 
1d1e587
17b449d
 
 
 
 
 
 
 
0b6b7cd
17b449d
0b6b7cd
17b449d
 
 
 
1d1e587
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
c38daff
 
1d1e587
 
 
 
 
 
 
 
 
 
 
 
 
c38daff
 
1d1e587
 
 
 
 
 
 
 
6c7aece
 
 
 
 
 
 
0e0ad49
6c7aece
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
---
library_name: pytorch
license: gpl-3.0
tags:
- bu_auto
- real_time
- android
pipeline_tag: object-detection

---

![](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/yolor/web-assets/model_demo.png)

# Yolo-R: Optimized for Qualcomm Devices

YoloR is a machine learning model that predicts bounding boxes and classes of objects in an image.

This is based on the implementation of Yolo-R found [here](https://github.com/WongKinYiu/yolor).
This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/v0.63.0/src/qai_hub_models/models/yolor) library to export with custom configurations. More details on model performance across various devices, can be found [here](#performance-summary).

Qualcomm AI Hub Models uses [Qualcomm AI Hub Workbench](https://workbench.aihub.qualcomm.com) to compile, profile, and evaluate this model. [Sign up](https://myaccount.qualcomm.com/signup) to run these models on a hosted Qualcomm® device.

## Getting Started
Due to licensing restrictions, we cannot distribute pre-exported model assets for this model.
Use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/v0.63.0/src/qai_hub_models/models/yolor) Python library to compile and export the model with your own:
- Custom weights (e.g., fine-tuned checkpoints)
- Custom input shapes
- Target device and runtime configurations

See our repository for [Yolo-R on GitHub](https://github.com/qualcomm/ai-hub-models/blob/v0.63.0/src/qai_hub_models/models/yolor) for usage instructions.


## Model Details

**Model Type:** Model_use_case.object_detection

**Model Stats:**
- Input resolution: 640x640
- Model checkpoint: yolor_p6
- Model size (float): 17.9 MB
- Number of parameters: 4.68M

## Performance Summary
| Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit
|---|---|---|---|---|---|---
| Yolo-R | ONNX | float | Snapdragon® 8 Elite Gen 5 For Galaxy Mobile | 25.765 ms | 1 - 190 MB | NPU
| Yolo-R | ONNX | float | Snapdragon® 8 Elite For Galaxy Mobile | 27.099 ms | 3 - 188 MB | NPU
| Yolo-R | ONNX | float | Snapdragon® X2 Elite | 35.909 ms | 5 - 5 MB | NPU
| Yolo-R | ONNX | float | Snapdragon® X Elite | 40.33 ms | 72 - 72 MB | NPU
| Yolo-R | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 32.364 ms | 6 - 253 MB | NPU
| Yolo-R | ONNX | float | Snapdragon® 8 Gen 1 Mobile | 54.675 ms | 1 - 305 MB | NPU
| Yolo-R | ONNX | float | Qualcomm® Dragonwing™ IQ-8275 | 49.729 ms | 5 - 13 MB | NPU
| Yolo-R | ONNX | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 40.984 ms | 0 - 77 MB | NPU
| Yolo-R | ONNX | float | Qualcomm® QCS8450 | 54.675 ms | 1 - 305 MB | NPU
| Yolo-R | ONNX | float | Qualcomm® Dragonwing™ IQ-9075 | 47.783 ms | 5 - 13 MB | NPU
| Yolo-R | ONNX | float | Qualcomm® Dragonwing™ IQ-X7181 | 40.33 ms | 72 - 72 MB | NPU
| Yolo-R | ONNX | float | Qualcomm® Dragonwing™ Q-8750 | 27.099 ms | 3 - 188 MB | NPU
| Yolo-R | ONNX | w8a16 | Snapdragon® 8 Elite Gen 5 For Galaxy Mobile | 14.486 ms | 1 - 328 MB | NPU
| Yolo-R | ONNX | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 13.576 ms | 1 - 320 MB | NPU
| Yolo-R | ONNX | w8a16 | Snapdragon® X2 Elite | 15.19 ms | 2 - 2 MB | NPU
| Yolo-R | ONNX | w8a16 | Snapdragon® X Elite | 23.229 ms | 37 - 37 MB | NPU
| Yolo-R | ONNX | w8a16 | Snapdragon® 8 Gen 3 Mobile | 15.874 ms | 3 - 393 MB | NPU
| Yolo-R | ONNX | w8a16 | Snapdragon® 8 Gen 1 Mobile | 30.311 ms | 0 - 389 MB | NPU
| Yolo-R | ONNX | w8a16 | Qualcomm® Dragonwing™ IQ-8275 | 21.484 ms | 1 - 7 MB | NPU
| Yolo-R | ONNX | w8a16 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 22.502 ms | 0 - 40 MB | NPU
| Yolo-R | ONNX | w8a16 | Qualcomm® QCS8450 | 30.311 ms | 0 - 389 MB | NPU
| Yolo-R | ONNX | w8a16 | Qualcomm® Dragonwing™ IQ-9075 | 23.232 ms | 1 - 6 MB | NPU
| Yolo-R | ONNX | w8a16 | Qualcomm® Dragonwing™ IQ-X7181 | 23.229 ms | 37 - 37 MB | NPU
| Yolo-R | ONNX | w8a16 | Qualcomm® Dragonwing™ Q-7790 | 34.113 ms | 3 - 307 MB | NPU
| Yolo-R | ONNX | w8a16 | Qualcomm® Dragonwing™ Q-8750 | 13.576 ms | 1 - 320 MB | NPU
| Yolo-R | ONNX | w8a16 | Snapdragon® 7 Gen 4 Mobile | 34.113 ms | 3 - 307 MB | NPU
| Yolo-R | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 For Galaxy Mobile | 24.446 ms | 5 - 196 MB | NPU
| Yolo-R | QNN_DLC | float | Snapdragon® 8 Elite For Galaxy Mobile | 20.795 ms | 0 - 186 MB | NPU
| Yolo-R | QNN_DLC | float | Snapdragon® X2 Elite | 27.008 ms | 5 - 5 MB | NPU
| Yolo-R | QNN_DLC | float | Snapdragon® X Elite | 32.207 ms | 5 - 5 MB | NPU
| Yolo-R | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 25.728 ms | 3 - 243 MB | NPU
| Yolo-R | QNN_DLC | float | Snapdragon® 8 Gen 1 Mobile | 50.503 ms | 5 - 304 MB | NPU
| Yolo-R | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-8275 | 40.83 ms | 5 - 13 MB | NPU
| Yolo-R | QNN_DLC | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 33.138 ms | 5 - 7 MB | NPU
| Yolo-R | QNN_DLC | float | Qualcomm® SA8650P | 61.374 ms | 1 - 197 MB | NPU
| Yolo-R | QNN_DLC | float | Qualcomm® SA8255P | 61.374 ms | 1 - 197 MB | NPU
| Yolo-R | QNN_DLC | float | Qualcomm® QCS8450 | 50.503 ms | 5 - 304 MB | NPU
| Yolo-R | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-9075 | 40.378 ms | 5 - 12 MB | NPU
| Yolo-R | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-X7181 | 32.207 ms | 5 - 5 MB | NPU
| Yolo-R | QNN_DLC | float | Qualcomm® Dragonwing™ Q-8750 | 20.795 ms | 0 - 186 MB | NPU
| Yolo-R | QNN_DLC | w8a16 | Snapdragon® 8 Elite Gen 5 For Galaxy Mobile | 5.742 ms | 2 - 314 MB | NPU
| Yolo-R | QNN_DLC | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 7.405 ms | 2 - 307 MB | NPU
| Yolo-R | QNN_DLC | w8a16 | Snapdragon® X2 Elite | 7.006 ms | 2 - 2 MB | NPU
| Yolo-R | QNN_DLC | w8a16 | Snapdragon® X Elite | 16.026 ms | 2 - 2 MB | NPU
| Yolo-R | QNN_DLC | w8a16 | Snapdragon® 8 Gen 3 Mobile | 9.927 ms | 2 - 369 MB | NPU
| Yolo-R | QNN_DLC | w8a16 | Snapdragon® 8 Gen 1 Mobile | 23.072 ms | 2 - 370 MB | NPU
| Yolo-R | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ QCS6490 | 56.763 ms | 2 - 7 MB | NPU
| Yolo-R | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ IQ-8275 | 13.89 ms | 2 - 8 MB | NPU
| Yolo-R | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 15.086 ms | 2 - 5 MB | NPU
| Yolo-R | QNN_DLC | w8a16 | Qualcomm® SA8650P | 15.488 ms | 1 - 310 MB | NPU
| Yolo-R | QNN_DLC | w8a16 | Qualcomm® SA8255P | 15.488 ms | 1 - 310 MB | NPU
| Yolo-R | QNN_DLC | w8a16 | Qualcomm® QCS8450 | 23.072 ms | 2 - 370 MB | NPU
| Yolo-R | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ IQ-9075 | 15.503 ms | 1 - 6 MB | NPU
| Yolo-R | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ IQ-X7181 | 16.026 ms | 2 - 2 MB | NPU
| Yolo-R | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ Q-6690 | 153.244 ms | 2 - 341 MB | NPU
| Yolo-R | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ Q-7790 | 21.917 ms | 2 - 318 MB | NPU
| Yolo-R | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ Q-8750 | 7.405 ms | 2 - 307 MB | NPU
| Yolo-R | QNN_DLC | w8a16 | Qualcomm® SA8295P | 19.92 ms | 0 - 301 MB | NPU
| Yolo-R | QNN_DLC | w8a16 | Snapdragon® 7 Gen 4 Mobile | 21.917 ms | 2 - 318 MB | NPU

## License
* The license for the original implementation of Yolo-R can be found
  [here](https://github.com/WongKinYiu/yolor/blob/main/LICENSE).

## References
* [You Only Learn One Representation: Unified Network for Multiple Tasks](https://arxiv.org/abs/2105.04206)
* [Source Model Implementation](https://github.com/WongKinYiu/yolor)

## Community
* Join [our AI Hub Slack community](https://aihub.qualcomm.com/community/slack) to collaborate, post questions and learn more about on-device AI.
* For questions or feedback please [reach out to us](mailto:ai-hub-support@qti.qualcomm.com).