Yolov8s no bounding box on default settings

[lida2003]

The issue is quite similar to #390, but I need to use latest up to date versions.

Here is the video when I test yolov8s: https://drive.google.com/file/d/1I5MGC9_91h0drNASEM2z9VQUDptLNW_4/view?usp=drive_link

yolov4 is OK, https://drive.google.com/file/d/1bIdyqcfNa6JbuOyBR6NYOjnPqPTp-o-m/view?usp=sharing

Software part of jetson-stats 4.2.12 - (c) 2024, Raffaello Bonghi
Model: NVIDIA Orin Nano Developer Kit - Jetpack 5.1.4 [L4T 35.6.0]
NV Power Mode[0]: 15W
Serial Number: [XXX Show with: jetson_release -s XXX]
Hardware:
 - P-Number: p3767-0005
 - Module: NVIDIA Jetson Orin Nano (Developer kit)
Platform:
 - Distribution: Ubuntu 20.04 focal
 - Release: 5.10.216-tegra
jtop:
 - Version: 4.2.12
 - Service: Active
Libraries:
 - CUDA: 11.4.315
 - cuDNN: 8.6.0.166
 - TensorRT: 8.5.2.2
 - VPI: 2.4.8
 - OpenCV: 4.9.0 - with CUDA: YES
DeepStream C/C++ SDK version: 6.3

Python Environment:
Python 3.8.10
    GStreamer:                   YES (1.16.3)
  NVIDIA CUDA:                   YES (ver 11.4, CUFFT CUBLAS FAST_MATH)
        OpenCV version: 4.9.0  CUDA True
          YOLO version: 8.3.33
         Torch version: 2.1.0a0+41361538.nv23.06
   Torchvision version: 0.16.1+fdea156
DeepStream SDK version: 1.1.8

[PaoXi]

Did you solve this error, the default yolov8s after running it with deepstream-app -c deep* no detection is shown no bounding boxes

[lida2003]

@PaoXi No, I didn't have time to dig into it. And I didn't find any clue yet.

[marcoslucianops]

@PaoXi is your board also Orin Nano?

[PaoXi]

Yes it's 16 Gb

[marcoslucianops]

Can someone send me the exported onnx file (from Orin Nano)?

[PaoXi]

There're two version, one exported using ultralytics API. other one directly with pytorch script

https://www.mediafire.com/file/edzascweikxrup9/yolov8s.pt.onnx/file
https://www.mediafire.com/file/5qxn3sxbqhym53q/yolov8sss.onnx/file

[PaoXi]

They're two version, one with ultralytics's API, and the other using directly pytorch

https://www.mediafire.com/file/edzascweikxrup9/yolov8s.pt.onnx/file
https://www.mediafire.com/file/5qxn3sxbqhym53q/yolov8sss.onnx/file

[lida2003]

@marcoslucianops I don't know exact model version, but I have downloaded here.

export from pt to onnx command:

$ yolo export model=yolov8s.pt format=onnx
$ yolo version
8.3.33

Attached below:

• yolov8s.pt
• yolov8s.onnx

[marcoslucianops]

@lida2003 you need to export with the utils/export_yoloV8.py. See the docs/YOLOv8.md.

[lida2003]

@marcoslucianops The result is the same (no bounding boxes), but I got the right way to generate onnx file, thanks.

PS: delete model_b1_gpu0_fp32.engine before run deepstream -c deep*.

• yolov8s.pt.onnx

[lida2003]

@marcoslucianops We are trying to reproduce the performance mentioned in the following link, which claims to achieve 181 FPS with INT8 precision on Jetson Orin NX. However, we are currently stuck on the bounding box selection issue. Any good suggestions?

EDIT: BTW, I did try wget https://github.com/ultralytics/assets/releases/download/v8.2.0/yolov8s.pt, the result is the same, no bounding box. I don't know what might be the issue or what can I do about it?

[marcoslucianops]

I didn't get detection with your models @lida2003 and @PaoXi, but I got detections exporting the model here (from ultralytics, using the export_yoloV8.py and with PyTorch 2.4). What is the PyTorch version you are using?

[lida2003]

@marcoslucianops

This PyTorch is from nvidia binary release

Python Environment:
Python 3.8.10
    GStreamer:                   YES (1.16.3)
  NVIDIA CUDA:                   YES (ver 11.4, CUFFT CUBLAS FAST_MATH)
        OpenCV version: 4.9.0  CUDA True
          YOLO version: 8.3.33
         Torch version: 2.1.0a0+41361538.nv23.06
   Torchvision version: 0.16.1+fdea156
DeepStream SDK version: 1.1.8

EDIT: This is the latest(maybe the last) binary release for Jetpack 5.1.4 (ubuntu20.04).

[marcoslucianops]

Can you try v2.0.0 and v1.14.0?

[lida2003]

Can you try v2.0.0 and v1.14.0?

No, on this board runing jetpack 5.1.3/5.1.4 there is only one release version torch-2.1.0a0+41361538.nv23.06-cp38-cp38-linux_aarch64.whl, which is in developer.download.nvidia.cn/compute/redist/jp/v512/pytorch/. Old versions(links) might be removed from their web server.

I will try to export in x86 env and to see if it helps, and get back to you soon.

Also I have made a request here: [REQUEST] build script for pytorch or up to date pytorh binary release supporting jetson boards running L4T35.6(ubuntu20.04)

[marcoslucianops]

I think the versions I said also works on 5.1.3/5.1.4. Can you try?

[lida2003]

@marcoslucianops Do you mean it might be related with PyTorch version?

• [NG] As I'm using 2.1 (from nvidia), I'm NOT sure what version @PaoXi was using.
• [OK] From previous talk, you were using 2.4 (Not sure GPU or CPU version).

We don't have other Pytorch GPU version for L4T35.6 except 2.1. So only possible version is CPU versions which might be v2.0.0 or v1.14.0, which you are refering.

So I'm going to use x86(ubuntu 22.04) latest version on laptop to export pt file if possible, which will not mess up the current jetson env(I did mess up the env just couple of weeks before).

EDIT: x86 donwloading torch-2.5.1-cp310-cp310-manylinux1_x86_64.whl, well, it's time consuming... :(

[marcoslucianops]

Please try:

• v2.0.0: https://nvidia.box.com/shared/static/i8pukc49h3lhak4kkn67tg9j4goqm0m7.whl
• v1.14.0: https://developer.download.nvidia.com/compute/redist/jp/v51/pytorch/torch-1.14.0a0+44dac51c.nv23.02-cp38-cp38-linux_aarch64.whl

Source: https://forums.developer.nvidia.com/t/pytorch-for-jetson/72048

[lida2003]

@marcoslucianops Do you mean it might be related with PyTorch version?

Well, don't have much time today. But ... ... It's great! It works using below exported onnx file to my jetson orin board.

          YOLO version: 8.3.50
         Torch version: 2.5.1+cu124
   Torchvision version: 0.20.1+cu124

$ python3 ./utils/export_yoloV8.py -w yolov8s.pt --dynamic

• yolov8s.pt.x86.onnx works pretty fine. And the speed is OK, stable at 30FPS (file:///opt/nvidia/deepstream/deepstream/samples/streams/sample_1080p_h265.mp4)

Note1: model_b1_gpu0_fp32.engine removed before using new onnx file.
Note2: Well, if needed I will try v2.0.0/v1.14.0 if I have time and get my current job done.

PS: The above test takes quite a lot of time for downloading python components.

---

EDIT: Should not use yolo command to export yolov8s.pt.yolo.onnx. It didn't work.

$ yolo export model=yolov8s.pt format=onnx
$ yolo version
8.3.50

[PaoXi]

Thanks, @lida2003 for your comment and for sharing this approach! This version works pretty fine for me as well. I'm grateful for your insights—it's been super helpful.

By the way, could you share more details about how you exported this ONNX version? I'm curious if there are specific steps or tweaks you used that made it work so well.

Also, just to share my setup, this ONNX file worked for me with the following PyTorch version:

• torch: 1.14.0a0+44dac51c.nv23.2
• torchvision: 0.14

Here’s my Jetson setup:

Model: NVIDIA Orin NX Developer Kit - Jetpack 5.1.2 [L4T 35.4.1]  
NV Power Mode[0]: MAXN  
Platform: Ubuntu 20.04 (focal)  
Kernel: 5.10.120-tegra  
Libraries:  
  - CUDA: 11.4.315  
  - cuDNN: 8.6.0.166  
  - TensorRT: 8.5.2.2  
  - VPI: 2.3.9  
  - Vulkan: 1.3.204  
  - OpenCV: 4.5.5 (with CUDA: YES)  

Looking forward to your thoughts!

[lida2003]

By the way, could you share more details about how you exported this ONNX version? I'm curious if there are specific steps or tweaks you used that made it work so well.

No special steps, just use 2.5.1 on x86 to export the onnx as guide said.

But I have found some issue related with BYTETrack here: #605. Not sure if it's related with onnx file.

@marcoslucianops Do you mean it might be related with PyTorch version?

* [NG] As I'm using 2.1 (from nvidia), I'm NOT sure what version @PaoXi was using.

* [OK] From previous talk, you were using 2.4 (Not sure GPU or CPU version).

• [OK] 2.5.1+cu124, x86 exported onnx file
• [OK] 1.14.0a0+44dac51c.nv23.2 , jetson Orin NX exported onnx file

@marcoslucianops we have the above results, what root cause might be?

I'm trying build jetson orin pytorch 2.5.1, still some issues now.