登录/ 注册
 找回密码
 立即注册
关闭

CSDN热搜

程序园 精品问答 技术交流 资源下载
返回列表 发新帖
首页 › 业界区 › 业界 ›玩客云 OEC/OECT 笔记(2) 运行RKNN程序

玩客云 OEC/OECT 笔记(2) 运行RKNN程序

堠秉 前天 20:11
目录


  • 玩客云 OEC/OECT 笔记(1) 拆机刷入Armbian固件
  • 玩客云 OEC/OECT 笔记(2) 运行RKNN程序
RKNN

OEC/OEC-Turbo 使用的芯片是 RK3566/RK3568, 这个系列是内建神经网络处理器 NPU 的, 利用 RKNN 可以部署运行 AI 模型利用 NPU 硬件加速模型推理. 要使用 NPU, 首先需要在电脑使用 RKNN-Toolkit2 将训练好的模型转换为 RKNN 格式的模型, 然后在传到 OEC/OEC-Turbo盒子上使用 RKNN C API 或 Python API进行推断.
涉及的工具有:

  • RKNN-Toolkit2 是一个软件开发工具包, 供用户在 PC 和 Rockchip NPU 平台上执行模型转换、推断和性能评估
  • RKNN-Toolkit-Lite2 为 Rockchip NPU 平台提供了 Python 编程接口, 帮助用户部署 RKNN 模型并加速实施 AI 应用
  • RKNN Runtime 为 Rockchip NPU 平台提供了 C/C++ 编程接口, 帮助用户部署 RKNN 模型并加速实施 AI 应用
  • RKNPU 内核驱动负责与 NPU 硬件交互
RKNN-Toolkit2 和 RKNN-Toolkit-Lite2 都在同一个GitHub仓库 https://github.com/airockchip/rknn-toolkit2
下面以 RKNN-Toolkit2 自带的 rknpu2 示例项目为例, 说明如何编译并在 OEC/OEC-Turbo 上运行 RKNN 项目.
准备GCC工具链

注意: 刷机的固件系统自带的 glibc 版本是 GLIBC_2.36, 因此对应的 gcc 版本最高到 12.2. 如果用 gcc 12.3 编译, 产生的二进制在板子上执行会报"/lib/aarch64-linux-gnu/libc.so.6: version `GLIBC_2.38' not found" 这样的错误.
从 https://developer.arm.com/downloads/-/arm-gnu-toolchain-downloads 下载 gcc 12.2版本工具链.
Arm GCC 12.2系列的最后一个版本 12.2.MPACBTI-Rel1 没有支持 host 为 Linux X86-64 的工具链, 支持 Linux X86-64 的最后一个版本是 12.2.Rel1, 需要下载这个版本,
在 x86_64 Linux hosted cross toolchains 下面找到 arm-gnu-toolchain-12.2.rel1-x86_64-aarch64-none-linux-gnu.tar.xz, 注意不是 elf, 也不是 big-endian, 不要下错了.
下载之后解压, 并移动到 /opt/gcc-arm/ 备用
准备 rknn-toolkit2

从GitHub导出 airockchip/rknn-toolkit2
  1. git clone https://github.com/airockchip/rknn-toolkit2.git
复制代码
这个仓库有2个多GB, 需要耐心等待导出完成.
注意: 导出的文件中存在一处链接错误, 需要手动修复一下, 不然后面编译rknn程序的时候会报错. 到 rknpu2/examples/3rdparty/mpp/Linux/aarch64 目录下
  1. rknn-toolkit2/rknpu2/examples/3rdparty/mpp/Linux/aarch64$ ll
  2. total 2268
  3. lrwxrwxrwx 1 milton milton       8 Jun  2 20:38 librockchip_mpp.so -> ''$'\177''ELF'$'\002\001\001\003'
  4. -rw-rw-r-- 1 milton milton 2321616 Jun  2 20:38 librockchip_mpp.so.0
  5. lrwxrwxrwx 1 milton milton       8 Jun  2 20:38 librockchip_mpp.so.1 -> ''$'\177''ELF'$'\002\001\001\003'
复制代码
删除这两个软链, 同时将 librockchip_mpp.so.0 复制为 librockchip_mpp.so 和 librockchip_mpp.so.1. 不用软链, 是因为使用软链的话, 传输到盒子的时候会出错.
  1. $ rm librockchip_mpp.so
  2. $ rm librockchip_mpp.so.1
  3. $ cp librockchip_mpp.so.0 librockchip_mpp.so
  4. $ cp librockchip_mpp.so.0 librockchip_mpp.so.1
复制代码
编译示例代码 rknn_yolov5_demo

到 rknpu2/examples/rknn_yolov5_demo 目录下, 先将两个sh文件设为可执行
  1. $ chmod +x *.sh
复制代码
执行编译, 将下面的/opt/gcc-arm/arm-gnu-toolchain-12.2.rel1-x86_64-aarch64-none-linux-gnu/bin/aarch64-none-linux-gnu换成你刚才解压的gcc路径以及文件前缀
  1. GCC_COMPILER=/opt/gcc-arm/arm-gnu-toolchain-12.2.rel1-x86_64-aarch64-none-linux-gnu/bin/aarch64-none-linux-gnu ./build-linux.sh -t rk3566 -a aarch64 -b Release
复制代码
编译输出
  1. ./build-linux.sh -t rk3566 -a aarch64 -b Release
  2. /opt/gcc-arm/arm-gnu-toolchain-12.2.rel1-x86_64-aarch64-none-linux-gnu/bin/aarch64-none-linux-gnu
  3. ===================================
  4. TARGET_SOC=RK3566_RK3568
  5. TARGET_ARCH=aarch64
  6. BUILD_TYPE=Release
  7. BUILD_DIR=/home/milton/WorkLR3576/rknn-toolkit2/rknpu2/examples/rknn_yolov5_demo/build/build_RK3566_RK3568_linux_aarch64_Release
  8. CC=/opt/gcc-arm/arm-gnu-toolchain-12.2.rel1-x86_64-aarch64-none-linux-gnu/bin/aarch64-none-linux-gnu-gcc
  9. CXX=/opt/gcc-arm/arm-gnu-toolchain-12.2.rel1-x86_64-aarch64-none-linux-gnu/bin/aarch64-none-linux-gnu-g++
  10. ===================================
  11. -- Configuring done (0.0s)
  12. -- Generating done (0.0s)
  13. -- Build files have been written to: /home/milton/WorkLR3576/rknn-toolkit2/rknpu2/examples/rknn_yolov5_demo/build/build_RK3566_RK3568_linux_aarch64_Release
  14. [ 10%] Linking CXX executable rknn_yolov5_video_demo
  15. [ 50%] Built target rknn_yolov5_demo
  16. [100%] Built target rknn_yolov5_video_demo
  17. [ 40%] Built target rknn_yolov5_demo
  18. [100%] Built target rknn_yolov5_video_demo
  19. Install the project...
  20. -- Install configuration: "Release"
  21. -- Installing: /home/milton/WorkLR3576/rknn-toolkit2/rknpu2/examples/rknn_yolov5_demo/install/rknn_yolov5_demo_Linux/./rknn_yolov5_demo
  22. -- Installing: /home/milton/WorkLR3576/rknn-toolkit2/rknpu2/examples/rknn_yolov5_demo/install/rknn_yolov5_demo_Linux/lib/librknnrt.so
  23. -- Installing: /home/milton/WorkLR3576/rknn-toolkit2/rknpu2/examples/rknn_yolov5_demo/install/rknn_yolov5_demo_Linux/lib/librga.so
  24. -- Installing: /home/milton/WorkLR3576/rknn-toolkit2/rknpu2/examples/rknn_yolov5_demo/install/rknn_yolov5_demo_Linux/./model/RK3566_RK3568
  25. -- Installing: /home/milton/WorkLR3576/rknn-toolkit2/rknpu2/examples/rknn_yolov5_demo/install/rknn_yolov5_demo_Linux/./model/RK3566_RK3568/yolov5s-640-640.rknn
  26. -- Installing: /home/milton/WorkLR3576/rknn-toolkit2/rknpu2/examples/rknn_yolov5_demo/install/rknn_yolov5_demo_Linux/./model/bus.jpg
  27. -- Installing: /home/milton/WorkLR3576/rknn-toolkit2/rknpu2/examples/rknn_yolov5_demo/install/rknn_yolov5_demo_Linux/./model/coco_80_labels_list.txt
  28. -- Installing: /home/milton/WorkLR3576/rknn-toolkit2/rknpu2/examples/rknn_yolov5_demo/install/rknn_yolov5_demo_Linux/./rknn_yolov5_video_demo
  29. -- Installing: /home/milton/WorkLR3576/rknn-toolkit2/rknpu2/examples/rknn_yolov5_demo/install/rknn_yolov5_demo_Linux/lib/librockchip_mpp.so
  30. -- Installing: /home/milton/WorkLR3576/rknn-toolkit2/rknpu2/examples/rknn_yolov5_demo/install/rknn_yolov5_demo_Linux/lib/libmk_api.so
复制代码
编译产生的文件在 install 目录下
  1. └── rknn_yolov5_demo_Linux
  2.     ├── lib
  3.     │   ├── libmk_api.so
  4.     │   ├── librga.so
  5.     │   ├── librknnrt.so
  6.     │   └── librockchip_mpp.so
  7.     ├── model
  8.     │   ├── bus.jpg
  9.     │   ├── coco_80_labels_list.txt
  10.     │   └── RK3566_RK3568
  11.     │       └── yolov5s-640-640.rknn
  12.     ├── rknn_yolov5_demo
  13.     └── rknn_yolov5_video_demo
复制代码
运行 rknn_yolov5_demo

将上面的 rknn_yolov5_demo_Linux 整个目录复制到 OEC/OEC-Turbo 文件系统里, 在 rknn_yolov5_demo_Linux 目录下执行以下命令
  1. LD_LIBRARY_PATH=./lib ./rknn_yolov5_demo model/RK3566_RK3568/yolov5s-640-640.rknn model/bus.jpg
复制代码
输出
  1. post process config: box_conf_threshold = 0.25, nms_threshold = 0.45
  2. Loading mode...
  3. sdk version: 2.3.2 (429f97ae6b@2025-04-09T09:09:27) driver version: 0.9.8
  4. model input num: 1, output num: 3
  5.   index=0, name=images, n_dims=4, dims=[1, 640, 640, 3], n_elems=1228800, size=1228800, w_stride = 640, size_with_stride=1228800, fmt=NHWC, type=INT8, qnt_type=AFFINE, zp=-128, scale=0.003922
  6.   index=0, name=output0, n_dims=4, dims=[1, 255, 80, 80], n_elems=1632000, size=1632000, w_stride = 0, size_with_stride=1638400, fmt=NCHW, type=INT8, qnt_type=AFFINE, zp=-128, scale=0.003922
  7.   index=1, name=286, n_dims=4, dims=[1, 255, 40, 40], n_elems=408000, size=408000, w_stride = 0, size_with_stride=409600, fmt=NCHW, type=INT8, qnt_type=AFFINE, zp=-128, scale=0.003922
  8.   index=2, name=288, n_dims=4, dims=[1, 255, 20, 20], n_elems=102000, size=102000, w_stride = 0, size_with_stride=122880, fmt=NCHW, type=INT8, qnt_type=AFFINE, zp=-128, scale=0.003922
  9. model is NHWC input fmt
  10. model input height=640, width=640, channel=3
  11. Read model/bus.jpg ...
  12. img width = 640, img height = 640
  13. once run use 55.863000 ms
  14. loadLabelName ./model/coco_80_labels_list.txt
  15. person @ (209 243 286 510) 0.879723
  16. person @ (479 238 560 526) 0.870588
  17. person @ (109 238 231 534) 0.839831
  18. bus @ (91 129 555 464) 0.692042
  19. person @ (79 353 121 517) 0.300961
  20. save detect result to ./out.jpg
  21. loop count = 10 , average run  48.848400 ms
复制代码
将产生的 out.jpg 传回本地电脑, 就能看到已经标记上识别结果
1.jpeg

编译和运行 rknn_benchmark

在 rknpu2/examples/rknn_benchmark 目录下, 编译命令和上面的示例是一样的, 编译完成后传输到 OEC/OEC-Turbo 后, 假定之前执行过 rknn_yolov5_demo 这个例子, 并且都在同一个目录下, 执行下面的命令
  1. LD_LIBRARY_PATH=./lib ./rknn_benchmark ../rknn_yolov5_demo_Linux/model/RK3566_RK3568/yolov5s-640-640.rknn ../rknn_yolov5_demo_Linux/model/bus.jpg
复制代码
输出
  1. rknn_api/rknnrt version: 2.0.0b0 (35a6907d79@2024-03-24T10:31:14), driver version: 0.9.8
  2. total weight size: 7299584, total internal size: 10585600
  3. total dma used size: 26521600
  4. model input num: 1, output num: 3
  5. input tensors:
  6.   index=0, name=images, n_dims=4, dims=[1, 640, 640, 3], n_elems=1228800, size=1228800, w_stride = 640, size_with_stride=1228800, fmt=NHWC, type=INT8, qnt_type=AFFINE, zp=-128, scale=0.003922
  7. output tensors:
  8.   index=0, name=output0, n_dims=4, dims=[1, 255, 80, 80], n_elems=1632000, size=1632000, w_stride = 0, size_with_stride=1638400, fmt=NCHW, type=INT8, qnt_type=AFFINE, zp=-128, scale=0.003922
  9.   index=1, name=286, n_dims=4, dims=[1, 255, 40, 40], n_elems=408000, size=408000, w_stride = 0, size_with_stride=409600, fmt=NCHW, type=INT8, qnt_type=AFFINE, zp=-128, scale=0.003922
  10.   index=2, name=288, n_dims=4, dims=[1, 255, 20, 20], n_elems=102000, size=102000, w_stride = 0, size_with_stride=122880, fmt=NCHW, type=INT8, qnt_type=AFFINE, zp=-128, scale=0.003922
  11. custom string:
  12. Warmup ...
  13.    0: Elapse Time = 40.69ms, FPS = 24.57
  14.    1: Elapse Time = 40.19ms, FPS = 24.88
  15.    2: Elapse Time = 40.11ms, FPS = 24.93
  16.    3: Elapse Time = 40.19ms, FPS = 24.88
  17.    4: Elapse Time = 40.74ms, FPS = 24.54
  18. Begin perf ...
  19.    0: Elapse Time = 41.03ms, FPS = 24.37
  20.    1: Elapse Time = 41.12ms, FPS = 24.32
  21.    2: Elapse Time = 41.20ms, FPS = 24.27
  22.    3: Elapse Time = 41.17ms, FPS = 24.29
  23.    4: Elapse Time = 41.11ms, FPS = 24.32
  24.    5: Elapse Time = 41.17ms, FPS = 24.29
  25.    6: Elapse Time = 41.08ms, FPS = 24.34
  26.    7: Elapse Time = 41.09ms, FPS = 24.34
  27.    8: Elapse Time = 41.25ms, FPS = 24.24
  28.    9: Elapse Time = 41.10ms, FPS = 24.33
  30. Avg Time 41.13ms, Avg FPS = 24.312
  32. Save output to rt_output0.npy
  33. Save output to rt_output1.npy
  34. Save output to rt_output2.npy
  35. ---- Top5 ----
  36. 0.984299 - 17902
  37. 0.984299 - 1122607
  38. 0.984299 - 1122705
  39. 0.984299 - 1122706
  40. 0.984299 - 1122707
  41. ---- Top5 ----
  42. 0.999985 - 280992
  43. 0.996063 - 9032
  44. 0.996063 - 280970
  45. 0.996063 - 280993
  46. 0.996063 - 281010
  47. ---- Top5 ----
  48. 1.000000 - 36255
  49. 1.000000 - 36256
  50. 0.996078 - 2236
  51. 0.996078 - 2245
  52. 0.996078 - 2255
复制代码
来源：程序园用户自行投稿发布，如果侵权，请联系站长删除
免责声明：如果侵犯了您的权益，请联系站长，我们会及时删除侵权内容，谢谢合作！

使用道具 举报
相关推荐
B Color Image Link Quote Code Smilies
您需要登录后才可以回帖 登录 | 立即注册
发帖
堠秉
前天 20:11

0

粉丝关注

7

主题发布

板块介绍填写区域，请于后台编辑
微信扫一扫