Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

TrtBackend::LoadTrtCache加载tensorrt模型时报错 #2544

Open
aidenyao opened this issue Oct 31, 2024 · 0 comments
Open

TrtBackend::LoadTrtCache加载tensorrt模型时报错 #2544

aidenyao opened this issue Oct 31, 2024 · 0 comments
Assignees

Comments

@aidenyao
Copy link

aidenyao commented Oct 31, 2024


温馨提示:根据社区不完全统计,按照模板提问,可以加快回复和解决问题的速度


环境

  • 【FastDeploy版本】: develop
  • 【编译命令】如果您是自行编译的FastDeploy,请说明您的编译方式(参数命令)
  • cmake .. -DENABLE_ORT_BACKEND=ON
    -DENABLE_PADDLE_BACKEND=OFF
    -DENABLE_OPENVINO_BACKEND=OFF
    -DENABLE_TRT_BACKEND=ON
    -DCMAKE_BUILD_TYPE=DEBUG
    -DWITH_GPU=ON
    -DCUDA_DIRECTORY=/usr/local/cuda
    -DCMAKE_INSTALL_PREFIX=/usr/local/
    -DENABLE_VISION=ON
    -DENABLE_TEXT=ON
    -DBUILD_EXAMPLES=ON
    -DTRT_DIRECTORY=${PWD}/../../thirdlibs-x86/tensorrt/TensorRT-8.6.1.6
    -DOPENCV_DIRECTORY=/usr/local/share/OpenCV/
    -DOPENVINO_DIRECTORY=${PWD}/../../thirdlibs-x86/openvino
  • 【系统平台】: Linux x64(Ubuntu 18.04)
  • 【硬件】:
  • nvidia 2060,
  • NVIDIA-SMI 530.30.02 Driver Version: 530.30.02 CUDA Version: 11.1
  • TensorRT-8.6.1.6
  • 【编译语言】: C++ ,python3.7

问题日志及出现问题的操作流程

模型转换参数
~/tensorrt/TensorRT-8.6.1.6/bin/trtexec
--onnx=fusionmodel_final_inNHWC-float32-255_outNHWC-float32-1.onnx
--saveEngine=x86/fusionmodel_final_inNHWC-float32-255_outNHWC-float32-1.trt
--sparsity=enable
--noTF32
--fp16
--int8
--skipInference
--minShapes=img_vis:1x100x100x3,img_ir:1x100x100x1
--optShapes=img_vis:1x480x640x3,img_ir:1x480x640x1
--maxShapes=img_vis:1x480x640x3,img_ir:1x480x640x1
--builderOptimizationLevel=0

加载tensorrt模型时报错:
Screenshot from 2024-10-31 15-31-35
Screenshot from 2024-10-31 15-31-12
Screenshot from 2024-10-31 15-29-48

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants