Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

invalid result in NVIDIA L4 (triton) #2657

Open
humblemh opened this issue Nov 18, 2024 · 0 comments
Open

invalid result in NVIDIA L4 (triton) #2657

humblemh opened this issue Nov 18, 2024 · 0 comments

Comments

@humblemh
Copy link

humblemh commented Nov 18, 2024

Describe the bug
My fp16 model in triton server is working in nvidia a6000, t4, p4000.
but the same model is not worked in nvidia l4. (same hw, os)
the recogniton result is empty or wrong text.

To Reproduce
Steps to reproduce the behavior:

  1. fp16 model loaded in triton server on nvidla l4

Expected behavior
recognition success

Desktop (please complete the following information):

  • OS: Ubuntu 22.04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant