Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

JSON mode support #433

Open
you-n-g opened this issue Oct 15, 2024 · 3 comments
Open

JSON mode support #433

you-n-g opened this issue Oct 15, 2024 · 3 comments
Labels
enhancement New feature or request

Comments

@you-n-g
Copy link
Contributor

you-n-g commented Oct 15, 2024

🌟 Feature Description

Currently, the RD-Agent workflow relies heavily on JSON mode to simplify implementation.

However, many LLMs do not natively support the JSON model.

RD-Agent should offer a fallback solution, even though it might result in a higher error rate.

A very naive proposal

  • The json mode should be transparent and make the interface consistant with current design.
  • It may internelly add some prompts like "you should return only in json format as described in previous content."
  • Do necessary post processing like strip ```` fence
@you-n-g you-n-g added the enhancement New feature or request label Oct 15, 2024
@you-n-g
Copy link
Contributor Author

you-n-g commented Oct 15, 2024

#419 is related

@frinkleko
Copy link
Contributor

There are also some related tools for json repair in the output of LLM, such as this repo.

@NAMEKDSUN
Copy link

Whether this package is useful for the project?https://github.com/dottxt-ai/outlines

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants