Skip to content

v1.74.0

Compare
Choose a tag to compare
@pelikhan pelikhan released this 12 Nov 15:33
· 113 commits to main since this release

New Features

  • Enhanced Log Probability Handling: Introducing the ability to handle logprobs and responseTokens more efficiently. This update includes the addition of the topLogprobsToMarkdown function, allowing users to visualize token probabilities in a more informative way.

  • 🎉 Entropy and Perplexity Calculations: We've added robust entropy and perplexity computations to provide deeper insights into token generation confidence and model performance.

Improvements

  • 🛠️ CLI Enhancements: The CLI now supports a --top-logprobs option, enabling users to specify the number of top log probabilities to report, enhancing the granularity of token probability analysis.

Refactoring

  • ♻️ Entropy Logic Update: The entropy calculation logic has been refined for better accuracy and performance, ensuring users get the most precise data.

Visual Updates

  • 🎨 Color Tuning: Minor color adjustments have been made to improve the readability and visual appeal of probability gradients.

This release empowers users with more detailed insights into model predictions, offering advanced tools for analyzing token probabilities and model confidence. Enjoy exploring these new capabilities!