Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Store if a prompt tree element is included in the final renderer result #38

Open
hediet opened this issue May 27, 2024 · 0 comments
Open
Assignees

Comments

@hediet
Copy link
Member

hediet commented May 27, 2024

The prompt renderer materializes the prompt tree and computes the messages from it under consideration of the max prompt size and the prompt tree prioritization. For visualization purposes, it would be nice if the prompt tree elements would indicate if they are included in the final result or skipped. Otherwise, it is difficult to indicate in the tree visualization if a node made it after prioritization or not.

public async render(progress?: Progress<ChatResponsePart>, token?: CancellationToken): Promise<RenderPromptResult> {

Are you up for a PR on this?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants