Skip to content

context : remove logits_all flag #13284

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 2 commits into from
May 8, 2025
Merged

Conversation

ggerganov
Copy link
Member

@ggerganov ggerganov commented May 3, 2025

This flag has been deprecated for quite some time and in order to simplify the logic in llama_context it's better to remove it. To achieve the same functionality, set llama_batch::logits accordingly.

libllama API Changes

  • Remove logits_all flag
  • Move the bool flags at the end of the struct

Copy link
Member

@slaren slaren left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think it still needs to be removed from llama_context_params.

Base automatically changed from gg/examples-remove-infill to master May 7, 2025 07:28
@ggerganov
Copy link
Member Author

Removed the flag from llama_context_params and also moved the bools to the end of the struct. Will update the API changelog with this breaking change.

@ggerganov ggerganov added the breaking change Changes that break ABIs, APIs, file formats, or other forms of backwards compatibility. label May 8, 2025
@ggerganov ggerganov requested a review from slaren May 8, 2025 09:58
@ggerganov ggerganov force-pushed the gg/context-remove-logits-all branch from d4ddcac to 6107303 Compare May 8, 2025 10:02
@ggerganov ggerganov merged commit 51fb96b into master May 8, 2025
55 checks passed
Nexesenex added a commit to Nexesenex/croco.cpp that referenced this pull request May 9, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
breaking change Changes that break ABIs, APIs, file formats, or other forms of backwards compatibility. examples
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants