fix: resize detokenization buffer for long token pieces - #2388

fix: resize detokenization buffer for long token pieces#2388

grinder81 wants to merge 2 commits into

abetlen:mainabetlen/llama-cpp-python:mainfrom

grinder81:codex/fix-detokenize-buffergrinder81/llama-cpp-python:codex/fix-detokenize-bufferCopy head branch name to clipboard