When using google/gemma-3-27b-it, I've noticed I run into the error
google/gemma-3-27b-it
Input validation error: inputs tokens + max_new_tokens must be <= 4096. Given: 4182 inputs tokens and 0 max_new_tokens
inputs
max_new_tokens
After 3-4 messages. Should/can this be increased?
· Sign up or log in to comment