Add FORBIDDEN_TOKENS to Gemma4Tokenizer covering image + audio placeholders#649

dparikh79 wants to merge 1 commit into

google-deepmind:maingoogle-deepmind/gemma:mainfrom

dparikh79:fix/613-gemma4-tokenizer-forbidden-tokensdparikh79/gemma:fix/613-gemma4-tokenizer-forbidden-tokensCopy head branch name to clipboard