Commit Graph

2 Commits

Author SHA1 Message Date
marauder-actual 934be8ce48 fix: load tokenizer from base repo for quant venv compat
Merged model has tokenizer_class=TokenizersBackend (transformers 5.x)
which is unknown to transformers 4.57.6 in the quant venv.
2026-06-01 04:16:32 +02:00
marauder-actual 0fa46c9fed add AWQ quantization script (llm-compressor) 2026-06-01 04:15:15 +02:00