fix: adamw_8bit → adamw_torch — bitsandbytes has no cu132 binary
This commit is contained in:
+1
-1
@@ -151,7 +151,7 @@ trainer = SFTTrainer(
|
|||||||
save_steps=100,
|
save_steps=100,
|
||||||
save_total_limit=2,
|
save_total_limit=2,
|
||||||
warmup_ratio=WARMUP_RATIO,
|
warmup_ratio=WARMUP_RATIO,
|
||||||
optim="adamw_8bit",
|
optim="adamw_torch",
|
||||||
seed=42,
|
seed=42,
|
||||||
report_to="none",
|
report_to="none",
|
||||||
max_seq_length=MAX_SEQ,
|
max_seq_length=MAX_SEQ,
|
||||||
|
|||||||
Reference in New Issue
Block a user