Also onPaydays(Pay schedule)
This is a big one, as I haven't released since March. Whoops! Also my last release as maintainer, as today is my last day at Ai2. I'll miss you all. Added - Add minimax-m3 to PRICE_PER_MILLION_TOKENS in open_instruct/judge_utils.py for cost tracking on the latest MiniMax flagship model.
Notable changelog items: 1. Fixed a major but where ZeRO-2 was discarding gradients. 2. We now support training with a RLEnvironment abstraction, including code execution sandboxing. 3. The Olmo-core DPO is ready to go, with support for TP, packing, and torch.compile. This should be much faster than the previous HF implementation. 4.
We have made the following changes to open-instruct: Added - Added OLMo-core based DPO training script (). - Added SLURM scripts for OLMo SFT training with checkpoint resume support and configurable shuffle seed. - Added retry logic with exponential backoff to make_api_request for tool API calls (retries on timeouts, connection errors, 429, and 5xx).
Ships open-instruct as open source on GitHub.
Releasesby Glyph