GRPO training with minimal dependencies (and low GPU memory usage!). We implement almost everything from scratch and only depend on tokenizers for tokenization and pytorch for training. Group Relative ...
Currently in development. The goal is to have a clean and functional implementation from scratch.
Some results have been hidden because they may be inaccessible to you
Show inaccessible results