Skip to content

MGE-PO: Entropy-Aware Credit Assignment for Mathematical Reasoning

Save

In brief

  1. MGE-PO adjusts rewards using generation entropy and response correctness.
  2. The method improves performance by 3.23 to 11.06 points across tested benchmarks.
  3. Tested on Qwen3-8B and Qwen2.5-7B, with notable gains after 8 training epochs.

A new method, MGE-PO, enhances reward attribution in training mathematical reasoning models. It combines correctness verification and generation entropy to adjust bonuses and penalties. Results show significant gains across multiple benchmarks after 8 training epochs.

This summary gives you the essentials. The full article, its figures and quotes are on cs.AI updates on arXiv.org.

Read the original article

AI-generated summary of the source, checked by rules. Report an error

Cookies and privacy

BrefAI only uses strictly necessary storage (language, theme, this choice). With your consent, we also measure traffic anonymously, without cookies, to improve the site. Learn more