Records · kv:2610.00001v2

Sebeni morphotactic post-training on MULTI13: SFT, DPO, APO and GRPO arms with SmolLM2-135M

Sebastien Diarra

Submitted by Sebastien Diarra @s7d11

Published 2026-10-10

Official implementation · Research paper · Natural language processing

Code

Record PDF (86 KB)

Changes in version 2: Added the GRPO arm (r4), run with the same commit, settings and K-Veritas capture as the SFT, DPO and APO arms. One difference: GRPO evaluates the held-out split once, at step 500, instead of every 50 steps, because one evaluation takes about 3 hours on this GPU. Like the other arms, sebeni eval reports checkpoint_id baseline, so the test scores match the other arms.

Abstract

Three post-training arms of Sebeni, a morphotactic generation toolkit for extremely low-resource Manding languages, on the MULTI13 scope (13 languages). Each arm distils the grammar and dictionary, fine-tunes SmolLM2-135M with 4-bit LoRA for 500 steps on the packaged 300-sample dataset with a 10% held-out split, and scores the held-out test set (phi, MER, MCS, UWEC). Code: github.com/mlsftwrs/sebeni at commit 8e66775, with K-Veritas capture added to the CLI.

Sealed reports

SFT arm

Sealed 2026-10-05 · K-Veritas server

Data hash 1c1699a5bb61643823134d4b20b8cbf76989b4df4327e1bd9ed91816f2e2d177

DPO arm

Sealed 2026-10-05 · K-Veritas server

Data hash b2c776c815223b6b9677d4aa01595ece5ca4c79c02fde0bbdd361ba783e7b4d8

APO arm

Sealed 2026-10-05 · K-Veritas server

Data hash 3d35b38ed6fb3a13c0ac03d020b070894bb4f1d5469f322ef456aca5b4eff9a6

GRPO arm

Sealed 2026-10-10 · K-Veritas server

Data hash 5eb44231f05c570e8de7328f5ef563ac55d43fb33de1f5a9f1569e3edf0bb93f

Cite this record

@misc{kveritas261000001v2,
  title={Sebeni morphotactic post-training on MULTI13: SFT, DPO, APO and GRPO arms with SmolLM2-135M},
  author={Sebastien Diarra},
  year={2026},
  howpublished={K-Veritas Records},
  note={kv:2610.00001v2},
  url={https://kveritas.org/records/2610.00001v2},
}

Versions

References

  1. [1] Mamadou K. Keita and Christopher Homan. Computer Science Conferences Should Require Nonrepudiable Experimental Results. NeurIPS 2026 Position Paper Track. arXiv:2605.08586.

Sealed with K-Veritas [1]. Listed, not endorsed. A record shows these results came from the sealed code, unchanged. Whether the work is sound is for the reader to judge.