Skip to content

fix: Average MoE expert K-FAC covariances over their routed positions - #565

Open
flyingdoubleG wants to merge 1 commit into
EleutherAI:mainfrom
flyingdoubleG:fix/moe-kfac-per-module-count
Open

fix: Average MoE expert K-FAC covariances over their routed positions#565
flyingdoubleG wants to merge 1 commit into
EleutherAI:mainfrom
flyingdoubleG:fix/moe-kfac-per-module-count

fix: Average MoE expert K-FAC covariances over their routed positions

e965374
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 warning and 1 notice
test
succeeded Oct 24, 2026 in 9m 10s