Issues

• Hub checkpoints of pythia-2.8b, 1b-deduped and 1.4b-deduped served the final model from April 2023 to February 2026; repair incomplete

  EleutherAI/pythia#207 · Filter by author TheMiddlePath opened on Oct 8, 2026

• pythia-12b: step50000 and step58000 serve the final checkpoint's first shard (embed_in + early layers)

  EleutherAI/pythia#206 · Filter by author starhopp3r opened on Aug 14, 2026

• pythia-2.8b: 86 of 154 step branches (incl. step0 and the entire early grid) serve final-era checkpoint content

  EleutherAI/pythia#205 · Filter by author starhopp3r opened on Aug 14, 2026

• pythia-160m-weight-seed{1,2} step>=1 checkpoints appear inconsistent with their own step0 initialization

  EleutherAI/pythia#203 · Filter by author shoyammishra opened on Jul 21, 2026
  1

• Three missing checkpoints: pythia-410m-seed9@step40000, pythia-410m-seed6@step88000, pythia-410m-seed2@step111000

  EleutherAI/pythia#202 · Filter by author gstoica27 opened on Jul 17, 2026

• question on overfitting

  EleutherAI/pythia#201 · Filter by author umer-wn opened on Jul 16, 2026

• Same weights between steps 0 and 2

  EleutherAI/pythia#198 · Filter by author sunwookim1214 opened on May 18, 2026

• Pythia-2.8B PT CheckPoints is same between steps 0 to steps 6300

  EleutherAI/pythia#195 · Filter by author HJXA opened on Mar 6, 2026
  3

• How does one obtain the loss for each model, size and checkpoint in the table in the main paper?

  EleutherAI/pythia#194 · Filter by author brando90 opened on Dec 9, 2025

• using madgraph to study processes at the EP collider with Pythia8 and Delphes enabled

  EleutherAI/pythia#192 · Filter by author lixinyang706 opened on Sep 26, 2025

• seed2 shuffle_idx.npy corrupted

  EleutherAI/pythia#190 · Filter by author efittschen opened on Jul 24, 2025
  1

• Shard hashes for EleutherAI/pile-deduped-pythia-preshuffled

  EleutherAI/pythia#183 · Filter by author pietrolesci opened on Mar 12, 2025

• torch.concat is supported when reproducing results with docker

  EleutherAI/pythia#178 · Filter by author pingzhili opened on Oct 20, 2024

• Pythia 160M is giving unreasonable logit values

  EleutherAI/pythia#177 · Filter by author danielmisrael opened on Oct 14, 2024
  2

• No EOD Tokens in EleutherAI/pile-deduped-pythia-preshuffled

  EleutherAI/pythia#175 · Filter by author markschoene opened on Oct 4, 2024
  2

• Questions regarding the WSC evaluation results

  EleutherAI/pythia#172 · Filter by author mutiann opened on Sep 20, 2024

• How to use the Huggingface dataset /EleutherAI/pythia-memorized-evals in predictable-memorization?

  EleutherAI/pythia#164 · Filter by author Happy2Git opened on Jun 6, 2024

• Convert to GGUF

  EleutherAI/pythia#159 · Filter by author yanxon opened on May 10, 2024
  1

• instruct-tuned pythia

  EleutherAI/pythia#155 · Filter by author WilliamsToTo opened on Mar 20, 2024

• Provide the shuffled index_mapping npy files for ease of reproducing training data

  EleutherAI/pythia#153 · Filter by author ziqi-zhang opened on Mar 14, 2024
  1

• Optimizer states in HF format

  EleutherAI/pythia#152 · Filter by author seyuboglu opened on Mar 7, 2024
  1

• Weird inconsistency in Tokenizer vocabulary

  EleutherAI/pythia#151 · Filter by author javirandor opened on Mar 4, 2024
  1

  

• Wrong files in eval?

  EleutherAI/pythia#139 · Filter by author borgr opened on Nov 28, 2023

• Reading data is slowly！

  EleutherAI/pythia#126 · Filter by author Lisennlp opened on Nov 2, 2023
  1