All pull requests

Pull requests

• perf(multimodal): the Pillow-exact resample's intermediate rows are recycled through the thread's scratch pool

  multimodal
  #5268·hello-alexmcc opened Nov 6, 2026Collaborator·

  ·
  2

• fix(multimodal): the Phi-3 vision tiles take the reference's resize, normalize and global-view kernels

  multimodal
  #5267·hello-alexmcc opened Nov 6, 2026Collaborator·

  ·
  2

• perf(symphony): the stay's bookkeeping on shown text costs nothing once the text has begun

  symphony
  #5266·hello-alexmcc opened Nov 6, 2026Collaborator·

  ·
  1

• perf(multimodal): the Pillow-exact resample's passes run on AVX-512 VNNI byte dot products over three byte chunks of every tap

  multimodal
  #5265·hello-alexmcc opened Nov 6, 2026Collaborator·

  ·
  5

• test(policy): the decision bench runs any selection policy against a live load feed

  benchmarksmodel-gateway
  #5264·fanyang-real opened Nov 6, 2026Member·2 of 4 tasks·

  ·
  1

• docs(policy): the selection layer says what a selection policy sees

  model-gateway
  #5262·fanyang-real opened Nov 6, 2026Member·3 of 4 tasks·

  ·
  1

• fix(gateway): the in-flight sampler's tick sets smg_http_connections_active from the tracker's count

  model-gateway
  #5261·hello-alexmcc opened Nov 6, 2026Collaborator·

  ·
  4

• fix(policy): a model's policy entry leaves with its last worker

  model-gateway
  #5260·fanyang-real opened Nov 6, 2026Member·2 of 4 tasks·

  ·
  1

• fix(workflow): a gRPC worker's KV-event stream follows the policy that places it

  model-gateway
  #5259·fanyang-real opened Nov 6, 2026Member·2 of 4 tasks·

  ·
  1

• perf(multimodal): the LLaVA processors write their tensors and canvases once instead of zero-filling them

  multimodal
  #5258·hello-alexmcc opened Nov 6, 2026Collaborator·

  ·
  4

• perf(multimodal): the baseline example returns the wire to the buffer pool as the gateway does

  multimodal
  #5257·hello-alexmcc opened Nov 6, 2026Collaborator·

  ·
  7

• fix(multimodal): a spec declares a per-request media count only where its family has one

  grpcmodel-gatewaymultimodal
  #5253·hello-alexmcc opened Nov 6, 2026Collaborator·

  ·
  21

• perf(gateway): the liveness sweep and the readiness checkpoint read the worker snapshot instead of walking every shard of the map

  model-gatewaytests
  #5252·hello-alexmcc opened Nov 6, 2026Collaborator·

  ·
  4

• feat(tokenizer): a tekken.json vocabulary loads, ahead of the tokenizer.json beside it

  documentationgrpcmodel-gatewaytokenizer
  #5250·hello-alexmcc opened Nov 6, 2026Collaborator·

  ·
  11

• perf(multimodal): the LLaVA 1.5 resize computes the center crop's columns alone

  multimodal
  #5249·hello-alexmcc opened Nov 6, 2026Collaborator·

  ·
  7

• perf(tokenizer): the long piece tier keeps pieces up to 16 KiB

  tokenizer
  #5248·hello-alexmcc opened Nov 6, 2026Collaborator·

  ·
  6

• fix(multimodal): a LLaVA checkpoint with a Pixtral vision tower takes the Pixtral processor

  multimodal
  #5246·hello-alexmcc opened Nov 6, 2026Collaborator·

  ·
  20

• perf(gateway): a prompt encodes on the request's thread up to 16 KiB, where the encode outweighs its offload

  grpcmodel-gateway
  #5245·hello-alexmcc opened Nov 6, 2026Collaborator·

  ·
  16

• perf(multimodal): the AVX2 resample passes take four rows and two taps per step

  multimodaltests
  #5243·hello-alexmcc opened Nov 6, 2026Collaborator·

  ·
  8

• perf(tokenizer): a pair that is no merge is answered by a filter word, not a bucket line of the pair table

  tokenizer
  #5240·hello-alexmcc opened Nov 6, 2026Collaborator·

  ·
  11

• fix(multimodal): the MoonViT families resize through the reference's Pillow bicubic kernel

  multimodal
  #5234·hello-alexmcc opened Nov 6, 2026Collaborator·

  ·
  2

• fix(multimodal): the LLaVA processors resize and normalize as the reference processor does

  multimodal
  #5233·hello-alexmcc opened Nov 6, 2026Collaborator·

  ·
  14

• fix(mesh): run the policy steps for imported workers

  model-gateway
  #5227·slin1237 opened Nov 6, 2026Member·

  ·
  26

• perf(gateway): the completion stream packs the engine chunks ready at one poll into one frame

  grpcmodel-gatewaytests
  #5215·hello-alexmcc opened Nov 5, 2026Collaborator·

  ·
  37

• refactor(cache_aware): the tree resolves a mesh delta's hash itself and the policy's hash index goes away

  kv-indexmodel-gatewaypython-bindings
  #5211·hello-alexmcc opened Nov 5, 2026Collaborator·

  ·
  1

  29