Upgrade to Zod 4.5 and compile schemas by NathanColosimo · Pull Request #3902 · vercel/workflow

NathanColosimo · 2026-08-31T18:43:50Z

Description

Upgrade the workspace Zod catalog to 4.5.4 and use namespace imports from the zod package root.

Enable compilation on every supported SDK-owned Zod schema root across the World contract and the local, Postgres, Vercel, and testing packages. Compilation stays library-owned through z.compile(schema); the application-global zod/compile preload is not imported from published libraries.

Two schemas intentionally remain on the standard parser: the recursive JSON schema, which Zod 4.5 does not support compiling, and the generic paginated-response factory, whose item schema is caller-owned. Preserve the pre-4.4 parsing contract for omitted serialized payloads and no-page Vercel responses.

How did you test your changes?

pnpm build: 28/28 package tasks passed
pnpm typecheck: 43/43 tasks passed
Biome formatting/checks: passed with existing advisory warnings only
@workflow/core: 2,293 tests passed
@workflow/world: 168 tests passed
@workflow/world-local: 559 tests passed
@workflow/world-vercel: 573 tests passed
@workflow/world-testing: 16 tests passed
@workflow/ai: 184 tests passed, with 22 expected failures
@workflow/world-postgres source tests: 27/27 passed
Isolated Postgres addition conformance case: passed
Workflow bundle-boundary regression: 2/2 passed
Final local gated flow bundles: Next.js 1,559,808 B raw / 246,450 B gzip; Hono 1,521,938 B raw / 240,893 B gzip
Switching first-party namespace imports from zod/v4 to zod changes both gated bundles by 0 B; their shared graphs still include a transitive named-z import
Structured Codex autoreview: clean, zero actionable P0-P2 findings

One combined Postgres conformance run reached 195/196 before the shared server was left unavailable by the preceding noop recovery case. The affected addition case passes when isolated.

The bundle-size gate requires the allow-bundle-size-growth label to explicitly accept the Zod 4.5/compiler payload relative to main.

PR Checklist - Required to merge

📦 pnpm changeset was run to create a changelog for this PR
🔒 DCO sign-off passes
📝 Ping @vercel/workflow in a comment once the PR is ready, and the above checklist is complete

Signed-off-by: Nathan Colosimo <110621881+NathanColosimo@users.noreply.github.com>

changeset-bot · 2026-08-31T18:43:55Z

🦋 Changeset detected

Latest commit: d2ed96a

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 21 packages

Name	Type
@workflow/ai	Patch
@workflow/cli	Patch
@workflow/core	Patch
@workflow/world	Patch
@workflow/world-local	Patch
@workflow/world-postgres	Patch
@workflow/world-testing	Patch
@workflow/world-vercel	Patch
workflow	Patch
@workflow/builders	Patch
@workflow/next	Patch
@workflow/nitro	Patch
@workflow/vitest	Patch
@workflow/web-shared	Patch
@workflow/web	Patch
@workflow/astro	Patch
@workflow/nest	Patch
@workflow/rollup	Patch
@workflow/sveltekit	Patch
@workflow/vite	Patch
@workflow/nuxt	Patch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

vercel · 2026-08-31T18:43:58Z

The latest updates on your projects. Learn more about Vercel for GitHub.

Project	Deployment	Actions	Updated
example-nextjs-workflow-turbopack	Ready	Preview, v0	Sep 1, 2026 12:35am UTC
example-nextjs-workflow-webpack	Ready	Preview, v0	Sep 1, 2026 12:35am UTC
example-workflow	Ready	Preview, v0	Sep 1, 2026 12:35am UTC
workbench-astro-workflow	Ready	Preview, v0	Sep 1, 2026 12:35am UTC
workbench-express-workflow	Ready	Preview, v0	Sep 1, 2026 12:35am UTC
workbench-fastify-workflow	Ready	Preview, v0	Sep 1, 2026 12:35am UTC
workbench-hono-workflow	Ready	Preview, v0	Sep 1, 2026 12:35am UTC
workbench-nestjs-workflow	Ready	Preview, v0	Sep 1, 2026 12:35am UTC
workbench-nitro-workflow	Ready	Preview, v0	Sep 1, 2026 12:35am UTC
workbench-nuxt-workflow	Ready	Preview, v0	Sep 1, 2026 12:35am UTC
workbench-python-workflow	Ready	Preview, v0	Sep 1, 2026 12:35am UTC
workbench-sveltekit-workflow	Ready	Preview, v0	Sep 1, 2026 12:35am UTC
workbench-tanstack-start-workflow	Ready	Preview, v0	Sep 1, 2026 12:35am UTC
workbench-vite-workflow	Ready	Preview, v0	Sep 1, 2026 12:35am UTC
workflow-swc-playground	Ready	Preview, v0	Sep 1, 2026 12:35am UTC
workflow-tarballs	Ready	Preview, v0	Sep 1, 2026 12:35am UTC
workflow-web	Ready	Preview, v0	Sep 1, 2026 12:35am UTC

1 Skipped Deployment

Project	Deployment	Actions	Updated
workflow-docs	Skipped	v0	Sep 1, 2026 12:35am UTC

github-actions · 2026-08-31T18:44:09Z

🧪 E2E Test Results

❌ Some tests failed

❌ Failed E2E Tests

▲ Vercel Production (8 failed)

python-node (8 failed):

promiseAllWorkflow | wrun_41M1D68SF40GS1VJ8MKDH9AF5Z | 🔍 observability
sleepingWorkflow | wrun_41M1D69E570GKKE1F5GR9MPM47 | 🔍 observability
parallelSleepWorkflow | wrun_41M1D69E8C0GTZ4VFGEMVT95CN | 🔍 observability
nullByteWorkflow | wrun_41M1D69MHY0GNGWJN9MWT3GHKY | 🔍 observability
cancelRun - cancelling a running workflow | wrun_41M1D6E2FE0GZPVK6Z0AYHV000 | 🔍 observability
cancelRun via CLI - cancelling a running workflow | wrun_41M1D6E2M70GK8Y80EXG6QN6AT | 🔍 observability
sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration | wrun_41M1D6EF9W0GN1M7NGD0TVKPNS | 🔍 observability
resilient start: addTenWorkflow completes when run_created returns 500 | wrun_41M1D6F0MS0GQ1794NZFCPHQS4 | 🔍 observability

🌐 Cross-language Conformance (9 failed)

python (9 failed):

deploymentId: 'latest' is a no-op in non-Vercel worlds | wrun_01M1D6CSSRMK2BEFARVJX17DVW
promiseAllWorkflow | wrun_41M1D68SF40GS1VJ8MKDH9AF5Z
sleepingWorkflow | wrun_41M1D69E570GKKE1F5GR9MPM47
parallelSleepWorkflow | wrun_41M1D69E8C0GTZ4VFGEMVT95CN
nullByteWorkflow | wrun_41M1D69MHY0GNGWJN9MWT3GHKY
cancelRun - cancelling a running workflow | wrun_41M1D6E2FE0GZPVK6Z0AYHV000
cancelRun via CLI - cancelling a running workflow | wrun_41M1D6E2M70GK8Y80EXG6QN6AT
sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration | wrun_41M1D6EF9W0GN1M7NGD0TVKPNS
resilient start: addTenWorkflow completes when run_created returns 500 | wrun_41M1D6F0MS0GQ1794NZFCPHQS4

⚠️ Flaky E2E Tests (passed on retry)

These tests failed at least once and passed on a retry. A recurring entry here is a real race worth investigating.

cancelRun via CLI - cancelling a running workflow (astro)
cancelRun via CLI - cancelling a running workflow (fastify)
cancelRun via CLI - cancelling a running workflow (hono)
cancelRun via CLI - cancelling a running workflow (nextjs-turbopack)
cancelRun via CLI - cancelling a running workflow (nextjs-webpack)
cancelRun via CLI - cancelling a running workflow (sveltekit)

🛠 Infra Events (absorbed by the harness)

Platform anomalies the e2e harness detected and worked around (e.g. a run the queue never picked up, replaced by a fresh run). Clustered timestamps indicate a backend blip; a steady drip indicates a platform issue worth escalating.

34 infra events

cold-start-warmup · suite warmup (astro) · at 00:35:03Z · abandoned wrun_01M1D67JWPM3EPJJ353KGMBGNE
cold-start-warmup · suite warmup (python) · at 00:35:29Z · abandoned wrun_41M1D659390GS59THZEYAGSZ8J · (+7 more)
cold-start-warmup · suite warmup (tanstack-start) · at 00:35:42Z · abandoned wrun_01M1D68GT082YVHAV546XC7ENV
run-pickup-stall · sleepingWorkflow (python) · at 00:35:45Z · abandoned wrun_41M1D68Y4H0GJBBETFTG0EQ61Y
run-pickup-stall · parallelSleepWorkflow (python) · at 00:35:45Z · abandoned wrun_41M1D68Y4H0GJBBETFTG0EQ61Z
run-pickup-stall · promiseAllWorkflow (python) · at 00:35:45Z · abandoned wrun_41M1D68Y4B0GZ9TVAZTZ48MN58
run-pickup-stall · nullByteWorkflow (python) · at 00:35:45Z · abandoned wrun_41M1D68Y4N0GM1BH3C5MVNPPDG
run-pickup-stall · cancelRun - cancelling a running workflow (python) · at 00:35:45Z · abandoned wrun_41M1D68YK00GJ4HC4VVJHK2RW8
run-pickup-stall · cancelRun - cancelling a running workflow (python) · at 00:36:18Z · abandoned wrun_41M1D69YBF0GMSRNCP57N3ACMD
cold-start-warmup · suite warmup (python) · at 00:36:20Z · abandoned wrun_01M1D66VBYMFYPMYQAQRTCG5Y9 · (+7 more)
run-pickup-stall · deploymentId: 'latest' is a no-op in non-Vercel worlds (python) · at 00:36:35Z · abandoned wrun_01M1D6AGGPP8RFGDVMSDJN4YHE
run-pickup-stall · sleepingWorkflow (python) · at 00:36:35Z · abandoned wrun_01M1D6AGGXA5QPT5CX5KVFM6K4
run-pickup-stall · parallelSleepWorkflow (python) · at 00:36:35Z · abandoned wrun_01M1D6AGGZ2WMPQ4NA1FW028AV
run-pickup-stall · promiseAllWorkflow (python) · at 00:36:35Z · abandoned wrun_01M1D6AGGQXJ2S3A864EYXT3HZ
run-pickup-stall · nullByteWorkflow (python) · at 00:36:35Z · abandoned wrun_01M1D6AGH12XR37XJ04SVSAMVF
run-pickup-stall · parallelSleepWorkflow (python) · at 00:36:46Z · abandoned wrun_41M1D6ASPT0GH6367G2HSBMY95
run-pickup-stall · nullByteWorkflow (python) · at 00:36:46Z · abandoned wrun_41M1D6ASQN0GVR98DG89YPMQSZ
run-pickup-stall · promiseAllWorkflow (python) · at 00:36:46Z · abandoned wrun_41M1D6ASPB0GHMMZKN9K95J20N
run-pickup-stall · sleepingWorkflow (python) · at 00:36:46Z · abandoned wrun_41M1D6ASQX0GZ6QQGD1DRZCDJE
run-pickup-stall · hookWithSleepFinalStepWorkflow - step only on final payload (nuxt) · at 00:37:00Z · abandoned wrun_01M1D6B8RSA8ZWEE50EZ9MYDPK
run-pickup-stall · promiseAllWorkflow (python) · at 00:37:35Z · abandoned wrun_01M1D6CB4GFVQ2SB4FWK4Z04T8
run-pickup-stall · sleepingWorkflow (python) · at 00:37:35Z · abandoned wrun_01M1D6CB4JBDY5R49D9JE3ZTB0
run-pickup-stall · deploymentId: 'latest' is a no-op in non-Vercel worlds (python) · at 00:37:35Z · abandoned wrun_01M1D6CB4FH4V4T7TT017MG1C3
run-pickup-stall · parallelSleepWorkflow (python) · at 00:37:35Z · abandoned wrun_01M1D6CB4PAQ8PEPB3EF2Z97AA
run-pickup-stall · nullByteWorkflow (python) · at 00:37:35Z · abandoned wrun_01M1D6CB4R3BN7NK64BTS9NA8K
run-pickup-stall · cancelRun via CLI - cancelling a running workflow (python) · at 00:37:36Z · abandoned wrun_41M1D6AXXG0GXKYACGKBD6AHSE
run-pickup-stall · cancelRun - cancelling a running workflow (python) · at 00:38:35Z · abandoned wrun_01M1D6E5R6YY97GAB1622PEHFD
run-pickup-stall · sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration (python) · at 00:38:35Z · abandoned wrun_01M1D6E5RJFP8N0PYYR05C0JFK
run-pickup-stall · cancelRun via CLI - cancelling a running workflow (python) · at 00:38:35Z · abandoned wrun_01M1D6E5RCFSXNGV230HK7TZXH
run-pickup-stall · cancelRun - cancelling a running workflow (python) · at 00:39:05Z · abandoned wrun_01M1D6F346WGHFQK91BY9DAYA2
run-pickup-stall · cancelRun via CLI - cancelling a running workflow (python) · at 00:39:05Z · abandoned wrun_01M1D6F347PSY07ZB70D6R6DTC
run-pickup-stall · sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration (python) · at 00:39:17Z · abandoned wrun_41M1D6DHJW0GMTT503J1AGQKP5
run-pickup-stall · cancelRun via CLI - cancelling a running workflow (python) · at 00:39:18Z · abandoned wrun_41M1D6DNT10GWA87YQ7N93F6NW
run-pickup-stall · sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration (python) · at 00:39:35Z · abandoned wrun_01M1D6G0BPHFH91GX5YE4X946F

E2E Test Summary

Summary

	Passed	Failed	Skipped	Total
❌ ▲ Vercel Production	3570	8	742	4320
✅ 💻 Local Development	3922	0	558	4480
✅ 📦 Local Production	3922	0	558	4480
✅ 🐘 Local Postgres	3922	0	558	4480
✅ 🪟 Windows	320	0	0	320
❌ 🌐 Cross-language Conformance	0	9	132	141
✅ vercel-http-transport	817	0	143	960
✅ vercel-multi-region	27	0	0	27
✅ vercel-ws-transport	553	0	87	640
Total	17053	17	2778	19848

Details by Category

❌ ▲ Vercel Production

App	Passed	Failed	Skipped
✅ astro-node	132	0	28
✅ astro-quickjs	132	0	28
✅ example-node	132	0	28
✅ example-quickjs	132	0	28
✅ express-node	132	0	28
✅ express-quickjs	132	0	28
✅ fastify-node	132	0	28
✅ fastify-quickjs	132	0	28
✅ hono-node	132	0	28
✅ hono-quickjs	132	0	28
✅ nest-node	132	0	28
✅ nest-quickjs	132	0	28
✅ nextjs-turbopack-node	157	0	3
✅ nextjs-turbopack-quickjs	157	0	3
✅ nextjs-webpack-node	157	0	3
✅ nextjs-webpack-quickjs	157	0	3
✅ nitro-node	132	0	28
✅ nitro-quickjs	132	0	28
✅ nuxt-node	132	0	28
✅ nuxt-quickjs	132	0	28
❌ python-node	0	8	152
✅ sveltekit-node	151	0	9
✅ sveltekit-quickjs	151	0	9
✅ tanstack-start-node	132	0	28
✅ tanstack-start-quickjs	132	0	28
✅ vite-node	132	0	28
✅ vite-quickjs	132	0	28

✅ 💻 Local Development

App	Passed	Skipped
✅ astro-stable-node	134	26
✅ astro-stable-quickjs	134	26
✅ express-stable-node	134	26
✅ express-stable-quickjs	134	26
✅ fastify-stable-node	134	26
✅ fastify-stable-quickjs	134	26
✅ hono-stable-node	134	26
✅ hono-stable-quickjs	134	26
✅ nest-stable-node	134	26
✅ nest-stable-quickjs	134	26
✅ nextjs-turbopack-canary-node	141	19
✅ nextjs-turbopack-canary-quickjs	141	19
✅ nextjs-turbopack-stable-node	160	0
✅ nextjs-turbopack-stable-quickjs	160	0
✅ nextjs-webpack-canary-node	141	19
✅ nextjs-webpack-canary-quickjs	141	19
✅ nextjs-webpack-stable-node	160	0
✅ nextjs-webpack-stable-quickjs	160	0
✅ nitro-stable-node	134	26
✅ nitro-stable-quickjs	134	26
✅ nuxt-stable-node	134	26
✅ nuxt-stable-quickjs	134	26
✅ sveltekit-stable-node	153	7
✅ sveltekit-stable-quickjs	153	7
✅ tanstack-start-node	134	26
✅ tanstack-start-quickjs	134	26
✅ vite-stable-node	134	26
✅ vite-stable-quickjs	134	26

✅ 📦 Local Production

App	Passed	Skipped
✅ astro-stable-node	134	26
✅ astro-stable-quickjs	134	26
✅ express-stable-node	134	26
✅ express-stable-quickjs	134	26
✅ fastify-stable-node	134	26
✅ fastify-stable-quickjs	134	26
✅ hono-stable-node	134	26
✅ hono-stable-quickjs	134	26
✅ nest-stable-node	134	26
✅ nest-stable-quickjs	134	26
✅ nextjs-turbopack-canary-node	141	19
✅ nextjs-turbopack-canary-quickjs	141	19
✅ nextjs-turbopack-stable-node	160	0
✅ nextjs-turbopack-stable-quickjs	160	0
✅ nextjs-webpack-canary-node	141	19
✅ nextjs-webpack-canary-quickjs	141	19
✅ nextjs-webpack-stable-node	160	0
✅ nextjs-webpack-stable-quickjs	160	0
✅ nitro-stable-node	134	26
✅ nitro-stable-quickjs	134	26
✅ nuxt-stable-node	134	26
✅ nuxt-stable-quickjs	134	26
✅ sveltekit-stable-node	153	7
✅ sveltekit-stable-quickjs	153	7
✅ tanstack-start-node	134	26
✅ tanstack-start-quickjs	134	26
✅ vite-stable-node	134	26
✅ vite-stable-quickjs	134	26

✅ 🐘 Local Postgres

App	Passed	Skipped
✅ astro-stable-node	134	26
✅ astro-stable-quickjs	134	26
✅ express-stable-node	134	26
✅ express-stable-quickjs	134	26
✅ fastify-stable-node	134	26
✅ fastify-stable-quickjs	134	26
✅ hono-stable-node	134	26
✅ hono-stable-quickjs	134	26
✅ nest-stable-node	134	26
✅ nest-stable-quickjs	134	26
✅ nextjs-turbopack-canary-node	141	19
✅ nextjs-turbopack-canary-quickjs	141	19
✅ nextjs-turbopack-stable-node	160	0
✅ nextjs-turbopack-stable-quickjs	160	0
✅ nextjs-webpack-canary-node	141	19
✅ nextjs-webpack-canary-quickjs	141	19
✅ nextjs-webpack-stable-node	160	0
✅ nextjs-webpack-stable-quickjs	160	0
✅ nitro-stable-node	134	26
✅ nitro-stable-quickjs	134	26
✅ nuxt-stable-node	134	26
✅ nuxt-stable-quickjs	134	26
✅ sveltekit-stable-node	153	7
✅ sveltekit-stable-quickjs	153	7
✅ tanstack-start-node	134	26
✅ tanstack-start-quickjs	134	26
✅ vite-stable-node	134	26
✅ vite-stable-quickjs	134	26

✅ 🪟 Windows

App	Passed	Failed	Skipped
✅ nextjs-turbopack-node	160	0	0
✅ nextjs-turbopack-quickjs	160	0	0

❌ 🌐 Cross-language Conformance

App	Passed	Failed	Skipped
❌ python	0	9	132

✅ vercel-http-transport

App	Passed	Skipped
✅ example	132	28
✅ express	132	28
✅ hono	132	28
✅ nextjs-turbopack	157	3
✅ nitro	132	28
✅ vite	132	28

✅ vercel-multi-region

App	Passed	Failed	Skipped
✅ nextjs-turbopack	27	0	0

✅ vercel-ws-transport

App	Passed	Skipped
✅ example	132	28
✅ express	132	28
✅ nextjs-turbopack	157	3
✅ vite	132	28

📋 View full workflow run

github-actions · 2026-08-31T18:44:12Z

📊 Workflow Benchmarks

commit d2ed96a · Tue, 01 Sep 2026 00:56:23 GMT · run logs

Backend: vercel · app: nextjs-turbopack

Metric	Scenario	Best (ms)	P75 (ms)	P90 (ms)	P99 (ms)	Samples
TTFS	step	187 (-73%) 💚	1600 🔴 (+45%) 🔻	1646 🔴 (+47%) 🔻	1799 🔴 (+54%) 🔻	30
TTFS	stream	198 (-81%) 💚	1649 🔴 (+50%) 🔻	1817 🔴 (+62%) 🔻	1877 🔴 (+51%) 🔻	30
TTFS	hook + stream	1797 (+46%) 🔻	1901 🔴 (+42%) 🔻	1972 🔴 (+43%) 🔻	2064 🔴 (-56%) 💚	30
Fan-out TTFS	Promise.all(100 steps)	546 (-1.8%)	758 (-8.6%)	975 (-39%) 💚	2245 (+21%) 🔻	10
Fan-out TTLS	Promise.all(100 steps)	1830 (-9.9%)	2464 (-1.4%)	2477 (-30%) 💚	8306 (+29%) 🔻	10
STSO	1020 steps (inline)	117 (+63%) 🔻	148 (+10%)	169 (+9.7%)	237 (+11%)	1019
WO	1020 steps	146469 (+8.9%)	146469 (+8.9%)	146469 (+8.9%)	146469 (+8.9%)	1
CRTT	first chunk (pooled)	100 (-9.9%)	153 (-12%)	205 (±0%)	438 (-46%) 💚	28

Streams

Scenario	CRTT 1st	p75	p90	p99	CDV max	iters
paced control (100/s, 60B)	127 (-26%)	150 (-45%)	264 (-53%)	441 (-67%)	144 (-55%)	10
size sweep (100/s, 160B-12KB)	147 (+8%)	173 (-11%)	246 (-27%)	492 (-28%)	166 (+18%)	10
replay gateway-gpt-5.4-nano-2000t (1x)	144 (+4%)	136 (-24%)	197 (-23%)	452 (-15%)	306 (-18%)	3
replay eve-gpt-5.6-sol-2000t (1x)	156 (-68%)	136 (-63%)	189 (-89%)	347 (-91%)	260 (-88%)	2
replay eve-gpt-5.6-sol-2000t (2x)	125 (-7%)	192 (-40%)	320 (-33%)	577 (-17%)	368 (-9%)	3

📈 STSO distribution vs main (inline / queue-hop histograms)

1020 steps (inline)

Cumulative STSO time: main 134339ms → this run 146308ms (Δ +11969ms, +9%)

 50-100 ms  ┃                         main   3  this   0    -3
100-150 ms  ████████████████████┃███  main 890  this 779  -111
150-200 ms  ███░░┃                    main 112  this 210   +98
200-250 ms  ┃                         main   8  this  23   +15
250-300 ms  ┃                         main   5  this   5    +0
300-350 ms  ┃                         main   1  this   1    +0
350-400 ms  ┃                         main   0  this   1    +1

📈 CRTT drill-down vs main (RTT distributions & profiles)

variant  RTT 1ms→5s+             avg         p50         p90         p99     n
control  ······▄█▂····  130.1 (-43%)  114 (-35%)  264 (-53%)  441 (-67%)  3000
sweep    ······▃█▂▁···    140 (-14%)  127 (-12%)  246 (-27%)  492 (-28%)  3000
gw 1x    ·····▁▅█▁▁···  121.5 (-19%)  111 (-15%)  197 (-23%)  452 (-15%)  5295
eve 1x   ·····▁▇█▂····  116.9 (-63%)  100 (-30%)  189 (-89%)  347 (-91%)  5186
eve 2x   ·····▁▂█▃▁···  162.6 (-32%)  141 (-26%)  320 (-33%)  577 (-17%)  7779

RTT over stream progress (avg per tenth of stream, bars scaled min→max):

control  ▆▆█▅▂▄▄▂▁▁  111–156ms
sweep    █▆▁▂▃▄▃▅▃▂  118–176ms
gw 1x    ▅▄▂█▇▄▃▃▁▄  105–143ms
eve 1x   ▁▂▂▂▁▃▄█▄▂  101–159ms
eve 2x   ▃▂▃▁▁▃▅█▃▃  129–240ms

RTT by chunk size (avg per log size bin, ~160B → ~12KB serialized, bars scaled min→max):

sweep  ▄▂▃▅▇█▁  139–141ms

Delivery jitter over stream progress (avg positive CDV per tenth of stream, bars scaled min→max):

control  ▃███▄▆▄▃▁▅  30–45ms
sweep    ▄▆▅▅▅█▅▆▄▁  44–68ms
gw 1x    ▃▆▃▅█▆▅▆▁▃  31–41ms
eve 1x   ▄▆▁▃▃▇█▇▆▆  20–27ms
eve 2x   █▇▃▄▃▆▄▁▃▆  22–30ms

📜 Previous results (2)

`def7526`

Mon, 31 Aug 2026 22:34:22 GMT · run logs

vercel / nextjs-turbopack

Metric	Scenario	Best (ms)	P75 (ms)	P90 (ms)	P99 (ms)	Samples
TTFS	step	183 (±0%)	1573 🔴 (+53%) 🔻	1731 🔴 (+61%) 🔻	1987 🔴 (+64%) 🔻	30
TTFS	stream	188 (-13%)	1535 🔴 (+42%) 🔻	1578 🔴 (+43%) 🔻	1714 🔴 (+14%)	30
TTFS	hook + stream	1637 (+35%) 🔻	1761 🔴 (+30%) 🔻	1832 🔴 (+31%) 🔻	2062 🔴 (+43%) 🔻	30
Fan-out TTFS	Promise.all(100 steps)	601 (-5.8%)	2129 (+24%) 🔻	2243 (+24%) 🔻	2269 (+26%) 🔻	10
Fan-out TTLS	Promise.all(100 steps)	2002 (+12%)	4242 (+41%) 🔻	4796 (+17%) 🔻	8439 (+98%) 🔻	10
STSO	1020 steps (inline)	108 (+4.9%)	147 (+7.3%)	171 (+8.2%)	231 (-8.7%)	1019
WO	1020 steps	146886 (+6.7%)	146886 (+6.7%)	146886 (+6.7%)	146886 (+6.7%)	1
CRTT	first chunk (pooled)	97 (-2.0%)	175 (-5.9%)	212 (-11%)	535 (+105%) 🔻	28

Streams

Scenario	CRTT 1st	p75	p90	p99	CDV max	iters
paced control (100/s, 60B)	131 (-3%)	190 (+5%)	416 (+46%)	814 (+88%)	192 (+5%)	10
size sweep (100/s, 160B-12KB)	132 (-9%)	162 (-21%)	283 (-35%)	690 (-28%)	122 (-42%)	10
replay gateway-gpt-5.4-nano-2000t (1x)	118 (-11%)	133 (-24%)	164 (-41%)	337 (-64%)	319 (-33%)	3
replay eve-gpt-5.6-sol-2000t (1x)	130 (-21%)	136 (-30%)	198 (-33%)	1104 (-30%)	438 (-62%)	2
replay eve-gpt-5.6-sol-2000t (2x)	126 (-11%)	189 (-35%)	261 (-40%)	758 (-4%)	371 (-31%)	3

`9cf50be`

Mon, 31 Aug 2026 19:12:14 GMT · run logs

vercel / nextjs-turbopack

Metric	Scenario	Best (ms)	P75 (ms)	P90 (ms)	P99 (ms)	Samples
TTFS	step	187 (-78%) 💚	1492 🔴 (+21%) 🔻	1534 🔴 (+19%) 🔻	2053 🔴 (+32%) 🔻	30
TTFS	stream	200 (-21%) 💚	1485 🔴 (+17%) 🔻	1550 🔴 (+16%) 🔻	1642 🔴 (+17%) 🔻	30
TTFS	hook + stream	1301 (+131%) 🔻	1784 🔴 (+25%) 🔻	1822 🔴 (+13%)	2162 🔴 (+3.1%)	30
Fan-out TTFS	Promise.all(100 steps)	762 (+48%) 🔻	2277 (+26%) 🔻	2303 (+22%) 🔻	2447 (+9.7%)	10
Fan-out TTLS	Promise.all(100 steps)	2678 (+35%) 🔻	4068 (-3.9%)	4265 (-9.6%)	5578 (-31%) 💚	10
STSO	1020 steps (inline)	73 (-5.2%)	154 (+7.7%)	198 (+21%) 🔻	356 (+59%) 🔻	1019
WO	1020 steps	150290 (+4.9%)	150290 (+4.9%)	150290 (+4.9%)	150290 (+4.9%)	1
CRTT	first chunk (pooled)	88 (-20%) 💚	154 (-8.3%)	192 (-5.0%)	442 (+44%) 🔻	28

Streams

Scenario	CRTT 1st	p75	p90	p99	CDV max	iters
paced control (100/s, 60B)	134 (-11%)	148 (-18%)	183 (-35%)	332 (-43%)	124 (-16%)	10
size sweep (100/s, 160B-12KB)	156 (+13%)	262 (+33%)	457 (+1%)	4133 (+360%)	239 (+34%)	10
replay gateway-gpt-5.4-nano-2000t (1x)	154 (+7%)	158 (-23%)	208 (-94%)	470 (-91%)	407 (-14%)	3
replay eve-gpt-5.6-sol-2000t (1x)	99 (-61%)	151 (-16%)	245 (+4%)	620 (-16%)	421 (-33%)	2
replay eve-gpt-5.6-sol-2000t (2x)	139 (-17%)	407 (+74%)	992 (+180%)	2456 (+305%)	777 (+136%)	3

ℹ️ Metric definitions & methodology

_{Streams: first-chunk RTT (the stream-open path, before any buffering/backpressure), CRTT percentiles, and worst delivery stall (CDV max). Cells are medians across iterations; per-run values in the artifacts. No 🔴/🟢 marks until targets attach.}

_{The collapsed STSO distribution section above buckets every step gap, split inline (same warm process — pure framework overhead) vs queue-hop (fresh process — dispatch, reinit, replay). █ = main, ┃ = this run, ░ = fill.}

_{The collapsed CRTT drill-down: per-variant RTT histograms (fixed log bins, · = empty) and mean RTT/positive-CDV profile lines over stream progress and chunk size. Histograms, avgs, and profiles merge exactly across runs; p50–p99 are percentile-of-percentiles. Per-index rows live in the artifacts.}

_{Best/P75/P90/P99 deltas compare against the most recent benchmark run on main at the time of this run. 🔻 flags a delta worse than +15%, 💚 one better than −15%.}

_{Metrics — TTFS: time to first step body (in-deployment start() → first step body) · Fan-out TTFS: fan-out time to first step (in-deployment start() → first of the parallel step bodies to complete) · Fan-out TTLS: fan-out time to last step (in-deployment start() → last of the parallel step bodies to complete, i.e. when the Promise.all resolves) · STSO: step-to-step overhead (gap between consecutive step bodies) · WO: workflow overhead (whole-run time outside step bodies, in-deployment anchored) · CRTT: chunk round-trip time (per-chunk write → read latency, one clock domain: deployment → stream backend → same deployment) · CDV: chunk delay variation / delivery jitter (inter-arrival gap minus inter-write gap per seq-adjacent pair; skew-free; the row is each run's MAX positive value, so one stall moves it)}

_{Scenarios — step: one trivial no-op step, no stream; no hooks, so the run stays in turbo mode (in-process fast path) · stream: one streaming step; no hooks, so the run stays in turbo mode (in-process fast path) · hook + stream: registers a hook before one step, which exits turbo mode (dispatch path) · 1020 steps: 1020 trivial sequential steps; STSO is measured between consecutive steps in the given step ranges, and WO is the whole-run overhead outside step bodies · Promise.all(100 steps): 100 trivial no-op steps started together in a single Promise.all; Fan-out TTFS is the first of them to complete and Fan-out TTLS the last, both from the in-deployment clientStart, so their gap is the spread the runtime adds across the fan-out · paced control (100/s, 60B): the control: 300 tiny (~60B) deltas metronome-paced at 100/s — zero workload structure, so it reads the transport floor and flush cadence, and disambiguates transport-wide vs workload-specific when a replay row moves · size sweep (100/s, 160B-12KB): same pacing as the control with deltas padded in rotation across seven log-spaced sizes (~160B–12KB) — rotation decouples size from stream position, so it isolates whether chunk size causes latency · replay gateway-gpt-5.4-nano-2000t (1x): raw provider SSE cadence captured at the AI gateway boundary (gpt-5.4-nano, the most popular gateway model; per-token deltas p50 208B = the modal production chunk size), replayed exactly as measured — the typical customer's workload; its CDV is the typical customer's real delivery jitter · replay eve-gpt-5.6-sol-2000t (1x): a captured eve turn (gpt-5.6-sol, the most-used demanding eve model; ~2000 output tokens = production p50 turn length) replayed exactly as measured — eve's envelope protocol re-ships the cumulative message so sizes ramp 142B→13KB; the demanding outlier tenant's reality · replay eve-gpt-5.6-sol-2000t (2x): the same eve capture at 2x — the headroom/stress row; real fast-tier models emit the same chunk sizes at proportionally higher rate, so time compression is a faithful speed model · first chunk (pooled): every run's seq-0 RTT pooled across all stream scenarios — the first chunk precedes any workload differentiation, so pooling samples one shared stream-open path with exact percentiles}

_{Replay cadences (semantic sha256) — eve-gpt-5.6-sol-2000t eaf22f5946e7c61f3c65c7006d550df180cfabd4e706254a09f22aec0cfb420d · gateway-gpt-5.4-nano-2000t 6f24ac518b6b83ff1d0e85a5fe78230db192716d66a7fc6b2fe022752001d041}

_{🔴 marks a percentile over its target (within target is left unmarked). Targets (p75/p90/p99, ms) — TTFS 200/300/600}

_{All timestamps are deployment-side; runs are triggered in-deployment, so the CI runner and api.vercel.com sit outside every measured window. TTFS = start() → first step body (includes dispatch + any cold start); Fan-out TTFS/TTLS = first/last step completion of one Promise.all from the same anchor (the gap is the runtime’s fan-out spread); STSO/WO between step bodies; CRTT inside the workflow (excludes the api.vercel.com read path).}

_{Cold starts stay in the numbers (real bursty-workload latency, inflates P75+); Best is the warm floor.}

socket-security · 2026-08-31T18:44:58Z

Review the following changes in direct dependencies. Learn more about Socket for GitHub.

Diff	Package	Supply Chain Security	Vulnerability	Quality	Maintenance	License
	npm/zod@4.5.4

View full report

github-actions · 2026-08-31T18:47:34Z

Sim World

Simulated world deterministic testing for races. Traces

🟠 world-sim scenario book — 1 fail of 41 total

fence=per-spec

scenario	outcome	events	virt	replay
✅ `smoke-no-steps`	completed	3	0ms	ok
✅ `smoke-one-step`	completed	6	0ms	ok
✅ `hook-at-step-started`	completed	12	0ms	ok
✅ `hook-at-step-completed`	completed	12	0ms	ok
✅ `hook-at-hook-created`	completed	12	0ms	ok
✅ `deadline-hook-wins`	completed	7	1.0h	ok
✅ `deadline-expires`	completed	7	1.0h	ok
✅ `long-sleep`	completed	11	30.0d	ok
✅ `hook-never-arrives`	stalled	3	0ms	skipped
✅ `step-retries-twice`	completed	10	2.0s	ok
✅ `parallel-steps`	completed	9	0ms	ok
✅ `hook-on-execution-state`	completed	12	0ms	ok
✅ `peek-hook-before-branch`	completed	12	0ms	ok
✅ `peek-hook-after-branch`	completed	12	0ms	ok
✅ `peek-hook-at-registration`	completed	12	0ms	ok
✅ `race-hook-before-probe`	completed	12	0ms	ok
✅ `race-hook-after-probe`	completed	12	0ms	ok
✅ `race-duplicate-delivery`	completed	13	0ms	ok
✅ `attr-hook-before-step`	completed	11	0ms	ok
✅ `attr-hook-after-step`	completed	11	0ms	ok
✅ `attr-from-step-body`	completed	13	0ms	ok
✅ `fork-hook-after-timeout`	completed	14	1.0m	ok
✅ `fork-hook-before-timeout`	completed	14	1.0m	ok
✅ `count-hook-after-timeout`	completed	17	1.0m	ok
✅ `count-hook-before-timeout`	completed	20	1.0m	ok
✅ `stale-read-step-count-fork`	completed	20	1.0m	ok
✅ `stale-read-equal-step-counts`	completed	14	1.0m	ok
✅ `step-vs-step-fork`	completed	12	0ms	ok
✅ `step-vs-step-fork-fenced`	completed	12	0ms	ok
✅ `fence-catches-benign-direction`	completed	12	5ms	ok
✅ `in-flight-before-decision`	completed	17	1.0m	ok
❌ `in-flight-before-decision-counted`	completed	17	1.0m	ok
✅ `in-flight-after-decision`	completed	19	2.0m	ok
✅ `stale-read-step-count-fork-fenced`	completed	20	1.0m	ok
✅ `fork-hook-wins`	completed	13	1.0m	ok
✅ `fork-timeout-wins`	completed	13	1.0m	ok
✅ `unclaimed-payload-under-fork`	completed	17	1.0m	ok
✅ `claimed-payload-under-fork`	completed	17	1.0m	ok
✅ `writers-independent-step-bodies`	completed	12	0ms	ok
✅ `writers-scripted-tempo`	completed	12	0ms	ok
✅ `cancel-mid-step`	cancelled	7	0ms	skipped

Full trace: world-sim.txt

github-actions · 2026-08-31T18:53:54Z

Framework	Flow route	Step reg.	Framework output
hono	235.2 KiB (+34.4 KiB) ⚠️	40.6 KiB (±0)	1.78 MiB (+13.2 KiB)
nextjs-turbopack	240.7 KiB (+34.4 KiB) ⚠️	439 B (±0)	823.7 KiB (+58.1 KiB)

About these numbers

Sizes are gzip; parentheses show the change against main.
Flow route and Step reg. gate this job, on raw bytes rather than the gzip shown, at max(2%, 50.0 KiB). Framework output is informational.
⚠️ marks growth past the threshold. Add the allow-bundle-size-growth label to accept it.

d2ed96a · run

Signed-off-by: Nathan Colosimo <110621881+NathanColosimo@users.noreply.github.com>

Upgrade to Zod 4.5 and compile schemas

9cf50be

Signed-off-by: Nathan Colosimo <110621881+NathanColosimo@users.noreply.github.com>

vercel Bot deployed to Preview – workbench-python-workflow August 31, 2026 18:43 View deployment

vercel Bot deployed to Preview – workflow-web August 31, 2026 18:44 View deployment

vercel Bot deployed to Preview – workbench-nitro-workflow August 31, 2026 18:46 View deployment

vercel Bot deployed to Preview – workbench-hono-workflow August 31, 2026 18:46 View deployment

vercel Bot deployed to Preview – workbench-astro-workflow August 31, 2026 18:46 View deployment

vercel Bot deployed to Preview – workbench-fastify-workflow August 31, 2026 18:46 View deployment

vercel Bot deployed to Preview – workbench-vite-workflow August 31, 2026 18:46 View deployment

vercel Bot deployed to Preview – example-workflow August 31, 2026 18:46 View deployment

vercel Bot deployed to Preview – workbench-tanstack-start-workflow August 31, 2026 18:46 View deployment

vercel Bot deployed to Preview – workbench-sveltekit-workflow August 31, 2026 18:46 View deployment

vercel Bot deployed to Preview – workbench-nestjs-workflow August 31, 2026 18:46 View deployment

vercel Bot deployed to Preview – workbench-nuxt-workflow August 31, 2026 18:46 View deployment

vercel Bot deployed to Preview – workbench-express-workflow August 31, 2026 18:46 View deployment

vercel Bot deployed to Preview – workflow-docs August 31, 2026 18:46 View deployment

vercel Bot deployed to Preview – example-nextjs-workflow-turbopack August 31, 2026 18:46 View deployment

vercel Bot deployed to Preview – workflow-tarballs August 31, 2026 18:47 View deployment

vercel Bot deployed to Preview – example-nextjs-workflow-webpack August 31, 2026 18:47 View deployment

vercel Bot deployed to Preview – workflow-swc-playground August 31, 2026 18:49 View deployment

Use stable Zod v4 namespace imports

26de0c7

Signed-off-by: Nathan Colosimo <110621881+NathanColosimo@users.noreply.github.com>

vercel Bot deployed to Preview – workbench-python-workflow August 31, 2026 21:51 View deployment

vercel Bot deployed to Preview – workflow-web August 31, 2026 21:52 View deployment

vercel Bot deployed to Preview – workflow-tarballs August 31, 2026 21:52 View deployment

vercel Bot deployed to Preview – workbench-nitro-workflow August 31, 2026 22:10 View deployment

vercel Bot deployed to Preview – workbench-fastify-workflow August 31, 2026 22:10 View deployment

vercel Bot deployed to Preview – workbench-vite-workflow August 31, 2026 22:10 View deployment

vercel Bot deployed to Preview – example-nextjs-workflow-webpack August 31, 2026 22:10 View deployment

vercel Bot deployed to Preview – example-workflow August 31, 2026 22:10 View deployment

vercel Bot deployed to Preview – workbench-nuxt-workflow August 31, 2026 22:10 View deployment

vercel Bot deployed to Preview – workbench-sveltekit-workflow August 31, 2026 22:10 View deployment

vercel Bot deployed to Preview – workflow-docs August 31, 2026 22:11 View deployment

vercel Bot deployed to Preview – workflow-swc-playground August 31, 2026 22:13 View deployment

Enable compilation for all Zod schemas

ca4ea2a

Signed-off-by: Nathan Colosimo <110621881+NathanColosimo@users.noreply.github.com>

vercel Bot deployed to Preview – workbench-python-workflow August 31, 2026 23:31 View deployment

vercel Bot deployed to Preview – workflow-web August 31, 2026 23:31 View deployment

vercel Bot deployed to Preview – workflow-tarballs August 31, 2026 23:31 View deployment

vercel Bot deployed to Preview – workbench-astro-workflow August 31, 2026 23:32 View deployment

vercel Bot deployed to Preview – workbench-vite-workflow August 31, 2026 23:32 View deployment

vercel Bot deployed to Preview – example-workflow August 31, 2026 23:32 View deployment

vercel Bot deployed to Preview – workbench-nestjs-workflow August 31, 2026 23:32 View deployment

vercel Bot deployed to Preview – workbench-fastify-workflow August 31, 2026 23:32 View deployment

vercel Bot deployed to Preview – workbench-nitro-workflow August 31, 2026 23:32 View deployment

vercel Bot deployed to Preview – workbench-express-workflow August 31, 2026 23:32 View deployment

vercel Bot deployed to Preview – workbench-nuxt-workflow August 31, 2026 23:32 View deployment

vercel Bot deployed to Preview – workbench-hono-workflow August 31, 2026 23:32 View deployment

vercel Bot deployed to Preview – example-nextjs-workflow-webpack August 31, 2026 23:32 View deployment

vercel Bot deployed to Preview – example-nextjs-workflow-turbopack August 31, 2026 23:32 View deployment

vercel Bot deployed to Preview – workbench-sveltekit-workflow August 31, 2026 23:32 View deployment

vercel Bot deployed to Preview – workbench-tanstack-start-workflow August 31, 2026 23:32 View deployment

NathanColosimo added 3 commits August 31, 2026 16:39

Use the Zod package root

9e6421e

Signed-off-by: Nathan Colosimo <110621881+NathanColosimo@users.noreply.github.com>

Remove schema compilation source scan

70d4b97

Signed-off-by: Nathan Colosimo <110621881+NathanColosimo@users.noreply.github.com>

Merge origin/main into codex/zod-4-5-schema-compilation

d2ed96a

Signed-off-by: Nathan Colosimo <110621881+NathanColosimo@users.noreply.github.com>

alangenfeld approved these changes Sep 1, 2026

View reviewed changes

Navigation Menu

Uh oh!

Upgrade to Zod 4.5 and compile schemas - #3902

Upgrade to Zod 4.5 and compile schemas#3902
NathanColosimo wants to merge 7 commits into
mainfrom
codex/zod-4-5-schema-compilation

NathanColosimo commented Aug 31, 2026 •

edited

Loading

Uh oh!

changeset-bot Bot commented Aug 31, 2026 •

edited

Loading

Uh oh!

vercel Bot commented Aug 31, 2026 •

edited

Loading

Uh oh!

github-actions Bot commented Aug 31, 2026 •

edited

Loading

Uh oh!

github-actions Bot commented Aug 31, 2026 •

edited

Loading

`def7526`

`9cf50be`

Uh oh!

socket-security Bot commented Aug 31, 2026 •

edited

Loading

Uh oh!

github-actions Bot commented Aug 31, 2026 •

edited

Loading

Uh oh!

github-actions Bot commented Aug 31, 2026 •

edited

Loading

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Uh oh!

Conversation

NathanColosimo commented Aug 31, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Description

How did you test your changes?

PR Checklist - Required to merge

Uh oh!

changeset-bot Bot commented Aug 31, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

🦋 Changeset detected

Uh oh!

vercel Bot commented Aug 31, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions Bot commented Aug 31, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

🧪 E2E Test Results

❌ Failed E2E Tests

▲ Vercel Production (8 failed)

🌐 Cross-language Conformance (9 failed)

⚠️ Flaky E2E Tests (passed on retry)

🛠 Infra Events (absorbed by the harness)

E2E Test Summary

Uh oh!

github-actions Bot commented Aug 31, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

📊 Workflow Benchmarks

def7526

9cf50be

Uh oh!

socket-security Bot commented Aug 31, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions Bot commented Aug 31, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Sim World

Uh oh!

github-actions Bot commented Aug 31, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

NathanColosimo commented Aug 31, 2026 •

edited

Loading

changeset-bot Bot commented Aug 31, 2026 •

edited

Loading

vercel Bot commented Aug 31, 2026 •

edited

Loading

github-actions Bot commented Aug 31, 2026 •

edited

Loading

github-actions Bot commented Aug 31, 2026 •

edited

Loading

`def7526`

`9cf50be`

socket-security Bot commented Aug 31, 2026 •

edited

Loading

github-actions Bot commented Aug 31, 2026 •

edited

Loading

github-actions Bot commented Aug 31, 2026 •

edited

Loading