Add PPR evals and fix env loading for agent-eval 0.9.5 (#92063)
Upgrades `@vercel/agent-eval` from 0.8.0 to 0.9.5. The new version loads `.env` / `.env.local` from its own cwd (`evals/`) rather than inheriting from the parent process, so the old `process.loadEnvFile()` call no longer works. Instead, `run-evals.js` now symlinks the root env files into `evals/` before spawning the harness. `evals/.env` is added to `.gitignore` to keep secrets out of the tree. Two new evals exercise PPR knowledge: `agent-041-optimize-ppr-shell` checks that the agent decomposes a monolithic `loading.tsx` into granular `Suspense` boundaries, and `agent-042-enable-ppr` verifies the agent knows PPR is enabled via `cacheComponents: true` (not the old `experimental.ppr` flag).
Showing
| ... | @@ -177,7 +177,7 @@ | ... | @@ -177,7 +177,7 @@ |
| "@types/string-hash": "1.1.1", | "@types/string-hash": "1.1.1", | ||
| "@types/trusted-types": "2.0.3", | "@types/trusted-types": "2.0.3", | ||
| "@types/yargs": "16.0.11", | "@types/yargs": "16.0.11", | ||
| "@vercel/agent-eval": "0.8.0", | "@vercel/agent-eval": "0.9.5", | ||
| "@vercel/devlow-bench": "workspace:*", | "@vercel/devlow-bench": "workspace:*", | ||
| "@vercel/kv": "3.0.0", | "@vercel/kv": "3.0.0", | ||
| "@vercel/og": "0.11.1", | "@vercel/og": "0.11.1", | ||
| ... | ... |
Please
register
or
sign in
to comment