[agent-feedback] Shorten managed agent instructions (#99065)
## Summary - reduce the managed agent-feedback block from 199 to 160 words while restoring four scannable issue-category bullets - explicitly authorize the feedback pass without coupling it to `agentRules` - explain that `next dev` restores the managed block and that committing `AGENTS.md` keeps the tree clean - preserve the network-sandbox retry and tell agents to read the command output once without piping or truncating it - clarify that prepared reports remain in a browser URL fragment until the user submits them - keep the AI agents guide, API reference, focused integration coverage, and eval fixtures in sync - restore the `CLAUDE.md` compatibility import inside eval sandboxes only, without generating it for users - replace subjective feedback transcript judges with deterministic source and report-payload checks The existing `agentRules` managed block is unchanged. ## Eval results | Eval | Existing instructions | Shortened instructions | | --- | --- | --- | | Routine debugging | 10/10 passed in #98887 | Earlier runs produced no reports; a post-harness-fix rerun is pending | | Anonymization | 2/2 reporting checks passed in #98887 | The post-harness-fix rerun reached AI Gateway timeouts; deterministic schema and redaction checks are in place | | Distinct issues | 1/1 passed in #98887 | The post-harness-fix run produced two distinct valid reports; both deterministic report checks passed | The historical results come from #98887. The shortened-instruction runs use the same private `agent-feedback` treatment and are not published to nextjs.org/evals. The fixtures explicitly enable `experimental.agentFeedback`, matching the production opt-in. The previous transcript judges mixed feature behavior with subjective judgments about browser-opening attempts. The fixtures now check the actual product outcomes directly: routine work produces no report, a qualifying issue produces one valid anonymized report, and distinct issues produce separate valid reports. ## Verification - `pnpm testonly packages/next/src/server/lib/generate-agent-files.test.ts` (10/10 passed) - `NEXT_SKIP_ISOLATE=1 HEADLESS=true pnpm test-dev-turbo test/development/app-dir/agent-rules-auto-generate/agent-rules-auto-generate.test.ts` (12/12 passed) - eval fixture dry-runs for `agent-057-agent-feedback-anonymization` and `agent-058-agent-feedback-distinct-issues` - targeted Prettier and ESLint through the pre-commit hook <!-- NEXT_JS_LLM -->
Showing
Please
register
or
sign in
to comment