2026-10-25T19:07:45.175Z Diffinery runner: job e2e (End-to-end (security)) for codician/diffinery@5c7ccde75ecf
2026-10-25T19:07:45.204Z Runner: image diffinery-runner:4d3bf17f06575e64ab4155b3, in iad03, ENAM, container b8583b47b652fa7b8126d6865fd11a820733c3ef5946590a26e31c308e6f16d4
2026-10-25T19:07:45.204Z Runner size: large (4 vCPU, 12 GiB of memory, 20 GB of disk), an earlier run of this job wasn't measured; runs-on: diffinery-large (or -medium, -small, -tiny) sets a size
2026-10-25T19:07:45.204Z Host: AMD EPYC (family 25, model 17), 4 vCPUs, 2546 MHz
2026-10-25T19:07:45.204Z Workspace: /workspace/diffinery
2026-10-25T19:07:45.360Z ##[group]Run actions/checkout@v4
2026-10-25T19:07:45.361Z ##[endgroup]
2026-10-25T19:07:45.363Z Syncing repository: codician/diffinery
2026-10-25T19:07:45.478Z Fetching the repository (depth 1)
2026-10-25T19:07:47.296Z remote: Enumerating objects: 866, done.        
2026-10-25T19:07:47.692Z Receiving objects:   0% (1/866)
Receiving objects:   1% (9/866)
Receiving objects:   2% (18/866)
Receiving objects:   3% (26/866)
Receiving objects:   4% (35/866)
Receiving objects:   5% (44/866)
Receiving objects:   6% (52/866)
Receiving objects:   7% (61/866)
Receiving objects:   8% (70/866)
Receiving objects:   9% (78/866)
Receiving objects:  10% (87/866)
Receiving objects:  11% (96/866)
Receiving objects:  12% (104/866)
Receiving objects:  13% (113/866)
Receiving objects:  14% (122/866)
Receiving objects:  15% (130/866)
Receiving objects:  16% (139/866)
Receiving objects:  17% (148/866)
Receiving objects:  18% (156/866)
Receiving objects:  19% (165/866)
Receiving objects:  20% (174/866)
Receiving objects:  21% (182/866)
Receiving objects:  22% (191/866)
Receiving objects:  23% (200/866)
Receiving objects:  24% (208/866)
Receiving objects:  25% (217/866)
Receiving objects:  26% (226/866)
Receiving objects:  27% (234/866)
Receiving objects:  28% (243/866)
Receiving objects:  29% (252/866)
Receiving objects:  30% (260/866)
Receiving objects:  31% (269/866)
Receiving objects:  32% (278/866)
Receiving objects:  33% (286/866)
Receiving objects:  34% (295/866)
Receiving objects:  35% (304/866)
Receiving objects:  36% (312/866)
Receiving objects:  37% (321/866)
Receiving objects:  38% (330/866)
Receiving objects:  39% (338/866)
Receiving objects:  40% (347/866)
Receiving objects:  41% (356/866)
Receiving objects:  42% (364/866)
Receiving objects:  43% (373/866)
Receiving objects:  44% (382/866)
Receiving objects:  45% (390/866)
Receiving objects:  46% (399/866)
Receiving objects:  47% (408/866)
Receiving objects:  48% (416/866)
Receiving objects:  49% (425/866)
Receiving objects:  50% (433/866)
Receiving objects:  51% (442/866)
Receiving objects:  52% (451/866)
Receiving objects:  53% (459/866)
Receiving objects:  54% (468/866)
Receiving objects:  55% (477/866)
Receiving objects:  56% (485/866)
Receiving objects:  57% (494/866)
Receiving objects:  58% (503/866)
Receiving objects:  59% (511/866)
Receiving objects:  60% (520/866)
Receiving objects:  61% (529/866)
Receiving objects:  62% (537/866)
Receiving objects:  63% (546/866)
Receiving objects:  64% (555/866)
Receiving objects:  65% (563/866)
Receiving objects:  66% (572/866)
Receiving objects:  67% (581/866)
Receiving objects:  68% (589/866)
Receiving objects:  69% (598/866)
Receiving objects:  70% (607/866)
Receiving objects:  71% (615/866)
Receiving objects:  72% (624/866)
Receiving objects:  73% (633/866)
Receiving objects:  74% (641/866)
Receiving objects:  75% (650/866)
Receiving objects:  76% (659/866)
Receiving objects:  77% (667/866)
Receiving objects:  78% (676/866)
Receiving objects:  79% (685/866)
Receiving objects:  80% (693/866)
Receiving objects:  81% (702/866)
Receiving objects:  82% (711/866)
Receiving objects:  83% (719/866)
Receiving objects:  84% (728/866)
Receiving objects:  85% (737/866)
Receiving objects:  86% (745/866)
Receiving objects:  87% (754/866)
Receiving objects:  88% (763/866)
Receiving objects:  89% (771/866)
Receiving objects:  90% (780/866)
Receiving objects:  91% (789/866)
Receiving objects:  92% (797/866)
Receiving objects:  93% (806/866)
Receiving objects:  94% (815/866)
Receiving objects:  95% (823/866)
Receiving objects:  96% (832/866)
Receiving objects:  97% (841/866)
remote: Total 866 (delta 0), reused 866 (delta 0)        
2026-10-25T19:07:47.695Z Receiving objects:  98% (849/866)
Receiving objects:  99% (858/866)
Receiving objects: 100% (866/866)
Receiving objects: 100% (866/866), 3.79 MiB | 10.57 MiB/s, done.
2026-10-25T19:07:47.719Z From https://diffinery.com/codician/diffinery
2026-10-25T19:07:47.719Z  * [new ref]         5c7ccde75ecf448dcc8272281ce77890d0332689 -> origin/main
2026-10-25T19:07:47.837Z Switched to a new branch 'main'
2026-10-25T19:07:47.843Z HEAD is now at 5c7ccde75ecf448dcc8272281ce77890d0332689
2026-10-25T19:07:48.532Z Download action repository 'pnpm/action-setup@b906affcce14559ad1aafd4ab0e942779e9f58b1'
2026-10-25T19:07:48.847Z ##[group]Run pnpm/action-setup@b906affcce14559ad1aafd4ab0e942779e9f58b1
2026-10-25T19:07:48.847Z with:
2026-10-25T19:07:48.847Z   dest: ~/setup-pnpm
2026-10-25T19:07:48.847Z   run_install: null
2026-10-25T19:07:48.847Z   cache: false
2026-10-25T19:07:48.847Z   cache_dependency_path: pnpm-lock.yaml
2026-10-25T19:07:48.847Z   package_json_file: package.json
2026-10-25T19:07:48.847Z   standalone: false
2026-10-25T19:07:48.847Z ##[endgroup]
2026-10-25T19:07:49.085Z ##[group]Running self-installer...
2026-10-25T19:07:49.981Z Progress: resolved 1, reused 0, downloaded 0, added 0
2026-10-25T19:07:49.992Z Packages: +1
2026-10-25T19:07:49.992Z +
2026-10-25T19:07:50.702Z Progress: resolved 1, reused 0, downloaded 1, added 1, done
2026-10-25T19:07:50.766Z 
2026-10-25T19:07:50.766Z dependencies:
2026-10-25T19:07:50.766Z + pnpm 10.28.0 (12.15.0 is available)
2026-10-25T19:07:50.766Z 
2026-10-25T19:07:50.775Z Done in 1.3s
2026-10-25T19:07:50.801Z ##[endgroup]
2026-10-25T19:07:50.801Z Installation Completed!
2026-10-25T19:07:52.104Z ##[group]Run actions/setup-node@v4
2026-10-25T19:07:52.104Z with:
2026-10-25T19:07:52.104Z   node-version: 22
2026-10-25T19:07:52.104Z   cache: pnpm
2026-10-25T19:07:52.104Z ##[endgroup]
2026-10-25T19:07:52.116Z Found in cache @ 22.22.0 (pre-installed node satisfies '22')
2026-10-25T19:07:54.070Z Cache Size: ~216 MB (226934503 B)
2026-10-25T19:08:00.972Z Cache restored from key: node-cache-Linux-x64-pnpm-42d02c0263a3b5f911ed6ae8e9210922b97166ca02e60b2c70c55dfa1f00371b
2026-10-25T19:08:01.315Z ##[group]Run pnpm install --frozen-lockfile
2026-10-25T19:08:01.315Z ##[endgroup]
2026-10-25T19:08:02.311Z Scope: all 8 workspace projects
2026-10-25T19:08:02.397Z Lockfile is up to date, resolution step is skipped
2026-10-25T19:08:02.468Z Progress: resolved 1, reused 0, downloaded 0, added 0
2026-10-25T19:08:02.529Z Packages: +251
2026-10-25T19:08:02.529Z ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
2026-10-25T19:08:03.472Z Progress: resolved 251, reused 245, downloaded 0, added 131
2026-10-25T19:08:04.471Z Progress: resolved 251, reused 245, downloaded 0, added 167
2026-10-25T19:08:04.883Z Progress: resolved 251, reused 245, downloaded 0, added 251, done
2026-10-25T19:08:05.297Z .../esbuild@0.25.11/node_modules/esbuild postinstall$ node install.js
2026-10-25T19:08:05.300Z .../esbuild@0.28.1/node_modules/esbuild postinstall$ node install.js
2026-10-25T19:08:05.305Z .../esbuild@0.25.12/node_modules/esbuild postinstall$ node install.js
2026-10-25T19:08:05.307Z .../node_modules/workerd postinstall$ node install.js
2026-10-25T19:08:05.387Z .../node_modules/workerd postinstall$ node install.js
2026-10-25T19:08:05.490Z .../esbuild@0.25.11/node_modules/esbuild postinstall: Done
2026-10-25T19:08:05.504Z .../esbuild@0.28.1/node_modules/esbuild postinstall: Done
2026-10-25T19:08:05.508Z .../esbuild@0.28.2/node_modules/esbuild postinstall$ node install.js
2026-10-25T19:08:05.538Z .../esbuild@0.25.12/node_modules/esbuild postinstall: Done
2026-10-25T19:08:05.944Z .../node_modules/workerd postinstall: Done
2026-10-25T19:08:06.220Z .../esbuild@0.28.2/node_modules/esbuild postinstall: Done
2026-10-25T19:08:06.226Z .../node_modules/workerd postinstall: Done
2026-10-25T19:08:07.209Z 
2026-10-25T19:08:07.209Z devDependencies:
2026-10-25T19:08:07.209Z + turbo 2.11.7
2026-10-25T19:08:07.209Z + typescript 5.9.3
2026-10-25T19:08:07.209Z 
2026-10-25T19:08:08.073Z Done in 6.2s using pnpm v10.28.0
2026-10-25T19:08:09.037Z ##[group]Run pnpm -r --if-present build
2026-10-25T19:08:09.037Z ##[endgroup]
2026-10-25T19:08:09.498Z Scope: 7 of 8 workspace projects
2026-10-25T19:08:09.504Z apps/diffinery build$ node islands/build.mjs && node scripts/build-docs.mjs
2026-10-25T19:08:09.505Z apps/cli build$ esbuild src/bin.ts --bundle --platform=node --target=node22 --format=esm --outfile=dist/diffinery.mjs "--banner:js=#!/usr/bin/env node
2026-10-25T19:08:09.505Z import { createRequire as __diffineryCreateRequire } from 'node:module'; const require = __diffineryCreateRequire(import.meta.url);"
2026-10-25T19:08:09.505Z containers/runner build$ esbuild src/main.ts --bundle --platform=node --target=node22 --format=esm --outfile=dist/agent.mjs --external:bufferutil --external:utf-8-validate "--banner:js=import { createRequire as __diffineryCreateRequire } from 'node:module'; const require = __diffineryCreateRequire(import.meta.url);"
2026-10-25T19:08:09.656Z apps/cli build:   dist/diffinery.mjs  468.9kb
2026-10-25T19:08:09.657Z apps/cli build: ⚡ Done in 108ms
2026-10-25T19:08:09.660Z apps/cli build: Done
2026-10-25T19:08:09.662Z containers/runner build:   dist/agent.mjs  684.1kb
2026-10-25T19:08:09.662Z containers/runner build: ⚡ Done in 116ms
2026-10-25T19:08:09.672Z containers/runner build: Done
2026-10-25T19:08:12.971Z apps/diffinery build: islands: kumo.js 466 KB, kumo.css 149 KB, terminal.js 286 KB
2026-10-25T19:08:13.686Z apps/diffinery build: docs: 84 pages (+2 generated at runtime), 19 site pages, 11 images, CLI 0.1.0 (250 KiB), editor extension 0.1.1 (20 KiB), JetBrains plugin 0.1.0 (64 KiB), Claude Code plugins diffinery 0.1.3, diffinery-ci 0.2.3
2026-10-25T19:08:13.734Z apps/diffinery build: Done
2026-10-25T19:08:14.511Z ##[group]Run # Shards of similar length; a new test file runs in "rest" unless it's added to another.
2026-10-25T19:08:14.511Z core='/e2e\.test\.mjs$'
2026-10-25T19:08:14.511Z agents='/(agentic|review|tasks)\.test\.mjs$'
2026-10-25T19:08:14.511Z # security.test.mjs, security-*.test.mjs (security-txt's too) and status.test.mjs.
2026-10-25T19:08:14.511Z security='/(security(-[a-z-]+)?|status)\.test\.mjs$'
2026-10-25T19:08:14.511Z # The core file's real histories and large pushes take minutes each (jquery's alone 2 to 3 on
2026-10-25T19:08:14.511Z # Diffinery's runners): two shards of their own, so no part of the file runs into node's
2026-10-25T19:08:14.511Z # per-file timeout, which is the --test-timeout here.
2026-10-25T19:08:14.511Z histories='^real histories:'
2026-10-25T19:08:14.511Z large='^(large files|large pushes):'
2026-10-25T19:08:14.511Z opts=(--test-timeout=600000)
2026-10-25T19:08:14.511Z case "security" in
2026-10-25T19:08:14.511Z   core) files=$(ls test/e2e/*.test.mjs | grep -E "$core"); opts+=(--test-skip-pattern="$histories" --test-skip-pattern="$large") ;;
2026-10-25T19:08:14.511Z   histories) files=$(ls test/e2e/*.test.mjs | grep -E "$core"); opts=(--test-timeout=900000 --test-name-pattern="$histories") ;;
2026-10-25T19:08:14.511Z   large) files=$(ls test/e2e/*.test.mjs | grep -E "$core"); opts+=(--test-name-pattern="$large") ;;
2026-10-25T19:08:14.511Z   agents) files=$(ls test/e2e/*.test.mjs | grep -E "$agents") ;;
2026-10-25T19:08:14.511Z   security) files=$(ls test/e2e/*.test.mjs | grep -E "$security") ;;
2026-10-25T19:08:14.511Z   *) files=$(ls test/e2e/*.test.mjs | grep -vE "$core|$agents|$security") ;;
2026-10-25T19:08:14.511Z esac
2026-10-25T19:08:14.511Z echo "$files"
2026-10-25T19:08:14.511Z # Two files at a time: each starts its own local server on its own port, database and
2026-10-25T19:08:14.511Z # directory, so they don't share state, and a file's server mostly keeps one core busy.
2026-10-25T19:08:14.511Z node --test --test-concurrency=2 "${opts[@]}" $files
2026-10-25T19:08:14.511Z ##[endgroup]
2026-10-25T19:08:19.181Z test/e2e/security-limits.test.mjs
2026-10-25T19:08:19.181Z test/e2e/security-txt.test.mjs
2026-10-25T19:08:19.181Z test/e2e/security.test.mjs
2026-10-25T19:08:19.181Z test/e2e/status.test.mjs
2026-10-25T19:08:19.261Z TAP version 13
2026-10-25T19:09:06.287Z # Subtest: security: environment reviewers hold a deploy job until a listed person approves, and nobody else can
2026-10-25T19:09:06.287Z ok 1 - security: environment reviewers hold a deploy job until a listed person approves, and nobody else can
2026-10-25T19:09:06.288Z   ---
2026-10-25T19:09:06.288Z   duration_ms: 46880.448448
2026-10-25T19:09:06.288Z   type: 'test'
2026-10-25T19:09:06.288Z   ...
2026-10-25T19:09:08.767Z # Subtest: security: adding someone by username sends an invitation, and they get access only once they accept
2026-10-25T19:09:08.767Z ok 2 - security: adding someone by username sends an invitation, and they get access only once they accept
2026-10-25T19:09:08.767Z   ---
2026-10-25T19:09:08.767Z   duration_ms: 2482.080826
2026-10-25T19:09:08.767Z   type: 'test'
2026-10-25T19:09:08.767Z   ...
2026-10-25T19:10:13.895Z # Subtest: security: per-account quotas on hosted minutes, hosted jobs at once, sandboxes and repositories
2026-10-25T19:10:13.897Z ok 3 - security: per-account quotas on hosted minutes, hosted jobs at once, sandboxes and repositories
2026-10-25T19:10:13.898Z   ---
2026-10-25T19:10:13.898Z   duration_ms: 65126.303871
2026-10-25T19:10:13.898Z   type: 'test'
2026-10-25T19:10:13.898Z   ...
2026-10-25T19:10:18.354Z # Subtest: security: a per-account storage quota refuses pushes, Git LFS and release asset uploads past it; reads and deletes keep working
2026-10-25T19:10:18.354Z ok 4 - security: a per-account storage quota refuses pushes, Git LFS and release asset uploads past it; reads and deletes keep working
2026-10-25T19:10:18.354Z   ---
2026-10-25T19:10:18.354Z   duration_ms: 4458.607074
2026-10-25T19:10:18.354Z   type: 'test'
2026-10-25T19:10:18.354Z   ...
2026-10-25T19:10:44.823Z # Subtest: security: kill switches suspend Actions for a repository or an account, and pause hosted compute on the instance
2026-10-25T19:10:44.823Z ok 5 - security: kill switches suspend Actions for a repository or an account, and pause hosted compute on the instance
2026-10-25T19:10:44.823Z   ---
2026-10-25T19:10:44.823Z   duration_ms: 26472.802543
2026-10-25T19:10:44.823Z   type: 'test'
2026-10-25T19:10:44.823Z   ...
2026-10-25T19:10:45.263Z # Subtest: security: Markdown images from other sites load through Diffinery's signed image proxy
2026-10-25T19:10:45.263Z ok 6 - security: Markdown images from other sites load through Diffinery's signed image proxy
2026-10-25T19:10:45.263Z   ---
2026-10-25T19:10:45.263Z   duration_ms: 419.419369
2026-10-25T19:10:45.263Z   type: 'test'
2026-10-25T19:10:45.263Z   ...
2026-10-25T19:10:45.436Z # Subtest: security.txt: every RFC 9116 field with SECURITY_CONTACT set
2026-10-25T19:10:45.436Z ok 7 - security.txt: every RFC 9116 field with SECURITY_CONTACT set
2026-10-25T19:10:45.436Z   ---
2026-10-25T19:10:45.436Z   duration_ms: 27579.492223
2026-10-25T19:10:45.436Z   type: 'test'
2026-10-25T19:10:45.436Z   ...
2026-10-25T19:10:45.436Z # Subtest: security reports: security.txt names the form, and an anonymous report needs a reply-to address
2026-10-25T19:10:45.436Z ok 8 - security reports: security.txt names the form, and an anonymous report needs a reply-to address
2026-10-25T19:10:45.438Z   ---
2026-10-25T19:10:45.438Z   duration_ms: 9051.136288
2026-10-25T19:10:45.438Z   type: 'test'
2026-10-25T19:10:45.438Z   ...
2026-10-25T19:10:45.438Z # Subtest: security reports: a signed-in report replies to the account's address
2026-10-25T19:10:45.438Z ok 9 - security reports: a signed-in report replies to the account's address
2026-10-25T19:10:45.438Z   ---
2026-10-25T19:10:45.438Z   duration_ms: 179.863322
2026-10-25T19:10:45.438Z   type: 'test'
2026-10-25T19:10:45.438Z   ...
2026-10-25T19:10:45.439Z # Subtest: security reports: only site administrators can see them (404 for anyone else)
2026-10-25T19:10:45.439Z ok 10 - security reports: only site administrators can see them (404 for anyone else)
2026-10-25T19:10:45.439Z   ---
2026-10-25T19:10:45.439Z   duration_ms: 403.693845
2026-10-25T19:10:45.439Z   type: 'test'
2026-10-25T19:10:45.439Z   ...
2026-10-25T19:10:45.439Z # Subtest: security reports: each new report emails the site administrators, and only them
2026-10-25T19:10:45.439Z ok 11 - security reports: each new report emails the site administrators, and only them
2026-10-25T19:10:45.439Z   ---
2026-10-25T19:10:45.439Z   duration_ms: 568.374325
2026-10-25T19:10:45.439Z   type: 'test'
2026-10-25T19:10:45.439Z   ...
2026-10-25T19:10:45.439Z # Subtest: security reports: triage and resolve, on the web and through the API, audited
2026-10-25T19:10:45.439Z ok 12 - security reports: triage and resolve, on the web and through the API, audited
2026-10-25T19:10:45.440Z   ---
2026-10-25T19:10:45.440Z   duration_ms: 305.612159
2026-10-25T19:10:45.440Z   type: 'test'
2026-10-25T19:10:45.440Z   ...
2026-10-25T19:11:05.956Z # Subtest: security: search, required checks, environments, reviews, locks, archives, drafts and tree names
2026-10-25T19:11:05.956Z ok 13 - security: search, required checks, environments, reviews, locks, archives, drafts and tree names
2026-10-25T19:11:05.956Z   ---
2026-10-25T19:11:05.956Z   duration_ms: 22767.336465
2026-10-25T19:11:05.956Z   type: 'test'
2026-10-25T19:11:05.956Z   ...
2026-10-25T19:11:05.956Z # Subtest: security: organization admins can't hand out ownership
2026-10-25T19:11:05.956Z ok 14 - security: organization admins can't hand out ownership
2026-10-25T19:11:05.956Z   ---
2026-10-25T19:11:05.956Z   duration_ms: 123.475536
2026-10-25T19:11:05.956Z   type: 'test'
2026-10-25T19:11:05.956Z   ...
2026-10-25T19:11:05.957Z # Subtest: security: anonymous writes, token scopes, agent secrets, merge rules and drafts
2026-10-25T19:11:05.957Z ok 15 - security: anonymous writes, token scopes, agent secrets, merge rules and drafts
2026-10-25T19:11:05.957Z   ---
2026-10-25T19:11:05.957Z   duration_ms: 3461.318453
2026-10-25T19:11:05.958Z   type: 'test'
2026-10-25T19:11:05.958Z   ...
2026-10-25T19:11:05.958Z # Subtest: security: push protection covers commits made without git
2026-10-25T19:11:05.958Z ok 16 - security: push protection covers commits made without git
2026-10-25T19:11:05.958Z   ---
2026-10-25T19:11:05.958Z   duration_ms: 554.544054
2026-10-25T19:11:05.958Z   type: 'test'
2026-10-25T19:11:05.958Z   ...
2026-10-25T19:11:05.958Z # Subtest: security: limited tokens, invisible repositories, readers' labels and the audit trail
2026-10-25T19:11:05.958Z ok 17 - security: limited tokens, invisible repositories, readers' labels and the audit trail
2026-10-25T19:11:05.958Z   ---
2026-10-25T19:11:05.958Z   duration_ms: 20668.338246
2026-10-25T19:11:05.958Z   type: 'test'
2026-10-25T19:11:05.958Z   ...
2026-10-25T19:11:05.958Z # Subtest: security: organization pictures are the owners' to change, and invitations aren't sent twice
2026-10-25T19:11:05.958Z ok 18 - security: organization pictures are the owners' to change, and invitations aren't sent twice
2026-10-25T19:11:05.958Z   ---
2026-10-25T19:11:05.958Z   duration_ms: 145.932041
2026-10-25T19:11:05.958Z   type: 'test'
2026-10-25T19:11:05.958Z   ...
2026-10-25T19:11:05.959Z # Subtest: security: organization members get the base permission, which only owners change
2026-10-25T19:11:05.959Z ok 19 - security: organization members get the base permission, which only owners change
2026-10-25T19:11:05.959Z   ---
2026-10-25T19:11:05.959Z   duration_ms: 677.72653
2026-10-25T19:11:05.959Z   type: 'test'
2026-10-25T19:11:05.959Z   ...
2026-10-25T19:11:05.961Z # Subtest: security: leaving an organization takes its repository access along
2026-10-25T19:11:05.961Z ok 20 - security: leaving an organization takes its repository access along
2026-10-25T19:11:05.961Z   ---
2026-10-25T19:11:05.961Z   duration_ms: 1055.08511
2026-10-25T19:11:05.961Z   type: 'test'
2026-10-25T19:11:05.961Z   ...
2026-10-25T19:11:05.961Z # Subtest: security: organization settings are checked before anything is saved, and agents see the base permission
2026-10-25T19:11:05.961Z ok 21 - security: organization settings are checked before anything is saved, and agents see the base permission
2026-10-25T19:11:05.961Z   ---
2026-10-25T19:11:05.961Z   duration_ms: 6044.762688
2026-10-25T19:11:05.961Z   type: 'test'
2026-10-25T19:11:05.961Z   ...
2026-10-25T19:11:05.961Z # Subtest: security: a transferred repository keeps its data, and its old name redirects only for readers
2026-10-25T19:11:05.962Z ok 22 - security: a transferred repository keeps its data, and its old name redirects only for readers
2026-10-25T19:11:05.962Z   ---
2026-10-25T19:11:05.962Z   duration_ms: 9826.697853
2026-10-25T19:11:05.962Z   type: 'test'
2026-10-25T19:11:05.962Z   ...
2026-10-25T19:11:05.962Z # Subtest: security: agents land changes on protected branches only through auto-merge a person allowed, gated by CI
2026-10-25T19:11:05.962Z ok 23 - security: agents land changes on protected branches only through auto-merge a person allowed, gated by CI
2026-10-25T19:11:05.962Z   ---
2026-10-25T19:11:05.962Z   duration_ms: 19079.241289
2026-10-25T19:11:05.962Z   type: 'test'
2026-10-25T19:11:05.962Z   ...
2026-10-25T19:11:05.962Z # Subtest: security: an admin can let agents' auto-merges land on green checks without an approval, and nothing more
2026-10-25T19:11:05.962Z ok 24 - security: an admin can let agents' auto-merges land on green checks without an approval, and nothing more
2026-10-25T19:11:05.962Z   ---
2026-10-25T19:11:05.962Z   duration_ms: 15383.874483
2026-10-25T19:11:05.962Z   type: 'test'
2026-10-25T19:11:05.962Z   ...
2026-10-25T19:11:05.963Z # Subtest: security: a branch rule has Diffinery auto-merge chosen agents' pull requests by itself, under every rule their own auto-merge has
2026-10-25T19:11:05.963Z ok 25 - security: a branch rule has Diffinery auto-merge chosen agents' pull requests by itself, under every rule their own auto-merge has
2026-10-25T19:11:05.963Z   ---
2026-10-25T19:11:05.963Z   duration_ms: 28364.048323
2026-10-25T19:11:05.963Z   type: 'test'
2026-10-25T19:11:05.963Z   ...
2026-10-25T19:11:08.082Z # Subtest: security: an archived repository lands nothing by itself: archiving ends auto-merge and empties the merge queue
2026-10-25T19:11:08.082Z ok 26 - security: an archived repository lands nothing by itself: archiving ends auto-merge and empties the merge queue
2026-10-25T19:11:08.082Z   ---
2026-10-25T19:11:08.082Z   duration_ms: 2127.420243
2026-10-25T19:11:08.082Z   type: 'test'
2026-10-25T19:11:08.082Z   ...
2026-10-25T19:11:11.116Z # Subtest: security: landing a pull request deletes its head branch only when asked, through auto-merge and the queue too, and never a protected one
2026-10-25T19:11:11.116Z ok 27 - security: landing a pull request deletes its head branch only when asked, through auto-merge and the queue too, and never a protected one
2026-10-25T19:11:11.116Z   ---
2026-10-25T19:11:11.116Z   duration_ms: 3032.627553
2026-10-25T19:11:11.116Z   type: 'test'
2026-10-25T19:11:11.116Z   ...
2026-10-25T19:11:12.011Z # Subtest: security: agents see what auto-merge needs next to the refusal to merge directly
2026-10-25T19:11:12.011Z ok 28 - security: agents see what auto-merge needs next to the refusal to merge directly
2026-10-25T19:11:12.011Z   ---
2026-10-25T19:11:12.011Z   duration_ms: 895.352773
2026-10-25T19:11:12.011Z   type: 'test'
2026-10-25T19:11:12.011Z   ...
2026-10-25T19:11:17.450Z # Subtest: security: the queue's bypass button does what it says, and a merge queue can't contradict linear history
2026-10-25T19:11:17.450Z ok 29 - security: the queue's bypass button does what it says, and a merge queue can't contradict linear history
2026-10-25T19:11:17.450Z   ---
2026-10-25T19:11:17.450Z   duration_ms: 5439.748056
2026-10-25T19:11:17.450Z   type: 'test'
2026-10-25T19:11:17.450Z   ...
2026-10-25T19:11:18.147Z # Subtest: security: no token can mint a token, an agent or a sandbox, through the API or the web forms
2026-10-25T19:11:18.147Z ok 30 - security: no token can mint a token, an agent or a sandbox, through the API or the web forms
2026-10-25T19:11:18.147Z   ---
2026-10-25T19:11:18.147Z   duration_ms: 697.188792
2026-10-25T19:11:18.147Z   type: 'test'
2026-10-25T19:11:18.147Z   ...
2026-10-25T19:11:26.645Z # Subtest: security: repository variable endpoints see only the repository's own, and organization variable deletes are checked
2026-10-25T19:11:26.645Z ok 31 - security: repository variable endpoints see only the repository's own, and organization variable deletes are checked
2026-10-25T19:11:26.645Z   ---
2026-10-25T19:11:26.645Z   duration_ms: 8496.201028
2026-10-25T19:11:26.645Z   type: 'test'
2026-10-25T19:11:26.645Z   ...
2026-10-25T19:11:27.487Z # Subtest: security: milestones are checked before an issue is saved, and lists filter by them
2026-10-25T19:11:27.487Z ok 32 - security: milestones are checked before an issue is saved, and lists filter by them
2026-10-25T19:11:27.487Z   ---
2026-10-25T19:11:27.487Z   duration_ms: 843.137358
2026-10-25T19:11:27.487Z   type: 'test'
2026-10-25T19:11:27.487Z   ...
2026-10-25T19:11:31.029Z # Subtest: security: push protection reads large files, and revoking a token through the API is on the record
2026-10-25T19:11:31.029Z ok 33 - security: push protection reads large files, and revoking a token through the API is on the record
2026-10-25T19:11:31.029Z   ---
2026-10-25T19:11:31.029Z   duration_ms: 3539.22059
2026-10-25T19:11:31.029Z   type: 'test'
2026-10-25T19:11:31.029Z   ...
2026-10-25T19:11:31.982Z # Subtest: security: git request bodies are bounded, compressed or not, before anything reads them
2026-10-25T19:11:31.982Z ok 34 - security: git request bodies are bounded, compressed or not, before anything reads them
2026-10-25T19:11:31.982Z   ---
2026-10-25T19:11:31.982Z   duration_ms: 954.825908
2026-10-25T19:11:31.982Z   type: 'test'
2026-10-25T19:11:31.982Z   ...
2026-10-25T19:11:33.044Z # Subtest: security: a file rewritten from scratch is diffed quickly, even for anonymous readers
2026-10-25T19:11:33.044Z ok 35 - security: a file rewritten from scratch is diffed quickly, even for anonymous readers
2026-10-25T19:11:33.044Z   ---
2026-10-25T19:11:33.044Z   duration_ms: 1060.109269
2026-10-25T19:11:33.044Z   type: 'test'
2026-10-25T19:11:33.044Z   ...
2026-10-25T19:11:33.788Z # Subtest: security: signed out, a private repository and a missing one look the same everywhere
2026-10-25T19:11:33.789Z ok 36 - security: signed out, a private repository and a missing one look the same everywhere
2026-10-25T19:11:33.789Z   ---
2026-10-25T19:11:33.789Z   duration_ms: 744.377245
2026-10-25T19:11:33.789Z   type: 'test'
2026-10-25T19:11:33.789Z   ...
2026-10-25T19:11:34.664Z # Subtest: security: live updates say only that something changed, and never carry audit entries or payloads
2026-10-25T19:11:34.664Z ok 37 - security: live updates say only that something changed, and never carry audit entries or payloads
2026-10-25T19:11:34.664Z   ---
2026-10-25T19:11:34.664Z   duration_ms: 877.476441
2026-10-25T19:11:34.664Z   type: 'test'
2026-10-25T19:11:34.664Z   ...
2026-10-25T19:11:38.044Z # Subtest: security: push protection reads commit and tag messages, UTF-16 files and Diffinery's own tokens, and records opt-outs
2026-10-25T19:11:38.044Z ok 38 - security: push protection reads commit and tag messages, UTF-16 files and Diffinery's own tokens, and records opt-outs
2026-10-25T19:11:38.044Z   ---
2026-10-25T19:11:38.044Z   duration_ms: 3378.781022
2026-10-25T19:11:38.044Z   type: 'test'
2026-10-25T19:11:38.044Z   ...
2026-10-25T19:11:39.172Z # Subtest: security: required checks gate direct pushes to a protected branch, as on GitHub
2026-10-25T19:11:39.178Z ok 39 - security: required checks gate direct pushes to a protected branch, as on GitHub
2026-10-25T19:11:39.178Z   ---
2026-10-25T19:11:39.178Z   duration_ms: 1128.760485
2026-10-25T19:11:39.178Z   type: 'test'
2026-10-25T19:11:39.178Z   ...
2026-10-25T19:11:39.691Z # Subtest: security: issue, pull request and comment text has GitHub's length limits
2026-10-25T19:11:39.691Z ok 40 - security: issue, pull request and comment text has GitHub's length limits
2026-10-25T19:11:39.692Z   ---
2026-10-25T19:11:39.692Z   duration_ms: 519.430038
2026-10-25T19:11:39.692Z   type: 'test'
2026-10-25T19:11:39.692Z   ...
2026-10-25T19:11:48.268Z # Subtest: security: deleting a repository deletes its stored objects too
2026-10-25T19:11:48.268Z ok 41 - security: deleting a repository deletes its stored objects too
2026-10-25T19:11:48.268Z   ---
2026-10-25T19:11:48.268Z   duration_ms: 8574.604516
2026-10-25T19:11:48.268Z   type: 'test'
2026-10-25T19:11:48.268Z   ...
2026-10-25T19:11:49.465Z # Subtest: security: pushes are checked like git's fsck: no '..' or '.git' entries, no unsafe .gitmodules
2026-10-25T19:11:49.465Z ok 42 - security: pushes are checked like git's fsck: no '..' or '.git' entries, no unsafe .gitmodules
2026-10-25T19:11:49.465Z   ---
2026-10-25T19:11:49.465Z   duration_ms: 1195.600194
2026-10-25T19:11:49.465Z   type: 'test'
2026-10-25T19:11:49.465Z   ...
2026-10-25T19:11:50.649Z # Subtest: security: a job's runner gets only the secrets the job names
2026-10-25T19:11:50.649Z ok 43 - security: a job's runner gets only the secrets the job names
2026-10-25T19:11:50.649Z   ---
2026-10-25T19:11:50.650Z   duration_ms: 1181.712926
2026-10-25T19:11:50.650Z   type: 'test'
2026-10-25T19:11:50.650Z   ...
2026-10-25T19:11:52.325Z # Subtest: security: runs of agent code get no repository secrets unless an admin allows it
2026-10-25T19:11:52.326Z ok 44 - security: runs of agent code get no repository secrets unless an admin allows it
2026-10-25T19:11:52.326Z   ---
2026-10-25T19:11:52.326Z   duration_ms: 1682.45206
2026-10-25T19:11:52.326Z   type: 'test'
2026-10-25T19:11:52.326Z   ...