End-to-end (security)
took 5m 38s Raw logs
Matrix: name: security, shard: security
Cancelled
cancelled by a newer run in the same concurrency group
Set up job
Diffinery runner: job e2e (End-to-end (security)) for codician/diffinery@5b06aae1e6d3Runner: image diffinery-runner:2a3052eff7a82a483a7fde51, in lhr01, WEUR, container 2afa63e5f3552d8347584831a28607bdf336d6e659e767acb7684f81bfb76166Workspace: /workspace/diffinery
Run actions/checkout@v42s
##[group]Run actions/checkout@v4##[endgroup]Syncing repository: codician/diffineryFetching the repository (depth 1)remote: Enumerating objects: 609, done. Receiving objects: 0% (1/609) Receiving objects: 1% (7/609) Receiving objects: 2% (13/609) Receiving objects: 3% (19/609) Receiving objects: 4% (25/609) Receiving objects: 5% (31/609) Receiving objects: 6% (37/609) Receiving objects: 7% (43/609) Receiving objects: 8% (49/609) Receiving objects: 9% (55/609) Receiving objects: 10% (61/609) Receiving objects: 11% (67/609) Receiving objects: 12% (74/609) Receiving objects: 13% (80/609) Receiving objects: 14% (86/609) Receiving objects: 15% (92/609) Receiving objects: 16% (98/609) Receiving objects: 17% (104/609) Receiving objects: 18% (110/609) Receiving objects: 19% (116/609) Receiving objects: 20% (122/609) Receiving objects: 21% (128/609) Receiving objects: 22% (134/609) Receiving objects: 23% (141/609) Receiving objects: 24% (147/609) Receiving objects: 25% (153/609) Receiving objects: 26% (159/609) Receiving objects: 27% (165/609) Receiving objects: 28% (171/609) Receiving objects: 29% (177/609) Receiving objects: 30% (183/609) Receiving objects: 31% (189/609) Receiving objects: 32% (195/609) Receiving objects: 33% (201/609) Receiving objects: 34% (208/609) Receiving objects: 35% (214/609) Receiving objects: 36% (220/609) Receiving objects: 37% (226/609) Receiving objects: 38% (232/609) Receiving objects: 39% (238/609) Receiving objects: 40% (244/609) Receiving objects: 41% (250/609) Receiving objects: 42% (256/609) Receiving objects: 43% (262/609) Receiving objects: 44% (268/609) Receiving objects: 45% (275/609) Receiving objects: 46% (281/609) Receiving objects: 47% (287/609) Receiving objects: 48% (293/609) Receiving objects: 49% (299/609) Receiving objects: 50% (305/609) Receiving objects: 51% (311/609) Receiving objects: 52% (317/609) Receiving objects: 53% (323/609) Receiving objects: 54% (329/609) Receiving objects: 55% (335/609) Receiving objects: 56% (342/609) Receiving objects: 57% (348/609) Receiving objects: 58% (354/609) Receiving objects: 59% (360/609) Receiving objects: 60% (366/609) Receiving objects: 61% (372/609) Receiving objects: 62% (378/609) Receiving objects: 63% (384/609) Receiving objects: 64% (390/609) Receiving objects: 65% (396/609) Receiving objects: 66% (402/609) Receiving objects: 67% (409/609) Receiving objects: 68% (415/609) Receiving objects: 69% (421/609) Receiving objects: 70% (427/609) Receiving objects: 71% (433/609) Receiving objects: 72% (439/609) Receiving objects: 73% (445/609) Receiving objects: 74% (451/609) Receiving objects: 75% (457/609) Receiving objects: 76% (463/609) Receiving objects: 77% (469/609) Receiving objects: 78% (476/609) Receiving objects: 79% (482/609) Receiving objects: 80% (488/609) Receiving objects: 81% (494/609) Receiving objects: 82% (500/609) Receiving objects: 83% (506/609) Receiving objects: 84% (512/609) Receiving objects: 85% (518/609) Receiving objects: 86% (524/609) Receiving objects: 87% (530/609) Receiving objects: 88% (536/609) Receiving objects: 89% (543/609) Receiving objects: 90% (549/609) Receiving objects: 91% (555/609) Receiving objects: 92% (561/609) Receiving objects: 93% (567/609) Receiving objects: 94% (573/609) Receiving objects: 95% (579/609) Receiving objects: 96% (585/609) remote: Total 609 (delta 0), reused 609 (delta 0) Receiving objects: 97% (591/609) Receiving objects: 98% (597/609) Receiving objects: 99% (603/609) Receiving objects: 100% (609/609) Receiving objects: 100% (609/609), 2.47 MiB | 10.34 MiB/s, done.From https://diffinery.com/codician/diffinery * [new ref] 5b06aae1e6d37966dbef35babfe4e212bd55a8f0 -> origin/diffinery-checkoutNote: switching to '5b06aae1e6d37966dbef35babfe4e212bd55a8f0'.You are in 'detached HEAD' state. You can look around, make experimentalchanges and commit them, and you can discard any commits you make in thisstate without impacting any branches by switching back to a branch.If you want to create a new branch to retain commits you create, you maydo so (now or later) by using -c with the switch command. Example: git switch -c <new-branch-name>Or undo this operation with: git switch -Turn off this advice by setting config variable advice.detachedHead to falseHEAD is now at 5b06aae Merge 0ce565c19de840aaf8903dcdd8311f987cf18f66 into 2e055f17cde26e5be9756aaa0de2120e4a87b4afHEAD is now at 5b06aae1e6d37966dbef35babfe4e212bd55a8f0
Run pnpm/action-setup@v45s
Download action repository 'pnpm/action-setup@v4'##[group]Run pnpm/action-setup@v4with: dest: ~/setup-pnpm run_install: null cache: false cache_dependency_path: pnpm-lock.yaml package_json_file: package.json standalone: false##[endgroup]##[group]Running self-installer...Progress: resolved 1, reused 0, downloaded 0, added 0Packages: +1+Progress: resolved 1, reused 0, downloaded 1, added 0Progress: resolved 1, reused 0, downloaded 1, added 1, donedependencies:+ pnpm 10.28.0 (12.14.0 is available)Done in 2.3s##[endgroup]Installation Completed!
Run actions/setup-node@v416s
##[group]Run actions/setup-node@v4with: node-version: 22 cache: pnpm##[endgroup]Found in cache @ 22.22.0 (pre-installed node satisfies '22')Cache Size: ~215 MB (225870423 B)Cache restored from key: node-cache-Linux-x64-pnpm-4b94436b86798d88b931ea24b5b847697aebf45520d6ef384cb382ce6c1f1e08
Run pnpm install --frozen-lockfile24s
##[group]Run pnpm install --frozen-lockfile##[endgroup]Scope: all 7 workspace projectsLockfile is up to date, resolution step is skippedProgress: resolved 1, reused 0, downloaded 0, added 0Packages: +248++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Progress: resolved 248, reused 242, downloaded 0, added 40Progress: resolved 248, reused 242, downloaded 0, added 247Progress: resolved 248, reused 242, downloaded 0, added 248, donedevDependencies:+ turbo 2.11.7+ typescript 5.9.3Done in 23.5s using pnpm v10.28.0
Run pnpm -r --if-present build3s
##[group]Run pnpm -r --if-present build##[endgroup]Scope: 6 of 7 workspace projectsapps/cli build$ esbuild src/bin.ts --bundle --platform=node --target=node22 --format=esm --outfile=dist/diffinery.mjs "--banner:js=#!/usr/bin/env nodeimport { createRequire as __diffineryCreateRequire } from 'node:module'; const require = __diffineryCreateRequire(import.meta.url);"apps/diffinery build$ node islands/build.mjs && node scripts/build-docs.mjscontainers/runner build$ esbuild src/main.ts --bundle --platform=node --target=node22 --format=esm --outfile=dist/agent.mjs --external:bufferutil --external:utf-8-validate "--banner:js=import { createRequire as __diffineryCreateRequire } from 'node:module'; const require = __diffineryCreateRequire(import.meta.url);"apps/cli build: dist/diffinery.mjs 442.5kbapps/cli build: ⚡ Done in 119msapps/cli build: Donecontainers/runner build: dist/agent.mjs 657.3kbcontainers/runner build: ⚡ Done in 126mscontainers/runner build: Doneapps/diffinery build: islands: kumo.js 466 KB, kumo.css 149 KB, terminal.js 286 KBapps/diffinery build: docs: 63 pages (+2 generated at runtime), CLI 0.1.0 (232 KiB)apps/diffinery build: Done
Run pnpm --filter @diffinery/app exec playwright install --with-deps chromium
Run as_root() { if [ "$(id -u)" = 0 ]; then "$@"; else sudo "$@"; fi; }
Run the shard's tests261h 38m
##[group]Run # Shards of similar length; a new test file runs in "rest" unless it's added to another.core='/e2e\.test\.mjs$'agents='/(agentic|review|tasks)\.test\.mjs$'security='/(security|status)\.test\.mjs$'# The core file's real histories and large pushes take minutes each (jquery's alone 2 to 3 on# Diffinery's runners): two shards of their own, so no part of the file runs into node's# per-file timeout, which is the --test-timeout here.histories='^real histories:'large='^(large files|large pushes):'opts=(--test-timeout=600000)case "security" in core) files=$(ls test/e2e/*.test.mjs | grep -E "$core"); opts+=(--test-skip-pattern="$histories" --test-skip-pattern="$large") ;; histories) files=$(ls test/e2e/*.test.mjs | grep -E "$core"); opts=(--test-timeout=900000 --test-name-pattern="$histories") ;; large) files=$(ls test/e2e/*.test.mjs | grep -E "$core"); opts+=(--test-name-pattern="$large") ;; agents) files=$(ls test/e2e/*.test.mjs | grep -E "$agents") ;; security) files=$(ls test/e2e/*.test.mjs | grep -E "$security") ;; *) files=$(ls test/e2e/*.test.mjs | grep -vE "$core|$agents|$security") ;;esacecho "$files"node --test --test-concurrency=1 "${opts[@]}" $files##[endgroup]test/e2e/security.test.mjstest/e2e/status.test.mjsTAP version 13# Subtest: security: search, required checks, environments, reviews, locks, archives, drafts and tree namesok 1 - security: search, required checks, environments, reviews, locks, archives, drafts and tree names --- duration_ms: 62286.652581 type: 'test' ...# Subtest: security: organization admins can't hand out ownershipok 2 - security: organization admins can't hand out ownership --- duration_ms: 223.544783 type: 'test' ...# Subtest: security: anonymous writes, token scopes, agent secrets, merge rules and draftsok 3 - security: anonymous writes, token scopes, agent secrets, merge rules and drafts --- duration_ms: 4105.135735 type: 'test' ...# Subtest: security: push protection covers commits made without gitok 4 - security: push protection covers commits made without git --- duration_ms: 1413.057277 type: 'test' ...# Subtest: security: limited tokens, invisible repositories, readers' labels and the audit trailok 5 - security: limited tokens, invisible repositories, readers' labels and the audit trail --- duration_ms: 29984.526256 type: 'test' ...# Subtest: security: organization pictures are the owners' to change, and invitations aren't sent twiceok 6 - security: organization pictures are the owners' to change, and invitations aren't sent twice --- duration_ms: 211.299182 type: 'test' ...# Subtest: security: organization members get the base permission, which only owners changeok 7 - security: organization members get the base permission, which only owners change --- duration_ms: 902.912151 type: 'test' ...# Subtest: security: leaving an organization takes its repository access alongok 8 - security: leaving an organization takes its repository access along --- duration_ms: 900.776929 type: 'test' ...# Subtest: security: organization settings are checked before anything is saved, and agents see the base permissionok 9 - security: organization settings are checked before anything is saved, and agents see the base permission --- duration_ms: 9002.803596 type: 'test' ...# Subtest: security: a transferred repository keeps its data, and its old name redirects only for readersok 10 - security: a transferred repository keeps its data, and its old name redirects only for readers --- duration_ms: 15232.405707 type: 'test' ...# Subtest: security: agents land changes on protected branches only through auto-merge a person allowed, gated by CIok 11 - security: agents land changes on protected branches only through auto-merge a person allowed, gated by CI --- duration_ms: 27970.298655 type: 'test' ...# Subtest: security: an admin can let agents' auto-merges land on green checks without an approval, and nothing moreok 12 - security: an admin can let agents' auto-merges land on green checks without an approval, and nothing more --- duration_ms: 17571.825808 type: 'test' ...# Subtest: security: an archived repository lands nothing by itself: archiving ends auto-merge and empties the merge queueok 13 - security: an archived repository lands nothing by itself: archiving ends auto-merge and empties the merge queue --- duration_ms: 2103.103026 type: 'test' ...# Subtest: security: landing a pull request deletes its head branch only when asked, through auto-merge and the queue too, and never a protected oneok 14 - security: landing a pull request deletes its head branch only when asked, through auto-merge and the queue too, and never a protected one --- duration_ms: 2732.454566 type: 'test' ...# Subtest: security: agents see what auto-merge needs next to the refusal to merge directlyok 15 - security: agents see what auto-merge needs next to the refusal to merge directly --- duration_ms: 1289.80426 type: 'test' ...# Subtest: security: the queue's bypass button does what it says, and a merge queue can't contradict linear historyok 16 - security: the queue's bypass button does what it says, and a merge queue can't contradict linear history --- duration_ms: 5514.272949 type: 'test' ...# Subtest: security: no token can mint a token, an agent or a sandbox, through the API or the web formsok 17 - security: no token can mint a token, an agent or a sandbox, through the API or the web forms --- duration_ms: 951.074037 type: 'test' ...# Subtest: security: repository variable endpoints see only the repository's own, and organization variable deletes are checkedok 18 - security: repository variable endpoints see only the repository's own, and organization variable deletes are checked --- duration_ms: 15077.151119 type: 'test' ...# Subtest: security: milestones are checked before an issue is saved, and lists filter by themok 19 - security: milestones are checked before an issue is saved, and lists filter by them --- duration_ms: 1310.21694 type: 'test' ...# Subtest: security: push protection reads large files, and revoking a token through the API is on the recordok 20 - security: push protection reads large files, and revoking a token through the API is on the record --- duration_ms: 6131.141987 type: 'test' ...# Subtest: security: git request bodies are bounded, compressed or not, before anything reads themok 21 - security: git request bodies are bounded, compressed or not, before anything reads them --- duration_ms: 1522.582922 type: 'test' ...# Subtest: security: a file rewritten from scratch is diffed quickly, even for anonymous readersok 22 - security: a file rewritten from scratch is diffed quickly, even for anonymous readers --- duration_ms: 1383.87067 type: 'test' ...# Subtest: security: signed out, a private repository and a missing one look the same everywhereok 23 - security: signed out, a private repository and a missing one look the same everywhere --- duration_ms: 714.769672 type: 'test' ...# Subtest: security: live updates say only that something changed, and never carry audit entries or payloadsok 24 - security: live updates say only that something changed, and never carry audit entries or payloads --- duration_ms: 926.642734 type: 'test' ...# Subtest: security: push protection reads commit and tag messages, UTF-16 files and Diffinery's own tokens, and records opt-outsok 25 - security: push protection reads commit and tag messages, UTF-16 files and Diffinery's own tokens, and records opt-outs --- duration_ms: 5513.929538 type: 'test' ...# Subtest: security: required checks gate direct pushes to a protected branch, as on GitHubok 26 - security: required checks gate direct pushes to a protected branch, as on GitHub --- duration_ms: 836.528548 type: 'test' ...# Subtest: security: issue, pull request and comment text has GitHub's length limitsok 27 - security: issue, pull request and comment text has GitHub's length limits --- duration_ms: 656.415996 type: 'test' ...# Subtest: security: deleting a repository deletes its stored objects toook 28 - security: deleting a repository deletes its stored objects too --- duration_ms: 13420.085478 type: 'test' ...# Subtest: security: pushes are checked like git's fsck: no '..' or '.git' entries, no unsafe .gitmodulesok 29 - security: pushes are checked like git's fsck: no '..' or '.git' entries, no unsafe .gitmodules --- duration_ms: 1560.760588 type: 'test' ...# Subtest: security: a job's runner gets only the secrets the job namesok 30 - security: a job's runner gets only the secrets the job names --- duration_ms: 1228.276432 type: 'test' ...# Subtest: security: runs of agent code get no repository secrets unless an admin allows itok 31 - security: runs of agent code get no repository secrets unless an admin allows it --- duration_ms: 1654.837728 type: 'test' ...# Subtest: security: adding someone by email always invites them, so the address doesn't reveal their username and they agree firstok 32 - security: adding someone by email always invites them, so the address doesn't reveal their username and they agree first --- duration_ms: 1327.595246 type: 'test' ...# Subtest: security: a job's log is capped, and oversized workflow files aren't parsedok 33 - security: a job's log is capped, and oversized workflow files aren't parsed --- duration_ms: 3918.228437 type: 'test' ...# Subtest: security: a workflow's token can't use another repository's private packages, and a repository's name is its ownok 34 - security: a workflow's token can't use another repository's private packages, and a repository's name is its own --- duration_ms: 1555.142283 type: 'test' ...# Subtest: security: OIDC tokens name the environment a job deployed to, and carry ids that survive a reused nameok 35 - security: OIDC tokens name the environment a job deployed to, and carry ids that survive a reused name --- duration_ms: 1458.38669 type: 'test' ...# Subtest: security: sensitive actions need a recent sign-in, sessions end 90 days after it, and one browser can be signed outok 36 - security: sensitive actions need a recent sign-in, sessions end 90 days after it, and one browser can be signed out --- duration_ms: 1123.744022 type: 'test' ...# Subtest: security: self-hosted runners register with a one-hour token and claim jobs with their ownok 37 - security: self-hosted runners register with a one-hour token and claim jobs with their own --- duration_ms: 1787.762535 type: 'test' ...# Subtest: security: an organization secret reaches only the repositories it's shared withok 38 - security: an organization secret reaches only the repositories it's shared with --- duration_ms: 3415.201087 type: 'test' ...# Subtest: security: an admin can purge objects a force-push left unreachableok 39 - security: an admin can purge objects a force-push left unreachable --- duration_ms: 1955.474274 type: 'test' ...# Subtest: security: webhooks reach only public hosts other than Diffinery, at most 20 per repositoryok 40 - security: webhooks reach only public hosts other than Diffinery, at most 20 per repository --- duration_ms: 1737.314916 type: 'test' ...# Subtest: security: invitations and test emails have limits, so an account can't be used to send mail in bulkok 41 - security: invitations and test emails have limits, so an account can't be used to send mail in bulk --- duration_ms: 3700.405389 type: 'test' ...# Subtest: security: inputs that were taken on trust are checked (collaborators, check links, paging, MCP batches, reserved names)ok 42 - security: inputs that were taken on trust are checked (collaborators, check links, paging, MCP batches, reserved names) --- duration_ms: 978.396783 type: 'test' ...# Subtest: security: environment reviewers hold a deploy job until a listed person approves, and nobody else canok 43 - security: environment reviewers hold a deploy job until a listed person approves, and nobody else can --- duration_ms: 15793.659002 type: 'test' ...# Subtest: security: adding someone by username sends an invitation, and they get access only once they acceptok 44 - security: adding someone by username sends an invitation, and they get access only once they accept --- duration_ms: 3218.66893 type: 'test' ...