Diffinery

codician/diffinerypublic

Open-source, agent-first GitHub and GitHub Actions alternative that runs on your own Cloudflare account: git hosting, pull requests, code review and drop-in GitHub Actions YAML on Workers, Durable Objects, R2 and Containers.

End-to-end (security)

took 3m 53s Raw logs

Matrix: name: security, shard: security

Set up job
Diffinery runner: job e2e (End-to-end (security)) for codician/diffinery@aeb26c270036Runner: image diffinery-runner:efee6389dfc1b5bd5a743d5e, in lhr01, WEUR, container 1e82c7a3bdf6b4e8aa78bcfc7ead6447f90e633a9de2b6bdfc909321f861a57aRunner size: large (4 vCPU, 12 GiB of memory, 20 GB of disk), an earlier run of this job wasn't measured closely enough (busy cores every quarter second); runs-on: diffinery-large (or -medium, -small, -tiny) sets a sizeHost: AMD EPYC (family 25, model 17), 4 vCPUs, 2550 MHzWorkspace: /workspace/diffineryHost: 0% of the vCPUs' time went to other work on the host (steal)Job completed with conclusion: successResources: 1.0 of 4 vCPUs busy on average (2.4 at the 95th percentile), peak memory 3.6 GiB of 11.9 GiB, peak disk 2.2 GB of 19.3 GB
Run actions/checkout@v42s
##[group]Run actions/checkout@v4##[endgroup]Syncing repository: codician/diffineryFetching the repository (depth 1)remote: Enumerating objects: 686, done.        Receiving objects:   0% (1/686)
Receiving objects:   1% (7/686)
Receiving objects:   2% (14/686)
Receiving objects:   3% (21/686)
Receiving objects:   4% (28/686)
Receiving objects:   5% (35/686)
Receiving objects:   6% (42/686)
Receiving objects:   7% (49/686)
Receiving objects:   8% (55/686)
Receiving objects:   9% (62/686)
Receiving objects:  10% (69/686)
Receiving objects:  11% (76/686)
Receiving objects:  12% (83/686)
Receiving objects:  13% (90/686)
Receiving objects:  14% (97/686)
Receiving objects:  15% (103/686)
Receiving objects:  16% (110/686)
Receiving objects:  17% (117/686)
Receiving objects:  18% (124/686)
Receiving objects:  19% (131/686)
Receiving objects:  20% (138/686)
Receiving objects:  21% (145/686)
Receiving objects:  22% (151/686)
Receiving objects:  23% (158/686)
Receiving objects:  24% (165/686)
Receiving objects:  25% (172/686)
Receiving objects:  26% (179/686)
Receiving objects:  27% (186/686)
Receiving objects:  28% (193/686)
Receiving objects:  29% (199/686)
Receiving objects:  30% (206/686)
Receiving objects:  31% (213/686)
Receiving objects:  32% (220/686)
Receiving objects:  33% (227/686)
Receiving objects:  34% (234/686)
Receiving objects:  35% (241/686)
Receiving objects:  36% (247/686)
Receiving objects:  37% (254/686)
Receiving objects:  38% (261/686)
Receiving objects:  39% (268/686)
Receiving objects:  40% (275/686)
Receiving objects:  41% (282/686)
Receiving objects:  42% (289/686)
Receiving objects:  43% (295/686)
Receiving objects:  44% (302/686)
Receiving objects:  45% (309/686)
Receiving objects:  46% (316/686)
Receiving objects:  47% (323/686)
Receiving objects:  48% (330/686)
Receiving objects:  49% (337/686)
Receiving objects:  50% (343/686)
Receiving objects:  51% (350/686)
Receiving objects:  52% (357/686)
Receiving objects:  53% (364/686)
Receiving objects:  54% (371/686)
Receiving objects:  55% (378/686)
Receiving objects:  56% (385/686)
Receiving objects:  57% (392/686)
Receiving objects:  58% (398/686)
Receiving objects:  59% (405/686)
Receiving objects:  60% (412/686)
Receiving objects:  61% (419/686)
Receiving objects:  62% (426/686)
Receiving objects:  63% (433/686)
Receiving objects:  64% (440/686)
Receiving objects:  65% (446/686)
Receiving objects:  66% (453/686)
Receiving objects:  67% (460/686)
Receiving objects:  68% (467/686)
Receiving objects:  69% (474/686)
Receiving objects:  70% (481/686)
Receiving objects:  71% (488/686)
Receiving objects:  72% (494/686)
Receiving objects:  73% (501/686)
Receiving objects:  74% (508/686)
Receiving objects:  75% (515/686)
Receiving objects:  76% (522/686)
Receiving objects:  77% (529/686)
Receiving objects:  78% (536/686)
Receiving objects:  79% (542/686)
Receiving objects:  80% (549/686)
Receiving objects:  81% (556/686)
Receiving objects:  82% (563/686)
Receiving objects:  83% (570/686)
Receiving objects:  84% (577/686)
Receiving objects:  85% (584/686)
Receiving objects:  86% (590/686)
Receiving objects:  87% (597/686)
Receiving objects:  88% (604/686)
Receiving objects:  89% (611/686)
Receiving objects:  90% (618/686)
Receiving objects:  91% (625/686)
Receiving objects:  92% (632/686)
Receiving objects:  93% (638/686)
Receiving objects:  94% (645/686)
Receiving objects:  95% (652/686)
Receiving objects:  96% (659/686)
Receiving objects:  97% (666/686)
remote: Total 686 (delta 0), reused 686 (delta 0)        Receiving objects:  98% (673/686)
Receiving objects:  99% (680/686)
Receiving objects: 100% (686/686)
Receiving objects: 100% (686/686), 3.04 MiB | 14.70 MiB/s, done.From https://diffinery.com/codician/diffinery * [new ref]         aeb26c2700364ee9445aab364ade438c2761d6fe -> origin/diffinery-checkoutNote: switching to 'aeb26c2700364ee9445aab364ade438c2761d6fe'.You are in 'detached HEAD' state. You can look around, make experimentalchanges and commit them, and you can discard any commits you make in thisstate without impacting any branches by switching back to a branch.If you want to create a new branch to retain commits you create, you maydo so (now or later) by using -c with the switch command. Example:  git switch -c <new-branch-name>Or undo this operation with:  git switch -Turn off this advice by setting config variable advice.detachedHead to falseHEAD is now at aeb26c2 Merge b13798399a855d4139aec47b82b47e87ff6caaf8 into c9968686398fb8e9fa997ae488944ce4164df93bHEAD is now at aeb26c2700364ee9445aab364ade438c2761d6fe
Run pnpm/action-setup@b906affcce14559ad1aafd4ab0e942779e9f58b12s
Download action repository 'pnpm/action-setup@b906affcce14559ad1aafd4ab0e942779e9f58b1'##[group]Run pnpm/action-setup@b906affcce14559ad1aafd4ab0e942779e9f58b1with:  dest: ~/setup-pnpm  run_install: null  cache: false  cache_dependency_path: pnpm-lock.yaml  package_json_file: package.json  standalone: false##[endgroup]##[group]Running self-installer...Progress: resolved 1, reused 0, downloaded 0, added 0Packages: +1+Progress: resolved 1, reused 0, downloaded 1, added 1, donedependencies:+ pnpm 10.28.0 (12.14.0 is available)Done in 982ms##[endgroup]Installation Completed!
Run actions/setup-node@v45s
##[group]Run actions/setup-node@v4with:  node-version: 22  cache: pnpm##[endgroup]Found in cache @ 22.22.0 (pre-installed node satisfies '22')Cache Size: ~216 MB (226493609 B)Cache restored from key: node-cache-Linux-x64-pnpm-a02ba8dce5cb7329b868883337d1a03f862819a15859861dae22d3a8b1092f41
Run pnpm install --frozen-lockfile3s
##[group]Run pnpm install --frozen-lockfile##[endgroup]Scope: all 8 workspace projectsLockfile is up to date, resolution step is skippedProgress: resolved 1, reused 0, downloaded 0, added 0Packages: +250++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Progress: resolved 250, reused 244, downloaded 0, added 250, done.../node_modules/workerd postinstall$ node install.js.../esbuild@0.25.12/node_modules/esbuild postinstall$ node install.js.../esbuild@0.25.11/node_modules/esbuild postinstall$ node install.js.../node_modules/workerd postinstall$ node install.js.../esbuild@0.28.1/node_modules/esbuild postinstall$ node install.js.../esbuild@0.28.1/node_modules/esbuild postinstall: Done.../esbuild@0.25.11/node_modules/esbuild postinstall: Done.../esbuild@0.28.2/node_modules/esbuild postinstall$ node install.js.../esbuild@0.25.12/node_modules/esbuild postinstall: Done.../node_modules/workerd postinstall: Done.../esbuild@0.28.2/node_modules/esbuild postinstall: Done.../node_modules/workerd postinstall: DonedevDependencies:+ turbo 2.11.7+ typescript 5.9.3Done in 2.8s using pnpm v10.28.0
Run pnpm -r --if-present build2s
##[group]Run pnpm -r --if-present build##[endgroup]Scope: 7 of 8 workspace projectsapps/cli build$ esbuild src/bin.ts --bundle --platform=node --target=node22 --format=esm --outfile=dist/diffinery.mjs "--banner:js=#!/usr/bin/env nodeimport { createRequire as __diffineryCreateRequire } from 'node:module'; const require = __diffineryCreateRequire(import.meta.url);"apps/diffinery build$ node islands/build.mjs && node scripts/build-docs.mjscontainers/runner build$ esbuild src/main.ts --bundle --platform=node --target=node22 --format=esm --outfile=dist/agent.mjs --external:bufferutil --external:utf-8-validate "--banner:js=import { createRequire as __diffineryCreateRequire } from 'node:module'; const require = __diffineryCreateRequire(import.meta.url);"apps/cli build:   dist/diffinery.mjs  446.1kbapps/cli build: ⚡ Done in 40msapps/cli build: Donecontainers/runner build:   dist/agent.mjs  682.1kbcontainers/runner build: ⚡ Done in 68mscontainers/runner build: Doneapps/diffinery build: islands: kumo.js 466 KB, kumo.css 149 KB, terminal.js 286 KBapps/diffinery build: docs: 72 pages (+2 generated at runtime), 6 images, CLI 0.1.0 (235 KiB), editor extension 0.1.1 (20 KiB)apps/diffinery build: Done
Run pnpm --filter @diffinery/app exec playwright install --with-deps chromium
Run as_root() { if [ "$(id -u)" = 0 ]; then "$@"; else sudo "$@"; fi; }
Run the shard's tests3m 37s
##[group]Run # Shards of similar length; a new test file runs in "rest" unless it's added to another.core='/e2e\.test\.mjs$'agents='/(agentic|review|tasks)\.test\.mjs$'security='/(security|status)\.test\.mjs$'# The core file's real histories and large pushes take minutes each (jquery's alone 2 to 3 on# Diffinery's runners): two shards of their own, so no part of the file runs into node's# per-file timeout, which is the --test-timeout here.histories='^real histories:'large='^(large files|large pushes):'opts=(--test-timeout=600000)case "security" in  core) files=$(ls test/e2e/*.test.mjs | grep -E "$core"); opts+=(--test-skip-pattern="$histories" --test-skip-pattern="$large") ;;  histories) files=$(ls test/e2e/*.test.mjs | grep -E "$core"); opts=(--test-timeout=900000 --test-name-pattern="$histories") ;;  large) files=$(ls test/e2e/*.test.mjs | grep -E "$core"); opts+=(--test-name-pattern="$large") ;;  agents) files=$(ls test/e2e/*.test.mjs | grep -E "$agents") ;;  security) files=$(ls test/e2e/*.test.mjs | grep -E "$security") ;;  *) files=$(ls test/e2e/*.test.mjs | grep -vE "$core|$agents|$security") ;;esacecho "$files"node --test --test-concurrency=1 "${opts[@]}" $files##[endgroup]test/e2e/security.test.mjstest/e2e/status.test.mjsTAP version 13# Subtest: security: search, required checks, environments, reviews, locks, archives, drafts and tree namesok 1 - security: search, required checks, environments, reviews, locks, archives, drafts and tree names  ---  duration_ms: 27936.957012  type: 'test'  ...# Subtest: security: organization admins can't hand out ownershipok 2 - security: organization admins can't hand out ownership  ---  duration_ms: 74.505693  type: 'test'  ...# Subtest: security: anonymous writes, token scopes, agent secrets, merge rules and draftsok 3 - security: anonymous writes, token scopes, agent secrets, merge rules and drafts  ---  duration_ms: 1115.061981  type: 'test'  ...# Subtest: security: push protection covers commits made without gitok 4 - security: push protection covers commits made without git  ---  duration_ms: 343.815723  type: 'test'  ...# Subtest: security: limited tokens, invisible repositories, readers' labels and the audit trailok 5 - security: limited tokens, invisible repositories, readers' labels and the audit trail  ---  duration_ms: 13468.24646  type: 'test'  ...# Subtest: security: organization pictures are the owners' to change, and invitations aren't sent twiceok 6 - security: organization pictures are the owners' to change, and invitations aren't sent twice  ---  duration_ms: 86.638364  type: 'test'  ...# Subtest: security: organization members get the base permission, which only owners changeok 7 - security: organization members get the base permission, which only owners change  ---  duration_ms: 334.059344  type: 'test'  ...# Subtest: security: leaving an organization takes its repository access alongok 8 - security: leaving an organization takes its repository access along  ---  duration_ms: 366.269513  type: 'test'  ...# Subtest: security: organization settings are checked before anything is saved, and agents see the base permissionok 9 - security: organization settings are checked before anything is saved, and agents see the base permission  ---  duration_ms: 3774.444237  type: 'test'  ...# Subtest: security: a transferred repository keeps its data, and its old name redirects only for readersok 10 - security: a transferred repository keeps its data, and its old name redirects only for readers  ---  duration_ms: 5833.247742  type: 'test'  ...# Subtest: security: agents land changes on protected branches only through auto-merge a person allowed, gated by CIok 11 - security: agents land changes on protected branches only through auto-merge a person allowed, gated by CI  ---  duration_ms: 12825.581902  type: 'test'  ...# Subtest: security: an admin can let agents' auto-merges land on green checks without an approval, and nothing moreok 12 - security: an admin can let agents' auto-merges land on green checks without an approval, and nothing more  ---  duration_ms: 10172.356791  type: 'test'  ...# Subtest: security: an archived repository lands nothing by itself: archiving ends auto-merge and empties the merge queueok 13 - security: an archived repository lands nothing by itself: archiving ends auto-merge and empties the merge queue  ---  duration_ms: 581.658055  type: 'test'  ...# Subtest: security: landing a pull request deletes its head branch only when asked, through auto-merge and the queue too, and never a protected oneok 14 - security: landing a pull request deletes its head branch only when asked, through auto-merge and the queue too, and never a protected one  ---  duration_ms: 1121.766647  type: 'test'  ...# Subtest: security: agents see what auto-merge needs next to the refusal to merge directlyok 15 - security: agents see what auto-merge needs next to the refusal to merge directly  ---  duration_ms: 392.853364  type: 'test'  ...# Subtest: security: the queue's bypass button does what it says, and a merge queue can't contradict linear historyok 16 - security: the queue's bypass button does what it says, and a merge queue can't contradict linear history  ---  duration_ms: 2473.611018  type: 'test'  ...# Subtest: security: no token can mint a token, an agent or a sandbox, through the API or the web formsok 17 - security: no token can mint a token, an agent or a sandbox, through the API or the web forms  ---  duration_ms: 352.729471  type: 'test'  ...# Subtest: security: repository variable endpoints see only the repository's own, and organization variable deletes are checkedok 18 - security: repository variable endpoints see only the repository's own, and organization variable deletes are checked  ---  duration_ms: 5452.617677  type: 'test'  ...# Subtest: security: milestones are checked before an issue is saved, and lists filter by themok 19 - security: milestones are checked before an issue is saved, and lists filter by them  ---  duration_ms: 214.863094  type: 'test'  ...# Subtest: security: push protection reads large files, and revoking a token through the API is on the recordok 20 - security: push protection reads large files, and revoking a token through the API is on the record  ---  duration_ms: 2315.261764  type: 'test'  ...# Subtest: security: git request bodies are bounded, compressed or not, before anything reads themok 21 - security: git request bodies are bounded, compressed or not, before anything reads them  ---  duration_ms: 689.340058  type: 'test'  ...# Subtest: security: a file rewritten from scratch is diffed quickly, even for anonymous readersok 22 - security: a file rewritten from scratch is diffed quickly, even for anonymous readers  ---  duration_ms: 420.466258  type: 'test'  ...# Subtest: security: signed out, a private repository and a missing one look the same everywhereok 23 - security: signed out, a private repository and a missing one look the same everywhere  ---  duration_ms: 207.345317  type: 'test'  ...# Subtest: security: live updates say only that something changed, and never carry audit entries or payloadsok 24 - security: live updates say only that something changed, and never carry audit entries or payloads  ---  duration_ms: 630.927208  type: 'test'  ...# Subtest: security: push protection reads commit and tag messages, UTF-16 files and Diffinery's own tokens, and records opt-outsok 25 - security: push protection reads commit and tag messages, UTF-16 files and Diffinery's own tokens, and records opt-outs  ---  duration_ms: 2207.688442  type: 'test'  ...# Subtest: security: required checks gate direct pushes to a protected branch, as on GitHubok 26 - security: required checks gate direct pushes to a protected branch, as on GitHub  ---  duration_ms: 342.351022  type: 'test'  ...# Subtest: security: issue, pull request and comment text has GitHub's length limitsok 27 - security: issue, pull request and comment text has GitHub's length limits  ---  duration_ms: 205.554795  type: 'test'  ...# Subtest: security: deleting a repository deletes its stored objects toook 28 - security: deleting a repository deletes its stored objects too  ---  duration_ms: 5633.172421  type: 'test'  ...# Subtest: security: pushes are checked like git's fsck: no '..' or '.git' entries, no unsafe .gitmodulesok 29 - security: pushes are checked like git's fsck: no '..' or '.git' entries, no unsafe .gitmodules  ---  duration_ms: 472.717173  type: 'test'  ...# Subtest: security: a job's runner gets only the secrets the job namesok 30 - security: a job's runner gets only the secrets the job names  ---  duration_ms: 603.003745  type: 'test'  ...# Subtest: security: runs of agent code get no repository secrets unless an admin allows itok 31 - security: runs of agent code get no repository secrets unless an admin allows it  ---  duration_ms: 433.202479  type: 'test'  ...# Subtest: security: an agent's commits stay agent code when a person pushes on top, until a person merges themok 32 - security: an agent's commits stay agent code when a person pushes on top, until a person merges them  ---  duration_ms: 666.010247  type: 'test'  ...# Subtest: security: a workflow on another branch can't cancel a protected branch's run by naming its concurrency groupok 33 - security: a workflow on another branch can't cancel a protected branch's run by naming its concurrency group  ---  duration_ms: 2494.113175  type: 'test'  ...# Subtest: security: adding someone by email always invites them, so the address doesn't reveal their username and they agree firstok 34 - security: adding someone by email always invites them, so the address doesn't reveal their username and they agree first  ---  duration_ms: 333.860735  type: 'test'  ...# Subtest: security: a job's log is capped, and oversized workflow files aren't parsedok 35 - security: a job's log is capped, and oversized workflow files aren't parsed  ---  duration_ms: 1429.907179  type: 'test'  ...# Subtest: security: a workflow's token can't use another repository's private packages, and a repository's name is its ownok 36 - security: a workflow's token can't use another repository's private packages, and a repository's name is its own  ---  duration_ms: 408.229758  type: 'test'  ...# Subtest: security: OIDC tokens name the environment a job deployed to, and carry ids that survive a reused nameok 37 - security: OIDC tokens name the environment a job deployed to, and carry ids that survive a reused name  ---  duration_ms: 635.190161  type: 'test'  ...# Subtest: security: sensitive actions need a recent sign-in, sessions end 90 days after it, and one browser can be signed outok 38 - security: sensitive actions need a recent sign-in, sessions end 90 days after it, and one browser can be signed out  ---  duration_ms: 293.49671  type: 'test'  ...# Subtest: security: self-hosted runners register with a one-hour token and claim jobs with their ownok 39 - security: self-hosted runners register with a one-hour token and claim jobs with their own  ---  duration_ms: 914.05138  type: 'test'  ...# Subtest: security: an organization secret reaches only the repositories it's shared withok 40 - security: an organization secret reaches only the repositories it's shared with  ---  duration_ms: 1146.087146  type: 'test'  ...# Subtest: security: an admin can purge objects a force-push left unreachableok 41 - security: an admin can purge objects a force-push left unreachable  ---  duration_ms: 613.586242  type: 'test'  ...# Subtest: security: webhooks reach only public hosts other than Diffinery, at most 20 per repositoryok 42 - security: webhooks reach only public hosts other than Diffinery, at most 20 per repository  ---  duration_ms: 600.345841  type: 'test'  ...# Subtest: security: invitations and test emails have limits, so an account can't be used to send mail in bulkok 43 - security: invitations and test emails have limits, so an account can't be used to send mail in bulk  ---  duration_ms: 1320.558125  type: 'test'  ...# Subtest: security: inputs that were taken on trust are checked (collaborators, check links, paging, MCP batches, reserved names)ok 44 - security: inputs that were taken on trust are checked (collaborators, check links, paging, MCP batches, reserved names)  ---  duration_ms: 397.319649  type: 'test'  ...# Subtest: security: environment reviewers hold a deploy job until a listed person approves, and nobody else canok 45 - security: environment reviewers hold a deploy job until a listed person approves, and nobody else can  ---  duration_ms: 12418.460115  type: 'test'  ...# Subtest: security: adding someone by username sends an invitation, and they get access only once they acceptok 46 - security: adding someone by username sends an invitation, and they get access only once they accept  ---  duration_ms: 872.185003  type: 'test'  ...# Subtest: security: per-account quotas on hosted minutes, hosted jobs at once, sandboxes and repositoriesok 47 - security: per-account quotas on hosted minutes, hosted jobs at once, sandboxes and repositories  ---  duration_ms: 62797.309805  type: 'test'  ...# Subtest: security: a per-account storage quota refuses pushes, Git LFS and release asset uploads past it; reads and deletes keep workingok 48 - security: a per-account storage quota refuses pushes, Git LFS and release asset uploads past it; reads and deletes keep working  ---  duration_ms: 3660.78779  type: 'test'  ...# Subtest: security: kill switches suspend Actions for a repository or an account, and pause hosted compute on the instanceok 49 - security: kill switches suspend Actions for a repository or an account, and pause hosted compute on the instance  ---  duration_ms: 18668.528501  type: 'test'  ...# Subtest: security: Markdown images from other sites load through Diffinery's signed image proxyok 50 - security: Markdown images from other sites load through Diffinery's signed image proxy  ---  duration_ms: 312.864326  type: 'test'  ...# Subtest: status page: anyone can read it, and everything is operational at firstok 51 - status page: anyone can read it, and everything is operational at first  ---  duration_ms: 5035.859813  type: 'test'  ...# Subtest: status page: only site administrators can manage incidents (404 for anyone else)ok 52 - status page: only site administrators can manage incidents (404 for anyone else)  ---  duration_ms: 93.47077  type: 'test'  ...# Subtest: status page: a site administrator opens an incident through the API, and the page shows itok 53 - status page: a site administrator opens an incident through the API, and the page shows it  ---  duration_ms: 63.525834  type: 'test'  ...# Subtest: status page: the web form opens an incident with several components and posts updatesok 54 - status page: the web form opens an incident with several components and posts updates  ---  duration_ms: 198.229619  type: 'test'  ...# Subtest: status page: resolving through the API returns the component to operational and moves the incident to past incidentsok 55 - status page: resolving through the API returns the component to operational and moves the incident to past incidents  ---  duration_ms: 47.887521  type: 'test'  ...# Subtest: status page: changes are audited without the updates' textok 56 - status page: changes are audited without the updates' text  ---  duration_ms: 20.028267  type: 'test'  ...# Subtest: status page: pausing hosted compute shows Actions and agent sandboxes under maintenanceok 57 - status page: pausing hosted compute shows Actions and agent sandboxes under maintenance  ---  duration_ms: 57.666499  type: 'test'  ...1..57# tests 57# suites 0# pass 57# fail 0# cancelled 0# skipped 0# todo 0# duration_ms 217013.01347
Post Run actions/setup-node@v40s
Cache hit occurred on the primary key node-cache-Linux-x64-pnpm-a02ba8dce5cb7329b868883337d1a03f862819a15859861dae22d3a8b1092f41, not saving cache.
Post Run pnpm/action-setup@b906affcce14559ad1aafd4ab0e942779e9f58b10s
Pruning is unnecessary.
Post Run actions/checkout@v40s
Removing persisted credentials