Skip to content

ci(install): time the one-line install on arm64 for the scorecard - #490

Merged
adeelahmad merged 1 commit into
mainfrom
claude/project-thread-yw34ry
Oct 17, 2026
Merged

adeelahmad merged 1 commit into
mainfrom
claude/project-thread-yw34ry

Conversation

@adeelahmad

@adeelahmad adeelahmad commented Oct 17, 2026 •

Copy link
Copy Markdown
Owner

Requested by Adeel · project thread

Description

Before: make scorecard (#487) reported install to first answer, idle RAM and disk as "not measured", because nothing timed an install on arm64, and nothing in CI installed Lens on arm64 at all.

After: the Install workflow has a new job, One-line install on arm64, timed, on GitHub's ubuntu-24.04-arm runner. It times the one-line install until the setup page answers, lets the stack settle for two minutes, then measures the containers' memory (docker stats) and the disk (Docker's images, containers and volumes, plus the install folder; the build cache is kept apart) with ci/scorecard/measure_install.py, and keeps the result as the install-scorecard artifact and in the run summary. make scorecard reads the newest one from main into install_to_first_answer_s, idle_ram_mb and disk_mb, with the machine, target and commit they were taken on.

The runner (4 cores, 16 GB, Docker already there) is faster than a Raspberry Pi, so the time is a floor; RAM and disk are what Lens takes there. It runs when the install changes, weekly and by hand, like the rest of the Install workflow.

First numbers, from this pull request's run (artifact), default full target on aarch64:

Number Value
Install line to setup page answering 144 s
Idle RAM 444 MB (surrealdb 148, backend 141, worker 84, frontend 71)
Disk 4462 MB (images 4435, volumes 1, install folder 26), plus 2423 MB of build cache

Motivation and Context

Closes #481: the last numbers the scorecard was missing.

Types of changes

  • New feature (non-breaking change which adds functionality)

Checklist:

  • The title is a Conventional Commit.
  • My code follows the code style of this project (ci/local-ci.sh --jobs pre-commit,title passed, actionlint included).
  • I added or updated tests (5 more in ci/scorecard/test_scorecard.py: sizes, docker stats and df, reading the artifact, no artifact or token).
  • My change requires documentation updates, and I have updated docs/ accordingly (Contributing, Scorecard).
  • Users need more than the title: n/a, CI only.

Done questions (AGENTS.md)

  • Goal: green CI, including the new arm64 job; merging now.
  • Agents: make scorecard carries the numbers.
  • Zero setup: CI only.
  • n/a Fewest clicks: CI only.
  • n/a Configurable: no app setting.
  • Light: this is the check that the default install runs on arm64, and what it weighs.
  • Private and secure: no new app surface.
  • n/a Cost: no model calls; arm64 hosted runners are free for public repositories.
  • User decides: defaults unchanged.
  • n/a Upgrades: no stored data.
  • Honest: the runner isn't a Pi, said in the workflow, the docs and the numbers' machine.
  • Tests, docs and generated files updated.
  • Open standards; no new dependencies.
  • Result reported with evidence; refine later: time on a real Pi (a self-hosted arm64 runner), the time to the assistant's first answer rather than the setup page, and whether the 2.4 GB build cache should stay after install.
  • Reuse: the same install steps as the One-line install job; Docker's own stats and df.

🤖 Generated with Claude Code

https://claude.ai/code/session_01SDzZtD95f3XeGHNfinM1qv

A new Install workflow job installs Lens on GitHub's arm64 runner, times the
install line until the setup page answers, then lets the stack settle and
measures its containers' memory and its disk (ci/scorecard/measure_install.py),
kept as the install-scorecard artifact. make scorecard reads the newest one
from main for install_to_first_answer_s, idle_ram_mb and disk_mb, which said
"not measured" until now.

Part of #481.

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01SDzZtD95f3XeGHNfinM1qv
@adeelahmad adeelahmad self-assigned this Oct 17, 2026
@adeelahmad
adeelahmad merged commit 2c42d92 into main Oct 17, 2026
18 checks passed
@adeelahmad
adeelahmad deleted the claude/project-thread-yw34ry branch October 17, 2026 03:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Scorecard: make scorecard measures whether Lens is meeting its goals

2 participants