Skip to content

Dropped the IPS_TO_SKIP secret in favor of the excluded_ips.txt file on the host - #11

Merged
CodyCBakerPhD merged 3 commits into
mainfrom
excluded-ips-list
Oct 28, 2026
Merged

CodyCBakerPhD merged 3 commits into
mainfrom
excluded-ips-list

Conversation

@CodyCBakerPhD

Copy link
Copy Markdown
Contributor

Summary

This is the EMBER counterpart of brain-bbqs-runners/dandi-usage-runner#12. It follows dandi/s3-log-extraction#321 (released in s3-log-extraction 1.14.1) and dandi/dandi-s3-log-extraction#108, after which dandis3logextraction no longer reads IPS_TO_SKIP. It drops the exact addresses listed in ~/.s3-log-extraction/excluded_ips.txt, the only list of excluded addresses, with one address per line and # comments.

  • Removed IPS_TO_SKIP: ${{ secrets.IPS_TO_SKIP }} from the extraction workflow.
  • Removed the "Validate required secrets" step. It existed only because an empty regex matched every IP. An empty list now excludes nothing.
  • The README drops the secret, documents the runner user's excluded_ips.txt as the one place to list excluded requesters, and notes that removing an address needs a fresh extraction to bring its requests back.

⚠️ Before merging

  1. Shared file? The list lives in the runner user's home directory, not under /mnt/s3-logs/ember-s3-logs. If the EMBER and DANDI runners run as the same user on Typhon, they share one excluded_ips.txt, so any address in it is excluded from both archives. If EMBER needs a different list, it has to run as a separate user.
  2. Convert EMBER's IPS_TO_SKIP regex into explicit addresses in that file, one per line. Patterns and CIDR networks are refused with an error. Any requester the regex matched but the list leaves out will start being extracted.
  3. Dispatch this repository's install workflow. EMBER has its own environment at /mnt/s3-logs/ember-s3-logs/env, so running the DANDI install workflow did not update it. Until then the old extractor still reads IPS_TO_SKIP.
  4. Merge, then delete the IPS_TO_SKIP repository secret.

Testing

pre-commit run --all-files passes, including the workflow schema check.


Generated by Claude Code

The extractor now drops the exact addresses listed in
~/.s3-log-extraction/excluded_ips.txt on the runner's host, so the regex
secret and the step that required it are removed.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01LWo8Rh1Ceh8UAWkJCdHou3
@CodyCBakerPhD CodyCBakerPhD self-assigned this Oct 28, 2026
@CodyCBakerPhD
CodyCBakerPhD marked this pull request as ready for review October 28, 2026 06:23
Keeps the new SUMMARIES_REPOSITORY_TOKEN secret from #9 and drops the
IPS_TO_SKIP entry, as this pull request does.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01LWo8Rh1Ceh8UAWkJCdHou3
@CodyCBakerPhD
CodyCBakerPhD merged commit c0e0550 into main Oct 28, 2026
1 check passed
@CodyCBakerPhD
CodyCBakerPhD deleted the excluded-ips-list branch October 28, 2026 06:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants