Skip to content

test: Fix flaky integration tests asserting membership in capped iterate()#824

Open
vdusek wants to merge 3 commits into
masterfrom
test/fix-flaky-request-queue-collection-iterate
Open

test: Fix flaky integration tests asserting membership in capped iterate()#824
vdusek wants to merge 3 commits into
masterfrom
test/fix-flaky-request-queue-collection-iterate

Conversation

@vdusek
Copy link
Copy Markdown
Contributor

@vdusek vdusek commented May 25, 2026

Summary

Several *_collection_iterate integration tests created a few resources, called iterate(limit=10, desc=True), and asserted each just-created ID showed up. limit is a total cap, not a per-page size — under the parallel suite, other workers creating the same resource type could push the fresh items past the 10-newest window before the assertion ran.

Dropping limit=10 lets the iterator walk the full collection (server-side pagination still chunks the requests), so the inclusion check runs against the full set instead of a racy window.

Failing CI runs

Drop the limit=10 cap so the iterator walks all of the user's queues;
under the parallel integration suite, other tests creating queues
concurrently could push the just-created ones past the 10-newest
window and the inclusion assertion would fail.
@vdusek vdusek added adhoc Ad-hoc unplanned task added during the sprint. t-tooling Issues with this label are in the ownership of the tooling team. labels May 25, 2026
@vdusek vdusek self-assigned this May 25, 2026
@vdusek vdusek requested a review from janbuchar May 25, 2026 11:59
@github-actions github-actions Bot added this to the 141st sprint - Tooling team milestone May 25, 2026
@github-actions github-actions Bot added the tested Temporary label used only programatically for some analytics. label May 25, 2026
@codecov
Copy link
Copy Markdown

codecov Bot commented May 25, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 94.56%. Comparing base (1fe3274) to head (19f3c2e).

Additional details and impacted files
@@           Coverage Diff           @@
##           master     #824   +/-   ##
=======================================
  Coverage   94.56%   94.56%           
=======================================
  Files          48       48           
  Lines        4929     4929           
=======================================
  Hits         4661     4661           
  Misses        268      268           
Flag Coverage Δ
integration 92.98% <ø> (ø)
unit 83.07% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@vdusek vdusek changed the title test: Fix flaky test_request_queue_collection_iterate test: Fix flaky integration tests asserting membership in capped iterate() May 25, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

adhoc Ad-hoc unplanned task added during the sprint. t-tooling Issues with this label are in the ownership of the tooling team. tested Temporary label used only programatically for some analytics.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants