Skip to content

Add pulse listener service for build repair agent#6246

Open
evgenyrp wants to merge 4 commits into
mozilla:masterfrom
evgenyrp:hackbot_pulse_listener
Open

Add pulse listener service for build repair agent#6246
evgenyrp wants to merge 4 commits into
mozilla:masterfrom
evgenyrp:hackbot_pulse_listener

Conversation

@evgenyrp

@evgenyrp evgenyrp commented Jun 26, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

A simple Pulse queue listener that triggers the Hackbot API Build Repair Agent

Job deduplication by revision is done in a memory cache with TTL, which should be sufficient for now if we run just one instance. A more robust deduplication will be done in #6279

Logs from testing locally (it created 4 successful build repair jobs):

 ✔ Image hackbot-pulse-listener-hackbot-pulse-listener       Built                                                                                                                                                                                                                                                                                                      4.4s
 ✔ Container hackbot-pulse-listener-hackbot-pulse-listener-1 Recreated                                                                                                                                                                                                                                                                                                  0.2s
Attaching to hackbot-pulse-listener-1
hackbot-pulse-listener-1  | INFO:__main__:Listening for build failures on exchange/taskcluster-queue/v1/task-failed; watched repos: ['autoland', 'try']
hackbot-pulse-listener-1  | INFO:kombu.mixins:Connected to amqp://build-repair-bot:**@pulse.mozilla.org:5671//
hackbot-pulse-listener-1  | INFO:httpx:HTTP Request: GET https://lando.moz.tools/api/hg2git/firefox/193667c8ffaa7cb05d5f0491f5c4ee1d59c8a72c "HTTP/1.1 200 OK"
hackbot-pulse-listener-1  | INFO:httpx:HTTP Request: POST https://hackbot-api-1016592520788.us-central1.run.app/agents/build-repair/runs "HTTP/1.1 201 Created"
hackbot-pulse-listener-1  | INFO:app.consumer:Triggered build-repair run 6f0da789-659a-4fc7-a538-1487b7921aac for autoland@193667c8ffaa7cb05d5f0491f5c4ee1d59c8a72c (git 696745f74f4494c9f0f5132198f5f6bd832ef403)
hackbot-pulse-listener-1  | INFO:httpx:HTTP Request: GET https://lando.moz.tools/api/hg2git/firefox/5fb63687f8d9f87ef085cfa1a54c9d4133750533 "HTTP/1.1 200 OK"
hackbot-pulse-listener-1  | INFO:httpx:HTTP Request: POST https://hackbot-api-1016592520788.us-central1.run.app/agents/build-repair/runs "HTTP/1.1 201 Created"
hackbot-pulse-listener-1  | INFO:app.consumer:Triggered build-repair run e4fd1ea4-5aa9-4b9f-a511-a6ba341cc9c9 for autoland@5fb63687f8d9f87ef085cfa1a54c9d4133750533 (git 97bc7e3aa0c8e08a9154cd320d033e0d176f84bb)
hackbot-pulse-listener-1  | INFO:app.consumer:Revision 193667c8ffaa7cb05d5f0491f5c4ee1d59c8a72c already processed; skipping
hackbot-pulse-listener-1  | INFO:httpx:HTTP Request: GET https://lando.moz.tools/api/hg2git/firefox/240ebcfdd513b8312a019416aab401a3be3ec82f "HTTP/1.1 200 OK"
hackbot-pulse-listener-1  | INFO:httpx:HTTP Request: POST https://hackbot-api-1016592520788.us-central1.run.app/agents/build-repair/runs "HTTP/1.1 201 Created"
hackbot-pulse-listener-1  | INFO:app.consumer:Triggered build-repair run 365379bc-00fe-4fb3-9acb-a68f247f40ba for autoland@240ebcfdd513b8312a019416aab401a3be3ec82f (git 1d4c4df03124a14c496e97f55f3aa618ebcbe49c)
hackbot-pulse-listener-1  | INFO:app.consumer:Revision 193667c8ffaa7cb05d5f0491f5c4ee1d59c8a72c already processed; skipping
hackbot-pulse-listener-1  | INFO:app.consumer:Revision 240ebcfdd513b8312a019416aab401a3be3ec82f already processed; skipping
hackbot-pulse-listener-1  | INFO:app.consumer:Revision 193667c8ffaa7cb05d5f0491f5c4ee1d59c8a72c already processed; skipping
hackbot-pulse-listener-1  | INFO:app.consumer:Revision 193667c8ffaa7cb05d5f0491f5c4ee1d59c8a72c already processed; skipping
hackbot-pulse-listener-1  | INFO:app.consumer:Revision 240ebcfdd513b8312a019416aab401a3be3ec82f already processed; skipping
hackbot-pulse-listener-1  | INFO:app.consumer:Revision 240ebcfdd513b8312a019416aab401a3be3ec82f already processed; skipping
hackbot-pulse-listener-1  | INFO:app.consumer:Revision 240ebcfdd513b8312a019416aab401a3be3ec82f already processed; skipping
hackbot-pulse-listener-1  | INFO:app.consumer:Revision 193667c8ffaa7cb05d5f0491f5c4ee1d59c8a72c already processed; skipping
hackbot-pulse-listener-1  | INFO:httpx:HTTP Request: GET https://lando.moz.tools/api/hg2git/firefox/ed978698b2622b731b9a638d4c1acec4b00c6d77 "HTTP/1.1 200 OK"
hackbot-pulse-listener-1  | INFO:httpx:HTTP Request: POST https://hackbot-api-1016592520788.us-central1.run.app/agents/build-repair/runs "HTTP/1.1 201 Created"
hackbot-pulse-listener-1  | INFO:app.consumer:Triggered build-repair run d85d67eb-cc5a-49dc-ac72-484e9ca2398d for autoland@ed978698b2622b731b9a638d4c1acec4b00c6d77 (git 2c5fe8a807f97d7cb5686f4efdd3f1d185fbe680)
hackbot-pulse-listener-1  | INFO:app.consumer:Revision 240ebcfdd513b8312a019416aab401a3be3ec82f already processed; skipping
hackbot-pulse-listener-1  | INFO:app.consumer:Revision 193667c8ffaa7cb05d5f0491f5c4ee1d59c8a72c already processed; skipping
hackbot-pulse-listener-1  | INFO:app.consumer:Revision 240ebcfdd513b8312a019416aab401a3be3ec82f already processed; skipping
hackbot-pulse-listener-1  | INFO:app.consumer:Revision ed978698b2622b731b9a638d4c1acec4b00c6d77 already processed; skipping
hackbot-pulse-listener-1  | INFO:app.consumer:Revision 5fb63687f8d9f87ef085cfa1a54c9d4133750533 already processed; skipping
hackbot-pulse-listener-1  | INFO:app.consumer:Revision 193667c8ffaa7cb05d5f0491f5c4ee1d59c8a72c already processed; skipping
hackbot-pulse-listener-1  | INFO:app.consumer:Revision 240ebcfdd513b8312a019416aab401a3be3ec82f already processed; skipping
hackbot-pulse-listener-1  | INFO:app.consumer:Revision 240ebcfdd513b8312a019416aab401a3be3ec82f already processed; skipping
hackbot-pulse-listener-1  | INFO:app.consumer:Revision 193667c8ffaa7cb05d5f0491f5c4ee1d59c8a72c already processed; skipping
hackbot-pulse-listener-1  | INFO:app.consumer:Revision 240ebcfdd513b8312a019416aab401a3be3ec82f already processed; skipping
hackbot-pulse-listener-1  | INFO:app.consumer:Revision 193667c8ffaa7cb05d5f0491f5c4ee1d59c8a72c already processed; skipping
hackbot-pulse-listener-1  | INFO:app.consumer:Revision 240ebcfdd513b8312a019416aab401a3be3ec82f already processed; skipping
hackbot-pulse-listener-1  | INFO:app.consumer:Revision 240ebcfdd513b8312a019416aab401a3be3ec82f already processed; skipping
hackbot-pulse-listener-1  | INFO:app.consumer:Revision 240ebcfdd513b8312a019416aab401a3be3ec82f already processed; skipping
hackbot-pulse-listener-1  | INFO:app.consumer:Revision 193667c8ffaa7cb05d5f0491f5c4ee1d59c8a72c already processed; skipping

fixes #6261

@evgenyrp evgenyrp mentioned this pull request Jun 30, 2026
Open
evgenyrp and others added 2 commits June 30, 2026 14:13
@evgenyrp @claude
Remove email notifications from pulse listener
2345e10 
Notification about run outcomes is out of scope for the listener (mozilla#6261);
it will live in the API or a separate service. Drop the SendGrid email
sender, the run-polling worker, the get_run API client, and the
ThreadPoolExecutor that fed them, along with their settings and deploy
config.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
@evgenyrp
Add hg commit mapping to git
de587c5
@evgenyrp evgenyrp changed the title [WIP] Initial implementation of pulse listener Add pulse listener service for build repair agent Jul 2, 2026
@evgenyrp evgenyrp marked this pull request as ready for review July 2, 2026 18:08
@evgenyrp evgenyrp requested a review from suhaibmujahid July 2, 2026 18:08
@evgenyrp

evgenyrp commented Jul 2, 2026

Copy link
Copy Markdown
Contributor Author

Some TRY tasks are skipped because there's no mapping to the git repo (or I don't know how to find it)

hackbot-pulse-listener-1  | INFO:httpx:HTTP Request: GET https://lando.moz.tools/api/hg2git/firefox/5060d391585bcb4051af08b3a5172b0d03536514 "HTTP/1.1 404 Not Found"
hackbot-pulse-listener-1  | WARNING:app.consumer:Could not map hg revision 5060d391585bcb4051af08b3a5172b0d03536514 to git for task e0OpWjxdQpaCpmJBmgtu4g (try); skipping
hackbot-pulse-listener-1  | INFO:httpx:HTTP Request: GET https://lando.moz.tools/api/hg2git/firefox/7210144a7a5e987d340af7fe352ef1291985ff2a "HTTP/1.1 404 Not Found"
hackbot-pulse-listener-1  | WARNING:app.consumer:Could not map hg revision 7210144a7a5e987d340af7fe352ef1291985ff2a to git for task KVH_kgsKRTmlhpCSc0-Vzw (try); skipping

@evgenyrp

evgenyrp commented Jul 2, 2026

Copy link
Copy Markdown
Contributor Author

@suhaibmujahid I don't know if the deployment script is in line with your latest developments. I didn't test it. Maybe I can try if I have enough permissions.

evgenyrp
evgenyrp commented Jul 2, 2026
View reviewed changes
Comment thread ui/changes/snowpack.config.js
devOptions: {
/* ... */
},
plugins: [/* ... */],

@evgenyrp evgenyrp Jul 2, 2026

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

CI failed on this, so I had to rerun prettier

@suhaibmujahid suhaibmujahid Jul 2, 2026

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is a fixed bug with pre-commit. If you rebase, it should be resolved.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@suhaibmujahid suhaibmujahid Awaiting requested review from suhaibmujahid

At least 1 approving review is required to merge this pull request.

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

Listener for Taskcluster build failures

2 participants

@evgenyrp @suhaibmujahid