Improve tools list

[zverianskii]

No description provided.

[Copilot]

Pull request overview

This PR expands the benchmark pipeline’s recognized tool/bot set by adding Devin, and updates stored offline result artifacts accordingly.

Changes:

• Add devin-ai-integration[bot] to the default chatbot usernames allowlist.
• Append Devin tool evaluation entries into the Sonnet results evaluations.json.
• Add Devin candidate issue lists to Sonnet/Opus candidates.json outputs and ignore a couple of local tooling files.

Reviewed changes

Copilot reviewed 2 out of 11 changed files in this pull request and generated no comments.

Show a summary per file

File	Description
online/etl/config.py	Adds Devin bot username to the default chatbot username list used by the ETL pipeline.
offline/results/anthropic_claude-sonnet-4-5-20250929/evaluations.json	Adds Devin evaluation metrics blocks for multiple PR URLs.
offline/results/anthropic_claude-sonnet-4-5-20250929/candidates.json	Adds Devin-extracted candidate issues per PR URL (and empty arrays where applicable).
offline/results/anthropic_claude-opus-4-5-20251101/candidates.json	Adds Devin (and qodo-v2) candidate issue lists to this result set.
.gitignore	Ignores .syncignore and .zed artifacts.

Comments suppressed due to low confidence (1)

online/etl/config.py:85

• DEFAULT_CHATBOT_USERNAMES appears to be kept in alphabetical order; adding devin-ai-integration[bot] at the end breaks that ordering and makes it harder to scan/diff over time. Consider inserting it in the correct sorted position (between cursor[bot] and entelligence-ai-pr-reviews[bot]).

    "kiloconnect[bot]",
    "propel-code-bot[bot]",
    "qodo-code-review[bot]",
    "devin-ai-integration[bot]",
]

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

You can also share your feedback on Copilot code review. Take the survey.