-
Notifications
You must be signed in to change notification settings - Fork 28
[Feature]: swebench pyxis x86 support #440
Copy link
Copy link
Open
Labels
area: evaluationAccuracy evaluation, scoring, extractorsAccuracy evaluation, scoring, extractorspriority: P1High — must address this cycleHigh — must address this cycletype: enhancementImprovement to existing functionalityImprovement to existing functionalitytype: featureNew feature or capabilityNew feature or capability
Description
Activity
Metadata
Metadata
Assignees
Labels
area: evaluationAccuracy evaluation, scoring, extractorsAccuracy evaluation, scoring, extractorspriority: P1High — must address this cycleHigh — must address this cycletype: enhancementImprovement to existing functionalityImprovement to existing functionalitytype: featureNew feature or capabilityNew feature or capability
Motivation
With #343 merged, we can use pyxis/enroot to run swebench. However, the current implementation only support arm64 machines.
Adding x86 support would make pyxis support functionally complete as submitters can use either docker/pyxis on their systems depending on what is supported.
Proposed Solution
Add support for x86/amd64 pyxis for swebench.
Alternatives Considered
No response
Additional Context
No response