Skip to content

Revisions#25

Merged
alexandonian merged 4 commits intomainfrom
revisions
Sep 30, 2025
Merged

Revisions#25
alexandonian merged 4 commits intomainfrom
revisions

Conversation

@alexandonian
Copy link
Copy Markdown
Contributor

This pull request refactors the data analysis environment and prompt templates to simplify question handling and answer submission. The main changes include removing support for multiple simultaneous questions, updating prompt instructions to reflect single-question tasks, and standardizing answer formatting with XML tags. Additionally, the notebook execution timeout has been increased to accommodate longer-running analyses.

Refactoring question and answer handling:

  • Removed support for multiple simultaneous questions and multiple-choice question lists (mcqs) from the DataAnalysisEnvironment class, simplifying it to handle only single questions and single answers. [1] [2] [3]
  • The submit_answer method no longer performs correctness evaluation or handles JSON/dictionary answers; it now simply records and returns the submitted answer.

Prompt and answer format updates:

  • Updated all prompt templates in prompts.py to refer to a single question instead of multiple questions, and clarified instructions for MCQ and open-ended tasks. [1] [2] [3]
  • Standardized answer submission instructions to require answers wrapped in XML tags (<answer>...</answer>) for all question types.

Environment configuration:

  • Increased the notebook execution timeout from 300 seconds to 1200 seconds in notebook_env.py to support longer-running analyses.

…ferences from "questions" to "question" and updating submission instructions for answers.
…ed in XML tags for consistency across different answer types.
…simplifying answer submission logic, enhancing code clarity and maintainability.
Copy link
Copy Markdown
Collaborator

@ludomitch ludomitch left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💪

@alexandonian alexandonian merged commit 953a6b1 into main Sep 30, 2025
2 checks passed
@alexandonian alexandonian deleted the revisions branch September 30, 2025 00:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants