-
Notifications
You must be signed in to change notification settings - Fork 2
All issues
Issue creation is restricted in this repository
Issues
is:issue state:open
is:issue state:open
Search results
make
qt versionworkenhancementNew feature or requestNew feature or requestStatus: Open.#76 In quantiles-evals/quantiles;- Status: Open.#74 In quantiles-evals/quantiles;
Add a
response_labelsfield toexact_matchcustom_nocodeevalsenhancementNew feature or requestNew feature or requestStatus: Open.#70 In quantiles-evals/quantiles;Make benchmark registry benchmarks optionally contain
qtversion constraintsenhancementNew feature or requestNew feature or requestStatus: Open.#69 In quantiles-evals/quantiles;Remove PubMedQA built-in benchmark code
enhancementNew feature or requestNew feature or requestStatus: Open.#64 In quantiles-evals/quantiles;- Status: Open.#60 In quantiles-evals/quantiles;
Add a
labelscoring style tocustom_nocodebenchmarksenhancementNew feature or requestNew feature or requestStatus: Open.#59 In quantiles-evals/quantiles;Seperate custom no-code example by style
documentationImprovements or additions to documentationImprovements or additions to documentationenhancementNew feature or requestNew feature or requestStatus: Open.#53 In quantiles-evals/quantiles;Make sure CLI versions built/uploaded with the
ci-release.yamljob have a correctqt --versionenhancementNew feature or requestNew feature or requestStatus: Open.#47 In quantiles-evals/quantiles;Set up GitHub actions caching for CLI builds/tests/etc...
testingTests that should be writtenTests that should be writtenStatus: Open.#45 In quantiles-evals/quantiles;Ensure all configuration, in
--inputflag and configuration file, to limit number of samples is named"samples"bugSomething isn't workingSomething isn't workingStatus: Open.#42 In quantiles-evals/quantiles;Add distribution metrics for input and output tokens
enhancementNew feature or requestNew feature or requestStatus: Open.#41 In quantiles-evals/quantiles;