Skip to content

Support salience annotation formats from open-source platforms #20

Open

Description

@g8a9

Part of our API accepts human rationale annotations to evaluate explanations on plausibility metrics. It is reasonable to assume that human workers will annotate text with such rationales using open-source tools such as Label Studio.

In this regard, we might want to support off-the-shelf some of the output formats these platforms have. E.g:

  • Label Studio: list of spans, where each span is a tuple with (starting index, ending index)

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions