Skip to content

[Feature Request] Allow interrupting the text generation #206

@felladrin

Description

@felladrin

Currently, it seems there is no way to send a signal to interrupt the text generation in the model.run().

/// User-facing method to run the model.
///
/// Untyped input is required unfortunately.
pub async fn run(&mut self, input: JsValue) -> Result<JsValue, JsValue> {
self.inner.run(input).await
}

My current workaround is to call location.reload() to interrupt it.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions