feat(client): add video_url content part for multimodal video input - #107
feat(client): add video_url content part for multimodal video input#107octo-patch wants to merge 1 commit into
Conversation
|
Thank you for your contribution. I see that you removed the PR template. Please read the CLA here: Contributor License Agreement Will be tested and if nothing comes up can be merged afterwards. Thank you! |
|
I'm confused on what an IDE needs with video input. |
|
There are some code -> video workflows where this can come in handy, also generally I think it can be helpful to attach videos as workflows instead of manually explaining things. It is a minimal targeted change and should equally support Gemma, I am not against it. |
|
Okay cool, I was just really curious on how this would work |
Reason: Add a video content-part type and request serialization so the OpenAI-compatible chat schema can express video input, preserving existing text/image handling.
Changes:
ContentPartVideoURLcontent-part type and aVideoURLpayload struct (mirroringImageURL) ininternal/client/types.go, serialized as the OpenAI-compatiblevideo_urlfield.Submitpath alongside images: files detected asvideo/*are encoded asvideo_urlcontent parts when the model supports vision; otherwise they fall back to a text note (parallel to the existing image behavior).Checks:
go build ./...go vet ./internal/client/ ./internal/orchestrator/ ./internal/tui/go test ./internal/client/ ./internal/orchestrator/ ./internal/tui/