Skip to content

✨ Added Anthropic and Groq support#684

Draft
devjpt23 wants to merge 1 commit into
konveyor:mainfrom
devjpt23:agents
Draft

✨ Added Anthropic and Groq support#684
devjpt23 wants to merge 1 commit into
konveyor:mainfrom
devjpt23:agents

Conversation

@devjpt23

Copy link
Copy Markdown
Contributor

Once this PR is merged, Anthropic and Groq models can be accessed via the IDE by changing the model in provider-settings.yaml. Below shows the way the file needs to be changed.


environment:
  ALWAYS_APPLIED_KEY: "envvar to be set regardless of which model is active"

# This is a collection of model configurations that may be used.  The `&active`
# anchor is used to reference the model to the active node below.  The extension will
# use the active node for configuration the kai-rpc-server.
models:
  ChatAnthropic:
    environment:
      ANTHROPIC_API_KEY: "YOUR_ANTHROPIC_API_KEY"

    provider: "ChatAnthropic"
    args:
      model: "claude-3-5-sonnet-20241022"

  
  ChatGroq: &active
    environment:
      GROQ_API_KEY: "YOUR_GROQ_API_KEY

    provider: "ChatGroq"
    args:
      model: "mixtral-8x7b-32768"

@devjpt23 devjpt23 marked this pull request as draft February 24, 2025 03:09
@devjpt23 devjpt23 force-pushed the agents branch 2 times, most recently from 55c1299 to d42e2c7 Compare February 24, 2025 15:12
@jwmatthews

Copy link
Copy Markdown
Member

@devjpt23 we will likely want to bring in #675 first and then your PR after it’s ready and tested.

It would be worth you taking a look at #675 and being familiar, we think the continuation support may be the fix to problems we’ve seen working with Claude and other models via Amazon bedrock in past.

@devjpt23 devjpt23 force-pushed the agents branch 2 times, most recently from b99dd1d to 81a7ee9 Compare February 27, 2025 03:27
Signed-off-by: devjpt23 <devpatel232408@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants