Tools do not work with ollama

[ColtonMcInroy]

Changing the example MiddleSchoolMathAgent.ts from openai to ollama results in the following error:
TypeError: model.doGenerateToolCalls is not a function

[lgrammel]

With Ollama, you need to specify how you go from text output to tools. There are some examples here: https://github.com/lgrammel/modelfusion/tree/main/examples/basic/src/model-provider/ollama

E.g.:

 const { tool, args, toolCall, result } = await useTool(
    ollama
      .CompletionTextGenerator({
        model: "mistral",
        promptTemplate: ollama.prompt.Mistral,
        raw: true, // required when using custom prompt template
        format: "json",
        temperature: 0,
        stopSequences: ["\n\n"], // prevent infinite generation
      })
      .withInstructionPrompt()
      .asToolCallGenerationModel(jsonToolCallPrompt.text()),

    new MathJsTool({ name: "calculator" }),
    "What's fourteen times twelve?"
  );

  console.log(`Tool call`, toolCall);
  console.log(`Tool: ${tool}`);
  console.log(`Arguments: ${JSON.stringify(args)}`);
  console.log(`Result: ${result}`);

That being said, chat w/ tools is not supported yet w/ Ollama, and the interface for creating tool models might change.

[Boorj]

Now it supports:

Ollama now supports tool calling with popular models such as Llama 3.1. This enables a model to answer a given prompt using tool(s) it knows about, making it possible for models to perform more complex tasks or interact with the outside world.

Ollama now supports structured outputs making it possible to constrain a model’s output to a specific format defined by a JSON schema.