Ollama Llama3.1

[prpanto]

How to use the llama3.1 with Ollama? Do you support it?

[pedinil]

First you should see if you have your model downloaded in ollama

you can see list of all your model with below command

ollama list

NAME           	ID          	SIZE  	MODIFIED
gemma2:latest  	ff02c3702f32	5.4 GB	2 weeks ago
llama3.1:latest	62757c860e01	4.7 GB	2 weeks ago
llama3:latest  	365c0bd3c000	4.7 GB	6 weeks ago

If llama3.1 is avaible than you can easily used below code to call the model

		  const res = await generateText({
			model: ollama
			  .ChatTextGenerator({
				model: "llama3.1",
				maxGenerationTokens: 500,
			  })
			  .withTextPrompt(),
			prompt: prompt,
		  })