I am trying to invoke a LLM model using Hugging Face Access Token by the following code:
{
from langchain_huggingface import ChatHuggingFace, HuggingFaceEndpoint
from dotenv import load_dotenv
load_dotenv()
llm = HuggingFaceEndpoint(
repo_id="TinyLlama/TinyLlama-1.1B-Chat-v1.0",
task="text-generation"
)
model = ChatHuggingFace(llm=llm)
result = model.invoke("What is the capital of Vietnam")
print(result.content)
}
where Access Key has been stored in .env with {HF_TOKEN = "XXXXXX"
Getting the following error:
huggingface_hub.errors.HfHubHTTPError: 503 Server Error: Service Temporarily Unavailable for url: https://router.huggingface.co/featherless-ai/v1/chat/completions
I am trying to invoke a LLM model using Hugging Face Access Token by the following code:
{
from langchain_huggingface import ChatHuggingFace, HuggingFaceEndpoint
from dotenv import load_dotenv
load_dotenv()
llm = HuggingFaceEndpoint(
repo_id="TinyLlama/TinyLlama-1.1B-Chat-v1.0",
task="text-generation"
)
model = ChatHuggingFace(llm=llm)
result = model.invoke("What is the capital of Vietnam")
print(result.content)
}
where Access Key has been stored in .env with {HF_TOKEN = "XXXXXX"
Getting the following error:
huggingface_hub.errors.HfHubHTTPError: 503 Server Error: Service Temporarily Unavailable for url: https://router.huggingface.co/featherless-ai/v1/chat/completions