platform/integrations/langchain

[giscus[bot]]

platform/integrations/langchain

Learn how to integrate Apify with 🦜🔗 LangChain, in order to feed vector databases and LLMs with data crawled from the web.

https://docs.apify.com/platform/integrations/langchain

[JackaDu]

getting the following error:
from langchain.document_loaders.base import Document
ImportError: cannot import name 'Document' from 'langchain.document_loaders.base' (/Users/jackdu/.local/share/virtualenvs/apify_langchain-rKxSQDZS/lib/python3.9/site-packages/langchain/document_loaders/base.py)

[jirispilka]

@JackaDu thank you for pointing this out. Langchain package structure was changed and the Document was moved to langchain_core.

The documentation will be soon updated, please check this PR for now: #934

Thanks again!

[TanviBhardwaj24]

For this line in the tutorial, index = VectorstoreIndexCreator().from_loaders([loader]), I am getting the following error: line 341, in init
raise validation_error
pydantic.v1.error_wrappers.ValidationError: 1 validation error for VectorstoreIndexCreator
embedding
field required (type=value_error.missing)

[jirispilka]

@TanviBhardwaj24 thank you! Good catch.

Langchain has recently changed VectorstoreIndexCreator and OpenAI is no longer a default provider and needs to be passed explicitly.

index = VectorstoreIndexCreator(embedding=OpenAIEmbeddings()).from_loaders([loader])

result = index.query_with_sources(query, llm=OpenAI())

The updated documentation should be published within a day or two. You can check this PR for now: #1051

[TanviBhardwaj24]

Thank you so much, it works now!