back
▲ 2 points

Ask HN: How do you deploy Python-based LangChain or LlamaIndex code on prod?

by pinglin·1y ago·1 comments·view on hn ↗
1 comments
Erick from LangChain here - would recommend either deploying with LangGraph Cloud or anywhere that deploys a FastAPI easily.

LangGraph Cloud: https://langchain-ai.github.io/langgraph/cloud/ Example (chat-langchain): https://github.com/langchain-ai/chat-langchain?tab=readme-ov...

FastAPI example with LangServe (old chat-langchain implementation): https://github.com/langchain-ai/chat-langchain/blob/langserv...

Or just use regular fastapi endpoints instead of langserve.add_routes with a fastapi server: https://fastapi.tiangolo.com/