Hacker News

Ask HN: Are there any production LLM pipeline setups to learn from?

4 points by atif089 ago | 0 comments
I believe vLLM has been the gold standard for inferencing but I'd like to learn how vLLM, langgraph, langfuse, other observability and business logic is meld into a single setup.