Langflow x Langfuse
Build in no-code in Langflow, observe and analyze in Langfuse
Many people wonder whether LLMs could be helpful for their specific use case: for example, a professional may want to create a chatbot on corporate knowledge in a specific language or on a very niche company domain.
Langflow provides a user interface that allows you to define LLM features and get started quickly. It offers a beautiful drag-and-drop UI that enables you to define complex chains of tools and LLM calls. This eliminates the need for coding everything from scratch and allows you to experiment and prototype effortlessly. With Langflow, you have the flexibility to choose different LLM Providers and a broad range of tools to enrich prompts. In addition to its user-friendly interface, Langflow also offers a community-provided set of pre-built LLM features. These features have produced good results for others, making it a great source of inspiration for your own projects.
Once you have set up your LLM feature chain using Langflow, it's time to test it in production. This is where Langfuse comes into play. Langfuse records all the steps of the LLM feature, allowing you to look into the details of how it behaved. It also provides analytics based on latency, API cost, and quality. Quality is measured by user feedback and model-based evaluations.
Setting up both Langflow and Langfuse is easy. You can choose to self-host them or use the hosted version of Langfuse. The integration between the two tools is simple: just add the Langfuse environment variables when starting Langflow.
export LANGFLOW_LANGFUSE_SECRET_KEY=<your secret key>
export LANGFLOW_LANGFUSE_PUBLIC_KEY=<your public key>Read the integration docs (opens in a new tab) for more details on how to set up the integration. If you are looking for a general intro to Langfuse, we recorded a 2 min demo (opens in a new tab) showing the core tracing and analytics features.
If you want to learn more about Langflow and Langfuse, you can join their Discords for further discussions and support (Langfuse (opens in a new tab), Langflow (opens in a new tab)). Additionally, as both projects are open source checkout the open issues to collaborate with the community (Langfuse (opens in a new tab), Langflow (opens in a new tab)) or leave a ⭐️.
I love how Langflow makes it easy to build complex LLM applications and am super excited about this new integration (there will be more coming over the next weeks).