Neural Inverse Integration with LobeChat
What is LobeChat?
LobeChat is an open-source LLM chat platform that seamlessly integrates with various AI models and tools, providing users with an intuitive interface to interact with advanced language technologies.
What is Neural Inverse?
Neural Inverse is one of the most used open-source LLM Observability platforms. By enabling the Neural Inverse integration, you can trace your application data with Neural Inverse to develop, monitor, and improve the use of LobeChat, including:
- Application traces
- Usage patterns
- Cost data by user and model
- Evaluations
Get Started
Set up Neural Inverse
Get your Neural Inverse API key by signing up for Neural Inverse Cloud or self-hosting Neural Inverse.
Set up LobeChat
There are multiple ways to self-host LobeChat. For this example, we will use the Docker Desktop deployment.
Before deploying LobeChat, set the following four environment variables with the Neural Inverse API keys you created in the previous step.
ENABLE_LANGFUSE = '1'
LANGFUSE_SECRET_KEY = 'sk-lf...'
LANGFUSE_PUBLIC_KEY = 'pk-lf...'
LANGFUSE_HOST = 'https://cloud.langfuse.com'Before running the Docker container, set the environment variables in the Docker Desktop with the Neural Inverse API keys you created in the previous step.
Activate Analytics in Settings
Once you have LobeChat running, navigate to the About tab in the Settings and activate analytics. This is necessary for traces to be sent to Neural Inverse.
See your traces in Neural Inverse
After setting your LLM model key, you can start interacting with your LobeChat application.
All conversations in the chat are automatically traced and sent to Neural Inverse. You can view the traces in the Traces section of the Neural Inverse platform.
Feedback
If you have any feedback or requests, please create a GitHub Issue or share your work with the community on Discord.
