Automatic Session Reconstruction
Understanding how users interact with your LLM applications is key to improving them. A crucial part of this is analyzing entire conversations or “sessions.” However, tracking sessions usually requires you to add a uniquesession_id
to every API request, which can be a hassle to implement and maintain.
Requesty’s gateway removes this burden with Automatic Session Reconstruction. You can send your LLM interaction data to us as-is, and we will automatically group related interactions into coherent sessions for you.
What It Means For You
- Zero Implementation Effort: You don’t need to modify your application code to generate or manage session IDs. Simply send us the interaction data, and we’ll handle the rest.
- Accurate Conversation Tracking: Get a clear view of the entire user journey or your agentic flow, from the first prompt to the final response.
- Powerful Analytics: With sessions correctly identified, you can analyze conversation length, user engagement, topic flow, and other critical metrics that depend on understanding the full context of an interaction.
How It Works
Our system intelligently analyzes the content of the messages in each interaction and automatically identifies if it’s a part of an existing session. For example, if a user starts a conversation:- User’s first turn:
system
: “You are a helpful assistant.”user
: “What is the capital of France?”assistant
: “The capital of France is Paris.”
- User’s second turn:
system
: “You are a helpful assistant.”user
: “What is the capital of France?”assistant
: “The capital of France is Paris.”user
: “What is its population?”assistant
: “The population of Paris is over 2 million.”