Chatbot Evaluation

Analyze and evaluate the performance of the text-to-query components.

Text-to-Query Components

Query Accuracy

Measures the percentage similarity between generated and reference queries, ensuring query optimization.

Execution Accuracy

Compares results from both generated and reference queries, validating logical correctness regardless of syntax.

Query Generation Time

Tracks the time taken to generate queries, measuring system performance.

Execution Time Difference

Analyzes the execution time difference between generated and reference queries.

View our detailed evaluation results on LangSmith for the Text to CAML Query component:

View our detailed evaluation results on LangSmith for the Text to PostgreSQL Query component: