Articles in this section

Triage Large Language Model (LLM) Tickets

The Tickets tab provides valuable insights into the performance of your Triage LLM (Large Language Model). You can view key metrics such as the number of tickets Triage predicted, ticket status, correct predictions, and the overall accuracy of Triage's label predictions. This information helps you assess the effectiveness of your Triage LLM and make informed decisions to improve its performance.

Key metrics

Name Description
Predicted Tickets Tickets where Triage successfully predicted and assigned a label.
Tickets Status This shows the latest ticket status (not the status of the tickets in the past).
Finalized Tickets Predicted tickets that have been closed or resolved by a human agent, finalizing the ticket status.

Correct Predictions

 

Tickets where Triage's predicted label was accurate, meaning the human agent did not override it, and the ticket is now closed or resolved.

Accuracy The percentage of correct predictions out of all finalized tickets. Calculated as: (Correct Predictions / Finalized Tickets) * 100

Table metrics

Name Description
Predicted Time The local time when Triage predicted the label and successfully wrote it on the ticket.
Tickets ID Ticket ID of the connected Help Desk
Ticket Title Title of the ticket. N/A if it's missing value on the Help Desk at the time of prediction.

Ticket Body

Content of the ticket body at the time of Triage prediction. The ticket body will not be updated once the prediction has been made.

Predicted Label The label predicted by Triage.
Finalized Label The label provided by the human agent is the correct or true field (also known as the ground truth).
Correct Prediction

Predictions will be considered correct if they meet the following conditions:

  1. The Finalized Label has not been altered.
  2. The Finalized Label matches the Predicted Label.
Reasons for no prediction

Reasons why the Triage was unable to assign from one of the defined labels.

 

Was this article helpful?
0 out of 0 found this helpful

Support

  • Need help?

    Click here to submit a support request. We are here to assist you.

  • Business hours

    Monday to Friday 8am - 5pm PST excluding US holidays

  • Contact us

    support@forethought.ai