Skip to content

Quality & QA

The Quality view provides supervisors and QA evaluators with tools to score agent conversations, track evaluation trends, calibrate scoring across the team, and manage scorecards. It consolidates QA stats, criteria breakdowns, calibration history, and individual evaluation records into a single view.

Navigate to the Quality tab in the sidebar to open this view. The tab requires the analytics.view permission.

Period Selection

Period tabs in the top-right corner control the time range for all quality metrics.

PeriodAPI Range
This WeekLast 7 days
This MonthLast 30 days
QuarterCurrent quarter

Switching periods reloads all data on the page.

QA Stats

A row of four stat cards displays the top-level quality metrics.

CardDescription
Avg QA ScoreAverage QA evaluation score across all evaluated conversations in the period. Color: green.
Evaluations DoneTotal number of evaluations completed.
Pending ReviewNumber of evaluations awaiting review. Color: amber.
Failed (<70%)Number of evaluations where the agent scored below the 70% threshold. Color: red.

Each card includes a trend indicator showing the change from the previous period (e.g., "+3%", "-2").

Scoring Criteria Breakdown

A horizontal bar chart on the left side of a two-column layout shows average scores for each evaluation criterion.

ElementDescription
Criteria nameThe evaluation category (e.g., Greeting & Opening, Active Listening, Problem Identification)
BarHorizontal bar whose width represents the percentage score. Color-coded: green (90%+), amber (70--89%), red (below 70%).
ScoreNumeric percentage on the right, matching the bar color

The criteria list reflects the scoring dimensions defined in the active scorecard. Common criteria include:

CriteriaWhat It Measures
Greeting & OpeningWhether the agent followed the standard greeting protocol
Active ListeningEvidence of acknowledging and understanding the customer's issue
Problem IdentificationAccuracy in diagnosing the root cause
Knowledge AccuracyCorrectness of information provided to the customer
Communication ClarityClear, professional language without jargon or confusion
Resolution EffectivenessWhether the issue was resolved completely
Compliance & PolicyAdherence to regulatory and organizational policies
Closing & Follow-upProper conversation closing and any necessary follow-up actions

TIP

If a particular criterion consistently scores below 80%, consider creating targeted training sessions for that skill area. The criteria breakdown helps identify systemic gaps across the team rather than individual agent issues.

Recent Calibration Sessions

On the right side of the two-column layout, a list shows recent calibration sessions. Calibration sessions are exercises where multiple evaluators score the same conversations to ensure consistency.

Each session displays:

FieldDescription
TitleName of the calibration session (e.g., "Monthly QA Calibration", "Escalation Handling Review")
DateWhen the session took place
EvaluatorsNumber of evaluators who participated
ConversationsNumber of conversations scored in the session
VarianceScore variance between evaluators, shown as a percentage. Color-coded: green when variance is 5% or below (indicating strong alignment), amber when above 5% (indicating the need for further calibration).

INFO

A variance above 5% suggests that evaluators are interpreting the scoring criteria differently. Schedule a calibration review meeting to align on expectations and scoring standards.

imageQuality scoring dashboard showing QA stat cards, horizontal bar chart of scoring criteria with color-coded percentage bars, recent calibration sessions list with variance indicators, and evaluated conversations table with QA scores and status badges
Quality scoring dashboard with evaluation criteria

Evaluated Conversations Table

Below the criteria and calibration sections, a full-width table lists individual conversation evaluations.

ColumnDescription
AgentAvatar and name of the agent who handled the conversation
ConversationTopic or summary of the evaluated conversation
ChannelChannel badge (WhatsApp, Voice, Email, Web Chat, SMS) with channel-specific color
QA ScorePercentage score with color-coded badge: green (90%+), amber (70--89%), red (below 70%)
EvaluatorName of the person who performed the evaluation
DateWhen the evaluation was completed (Today, Yesterday, or date)
StatusBadge showing the evaluation outcome: Passed (green), Needs Coaching (red for scores below 70%), or Pending Review (amber)

Score Thresholds

RangeBadgeMeaning
90% and aboveGreenExcellent performance. No corrective action needed.
70 -- 89%AmberAcceptable but with room for improvement.
Below 70%RedBelow passing threshold. Marked as "Needs Coaching" and flagged for follow-up.

Scorecard Management

Click the Scorecards button in the header to toggle the scorecard management panel at the bottom of the view.

The panel lists all configured scorecards with the following details:

FieldDescription
NameThe scorecard name (e.g., "Standard QA Scorecard", "Sales Evaluation")
VersionCurrent version number of the scorecard
Criteria countNumber of scoring criteria defined in the scorecard
Passing scoreThe minimum percentage required to pass (e.g., 70%)
StatusActive (green) or Inactive (gray)

WARNING

Only active scorecards are used for new evaluations. If you deactivate a scorecard, existing evaluations scored with that card are preserved but new evaluations will use the active scorecard instead.

Scorecards are fetched from the quality API's dedicated scorecards endpoint and are managed separately from the period-filtered data.

Data Sources

EndpointData Provided
qualityApi.getStats()QA stat cards (averages, counts, trends)
qualityApi.getCriteria()Scoring criteria breakdown with per-criterion averages
qualityApi.getCalibrations()Recent calibration session list
qualityApi.getEvaluations()Individual evaluated conversation records
qualityApi.getScorecards()Scorecard definitions and configurations

OmniBots AI Bot Platform