Skip to main content

Configuring Notifications for Real-Time Issue Response

Once your app is streaming data into Okareo and you've set up real-time error tracking, the next critical step is ensuring your team knows when something goes wrong.

Some issues are urgent. A customer-facing bot may offer an unauthorized refund. A sales agent might repeatedly get stuck in a loop. A backend system might silently misroute a workflow. These aren’t just anomalies—they’re production risks.

To respond fast, you need the right people alerted at the right time:

  • Product or support teams for customer-impacting behavior
  • Engineering for technical errors or system exceptions

Okareo’s notification system helps you connect your monitors to alerting channels, so teams stay ahead of problems instead of reacting too late.

Step 1: Confirm Your Data Is Flowing​

First, make sure data is flowing correctly into Okareo:

  • Open the Issues page from the left-hand navigation.
  • Run test prompts through your app and check that entries appear under All Datapoints or within a specific monitor view.

You’ll need at least one working monitor with incoming data to test notifications.

Step 2: Set Up Monitors for Notification​

Rather than watching dashboards all day, tie Monitors to real-time notifications. Each monitor evaluates incoming data using Checks you define and can trigger alerts when it detects a new issue or error. When using monitors for notificatin, you will likely want to be alerted when specific behaviors or conditions occur. This is easily done with Custom Checks.

Examples:

  • Route all scope violations from your customer support bot to #support-ops in Slack.
  • Send factuality hallucinations, redundant prompts, or errors to product engineering.
  • Token counts exceeding a threshold should notify the Ops team.

Step 3: Tie Monitors to Notifications​

With Monitors tracking the appropriate events, you can decide which types of issues trigger an alert and via which channel. For example, you might send critical notification (like customer impacting errors) to Slack immediately, while minor issues just go to email daily. By enabling notifications, you’ll get proactive alerts whenever an issue is detected, so you don’t miss important problems. To edit a Monitor, select the edit icon for the one you want to configure.

Email​

  • All team members with registered accounts receive email error alerts by default.
  • These alerts respect the monitor-level notification settings you configure.
  • Emails can be customized to batch issues or send immediately.

Slack​

  • Connect your workspace via the Slack integration in the Okareo dashboard.
  • Once connected, add the Okareo Slack App to any channel (e.g., #ai-monitoring, #prod-alerts).
  • Customize which monitors route alerts to which channels.

Slack is ideal for critical, real-time awareness. Your team can triage the issue and replay it directly from the link.

You’re Now Notification-Ready​

With monitoring and notifications configured, your system is now:

  • Actively detecting behavioral and system errors
  • Evaluating each interaction in real time using Checks
  • Routing alerts to the right team instantly
  • Enabling fast diagnosis via links to the full replay and root cause

This closes the loop between detection and response—whether it’s a support team catching a broken user flow or an engineer debugging a config issue in production.