Introduction to AgentWatch

AgentWatch is a read-only monitoring app for Shopify merchants who want to understand whether AI-commerce activity and agent-facing store capabilities are working as expected.


It brings three types of information into one embedded Shopify app:


  • Performance: aggregate AI-referred sessions, orders, revenue, and channel trends reported by Shopify.
  • Exposure: Shopify Global Catalog search requests for the store and its products.
  • Health: checks of Shopify analytics access and machine-facing catalog, product, cart, policy, and FAQ capabilities.


When a qualified signal changes significantly, AgentWatch creates an incident with an evidence timeline and a sanitized diagnostic report. Email notifications are optional.


Who AgentWatch is for


AgentWatch is useful for store owners and ecommerce teams who:


  • Receive traffic or sales from AI-assisted shopping experiences.
  • Want visibility into Shopify Global Catalog search activity.
  • Need a record of unusual drops or commerce-surface failures.
  • Prefer monitoring that does not modify their theme or catalog.


What the data means


AgentWatch uses Shopify-reported aggregate data. AI-referred sessions are grouped by Shopify's agentic referring channel. AI-referred orders and revenue use Shopify's last-click attribution in the aggregate report.


These signals are observational. A change can help you decide what to investigate, but it does not prove why the change occurred or guarantee how an external AI service ranks or displays products.


Reporting timing


Analytics pages use completed days and are not real time. The Dashboard shows the latest analytics sync and health-check timestamps so you can verify how current the displayed information is.


Health checks can run more frequently than completed-day analytics. Their actual cadence depends on the app's production monitoring schedule, and you can also run them manually.


Main navigation


  • Dashboard: overall status, 30-day KPIs, channel performance, trends, and active incidents.
  • Health: the latest commerce-surface checks and recent health history.
  • Products: products ranked by Global Catalog search requests.
  • Incidents: anomaly history, filters, evidence, actions, and diagnostics.
  • Settings: alert preferences, manual monitoring operations, recent runs, and data deletion.
  • Plan: Shopify-hosted subscription and billing management.


Next: Getting started

Updated on: 19/10/2026

Was this article helpful?

Share your feedback

Cancel

Thank you!