Datacheck

Datacheck monitors your indexed store data against rules you define. When a record is missing a required field, has the wrong value, or fails a format check, Indexly raises a violation so you can fix it in Shopify Admin.

Open Datacheck from the app navigation.

Data Health dashboard

The Datacheck home page shows a health score out of 100, plus counts of open violations by severity:

  • Critical
  • Warning
  • Informational

The score reflects open violations relative to the size of your index. Critical violations weigh more than warnings.

You can:

  • Click New rule to create a rule
  • Click Manage rules to enable, disable, edit, or delete rules
  • Click Re-evaluate all rules to scan your current index against every active rule

Rules also re-evaluate automatically when an order, customer, or product is created or updated in Shopify.

Creating a rule

Each rule describes the desired state of a field. A violation is raised when a record does not meet that state.

When you create or edit a rule, you set:

FieldWhat it does
Rule nameA label your team will recognise, e.g. B2B PO Number Required
Resource typeOrders, Customers, Products, or Variants
Field to checkThe standard field, metafield, or custom attribute to evaluate. Options come from your index — rebuild the index if a custom field is missing from the list
ConditionThe desired state of that field
Expected valueRequired for some conditions (equals, contains, format)
Filter: tags containOptional. Only apply the rule to records whose tags include this value, e.g. b2b
SeverityCritical, Warning, or Informational
ActiveInactive rules are skipped during evaluation

Conditions

ConditionFlags records when…
Is blankThe field is empty or missing
Has unexpected value (should be blank)The field has any value
Must equalThe field does not match the expected value
Must not equalThe field matches a forbidden value
Must containThe field does not contain the expected text
Must match format (regex)The field does not match the regular expression you entered

Example: a rule named B2B PO Number Required on Orders, field Purchase Order (metafield), condition Is blank, filter tags contain b2b, severity Critical flags B2B orders that are missing a PO number.

Limitation: Datacheck rules cannot target metaobjects. You can still search metaobject fields from the Search page.

Managing rules

On Manage rules you can:

  • Enable or Disable a rule without deleting it
  • Edit the rule
  • Delete the rule (with confirmation)

Inactive rules stay in the list but are not evaluated.

Results: failing and passing

From the dashboard, click a rule’s failing or passing count to open its results. Use the Failing and Passing tabs to switch lists (50 per page). Each row links to the record in Shopify Admin via Open in Shopify.

  • Failing — records that do not meet the rule. These are open violations.
  • Passing — indexed records of that resource type (matching any tag filter) that currently meet the rule.

A violation is resolved automatically when the record later passes the rule — for example after you fill in a missing metafield and Shopify sends an update webhook. You do not mark violations as resolved by hand. Resolved history is not displayed; the Passing tab shows the current passing set.

Keeping checks current

  • Automatic: when an order, customer, or product changes in Shopify, Indexly re-indexes that record and re-evaluates rules. Variant metafield edits (for example custom.product_check) are picked up via a dedicated metafield event — they do not fire a normal product update.
  • Manual: click Re-evaluate all rules after you create or change rules. If you already fixed records in Shopify and Datacheck still looks stale, run Rebuild Index in Settings first (that pulls fresh metafields), then Re-evaluate all rules.

If a field path is no longer in your index (for example you disabled a metafield type and rebuilt), edit the rule and pick a field that still exists, or rebuild the index so custom fields are discovered again.

Next: Settings to control what gets indexed, or FAQ for troubleshooting.