Datacheck
Datacheck monitors your indexed store data against rules you define. When a record is missing a required field, has the wrong value, or fails a format check, Indexly raises a violation so you can fix it in Shopify Admin.
Open Datacheck from the app navigation.
Data Health dashboard
The Datacheck home page shows a health score out of 100, plus counts of open violations by severity:
- Critical
- Warning
- Informational
The score reflects open violations relative to the size of your index. Critical violations weigh more than warnings.
You can:
- Click New rule to create a rule
- Click Manage rules to enable, disable, edit, or delete rules
- Click Re-evaluate all rules to scan your current index against every active rule
Rules also re-evaluate automatically when an order, customer, or product is created or updated in Shopify.
Creating a rule
Each rule describes the desired state of a field. A violation is raised when a record does not meet that state.
When you create or edit a rule, you set:
| Field | What it does |
|---|---|
| Rule name | A label your team will recognise, e.g. B2B PO Number Required |
| Resource type | Orders, Customers, Products, or Variants |
| Field to check | The standard field, metafield, or custom attribute to evaluate. Options come from your index — rebuild the index if a custom field is missing from the list |
| Condition | The desired state of that field |
| Expected value | Required for some conditions (equals, contains, format) |
| Filter: tags contain | Optional. Only apply the rule to records whose tags include this value, e.g. b2b |
| Severity | Critical, Warning, or Informational |
| Active | Inactive rules are skipped during evaluation |
Conditions
| Condition | Flags records when… |
|---|---|
| Is blank | The field is empty or missing |
| Has unexpected value (should be blank) | The field has any value |
| Must equal | The field does not match the expected value |
| Must not equal | The field matches a forbidden value |
| Must contain | The field does not contain the expected text |
| Must match format (regex) | The field does not match the regular expression you entered |
Example: a rule named B2B PO Number Required on Orders, field Purchase Order (metafield), condition Is blank, filter tags contain b2b, severity Critical flags B2B orders that are missing a PO number.
Limitation: Datacheck rules cannot target metaobjects. You can still search metaobject fields from the Search page.
Managing rules
On Manage rules you can:
- Enable or Disable a rule without deleting it
- Edit the rule
- Delete the rule (with confirmation)
Inactive rules stay in the list but are not evaluated.
Violations
From the dashboard, click a rule’s violation count to see its open violations (50 per page). Each row links to the record in Shopify Admin via Open in Shopify.
A violation is resolved automatically when the record later passes the rule — for example after you fill in a missing metafield and Shopify sends an update webhook. You do not mark violations as resolved by hand.
The violations list shows only open items. Resolved history is not displayed in the app.
Keeping checks current
- Automatic: when an order, customer, or product (including variants on product updates) changes in Shopify, Indexly re-evaluates rules for that record.
- Manual: click Re-evaluate all rules after you create or change rules, or after a Rebuild Index, so historical records are scanned.
If a field path is no longer in your index (for example you disabled a metafield type and rebuilt), edit the rule and pick a field that still exists, or rebuild the index so custom fields are discovered again.
Next: Settings to control what gets indexed, or FAQ for troubleshooting.