EcomAtlas

Module

Evidence and diagnosis

For
Head of ecommerce / growth · also Lean founder-operator, Ecommerce marketer becoming an operator
Stage
Early tractionGrowingScaling

Published · v1.1.0

Locked

Lessons

9 lessons, in order.

0/9
  1. Lesson 1: Find the first funnel step that changed

    Compare each Shopify funnel transition with its own baseline, then use the first material deterioration to choose the next investigation.

    Locked✓
  2. Lesson 2: Separate a traffic-mix change from a storefront change

    Compare traffic sources and landing pages with their own baselines, then assign the next check without claiming that one segmented report proves the cause.

    Locked✓
  3. Lesson 3: What you can honestly conclude without the traffic to test

    When a controlled test cannot reach a trustworthy answer in a useful time, use evidence matched to the decision and record what it can and cannot establish.

    Locked✓
  4. Lesson 4: Decide how much evidence a change needs

    Raise the evidence requirement as downside, cost, and irreversibility increase.

    Locked✓
  5. Lesson 5: Stop reading blended conversion rate

    Segment the top-line rate to locate where the mix changed without calling the segment a cause.

    Locked✓
  6. Lesson 6: Mine customer evidence without inventing prevalence

    Use searches, tickets, and reviews to find language and mechanisms while keeping self-selected evidence within its limits.

    Locked✓
  7. Lesson 7: Use session replays and heatmaps to investigate one question

    Filter behavioral recordings around a specific symptom, inspect the underlying sessions, and keep the result within its observational limits.

    Locked✓
  8. Lesson 8: Decide when customer value should outrank first-order conversion

    Choose a customer-value outcome before a change only when repeat economics can materially change the decision and the store can observe them.

    Locked✓
  9. Lesson 9: Check for device handoff before diagnosing mobile conversion

    Separate a broken mobile journey from shoppers who research on one device and complete on another.

    Locked✓

Evidence is useful when it changes the next decision. This module helps you locate a problem, choose evidence proportional to the proposed change, and state what each source can and cannot support.

Start with funnel and segment views to locate movement. Shopify provides funnel, landing-page, device, and storefront-search reports with specific counting rules.1 Then choose the evidence route. Analytics describes recorded behavior. Search logs, tickets, reviews, heatmaps, and session replays can expose language, context, interaction sequences, and possible mechanisms. They do not establish cause or population prevalence by themselves.

Behavioral recording adds collection and privacy dependencies. Confirm the app or script, published-theme coverage, filters, masking, retention, access, and processing permission before interpretation. Shopify's privacy API exposes whether analytics processing is allowed under the merchant's settings, visitor location, and consent.2

The module also asks what outcome belongs in the change brief. Customer value can outrank first-order conversion when repeat economics can reverse the decision and mature, comparable cohorts exist. Shopify cohorts can report repeat-purchase and spending measures, but projections are estimates rather than guarantees.3 Use a nearer outcome when lifetime evidence is unavailable or irrelevant.

Module diagnostic

Take the last storefront conclusion your team shared. Can another operator recover the source, dates, counts, comparison, collection boundary, limitations, and next check? Can they distinguish observation, hypothesis, and causal claim?

Assignment

Create one evidence brief with the decision, downside, observed movement, segment, customer or behavioral evidence, alternative explanation, missing artifact, owner, outcome, and release route. Remove any prevalence, cause, or future-value claim the evidence cannot support.

Evidence and further reading

  1. “Behavior reports,” Shopify Help Center, https://help.shopify.com/en/manual/reports-and-analytics/shopify-reports/report-types/default-reports/behaviour-reports. Supports Shopify funnel and search evidence. Accessed August 23, 2026.
  2. “Customer Privacy API,” Shopify Developers, https://shopify.dev/docs/api/customer-privacy. Supports analytics processing-permission checks. Accessed August 23, 2026.
  3. “Customers reports,” Shopify Help Center, https://help.shopify.com/en/manual/reports-and-analytics/shopify-reports/report-types/default-reports/customers-reports. Supports cohort definitions and projection limitations. Accessed August 23, 2026.

Was this helpful?