Product Analytics Data Flow

Events, consent, PII isolation, warehouse sync, and downstream analytics

Product Analytics Data Flow Events, consent, PII isolation, warehouse sync, and downstream analytics 01 / Sources 02 / Ingest 03 / Process 04 / Store 05 / Consume Web App · browser SDK · 01 / Sources · events Web App browser SDK events Mobile · iOS / Android · 01 / Sources · events Mobile iOS / Android events Edge API · collector · 02 / Ingest · TLS Edge API collector TLS Consent Gate · policy filter · 03 / Process · PII guard Consent Gate policy filter PII guard Event Stream · Kafka topic · 03 / Process · ordered Event Stream Kafka topic ordered PII Vault · encrypted · 04 / Store · restricted PII Vault encrypted restricted Warehouse · analytics tables · 04 / Store · curated Warehouse analytics tables curated Feature Store · daily batch · 04 / Store · derived Feature Store daily batch derived Dashboards · product metrics · 05 / Consume · SQL Dashboards product metrics SQL ML Model · ranking job · 05 / Consume · features ML Model ranking job features clickstream user events app events device events identity + consent PII touch accepted events append-only identity map encrypted PII normalized facts non-PII daily aggregates batch metrics SQL read-only feature vectors derived restricted join approved only Legend primary data policy / PII async batch data store

Primary Data Path

  • • Events move left to right through source, ingest, process, store, and consume stages
  • • The hot path stays visually clear even with secondary batch flows
  • • Labels name data assets instead of generic API verbs

Sensitive Boundary

  • • Consent and PII paths are styled as security flows
  • • PII lands in a restricted vault, separate from the analytics warehouse
  • • Restricted joins are visible without implying default access

Derived Consumers

  • • Dashboards read curated facts from the warehouse
  • • Feature vectors are derived by batch from analytics tables
  • • Consumption paths stay distinct from collection and consent handling