Skip to content

docs(limits): integrate Data platform limits in-context (§1, §2, §3, §5) - #447

Open
mallikarjun-dhulange wants to merge 2 commits into
mainfrom
docs/limits-data
Open

docs(limits): integrate Data platform limits in-context (§1, §2, §3, §5)#447
mallikarjun-dhulange wants to merge 2 commits into
mainfrom
docs/limits-data

Conversation

@mallikarjun-dhulange

Copy link
Copy Markdown
Member

Platform limits — Data POD

Covers the Data platform limits (Confluence §1 Ingestion FUP, §2 Profile Storage, §3 Schema Caps, §5 Data Warehouses). No snippets, no hub. Confluence is the source of truth for this work.

This POD was almost entirely documented already — this PR adds the one genuine gap and records what was verified.

Gap filled in-context

  • Data warehouse historical migration rate = 15M rows/hour · 50M rows/day (shared user+event pool) → overview-imports.mdx, in the existing historical-imports note.

Verified already-documented (no change needed)

  • §1 Ingestion FUP — 100/min, 300/5min, 500/hr, 1000/day with block actions; 3 consecutive breaches → 7-day block; max 1,000 devices/profile. All on fair-usage-policy-fup.mdx.
  • §2 Profile storage — activity feed 12,000 events / 12 MB / 30 days (fair-usage-policy-fup.mdx); list/array element caps (data-tracking-policies.mdx, support-for-object-data-type.mdx).
  • §3 Schema caps — unique events 512, user attributes 256, event attributes 100/event, name length 200, value length 512, list max 50 elements, URL value >512 rejected. All on data-tracking-policies.mdx.
  • §4 File-import rates (600K/hr, 14M/day users) are also already documented in the imports limits table.

Deferred / flagged (see PR comment)

  • User merge limit = 50 per operation → API POD (it's a User Merge API operation cap).
  • User/device record deletion after 60 days of inactivity → not published: it's marked SDP-internal in Confluence and appears to conflict with the retention-policy messaging on the FUP page ("permanent storage based on your retention policy"). Needs PM confirmation.

🤖 Generated with Claude Code

Add data warehouse historical migration rate (15M/hr, 50M/day). §1
ingestion FUP, §2 profile storage, §3 schema caps, and §4 file-import
rates were already documented correctly. Deferred user merge limit (50)
to API POD; flagged 60-day inactivity expiry pending PM (retention
messaging conflict).

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
@mallikarjun-dhulange

Copy link
Copy Markdown
Member Author

Notes for review

This POD was already ~95% documented, so the diff is intentionally tiny (one addition). Two items were held rather than published:

Deferred to the API POD: User merge limit (50 profiles per operation) — this is a User Merge API operation cap and belongs on the api/ User Merge page with the other API-surface limits.

Held for PM — possible conflict: Confluence §2 states a user/device record with no activity for 60 days is automatically deleted (marked "hard-coded in SDP"). This appears to conflict with the retention messaging on fair-usage-policy-fup.mdx, which says events have permanent storage based on your retention policy. Publishing "your inactive user data is deleted after 60 days" is both alarming to customers and potentially inaccurate. Please confirm the actual behaviour before we document it.

@mintlify

mintlify Bot commented Jul 24, 2026

Copy link
Copy Markdown
Contributor

Preview deployment for your docs. Learn more about Mintlify Previews.

Project Status Preview Updated (UTC)
moengage 🟢 Ready View Preview Jul 24, 2026, 6:20 AM

💡 Tip: Enable Workflows to automatically generate PRs for you.

@mintlify

mintlify Bot commented Jul 24, 2026

Copy link
Copy Markdown
Contributor

Preview deployment for your docs. Learn more about Mintlify Previews.

Project Status Preview Updated (UTC)
moengage 🟡 Building Jul 24, 2026, 6:10 AM

💡 Tip: Enable Workflows to automatically generate PRs for you.

@mallikarjun-dhulange
mallikarjun-dhulange marked this pull request as ready for review July 28, 2026 11:47
@mallikarjun-dhulange
mallikarjun-dhulange requested a review from a team July 28, 2026 11:47
Adds a "User and Device Data Expiry" section to the FUP page: dormant
user/device records with no activity for 60 days are removed; active
users' events are retained per the Data Retention Policy (clarifies the
relationship to avoid contradicting existing retention messaging).

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant