mesh-certification-coach
Help data product owners assess, explain, and improve a Mesh Certification Score using evidence-backed review, gap analysis, and prioritized remediation planning. Use when a team needs to estimate certification readiness, respond to certification feedback, strengthen data product ownership, improve discoverability, tighten data quality and reliability controls, document access/privacy posture, or turn a mesh scorecard into an actionable plan.
Mesh Certification Coach
Help a data product owner raise certification readiness with evidence, not slogans.
Use references/scoring-guide.md as the primary rubric for Mesh Certification scoring unless the user explicitly supplies a newer version. Treat that file as the official section and star model.
Workflow
- Identify the assessment target: product name, domain, owner, intended consumers, and the certification checkpoint or review date.
- Gather evidence before scoring. Prefer concrete artifacts such as product docs, catalog entries, data contracts, schema definitions, lineage views, quality dashboards, SLOs, access request flows, runbooks, incident notes, onboarding docs, and adoption evidence.
- Map the evidence to the official rubric sections and individual criteria in
references/scoring-guide.md. - Score each section conservatively using the star-gating rule: a section earns a star level only when every requirement at that level and all lower levels in that section are met.
- Distinguish verified evidence from inferred evidence and never present guesses as confirmed facts.
- Find the score-limiting gaps. Focus on the few unmet lower-star requirements that block multiple higher-star outcomes.
- Convert the gaps into a prioritized plan. Separate fast documentation and metadata wins from structural changes such as observability, contract enforcement, mastering alignment, or access-control redesign.
- Prepare the product owner for review. Explain what proof to bring, what narrative to use, and which weak areas need mitigation or explicit acknowledgement.
Tooling
- Use
scripts/datahub_mesh_snapshot.pywhen the data product lives in DataHub and you need a fast evidence pull for catalog metadata, ownership, schema coverage, glossary terms, lineage, profiling signals, and native certification scorecards. - Use
assets/datahub-mesh-config.sample.jsonas the starting point for enterprise-specific regex patterns such as managed platforms, owner-role labels, bronze dataset naming, and glossary-term families. - Read
references/datahub-evidence.mdbefore relying on the script for a final score. It explains which criteria are fully supported, heuristic, or still require external proof. - When DataHub exposes a native Mesh Certification scorecard, prefer it for per-section star scores and blocking rules. Use sampled dataset metadata to explain why the failed rules are failing, not to override the scorecard.
- In DataHub script JSON, use
next_star_blockersfor the concise section-by-section answer andsample_metadata_summaryfor evidence notes about dataset/field metadata gaps. - For large DataHub products, keep
--dataset-countmodest first. Increase it only when the next decision depends on full dataset coverage and the gateway can handle the larger query.
Review Focus
- Data Mesh Enablement
- Enterprise Data Standards & Mesh Certification
- Centralized Data Mastering
- Governance, Compliance & Security
- Self-Service
- Evidence quality for every criterion: catalog entries, glossary term tagging, platform configuration, lineage, access controls, subscriptions, documentation, and operational records
Scoring Rules
- Score each section independently.
- A section earns
*only if every*criterion in that section is met. - A section earns
**only if every*and**criterion in that section is met. - A section earns
***only if every*,**, and***criterion in that section is met. - A section earns
****only if every*,**,***, and****criterion in that section is met. - If a lower-star requirement is not met, do not award a higher star for that section even if some higher-star criteria are met.
- Penalize missing evidence more than weak narrative. A confident claim without proof should not receive credit.
- Reward repeatable controls more than one-time manual heroics.
- Call out dependencies between criteria when one fix improves several sections or star levels.
- If the system scorecard and bundled rubric disagree about exact star placement, report both clearly and treat the system scorecard as the current product state while explaining the bundled-rubric implication.
Output
Return a concise, decision-ready assessment:
- Per-section star score, with a note about whether the rubric is official, user-provided, or inferred from the bundled reference.
- Per-section blocking criteria: the unmet lowest-level requirements currently preventing the next star.
- Criterion summary: met, not met, or unclear, with evidence notes. Keep this secondary when
next_star_blockersis available. - Top score multipliers: the 3 to 5 changes most likely to lift the certification result across sections.
- Prioritized plan by horizon: immediate, next, and later.
- Reviewer-prep notes: artifacts to gather, likely challenges, and how to answer them honestly.
If the user wants a fuller deliverable, read references/report-template.md and use that structure.
Guardrails
- Do not invent DUR approval, subscription approval, lineage coverage, ownership, or security score performance.
- Do not treat a dashboard, wiki page, or contract stub as sufficient evidence unless it is populated and actively maintained.
- Do not recommend bypassing privacy, access, or governance controls to increase the score quickly.
- If the user provides a newer rubric that conflicts with the bundled rubric, follow the newer rubric and explain the mapping.
- Preserve duplicate or overlapping criteria unless the user explicitly confirms that the rubric was entered in error.
References
references/scoring-guide.md: Official bundled mesh certification rubric, star-gating rules, section criteria, evidence checklist, and common gap patterns.references/report-template.md: Reusable output shape for a certification-readiness review or remediation brief.references/datahub-evidence.md: DataHub-specific evidence retrieval workflow and limits.
Related Assets
AIRB Risk Assessment (Optum)
Perform a comprehensive risk assessment for AI/LLM systems to determine AIRB tier classification and required governance controls.
Owner: epic-platform-sre
Analyze Testing Strategy Across Pipeline Stages
Comprehensive analysis of existing testing infrastructure mapped to pipeline stages (left-to-right), identifying gaps, overlaps, and optimization opportunities
Owner: thudak
Optum Responsible AI (RAI) compliance
Responsible AI compliance requirements for Optum AI/ML development, covering AIRB submission, shadow mode pilots, RAI risk tiers, and governance processes.
Owner: epic-platform-sre
cerberus
Multi-head code guardian for security, quality, and architecture review
Owner: epic-platform-sre
drzero-analysis
Deep codebase analysis without making changes - architecture review, quality assessment, and improvement recommendations
Owner: epic-platform-sre
drzero-autonomous
Autonomous repository improvement loop with two-phase propose-then-solve workflow using domain specialist agents
Owner: epic-platform-sre

