Skip to content

mesh-certification-coach

Help data product owners assess, explain, and improve a Mesh Certification Score using evidence-backed review, gap analysis, and prioritized remediation planning. Use when a team needs to estimate certification readiness, respond to certification feedback, strengthen data product ownership, improve discoverability, tighten data quality and reliability controls, document access/privacy posture, or turn a mesh scorecard into an actionable plan.

experimental
IDE:
codex
Version:
1.0.0
Owner:optum-tech-compute
data-mesh
certification
data-product
governance
quality
scorecard

Mesh Certification Coach

Help a data product owner raise certification readiness with evidence, not slogans.

Use references/scoring-guide.md as the primary rubric for Mesh Certification scoring unless the user explicitly supplies a newer version. Treat that file as the official section and star model.

Workflow

  1. Identify the assessment target: product name, domain, owner, intended consumers, and the certification checkpoint or review date.
  2. Gather evidence before scoring. Prefer concrete artifacts such as product docs, catalog entries, data contracts, schema definitions, lineage views, quality dashboards, SLOs, access request flows, runbooks, incident notes, onboarding docs, and adoption evidence.
  3. Map the evidence to the official rubric sections and individual criteria in references/scoring-guide.md.
  4. Score each section conservatively using the star-gating rule: a section earns a star level only when every requirement at that level and all lower levels in that section are met.
  5. Distinguish verified evidence from inferred evidence and never present guesses as confirmed facts.
  6. Find the score-limiting gaps. Focus on the few unmet lower-star requirements that block multiple higher-star outcomes.
  7. Convert the gaps into a prioritized plan. Separate fast documentation and metadata wins from structural changes such as observability, contract enforcement, mastering alignment, or access-control redesign.
  8. Prepare the product owner for review. Explain what proof to bring, what narrative to use, and which weak areas need mitigation or explicit acknowledgement.

Tooling

  • Use scripts/datahub_mesh_snapshot.py when the data product lives in DataHub and you need a fast evidence pull for catalog metadata, ownership, schema coverage, glossary terms, lineage, profiling signals, and native certification scorecards.
  • Use assets/datahub-mesh-config.sample.json as the starting point for enterprise-specific regex patterns such as managed platforms, owner-role labels, bronze dataset naming, and glossary-term families.
  • Read references/datahub-evidence.md before relying on the script for a final score. It explains which criteria are fully supported, heuristic, or still require external proof.
  • When DataHub exposes a native Mesh Certification scorecard, prefer it for per-section star scores and blocking rules. Use sampled dataset metadata to explain why the failed rules are failing, not to override the scorecard.
  • In DataHub script JSON, use next_star_blockers for the concise section-by-section answer and sample_metadata_summary for evidence notes about dataset/field metadata gaps.
  • For large DataHub products, keep --dataset-count modest first. Increase it only when the next decision depends on full dataset coverage and the gateway can handle the larger query.

Review Focus

  • Data Mesh Enablement
  • Enterprise Data Standards & Mesh Certification
  • Centralized Data Mastering
  • Governance, Compliance & Security
  • Self-Service
  • Evidence quality for every criterion: catalog entries, glossary term tagging, platform configuration, lineage, access controls, subscriptions, documentation, and operational records

Scoring Rules

  • Score each section independently.
  • A section earns * only if every * criterion in that section is met.
  • A section earns ** only if every * and ** criterion in that section is met.
  • A section earns *** only if every *, **, and *** criterion in that section is met.
  • A section earns **** only if every *, **, ***, and **** criterion in that section is met.
  • If a lower-star requirement is not met, do not award a higher star for that section even if some higher-star criteria are met.
  • Penalize missing evidence more than weak narrative. A confident claim without proof should not receive credit.
  • Reward repeatable controls more than one-time manual heroics.
  • Call out dependencies between criteria when one fix improves several sections or star levels.
  • If the system scorecard and bundled rubric disagree about exact star placement, report both clearly and treat the system scorecard as the current product state while explaining the bundled-rubric implication.

Output

Return a concise, decision-ready assessment:

  • Per-section star score, with a note about whether the rubric is official, user-provided, or inferred from the bundled reference.
  • Per-section blocking criteria: the unmet lowest-level requirements currently preventing the next star.
  • Criterion summary: met, not met, or unclear, with evidence notes. Keep this secondary when next_star_blockers is available.
  • Top score multipliers: the 3 to 5 changes most likely to lift the certification result across sections.
  • Prioritized plan by horizon: immediate, next, and later.
  • Reviewer-prep notes: artifacts to gather, likely challenges, and how to answer them honestly.

If the user wants a fuller deliverable, read references/report-template.md and use that structure.

Guardrails

  • Do not invent DUR approval, subscription approval, lineage coverage, ownership, or security score performance.
  • Do not treat a dashboard, wiki page, or contract stub as sufficient evidence unless it is populated and actively maintained.
  • Do not recommend bypassing privacy, access, or governance controls to increase the score quickly.
  • If the user provides a newer rubric that conflicts with the bundled rubric, follow the newer rubric and explain the mapping.
  • Preserve duplicate or overlapping criteria unless the user explicitly confirms that the rubric was entered in error.

References

  • references/scoring-guide.md: Official bundled mesh certification rubric, star-gating rules, section criteria, evidence checklist, and common gap patterns.
  • references/report-template.md: Reusable output shape for a certification-readiness review or remediation brief.
  • references/datahub-evidence.md: DataHub-specific evidence retrieval workflow and limits.

Related Assets