🏠 Dashboard · ☑ Progress · 🔎 Finder · 📚 Block · ← Previous · Next →
Sequence 135 — T7 - duplicates and normalization
Context: Technology Gate B - Programmatic Data Management | Technology Gate
Source: CDMP Master Execution Manual
When / purpose
Support master-data and quality investigation without blindly deduplicating.
What you should learn
- duplicated/drop_duplicates awareness.
- String normalization.
- Preserve source evidence.
- Candidate vs exact duplicates.
Resources / limits
Technology Competency Roadmap: active T6–T10 only. Detailed Technology Competency Reference: topic detail/readiness only.
Do this in order
- Detect exact duplicate candidates.
- Normalize a working copy of strings.
- Compare before/after counts.
- Keep raw unchanged.
Meridian application
Use Meridian synthetic files and database only for bounded practice.
Create / save
Duplicate/normalization evidence.
Stop / boundary
Stop before production data engineering, application development, advanced OOP, orchestration or distributed processing.
Completion gate
You can distinguish detection from remediation and preserve provenance.
NEXT → Sequence 136
🏠 Dashboard · ☑ Progress · 🔎 Finder · 📚 Block · ← Previous · Next →