Rapid Recall Key 01–20
- Big Data: large/fast/varied and difficult-to-manage data whose characteristics require different storage, integration, Metadata, DQ, and analytical approaches; not a fixed row/byte threshold.
- Data Science: iterative scientific/analytical practice using mining, statistics, ML, integration, and modeling to discover patterns, test hypotheses, and build useful predictive/prescriptive insight.
- “Big” is relative: management difficulty depends on organization, technology, data type, and workload; no universal size threshold.
- Six V's: Volume, Velocity, Variety/Variability, Viscosity, Volatility, Veracity.
- Volume vs Velocity: amount/scale vs speed of generation/capture/share/use.
- Variety vs Viscosity: different forms/structures vs difficulty using/integrating the data.
- Volatility vs Veracity: change/useful life vs trustworthiness.
- Four goals: discover data-business relationships; discover/analyze new factors; package model outputs for stakeholders; integrate organizational practices with DM/Big Data/Data Science best practices.
- Nine activities: strategy/business needs; environment; choose sources; acquire/ingest; hypotheses/methods; integrate/align; explore/model; communicate; deploy/monitor.
- Seven phases: strategy/business need; choose sources; acquire/ingest; hypotheses/methods; integrate/align; explore/model; deploy/monitor.
- Why compatible: the context diagram is broader and separately exposes environment establishment and communication; the seven-step view focuses model development.
- Descriptive: what happened and why?
- Predictive: what is likely to happen?
- Prescriptive: what action should be taken to influence the outcome?
- Rear-view vs windshield: traditional BI looks backward; Data Science adds forward-looking predictive/prescriptive insight.
- ETL vs ELT: transform/integrate before load vs load/ingest first and transform/integrate later.
- Why ELT: diverse raw sources can be landed before a specific analytical use determines needed transformation/integration.
- Data lake: flexible environment for varied data used for exploration, detailed history, archive, streams, or analytics.
- Swamp: missing inventory, Metadata, provenance, DQ, relationships, ownership, and discoverability make the lake opaque/untrusted.
- At ingest: preserve origin/source, size, currency, content/structure, lineage, and other Metadata plus profiling/DQ context.
← Prompts 01–20 · Key 21–40 →