🚀 New Course CSCAP™ — Supply Chain Analytics Practitioner, 24 weeks · diagnose, forecast, optimize, decide View Program →
Issue #17 · Data Architecture

Data Lake, Warehouse or Mart? The Architecture Behind a Supply Chain AI Platform

Bronze/Silver/Gold explained with one real sales row, why the warehouse doesn't retire once you have a lake, where feature stores and AI agents plug in, and a six-stage build order that doesn't try to do it all at once.

Every few weeks, a client asks some version of the same question. "We already have a data warehouse — why do we need a data lake too?" Or the reverse: "We built a lake last year, isn't that enough?" The honest answer is that a lake, a warehouse and a mart aren't three ways to do the same job. They're three different jobs that happen to sit on one pipeline — and confusing them is the most common reason supply chain data projects stall at the "we have the data but nobody trusts it" stage.

This issue is the mental model we give clients before any tooling conversation happens. No vendor names, because the layers matter more than which product implements them.

THE ONE-LINE TEST

If two departments run the same KPI and get different numbers, that isn't a reporting bug — it's a missing warehouse. If your forecast is quietly retrained on slightly different feature logic every sprint, that's a missing feature store. Each layer below exists to close one specific gap like this.

What Each Layer Actually Answers

Before the diagram, the table. Every layer below answers a question the others cannot:

LayerAnswersTypical data
Operational databaseCan I approve this purchase order right now?current transactions
Data lake — BronzeWhat did the source system actually send us?raw files, raw tables
Data lake — SilverIs this record clean, deduplicated, valid?standardised records
Data lake — GoldIs this ready for a business question?conformed entities
Data warehouseGive me three years of this, fast, governed.facts & dimensions
Data martShow my department only what it needs.sales / inventory / procurement subsets
Feature storeWhat does the forecasting model actually eat?lags, rolling means, engineered features
Vector databaseWhat does this contract or SOP say?document embeddings

Bronze, Silver, Gold — in One Sales Row

The refinement stages aren't abstract. Take one row of sales data arriving from a store's POS system:

BZ

Bronze

Kept exactly as the store sent it — SKU as RC-45B, quantity in cases, timestamp in local time, possibly duplicated because the POS retried the upload. Nothing is fixed yet, because you may need to prove later what the source actually said.

SV

Silver

The duplicate is dropped, the SKU is mapped to your master product code, cases are converted to units, and the timestamp is normalised to UTC. Trustworthy now, but still just a transaction.

GD

Gold

Joined to the product dimension, rolled up into daily_sales, tagged with the SKU's ABC-XYZ class — ready for a forecast model or a Power BI card to consume directly.

Why the Warehouse Doesn't Retire Once You Have a Lake

This is the part that trips teams up. If Gold is already clean and business-ready, why load it into a warehouse at all? Two reasons: query speed — a dimensional model with proper fact and dimension tables answers "OTIF by supplier by month for the last three years" in seconds, where scanning lake files directly does not — and access scoping. Procurement shouldn't need warehouse-wide access just to see supplier lead times.

📊

Sales Mart

Same governed facts and dimensions as the warehouse, scoped to what the sales team actually asks.

📦

Inventory Mart

Stock position, safety stock, ABC-XYZ — without needing to see procurement spend.

🛒

Procurement Mart

Supplier lead times and spend, filtered from the same warehouse, not a separate copy of the logic.

Marts don't duplicate the warehouse's logic — they filter it. That's the whole design: one governed set of facts and dimensions, scoped three different ways.

Where Forecasting, Optimisation and AI Agents Plug In

This is also where our own DAPP → RESO method lives in the architecture, not just in a slide. The Data and Algorithm steps run on the feature store — lag values, rolling means, promotion flags, engineered from Gold, versioned so you always know which feature set trained which model. The Predict + Prescribe steps hand a forecast to an optimisation solver — order quantity, reorder point, route — constrained by real lead times and MOQs, not a spreadsheet guess.

Feature store — model-ready inputs (lags, rolling means, promotion flags), versioned, sitting between Gold and your forecasting or optimisation models.

Vector database — embeddings of unstructured documents (contracts, SOPs, quality certificates), so an AI agent can retrieve the relevant clause by meaning, not keyword.

The agent — a router, not a shortcut. It calls a warehouse query for structured history, a feature-store lookup for the current forecast, and a vector-database search for the supplier contract's lead-time terms, then reasons over the three answers together.

An agent that only reads raw lake files inherits every inconsistency in your source data and has no fast way to answer a three-year trend question. See Issue #15 — Agentic AI for Supply Chain Planning for the guardrails and build steps once these layers exist; the agent is only as good as whether they do.

THE MENTAL MODEL TO KEEP

Don't ask which one to build. Ask which problem you're solving this quarter — running the business, reporting on it, or predicting where it's going — and let that answer which layer comes next.

A Pragmatic Build Order

We rarely recommend building all of this at once, even for clients who can afford to. Six stages, roughly in sequence:

  1. 01
    FoundationSQL database, Power BI, Excel. Source → database → dashboard. Gets a real number in front of decision-makers in weeks, not quarters.
  2. 02
    Data engineeringData lake, Bronze/Silver/Gold, orchestration, and the data-quality checks that catch a negative quantity before it reaches a dashboard.
  3. 03
    Enterprise analyticsWarehouse, data marts, and one semantic layer — so "OTIF" is calculated once and means the same thing in every report.
  4. 04
    Machine learningFeature store and demand forecasting, from a moving-average baseline up through XGBoost or a temporal fusion transformer where SKU count justifies it.
  5. 05
    OptimisationTurn the forecast into a decision — order quantity, safety stock, route — subject to the constraints that actually bind: capacity, MOQ, service level.
  6. 06
    AI agentsTool-calling agents that query the warehouse, call the forecast, and read the contracts — in one conversation, once stages 1–5 give them something real to call.

Not sure which stage you're actually at? Run the free Inventory Health Check or book a 30-minute architecture review — we'll tell you honestly whether you need a warehouse yet, or just a cleaner Silver layer.

The Honest Summary

A data lake, a warehouse and a mart are not a menu you pick one item from. They are stages a business passes through as more people need to trust the same numbers, and as more of the "what should we do" question gets handed to a model instead of a spreadsheet. Build the stage the current quarter's problem actually needs — not the stage a vendor's architecture diagram says you should be at.

Frequently Asked Questions

What is the difference between a data lake and a data warehouse?
A data lake stores data in its raw, original form at any scale and cost, so nothing is lost before you decide how to use it. A data warehouse stores only structured, cleaned data organised into facts and dimensions, built for fast, governed queries across years of history. The lake is where data lands and gets refined; the warehouse is where refined data gets queried at speed.
Do I need a data warehouse if I already have a data lake?
Yes, once two conditions show up: you need sub-second queries across years of history that scanning lake files can't deliver, and more than one team needs the same numbers with the same definition. A lake alone works fine for a single analyst running Python against Gold-layer files; a warehouse earns its cost the moment a KPI like OTIF needs to mean the same thing in every team's report.
What is the Bronze, Silver, Gold data lake architecture?
It is the three refinement stages inside a data lake. Bronze keeps data exactly as the source system sent it, duplicates included, so you can always prove what was actually received. Silver is the same data deduplicated, validated and standardised. Gold is Silver joined to your business dimensions and rolled up into a form a dashboard or model can consume directly.
What is a data mart and how is it different from a data warehouse?
A data mart is a department-scoped subset of the data warehouse — a Sales Mart, an Inventory Mart, a Procurement Mart — each filtered to one team's questions using the same governed facts and dimensions. Marts don't duplicate the warehouse's logic, they scope access to it, so a team doesn't need warehouse-wide visibility just to see its own numbers.
Where does a feature store fit in a supply chain AI platform?
Between the Gold layer and your forecasting or optimisation models. It holds the engineered inputs a model actually trains on — lag values, rolling means, promotion flags — versioned, so you always know which feature set trained which model version. Without one, teams end up with slightly different feature logic in every notebook and a forecast nobody can reproduce.
Can an AI agent query a data lake directly?
It can, but it shouldn't be its only option. An agent reading only raw or lightly-cleaned lake files inherits every inconsistency in the source data and has no fast, governed way to answer a multi-year trend question. The reliable pattern gives the agent tools: a warehouse query for structured history, a feature-store lookup for model inputs, and a vector-database search for documents.
What is the right build order for a supply chain analytics platform?
Six stages, roughly in sequence: a SQL database with Power BI dashboards for a quick first win; a data lake with Bronze, Silver and Gold plus orchestration once volume and sources grow; a warehouse and data marts with one semantic layer once more than one team needs the same numbers; a feature store and demand forecasting; an optimisation layer that turns forecasts into decisions; and AI agents that call the layers built in stages one through five.
Do I need a vector database for supply chain AI?
Only once you want AI to reason over unstructured documents such as supplier contracts, SOPs or quality certificates alongside your structured data. A vector database stores embeddings of those documents so an AI agent can retrieve the relevant clause by meaning, not just keyword. A purely numeric use case — forecasting, inventory, routing — can build significant value with a warehouse and feature store alone.
CSCAP™ · Next cohort forming

Supply Chain Analytics Practitioner — watch the 90-second pitch.

SQL, statistics, forecasting, inventory, optimization, simulation, Power BI and AI — 24 live weeks, 150+ hours, one enterprise dataset, 12 projects you can show in interviews.

📅 24 Weeks🧪 12 Projects🎓 Practitioner Exam🎁 Early-bird pricing
Mathnal Insights · Free Newsletter

Supply chain intelligence, decisions from evidence

Join supply chain leaders getting practical AI, forecasting, inventory and optimisation playbooks — plus new tools, courses and case studies. No spam, unsubscribe anytime.

By subscribing you agree to our Privacy Policy. Processed via Formspree.

📰 Latest from Mathnal Insights

Supply Chain Intelligence You Can't Afford to Miss

Issue #15 · Agentic AI

Agentic AI for Supply Chain Planning — What Actually Works

The five jobs worth giving an agent first, a full build guide for an inventory agent, and where agents genuinely fail.

Issue #16 · SQL Playbook

12 SQL Queries Every Supply Chain Analyst Should Know

Copy-ready SQL for fill rate, OTIF, MAPE, ABC classification, dead stock and days of cover.

Free Tool · No Signup

Inventory Health Check

A 10-dimension score — safety stock, ABC-XYZ, turns, aging — to see which layer your own data actually needs next.

View all 17 newsletters →  |  Free diagnostic tools →  |  SC ML Engineering & MLOps →