AW-10865990051
MLOps feature engineering · production architecture

MLOps feature engineering without another mandatory feature store.

IOblend builds governed ML feature pipelines from batch, streaming and CDC data. Define feature logic with SQL or Python, maintain state and point-in-time history, apply data quality and record-level lineage, and continuously materialise features into the warehouse, lake or serving target you already operate—using Apache Spark underneath and customer-controlled infrastructure.

Real-time + batch feature pipelines Point-in-time aware feature engineering Apache Spark execution
MLOPS FEATURE ARCHITECTURE feature computation · governance · serving
Conventional feature-store patternmultiple synchronised tiers
RAW DATAbatch · events · CDC
FEATURE PIPELINEcompute + transforms
OFFLINE + ONLINE STOREhistory + synchronised serving copy
MODEL / APPfeature lookup + inference
IOblend patternserving becomes a choice
RAW DATAbatch · stream · CDC
IOBLEND FEATURE PIPELINEcompute · quality · lineage · state
YOUR LAKE / WAREHOUSEcontinuous feature materialisation
TRAIN / INFER / ACTdirect, cached or online serving
DESIGN PRINCIPLEKeep feature logic independent of the final serving product.
DEPLOYMENTCustomer-controlled cloud · on-prem · hybrid · edge.
FEATURE ENGINEERINGSTREAMINGCDCPOINT-IN-TIMELINEAGEDATA QUALITYCI/CDAPACHE SPARKAI / AGENTS
The answer in one paragraph

Feature-store value. Without making a feature store your new centre of gravity.

IOblend is a production feature-engineering layer for MLOps. It ingests historical and live data, calculates ML features with SQL or Python, applies data quality and governance, maintains state, and materialises continuously updated feature tables into data platforms you already operate. Your warehouse, lake or chosen serving target remains the system of record; IOblend manages the governed feature flow around it.

Feature engineeringTraining / serving consistencyReal-time featuresRecord-level lineagePoint-in-time historySchema evolution
Rethink the architecture

Feature stores solved real problems. They can also become another platform to operate.

IOblend keeps the valuable parts—reusable definitions, freshness, lineage, historical consistency and production controls—while removing the assumption that every MLOps architecture needs another mandatory persistent tier.

Typical multi-tier pattern

More moving parts between the feature and the prediction.

A conventional feature-store architecture may separate historical storage, online serving and synchronisation.

Feature computationBatch / streaming feature jobs.
Offline feature storeTraining history and point-in-time retrieval.
Publish / synchroniseKeep selected features aligned.
Online feature storeLow-latency keyed access.
Model servingPrediction path consumes features.
Industry reference: Feast

Feast documents a feature-store architecture with offline and online stores and separate historical/online retrieval patterns.

Feast feature-store documentation ↗
IOblend principle

Make feature serving an architectural choice—not a platform dependency.

Compute and govern feature data as production data pipelines. Materialise into the warehouse or lake you already use, or add a specialised serving target only where latency genuinely requires it.

One reusable feature definitionPortable playbook + SQL / Python.
IOblend executionBatch · stream · CDC · state.
Your existing data platformLake · warehouse · operational target.
Optional low-latency tierAdd only where response time warrants it.
Many consumersTraining · inference · BI · agents.
Important: this does not suggest that specialised online serving is never needed. Millisecond lookup can still justify Redis, DynamoDB, Cassandra, Lakebase, Postgres or application caching. The difference is that feature logic remains independent of that serving choice.
The IOblend feature factory

One production flow from raw events to model-ready context.

The same pipeline can combine historical backfill, streaming events, operational CDC, feature logic, governance, state and materialisation.

01

Ingest

Operational databases, events, files, APIs and history.

CDCstreambatch
02

Compute

Windows, joins, chained aggregations and SQL/Python logic.

windowsjoinsPython
03

Govern

Schema, quality, lineage, metadata and exceptions.

qualitylineageschema
04

Maintain state

Deduplication, SCD, MDM, late data and entity state.

SCDMDMdedup
05

Materialise

Continuously upsert into the table or target you already use.

DeltaIcebergHudi
06

Consume + act

Training, inference, analytics and agentic workflows.

MLBIagents
Feature-store capabilities, reassembled

The MLOps capabilities teams need, embedded in the pipeline operating model.

Instead of treating feature engineering as a separate island, IOblend reuses the production DataOps controls already required to keep enterprise data fresh, correct and traceable.

01

Feature definitions

Represent sources, transforms, parameters and sinks as portable metadata with SQL and Python for custom feature logic.

Reusable · versionable · CI/CD-ready
02

Registry foundation

Use record-level lineage, metadata and schema information to make feature provenance and dependencies discoverable.

Lineage · metadata · ownership context
03

Historical / offline features

Keep feature history in the lake or warehouse already used by the training and analytics estate.

Backfills · history · reproducibility
04

Freshness + state

Combine streaming, CDC, windows, watermarks, late-data handling, deduplication and stateful transforms.

Streaming · CDC · late events
05

Point-in-time datasets

Use event-time processing, historical state and repeatable logic to construct training datasets that reflect what was known at the relevant time.

Time-aware joins · SCD · history
06

Production guardrails

Apply schema checks, quality rules, error isolation, retries, observability and recovery patterns around feature production.

Quality · resilience · auditability
Feature logic becomes an asset

Define the intent once. Run it across the lifecycle.

Feature engineering should not disappear into notebooks and bespoke serving code. IOblend's metadata-driven model keeps the definition portable, inspectable and suitable for normal software-delivery practices.

The visual shows the concept of an IOblend playbook rather than literal product syntax.

IOBLEND · FEATURE PLAYBOOK customer_risk_features · version 3
customer_risk_v3 CONTINUOUS
Entity key customer_id
Window 30-day rolling
Sources payments CDC + account events
Feature logic SQL + Python
Production controls schema · quality · lineage · state · exception handling
Define Sources, parameters and feature logic.
Test Validate pipeline logic before deployment.
Deploy Execute as a production Spark pipeline.
Reuse Backfill, continuous updates and new targets.
VERSIONED TESTABLE REUSABLE PORTABLE GOVERNED
Governed feature setfresh · traceable · reusable
TRAININGHistorical, point-in-time feature datasets.
ONLINE INFERENCEDirect, cached or specialist low-latency lookup.
BATCH INFERENCEWarehouse / lake execution.
BI + ANALYTICSThe same governed business context.
AGENTSFeature context plus model outputs.
OPERATIONSApplications and business workflows.
One feature path, many consumers

Stop rebuilding the same business context for every workload.

The feature set is valuable beyond the model. The same governed, continuously maintained entity context can feed analytics, applications and AI workflows alongside training and inference.

Reduce training-serving skewReuse shared feature logic instead of rewriting transformations in separate paths.
Reuse feature-ready contextCustomer, asset, risk and behavioural features can serve ML, BI and decisions.
Keep governance attachedLineage, quality and schema context remain part of feature production.
Low-latency feature serving

Choose the serving architecture by latency requirement, not by habit.

IOblend can support low-latency feature delivery directly, so another online feature platform does not need to be the default. Start with the simplest architecture that meets the workload, then add a specialist serving tier only where there is a clear technical reason.

Pattern A · IOblend low-latency serving

Production features without another mandatory serving platform.

IOblend can maintain governed, continuously updated feature context and deliver it with low latency while keeping feature logic, lineage, quality and state inside the same production data layer.

p99 < 100 ms
Low-latency feature delivery for workloads that need fast, production-ready context.

Benchmark claim should be interpreted under defined test conditions. Actual latency depends on infrastructure, network topology, feature complexity, data volume and deployment architecture.

Continuously updated Fresh features maintained from live enterprise data.
Governed Schema, quality and lineage stay attached to the feature flow.
Portable logic Serving technology does not own the feature definition.
Customer-controlled Deploy where the latency path makes the most sense.
Latency-driven architecture choice Use the serving pattern that matches the response-time requirement.
IOblend low-latency path p99 < 100 ms Fast delivery without defaulting to another feature platform.
Warehouse / lake serving Use when already sufficient Best for training, batch inference, analytics and near-real-time workloads.
Specialist online store Add only if genuinely needed Redis, DynamoDB or similar for specialised latency or access patterns.
The feature logic stays independent of the serving technology. That means the serving layer can evolve without forcing a rebuild of the feature-engineering logic.
Pattern B

Warehouse or lake serving

Use the existing lakehouse or warehouse directly for training, batch inference, analytics and workloads where the current platform already meets the required response time.

Pattern C

Specialist online serving

Redis, DynamoDB, Cassandra, Postgres or another dedicated serving technology can still make sense when a workload needs a particular latency, scaling or keyed-access pattern.

DESIGN
PRINCIPLE
Low latency does not automatically require another feature platform.

IOblend separates feature logic from serving infrastructure while supporting low-p99 feature delivery itself. That lets teams choose the simplest serving architecture that meets the workload instead of introducing an online feature store by default.

Beyond feature engineering

Close the loop from enterprise data to prediction to action.

IOblend can combine governed feature production with model outputs and Python-based AI or agent logic inside the wider dataflow—then validate and route what happens next.

Fresh enterprise contextFeatures maintained from batch, stream and CDC.
Model inferenceScore, classify, forecast or recommend.
Capture outputBring model results back into the production flow.
Validate + contextualiseQuality, rules, lineage and operational context.
Act or escalateAgent · app · workflow · human review.
External ecosystem reference

MLOps has to coexist with the platforms already used for models and analytics.

Microsoft Fabric is one example of a broader analytics and data-science environment. MLflow is a common model-lifecycle reference. IOblend's role remains the governed enterprise feature and dataflow layer around those choices.

Official Microsoft Fabric architecture diagram showing Fabric workloads, shared OneLake storage and governance
Official Microsoft Learn architecture image. External reference only.
Where the architecture earns its keep

Feature engineering for systems that cannot live on yesterday's context.

The strongest use cases combine changing enterprise state, reusable entity context and a need for reliable production delivery.

01 / RISK

Fraud + risk

Maintain velocity, behavioural and account-state features from transactions and operational CDC.

Fresh context + point-in-time history
02 / CX

Real-time personalisation

Update customer, session and interaction features as activity changes rather than waiting for the next batch cycle.

Recommendations + next-best action
03 / INDUSTRIAL

Predictive maintenance

Turn IoT and equipment events into rolling health, utilisation and anomaly features for predictive models.

Streaming windows + state
04 / CUSTOMER

Customer 360

Maintain governed customer state across CRM, transactions, service events and behavioural signals.

MDM + SCD + CDC
05 / OPERATIONS

Operational analytics

Use the same feature-ready business context for models, dashboards and operational decisioning.

One context · multiple consumers
06 / SOVEREIGN

Edge + air-gapped AI

Run feature pipelines inside constrained or sovereign environments without an external IOblend-hosted serving dependency.

Customer-controlled deployment
Open MLOps architecture

Build around the data technologies you already trust.

IOblend is strongest when it complements the existing data and ML estate rather than demanding that the estate be rebuilt around IOblend.

Apache Spark underneath. IOblend production engineering around it.

Spark provides distributed processing. IOblend Designer, metadata playbooks and Engine manage the higher-level feature-pipeline lifecycle, execution and DataOps controls.

Official Apache Spark logo
External technology referenceApache Spark is the open-source processing foundation used underneath IOblend execution.

Your lakehouse, warehouse or serving target remains yours.

Materialise feature data into open table formats or commercial platforms according to the architecture. The feature logic stays in the pipeline layer rather than being defined by a single storage vendor.

Delta LakeLakehouse tables + streaming / batch.
Apache IcebergOpen table format.
Apache HudiIncremental lakehouse processing.
The engineering argument

Spend engineering time on the features, not another serving platform.

The value of the “no mandatory store” model is architectural: fewer default copies, fewer synchronisation paths and less coupling between feature logic and a specific serving product.

1 flow

Historical backfill, live updates, governance and materialisation can be managed as one production feature pipeline.

Mixed batch, streaming and CDC ingestion can operate with lineage, schema evolution, quality controls, state management and continuously maintained outputs inside the same production model.

Read the MLOps deep dive →
INFRASTRUCTURE

Do not duplicate by default.

Keep feature history in the warehouse or lake already operated by the business and introduce another online copy only where the serving requirement justifies it.

PORTABILITY

Decouple feature logic from the serving vendor.

Keep feature definitions and transformations in the pipeline layer so the target can change without rebuilding business logic from scratch.

MLOps FAQ

Questions ML platform teams usually ask next.

FAQ for architecture review, technical evaluation and AI-search retrieval.

What does “feature store without the store” mean?

It means IOblend can compute, govern and continuously materialise ML features into the warehouse, lake or operational store you already use instead of requiring a separate IOblend-hosted feature-store tier in every serving path.

Does IOblend replace every online feature store?

No. Some inference workloads genuinely require specialised low-latency serving. IOblend makes that a serving choice rather than a mandatory architectural dependency.

How can IOblend reduce training-serving skew?

Feature logic can be represented as reusable pipeline metadata and SQL or Python transformations, then reused for historical backfills, continuous updates and downstream materialisation rather than being independently reimplemented.

Can IOblend build real-time ML features?

Yes. IOblend supports streaming, CDC and batch ingestion, with stateful processing such as windows, joins, deduplication, SCD and continuously updated outputs.

How are feature definitions governed?

IOblend uses portable JSON playbooks for pipeline definitions and provides metadata, record-level lineage, schema management, data-quality controls and integrated development/testing patterns.

Where can IOblend MLOps pipelines run?

IOblend is designed to run on customer-controlled infrastructure across local, on-premises, cloud, hybrid, edge and air-gapped scenarios, with Apache Spark as the distributed processing foundation.

Make your current MLOps architecture the test

Bring us the feature pipeline that has too many moving parts.

Show us the raw sources, feature logic, freshness target, training path and serving latency. We will map where IOblend can consolidate the engineering—and where a specialised serving layer genuinely still makes sense.

Scroll to Top