FeaturesHow It WorksArchitectureIntegrationsPricingBlog
Architecture

PRISM architecture, purpose-built for financial services

Progressive data refinement from Protected Raw ingestion through Refined transforms and Intelligence enrichment to Market-Ready outputs. Quality gates at every layer transition.

PRISM Layers

P → R → I → S → M

Five layers of progressive data refinement. Quality gates enforce standards at every transition — only data that passes is promoted to the next layer.

Protected Raw
Schema validation, PII classification, null checks
Refined
Business rules, referential integrity, lineage recording
Intelligence
Entity resolution, regulatory domain checks
Semantic
Access policy, schema lock, owner approval
Market-Ready

Protected Raw

Compliance-first ingestion with PII scanning and immutable audit trail.

  • Compliance-first ingestion — PII scanned before storage
  • Immutable audit trail for every record
  • Format auto-detection on ingestion
  • Append-only storage with full history
{  "customer_id": "C-4521",  "name": "Acme Corp",  "txn_date": "2024-01-15",  "amount": "12450.00",  "status": null}
CSVJSONParquetXMLAvro
All Data Types

Structured, semi-structured, and unstructured

Handle every data format your enterprise produces. From relational tables to PDFs, JSON feeds to server logs.

Structured

PostgreSQLSnowflakeOracleSQL ServerMySQLCSVTSV

Full schema discovery and type mapping

Semi-Structured

JSONJSONLXMLAvroParquetORCYAMLProtocol Buffers

Schema inference and nested field flattening

Unstructured

PDFWordtextserver logsapplication logsimagesaudiovideo

OCR/NLP text extraction and metadata extraction

Format Auto-Detection

Automatically identifies file formats on ingestion

Cross-Format Migration

Convert between relational, Parquet, JSON, and more

Schema Inference

Infer schemas from semi-structured and unstructured data

Industry Templates

Pre-built for financial services

Start with a battle-tested template and customise to your needs. Each template ships with pre-configured PRISM layers.

Financial Transactions

KYC/AML pipeline with transaction monitoring and sanctions matching

P
R
I
S
M

Protected Raw

Raw transaction feeds, KYC documents, sanctions lists

Refined Transforms

  • Deduplication
  • Type casting
  • Null handling
  • Schema validation

Market-Ready Outputs

  • Transaction risk scores
  • Sanctions match flags
  • Suspicious activity reports

Customer Master

Customer 360 with MDM, ID resolution, and lifecycle tracking

P
R
I
S
M

Protected Raw

Raw CRM exports, support tickets, usage logs

Refined Transforms

  • Identity resolution
  • Address standardization
  • Dedup/merge
  • SCD Type 2

Market-Ready Outputs

  • Customer 360 profiles
  • Lifetime value scores
  • Churn predictions

Generic

General-purpose PRISM template with SCD Type 2 and time-series support

P
R
I
S
M

Protected Raw

Any structured, semi-structured, or unstructured source

Refined Transforms

  • Schema validation
  • Type casting
  • Deduplication
  • Null handling

Market-Ready Outputs

  • Star schema
  • Aggregate tables
  • Time-series rollups
Pipeline Compiler

From visual canvas to production workflow

The pipeline compiler transforms your visual DAG into a durable Temporal workflow in five deterministic steps.

1

Validate DAG

Check for cycles, verify all required inputs are connected, validate component compatibility

2

Resolve Components

Lock component versions, resolve configuration schemas, validate parameter types

3

Apply Policy Overlays

Merge organisation → team → pipeline security and compliance policies

4

Generate Workflow

Compile visual DAG into Temporal workflow definition (Python)

5

Register & Emit Lineage

Register with Temporal server, emit column-level lineage metadata as byproduct

Compilation Path

Visual DAG Intermediate Representation Temporal Workflow

Column-level lineage metadata is emitted as a byproduct of compilation, not a separate process.

Start with a template, customise with the visual builder

Choose from pre-built financial services templates or build from scratch. Your pipeline, your way.