Real-Time Big Data Architecture Patterns

1. App server writes to  Shared in-memory cluster with a TTL and to queue dispatcher.
2. Queue Dispatcher asynchronously writes to persistent bigdata database (With out TTL)
3. Reads are first look in memory cache database. If it is missed, then look in persistent bigdata database.

BIGDATA ARCHITECTURE PATTERN2 – DISTRIBUTED MERGE & UPDATE

1. Read-Modify-Write step in a single RPC
2. Saves data flow over network.

 

BIGDATA ARCHITECTURE PATTERN3 – DISTRIBUTED MERGE & UPDATE

1. Good for write once read many workload.
2. Embedded database (with TTL) for local in process cache.
3. Embedded database used as cache and designed to use Memory and SSD deficiently.
4. Bigdata Database works for distributed writes, sharding and failover.