Replayable telemetry ingestion for independent consumers
Task 3.5: Determine high-performing data ingestion and transformation solutions
QuestionWatch the method
Predict first. Then watch short phrases—not full sentences—drive the decision.
Scenario
Harbourline Marine streams telemetry from 400,000 hull sensors; each unit emits a reading every two seconds, and bursts during storm season triple the rate without warning.
The diagnostics team needs the readings from a single sensor in the order they were emitted, because a pressure alarm only means something after the preceding temperature trend.
Two applications must read the same feed at the same time without slowing each other: a live operations dashboard and a batch anomaly detector.
After a detector bug is fixed the team must re-read the last seven days of readings, and the platform group wants whichever design adds the least operational overhead.
Question
Which ingestion design should the platform group choose?
Activity timeline · 1 events
- 01coach · Make a prediction, record your confidence, then watch the reasoning method.