{"id":"stream-processing-correctness-is-doubly-forward-only","text":"Stream processing achieves its correctness guarantees through two coordinated forward-only mechanisms: state ratchets prevent regression (windows never reopen, cursors never reverse), and dedup retention outlives finalization (2x allowed lateness), ensuring the system never double-counts events and never revises emitted results.","truth_value":"IN","source":"","source_url":"","source_hash":"","justifications":[{"type":"SL","antecedents":["dedup-and-finalization-are-coordinated","forward-only-design-prevents-regression-and-maximizes-progress"],"outlist":[],"label":"Dedup-finalization coordination and forward-only state ratchets are complementary mechanisms that together prevent both duplication and revision"}],"dependents":["state-is-monotonically-accumulative"],"metadata":{"last_reviewed":"2026-06-06T06:26:57","review_result":"pass"},"created_at":"","updated_at":"","reviewed_at":"","verified_at":"","retracted_at":"","explanation":{"steps":[{"node":"stream-processing-correctness-is-doubly-forward-only","truth_value":"IN","reason":"SL justification valid","antecedents":["dedup-and-finalization-are-coordinated","forward-only-design-prevents-regression-and-maximizes-progress"],"label":"Dedup-finalization coordination and forward-only state ratchets are complementary mechanisms that together prevent both duplication and revision"},{"node":"dedup-and-finalization-are-coordinated","truth_value":"IN","reason":"SL justification valid","antecedents":["dedup-outlives-aggregation-window","watermark-finalization-is-irreversible"],"label":"Irreversible finalization demands that dedup outlive the window — these two depth-1 conclusions are not independent but structurally dependent"},{"node":"dedup-outlives-aggregation-window","truth_value":"IN","reason":"SL justification valid","antecedents":["dedup-pruning-uses-2x-lateness","watermark-drives-finalization"],"label":"The 2× multiplier ensures dedup coverage extends beyond the point where corrections would be impossible"},{"node":"dedup-pruning-uses-2x-lateness","truth_value":"IN","reason":"premise"},{"node":"watermark-drives-finalization","truth_value":"IN","reason":"premise"},{"node":"watermark-finalization-is-irreversible","truth_value":"IN","reason":"SL justification valid","antecedents":["watermark-drives-finalization","window-lifecycle-one-directional","no-window-merging-or-retraction"],"label":"Three properties compose into hard irreversibility: watermark-only trigger + one-way lifecycle + no retraction"},{"node":"window-lifecycle-one-directional","truth_value":"IN","reason":"premise"},{"node":"no-window-merging-or-retraction","truth_value":"IN","reason":"premise"},{"node":"forward-only-design-prevents-regression-and-maximizes-progress","truth_value":"IN","reason":"SL justification valid","antecedents":["state-ratchets-prevent-regression-across-domains","pipeline-processing-maximizes-forward-progress"],"label":"State ratchets and forward-progress pipelines are complementary mechanisms — ratchets prevent regression in stateful systems, pipelines prevent regression in dataflow systems"},{"node":"state-ratchets-prevent-regression-across-domains","truth_value":"IN","reason":"SL justification valid","antecedents":["chat-monotonic-read-progress","watermark-finalization-is-irreversible"],"label":"chat read cursors are monotonic (never re-mark as unread), aggregation windows follow OPEN→CLOSED→FINALIZED with no reversal — both are state ratchets that make backwards movement structurally impossible"},{"node":"chat-monotonic-read-progress","truth_value":"IN","reason":"SL justification valid","antecedents":["chat-dual-ordering-sequence-and-lamport","chat-read-cursors-monotonic"],"label":"Sequence-number ordering + monotonic cursors create an irreversible read-progress guarantee"},{"node":"chat-dual-ordering-sequence-and-lamport","truth_value":"IN","reason":"premise"},{"node":"chat-read-cursors-monotonic","truth_value":"IN","reason":"premise"},{"node":"pipeline-processing-maximizes-forward-progress","truth_value":"IN","reason":"SL justification valid","antecedents":["video-pipeline-maximizes-useful-work-on-failure","watermark-finalization-is-irreversible"],"label":"Video pipeline (branch-independent failure containment) and stream processing (irreversible finalization) both embody the same forward-only processing principle"},{"node":"video-pipeline-maximizes-useful-work-on-failure","truth_value":"IN","reason":"SL justification valid","antecedents":["dag-failure-cascade","youtube-pipeline-dag-structure"],"label":"DAG topology + selective cascade means a thumbnail failure doesn't block a successful transcode"},{"node":"dag-failure-cascade","truth_value":"IN","reason":"premise"},{"node":"youtube-pipeline-dag-structure","truth_value":"IN","reason":"premise"}]}}