State Space Explosion and Deterministic Chaos

State Space Explosion and Deterministic Chaos: How Concurrent System Fragility and ML Model Sensitivity to Perturbation Mirror Each Other

2026-05-18 · security-risk ai-architecture formal-methods system-dynamics · medium · source → · wiki →
key claims
  1. State space explosion in concurrent systems is a genuine exponential-growth problem, because the reachable state space often grows exponentially in the number of processes and variables rather than merely linearly with added componentsKot (2003)
  2. Race conditions are the runtime symptom of that explosion, because multiple valid interleavings of simple read-modify-write operations can produce different outcomes from the same code and nominal inputOracle Java Tutorials (n.d.)MITRE (n.d.)Kot (2003)
  3. Lorenz's deterministic nonperiodic-flow result shows that deterministic equations can still yield practical unpredictability when small initial differences grow into considerably different later states. (; medium confidence; source: https://doi.org/10.1175/1520-0469(1963)020%3C0130:DNF%3E2.0.CO;2; https://www.ams.org/publicoutreach/feature-column/fcarc-lorenz)Lorenz (1963)
  4. Adversarial examples show small-perturbation vulnerability inside machine learning, and this item treats that result as an analogous sensitivity pattern because small worst-case perturbations can force high-confidence misclassification through high-dimensional linear behaviorGoodfellow et al. (2015)
  5. Across concurrency, chaos, and adversarial learning, small local perturbations can trigger much larger qualitative behavioral changes than a simple reading of the governing rules would suggest. (; medium confidence; source: https://www.cs.vsb.cz/kot/down/Texts/StateSpace.pdf; https://doi.org/10.1175/1520-0469(1963)020%3C0130:DNF%3E2.0.CO;2; https://arxiv.org/abs/1412.6572)Kot (2003)Lorenz (1963)
  6. The analogy stops at mechanism, because chaotic sensitivity tracks divergence of nearby trajectories through time while adversarial fragility usually tracks local instability of a learned classifier around a decision boundary at inference time. (; medium confidence; source: https://doi.org/10.1175/1520-0469(1963)020%3C0130:DNF%3E2.0.CO;2; https://arxiv.org/abs/1412.6572)Lorenz (1963)
  7. Lamport's happened-before relation provides a rigorous partial-order framework for causal ordering in distributed systems, but concurrent events remain those for which neither event happens before the otherLamport (1978)
  8. This item extends Research Question 6.1 and Research Question 2.3 together by showing that formal impossibility and structural fragility are complementary rather than competing explanations of why deterministic coded systems can still be hard to predict, verify, or stabilize. (; medium confidence; source: https://davidamitchell.github.io/Research/research/2026-05-18-rq6-1-halting-problem-static-analysis.html; https://davidamitchell.github.io/Research/research/2026-05-18-rq2-3-predictive-model-fragility.html; https://www.cs.vsb.cz/kot/down/Texts/StateSpace.pdf; https://doi.org/10.1175/1520-0469(1963)020%3C0130:DNF%3E2.0.CO;2)Research Question 6.1 (n.d.)Research Question 2.3 (n.d.)Kot (2003)Lorenz (1963)

Research Question

How do state space explosion in concurrent systems and chaos theory, especially sensitive dependence on initial conditions, mirror the fragility of machine learning models when subjected to minor input perturbations?

Findings

(Populated from §6 Synthesis above.)

Executive Summary

State space explosion and deterministic chaos do mirror machine-learning fragility, but only at the level of bounded perturbation sensitivity rather than as one shared mathematical theorem. In concurrent coded systems, the core mechanism is combinatorial growth of reachable states and interleavings, which makes exhaustive verification or prediction practically intractable and appears concretely in race conditions. In Lorenz-style chaos, the core mechanism is sensitive dependence on initial conditions, where tiny initial differences evolve into large trajectory differences despite fully deterministic governing equations. In adversarial machine learning, small worst-case perturbations can force high-confidence errors through high-dimensional linear sensitivity and unstable learned boundaries, which makes adversarial fragility a useful comparison point rather than a proven equivalent of chaotic sensitivity. Lamport's logical clocks narrow one part of the concurrency problem by preserving causal order, but they do not remove the underlying branching state space or all schedule-dependent behavior.

Key Findings

  1. State space explosion in concurrent systems is a genuine exponential-growth problem, because the reachable state space often grows exponentially in the number of processes and variables rather than merely linearly with added components.
  2. Race conditions are the runtime symptom of that explosion, because multiple valid interleavings of simple read-modify-write operations can produce different outcomes from the same code and nominal input.
  3. Lorenz's deterministic nonperiodic-flow result shows that deterministic equations can still yield practical unpredictability when small initial differences grow into considerably different later states. ([fact]; medium confidence; source: doi.org Ghys and Leys (2006) Lorenz and Modular Flows: A Visual Introduction
  4. Adversarial examples show small-perturbation vulnerability inside machine learning, and this item treats that result as an analogous sensitivity pattern because small worst-case perturbations can force high-confidence misclassification through high-dimensional linear behavior.
  5. Across concurrency, chaos, and adversarial learning, small local perturbations can trigger much larger qualitative behavioral changes than a simple reading of the governing rules would suggest. ([inference]; medium confidence; source: Kot, M. (2003) The State Explosion Problem doi.org Goodfellow et al. (2015) Explaining and Harnessing Adversarial Examples
  6. The analogy stops at mechanism, because chaotic sensitivity tracks divergence of nearby trajectories through time while adversarial fragility usually tracks local instability of a learned classifier around a decision boundary at inference time. ([inference]; medium confidence; source: doi.org Goodfellow et al. (2015) Explaining and Harnessing Adversarial Examples
  7. Lamport's happened-before relation provides a rigorous partial-order framework for causal ordering in distributed systems, but concurrent events remain those for which neither event happens before the other.
  8. This item extends Research Question 6.1 and Research Question 2.3 together by showing that formal impossibility and structural fragility are complementary rather than competing explanations of why deterministic coded systems can still be hard to predict, verify, or stabilize. ([inference]; medium confidence; source: Research Question 6.1: The Halting Problem and Rice's Theorem, the Absolute Boundary of Static Analysis for Coded Systems Research Question 2.3: Structural Stability vs. Predictive Fragility, Dynamical Systems Theory and the Cost of Noise Kot, M. (2003) The State Explosion Problem doi.org

Assumptions

Analysis

The analogy is defensible because all three domains punish small local differences with much larger downstream behavioral changes than naive intuitions expect. Its limit is mechanistic rather than empirical, because concurrent software fragility is combinatorial, chaotic fragility is dynamical, and adversarial machine-learning fragility is geometric and statistical. Lamport's logical clocks matter because they show one principled mitigation strategy, adding causal structure to event order, yet they also clarify the limit of that mitigation because concurrency itself is not abolished by assigning timestamps. That bounded reading fits the prior repository items better than a stronger claim of literal equivalence, because Research Question 6.1 is about semantic undecidability and Research Question 2.3 is about missing invariant structure rather than about one universal fragility mechanism.

Risks, Gaps, and Uncertainties

Open Questions


sources


cites
cites The Halting Problem and Rice's Theorem: The Absolute Computational Boundary of Static Analysis for Arbitrary Coded Systems
cites Structural Stability vs. Predictive Fragility: Dynamical Systems Theory and the Cost of Noise in Mechanism-Free Models
related (frontmatter)
related Stochastic LLM Agent vs. Deterministic Coded System: Comparative Failure Mode Analysis on Identical Unvalidated Inputs
version history
versiondatecommitsummary
1.02026-05-19dac224cInitial completion

Connected items

Loading…

View full knowledge graph →