Research

Conditions for a Compounding Causal Decision Loop in the Enterprise

Four requirements, three failure modes, and the literature each is drawn from.
Mohamed Irshaid  ·  Eystx Research  ·  15 September 2026
Position paper. No new experiments; every claim is cited or derived from a stated model.

Abstract

Enterprises have spent a decade operationalizing predictive machine learning. Prediction answers what is likely given what we observe; it does not answer what will happen if we act. Causal inference closes that gap, and the methods that close it are mature: structural causal models, potential outcomes, double machine learning, heterogeneous effect estimation, policy learning. This paper argues that their maturity is precisely why they are no longer the scarce asset.

An estimated causal effect is a depreciating asset. It measures a data-generating process that begins drifting the moment it is published, and any competent team with the same data can reproduce it. What appreciates is the loop: a deployed policy that acts, observes the realized outcome, and re-estimates. We state four conditions under which such a loop compounds — deployment ownership, cheap and attributable outcome observation, clock-rate dominance over drift, and a standing exploration budget — and three failure modes that close it. Each of the four is an established result in a literature of its own — non-stationary bandits, overlap in causal identification, policy learning under unobserved confounding, and the selective-labels problem — and none of those literatures is usually read by the person deciding whether to fund the platform. The contribution here is the assembly: one deployment test, in the operator's terms, with each condition traced to the work that establishes it. Its sharpest consequence is that the advisory stage, almost universally recommended as the safe on-ramp to causal decisioning, is where the operator's own logs become confounded.

The durable question in enterprise causal AI is therefore not which estimator to use. It is whether the deployment context admits a loop at all, and what to do when it does not.

Keywords: causal inference, structural causal models, potential outcomes, do-calculus, double machine learning, heterogeneous treatment effects, policy learning, decision systems, unobserved confounding.

1. Introduction

1.1 The correlation ceiling

The dominant enterprise ML paradigm is supervised prediction: learn a map from features to an outcome and rank, score, or forecast. This is association — rung one of the ladder of causation. It is genuinely valuable for triage, ranking, and forecasting under a stable regime. But the moment a decision-maker asks what should we do, the question leaves the regime the model was trained on. Acting changes the data-generating process, and a correlational model trained on the old process cannot, in general, predict the outcome of the new one.

The familiar failure modes — a churn model that flags customers who would have stayed anyway, an attribution model that credits a channel merely shadowing demand — are not modeling defects. They are a category error: a rung-one tool answering a rung-two question.

1.2 From prediction to intervention

Causal inference raises the query from P(y | x) to P(y | do(x)) — the distribution of the outcome when we set x by intervention rather than observe it. This requires more than data. It requires assumptions about the structure of the world, made explicit and held accountable. The payoff is decisions: an effect estimate for an action, its heterogeneity across segments, and a policy mapping context to the action with the largest expected effect under constraints.

1.3 The thesis

That much is established, and increasingly well tooled. The argument of this paper begins after it.

The scarce asset in enterprise causal AI is not the effect estimate. It is the closed loop that keeps producing fresh ones — and a loop is not a modeling achievement but a property of the deployment context. Most organizations investing in causal machinery are structurally unable to close one, and the standard adoption path makes the problem worse rather than better.

1.4 Scope and contributions

This is a framework and position paper. It runs no new experiments, and every quantitative or methodological claim is either cited or derived from a stated model. Sections 2 through 4 are expository. Section 5 is a synthesis: it establishes no new result, and its value, if it has any, is that these four conditions have not to our knowledge been stated together as a single precondition test for deployment.

2. Foundations: two languages for cause

2.1 The ladder of causation

Pearl's three-rung hierarchy [1][2] organizes every causal question and fixes where today's systems sit.

3 · Counterfactual Had we acted differently, what would have happened? P(y_x | x', y') almost no systems 2 · Intervention What happens if we DO x? P(y | do(x)) causal methods 1 · Association What is likely, given what we observe? P(y | x) ~ all enterprise ML today
Figure 1. The ladder of causation. A result at a higher rung cannot, in general, be derived from data at a lower rung alone: climbing requires either an experiment or assumptions encoded as a model. Rung two is marked because it is where decisions live, and where almost no deployed enterprise system sits.

A result at a higher rung cannot, in general, be derived from data at a lower rung alone. Climbing requires either experiment or assumptions encoded as a model. This is the structural reason that more data and larger correlational models never, by themselves, produce decision-grade causal answers.

2.2 Structural causal models

The first formal language represents the world as a set of assignments: each variable is generated from its direct causes and an exogenous noise term.

X_i := f_i( PA_i , U_i )

The associated directed acyclic graph encodes which variables cause which. An intervention do(X = x) replaces the assignment for X with the constant x, severing the arrows into X while leaving every other mechanism intact — the formal definition of doing as against seeing. The do-calculus [1][3] gives complete rules for deciding whether, and how, an interventional quantity can be rewritten in terms of observable distributions.

2.3 Potential outcomes

The second language, equivalent in content [4][5][6], is the potential-outcomes (Neyman-Rubin) framework. For a binary action T, each unit has two potential outcomes, Y(1) and Y(0); only one is ever observed. The targets of estimation are the average and the conditional treatment effect.

ATE = E[ Y(1) - Y(0) ] tau(x) = E[ Y(1) - Y(0) | X = x ]

Both are developed together in [19]. The structural language is better for reasoning about mechanism; the potential-outcomes language is better for estimation and is the lingua franca of the heterogeneous-effect tooling in Section 3. A mature practice uses both.

2.4 Identification

Before any estimation, one must establish identifiability — whether the causal effect can be written as a functional of the observed distribution under the stated assumptions. The workhorse is backdoor adjustment: if a set Z blocks every confounding path between action and outcome and contains no descendants of the action, then

P(y | do(x)) = SUM_z P(y | x, z) P(z)

Where no admissible adjustment set exists, identification may still be possible through instruments, front-door adjustment, or, with weaker guarantees, regression discontinuity and difference-in-differences. The decisive discipline: identification is an assumption-driven step that precedes and constrains estimation. Skipping it produces a precise estimate of the wrong quantity.

3. The stack

Four stages turn raw enterprise data and domain knowledge into governed decisions. Each maps to a distinct body of method.

(1) DISCOVERY data + domain (2) IDENTIFICATION graph + assumptions (3) ESTIMATION ATE and tau(x) (4) DECISIONING choose do(x*) (5)  act → observe the realized outcome → refute → update Stages 1 to 4 produce an estimate. Stage 5 is the only one that produces an asset. Section 5 gives the four conditions under which stage 5 can run at all.
Figure 2. The reference stack. Each stage maps to a distinct body of method; the return path is the loop this paper is about.

3.1 Discovery

Where the causal graph is not known, structure-learning algorithms propose it from data plus constraints. Constraint-based methods [7] infer structure from conditional-independence tests; score-based and functional methods add assumptions to orient edges. In the enterprise, discovery is human-in-the-loop: algorithms propose, domain experts prune and orient, and the result is a documented graph of assumptions rather than a discovered truth. Discovery reduces the search space; it does not absolve the modeler of stating assumptions.

3.2 Identification and assumptions

Given a candidate graph, identification determines which effects are estimable and what each requires. The output of this stage is an auditable contract: the target estimand, the assumed graph, the admissible adjustment set, and the threats — unobserved confounding, selection, measurement error — that would invalidate it.

3.3 Estimation

3.4 Decisioning

Effects are inputs to decisions, not the deliverable. Policy learning [14] turns estimated heterogeneous effects into a mapping from context to action under business constraints — budget, risk, fairness, capacity. For sequential decisions, marginal structural models and related methods [15] extend the logic to time-varying actions and confounders. This is where the discipline becomes operational: a governed policy, not a chart.

4. Tooling: capability against hype

The open ecosystem is mature enough for production, provided it is used with discipline.

The honest reading: estimation and inference under a correct graph are solved and productizable. Discovery of the correct graph and defense against unobserved confounding are not, and no library removes the need for domain assumptions and refutation. Claims of automatic causal discovery from raw data with no domain input are the field's principal hype signal; the serious version of that ambition is the causal-representation-learning programme [18], which is honest about being unsolved.

This is also the point at which the paper's argument turns. If estimation is solved and available to everyone, then estimation cannot be where durable advantage lives.

5. The compounding condition

5.1 What is new here, and what is not

Everything this section asserts about mechanism is established elsewhere, and it is worth putting the inventory before the argument rather than in a footnote after it.

What is left, then, is smaller than a discovery and larger than nothing. These five results live in five literatures that do not cite each other, written for readers who are not the person signing off on the platform. Assembled, they stop being separate cautions and become a single question asked before the spending starts: does this deployment context admit a loop at all? The claim of this paper is that the question is answerable in advance, that the answer is frequently no, and that nothing in the estimator changes it.

A reader who wants the underlying results should go to the sources above rather than to this paper. A reader who wants to know whether to build the thing should keep reading.

5.2 Two assets, one of which depreciates

An estimated effect tau(x) is a measurement of a data-generating process at a moment. Enterprise processes are not stationary: prices move, competitors act, customer mix shifts, and — most consequentially — the organization's own policy changes in response to the estimate. The estimate therefore has a half-life. Write T_drift for the time over which the true effect moves outside the estimate's confidence interval.

A loop is a different object: a deployed mapping from context to action, together with an instrument that records realized outcomes and re-estimates. Its value is not the current estimate but the rate at which it can produce a fresh one. Where a loop runs, each decision is simultaneously an action and an observation, and the data asset grows with usage instead of ageing with it.

Usable decision value, indexed to 100 at deployment the loop (re-estimates each quarter) a single estimate (published once) 0 100 200 the loop a single estimate deployment year 1 year 2 year 3 Illustrative. The shapes encode the argument of 5.2, not measured data.
Figure 3. The two assets. An estimate measures a process at a moment and decays as the process drifts; a loop converts every decision into an observation, so the asset grows with usage instead of ageing with it. The steps are deliberate: each one is a re-estimation, and their spacing is the quantity Figure 4 is about.

The clearest instance is not an enterprise at all: a system that generates its training data by playing itself [20] has a loop whose data cannot be acquired by anyone who is not playing. The distinction decides what is defensible. An estimate can be reproduced by any competent team given the same data. A loop cannot, because reproducing it requires the deployment position that generates the data in the first place.

5.3 Four conditions

We state four conditions as necessary for a causal decision loop to compound. We do not claim they are sufficient.

(C1) Deployment ownership — the authority to set, not to suggest. The loop requires do(x), not P(y | x). A system that recommends an action which someone else may or may not take does not intervene; it observes a process in which its recommendation is one input among many. Ownership of the action is what makes the record of it interventional data. This condition is organizational before it is technical, and it is the one most often assumed rather than checked.

(C2) Cheap, attributable outcome observation — the verifier. The loop's spine is a verifier: a mechanism returning the realized outcome of an action at low cost and attributing it correctly. Loops close fastest where ground truth is mechanical — the payment arrived, the customer renewed, the shipment landed on time. Where the outcome requires human judgment, arrives after a multi-quarter lag, or cannot be attributed to a single action, no estimator quality compensates.

(C3) Clock-rate dominance. Let T_loop be the latency from action to re-estimated policy. Compounding requires

T_loop << T_drift

When T_loop approaches T_drift, the system permanently estimates a world that has already moved. It will appear to learn while tracking noise. The inequality is shorthand for a result that is already proved: under a variation budget, regret against a dynamic oracle is governed by the drift, and the re-estimation schedule that achieves the bound is set by it [22]. The engineering content is not the mathematics but the measurement — almost no operator knows their own T_drift, and it is cheap to estimate from held-out re-estimations. This, rather than model accuracy, is the binding constraint in most enterprise deployments that fail quietly. It also explains an observation practitioners find counterintuitive: a cruder estimator inside a fast loop routinely outperforms a superior estimator inside a slow one.

what the policy believes what is true the gap it is acting on T_loop << T_drift re-estimated every quarter T_loop ~ T_drift re-estimated once a year acting on this gap Illustrative. Same drift, same estimator quality; only the re-estimation interval differs.
Figure 4. Clock-rate dominance. Nothing changes between the panels except how often the loop closes. The lower system is not worse at estimation, and it will report the same confidence intervals; it is simply acting on a world that has already moved. This is why a cruder estimator inside a fast loop routinely beats a better one inside a slow loop.

(C4) An exploration budget — the policy must not starve its own identification. A policy that always plays the arg-max action stops generating variation in treatment assignment. Over time, treatment becomes a near-deterministic function of context, overlap (positivity) fails [5][6], and the effect ceases to be identifiable from the system's own logs. The loop degrades into a self-confirming policy: it can no longer detect that it is wrong. Compounding therefore requires standing, budgeted randomization — a deliberate cost paid in immediate expected outcome to preserve future identifiability. The exploration budget is not a machine-learning nicety. It is the maintenance cost of the asset.

5.4 Three failure modes

(F1) The advisory trap. The standard roll-out recommends advisory before autonomy: the system surfaces recommendations and a human decides. This is prudent as governance and destructive as data engineering.

When a human selects among recommendations using private information — a relationship, a conversation, an unrecorded constraint — that private information is a common cause of both the realized action and the outcome. It is, by construction, an unobserved confounder in the operator's own logs. The resulting data is not merely noisier than interventional data; it is biased in a direction the operator cannot estimate, and for identification it is worse than data from a naive random policy.

R recommendation A action taken Y outcome private information (a relationship, an unrecorded constraint) U (a) advisory, uninstrumented U causes both the action and the outcome. Back-door path open: the effect is not identified. R recommendation A action taken Y outcome private information (a relationship, an unrecorded constraint) U O override recorded (b) advisory, instrumented U reaches A only via the logged override. Conditioning on O blocks the path.
Figure 5. The advisory trap, stated as a graph — the confounded-logging structure of [23], drawn for the advisory case. Dashed circles are unobserved; the boxed node is conditioned on. The point of (a) is that the corrupted quantity is the operator's own training data, and nothing in the estimator can repair it. The point of (b) is narrow and worth being precise about: logging the override does not let anyone observe U. It blocks the path only to the extent that U reaches the action through the recorded decision. Where the human acts on private information without recording it, (b) collapses back into (a).

This is the setting Kallus and Zhou [23] treat formally as policy learning under unobserved confounding, and it is the reason their answer is bounds rather than point estimates: where the logging decision-maker holds private information, the policy value is not identified, only partially so. Empirically, De-Arteaga and colleagues [26] find that human reviewers do adjust their behaviour around algorithmic scores rather than deferring to them, which is precisely the behaviour that makes the override informative and its absence from the log costly. The advisory stage, treated as a data-collection phase, systematically corrupts the asset it is meant to build. Organizations arrive at the threshold of autonomy having spent a year accumulating a corpus they cannot use, and the corpus looks usable, which is why the error survives review.

The resolution is not to skip advisory. It is to instrument it. The human's decision must be recorded as a first-class variable — recommendation shown, action taken, override flag, and where feasible the stated reason — so the override is modeled rather than silently absorbed. An advisory system that logs only its own recommendations and the eventual outcome is generating data that cannot support the inference it is being collected for.

(F2) Policy-induced confounding. Once deployed, a policy becomes part of the mechanism generating the data — what the recommender-systems literature calls algorithmic confounding, and documents as a measurable loss of utility as the closed loop homogenises the data it sees [25]. Analysts who later estimate effects from post-deployment logs without conditioning on the policy version recover the policy, not the effect. Every logged decision must carry the identifier and parameters of the policy that produced it; a loop without policy versioning cannot audit its own history.

(F3) Outcome censoring at the tail. This is the selective-labels problem [21]: loops learn from the outcomes they observe, and they observe only the outcomes their own policy permitted. Customers never contacted, loans never approved, shipments never attempted — these generate no outcome and are silently dropped rather than recorded as missing. The estimate then converges confidently on the region the policy already explores, and its confidence is an artifact of the censoring. The exploration budget of (C4) is the only reliable remedy.

5.5 What follows

Where the four conditions hold, causal machinery is the right investment and it compounds. Where they do not, the honest recommendation is narrower and cheaper: run experiments and stop. Periodic, well-designed randomized tests and staged rollouts deliver trustworthy effects without pretending to a loop the deployment context cannot support.

The expensive error is the third case — building loop infrastructure in a context that fails (C2) or (C3), where it produces the appearance of continuous learning over an effect estimate that never meaningfully refreshes. Such a system is not merely wasteful. It is actively misleading, because its architecture signals a rigor its data cannot deliver.

6. A revised maturity model

The conventional ladder runs from description to autonomy.

LEVEL 4 AUTONOMY executes interventions within policy bounds LEVEL 3 ADVISORY recommends interventions with effects and intervals LEVEL 2 PREDICTIVE forecasts and scores outcomes; no intervention logic LEVEL 1 DESCRIPTIVE dashboards, retrospective correlation ↑  most enterprises sit at level 1 to 2 today
Figure 6. The conventional maturity ladder, with the revision Section 5.4 forces. Level 3 is ordinarily sold as both a safeguard and a data-collection stage; it is the first and not the second, unless human overrides are logged.

Section 5.4 forces a revision. Level 3 is ordinarily presented as both a governance safeguard and a data-collection stage on the way to Level 4. It is sound as the first and unsound as the second. An organization that spends a year at advisory without instrumenting human overrides does not arrive at Level 4 with a head start; it arrives with a confounded corpus and an unwarranted confidence in it.

The practical path, then:

  1. Frame and identify. Pick one high-value decision. Document the estimand, the graph, and the assumptions before touching a model.
  2. Estimate and refute. Produce ATE and tau(x) with valid intervals; pass placebo, random-common-cause, and subset refutations before any recommendation ships.
  3. Advise, instrumented. Surface interventions with effects and uncertainty to a human owner — and log the recommendation, the action actually taken, and the override. Treat an uninstrumented advisory deployment as producing no usable causal data at all.
  4. Close the loop. Feed realized outcomes back to re-estimate and update policy, under a standing exploration budget and with policy versions recorded. Graduate selected low-risk decisions to bounded autonomy.

Before any of this: check (C1) through (C4). Where they fail, the correct output of the exercise is an experiment programme, not a platform.

7. Governance and validation

Causal claims are only as good as their assumptions, so validation is structural rather than optional.

8. Limitations

  1. This is analysis, not evidence. The paper specifies a framework and cites results; it reports no new benchmarks or experiments.
  2. The clock-rate inequality is a design heuristic, not a theorem. T_loop << T_drift is stated informally. Formalizing it under an explicit drift model — and deriving the regret of a loop whose latency approaches the drift half-life — is open work.
  3. Nothing here is established by this paper. Every mechanism in Section 5 is proved or measured elsewhere, as §5.1 sets out; the paper contributes an arrangement of them and an argument about when they bind together. A reader who treats it as a source for any of the underlying results is misreading it.
  4. The assembly itself is untested. The claim that the four conditions predict which deployments compound is exactly the sort of claim that should be checked against real deployments and is not checked here. The natural test is operator-side and longitudinal: instrument the overrides on one live decision, measure T_drift, and compare the effect estimates recovered from instrumented against uninstrumented logs over the same decisions. We would consider the framing falsified if deployments failing two or more conditions compounded anyway.
  5. Necessity is claimed; sufficiency is not. The four conditions are argued as necessary. A system satisfying all four may still fail for reasons outside this analysis.
  6. Unconfoundedness remains untestable from data alone and is the dominant real-world risk. Where it is implausible, only experimentation or strong instruments deliver trustworthy effects.
  7. Discovery output is a proposal, not a structure. Treating it as ground truth reintroduces the error the discipline exists to prevent.

9. Conclusion

Enterprises are saturated with prediction and starved of decisions. The gap between them is not a tooling gap; it is the gap between rungs of the ladder, and it closes only by adding assumptions, estimating effects, and refuting them.

But closing it once is an analysis. The asset is the loop that closes it repeatedly, and a loop is a property of position rather than of method: it requires the authority to act, a cheap verifier, a clock faster than the drift, and the discipline to keep paying for exploration it does not immediately need. Where those hold, the advantage compounds and cannot be copied from the outside. Where they do not, the responsible answer is a smaller one — run the experiment, take the estimate, and decline to build the machine.

The reproducible part is the estimate. The defensible part is the loop.

References

Verified against primary sources.

Back to Eystx
Correspondence: hello@eystx.com