Blog··7 min read

Cross-Agent Dependencies and the Common-Root-Cause Problem

Why multi-agent pentest systems miss cross-agent links and confuse shared root causes with exploitation steps: measured error classes and failed fixes.

DarkMoon research series·A. Architecture & attack paths·Article 8 of 23·All 23 articles

Introduction

DarkMoon runs a campaign as an orchestrator plus specialist sub-agents: one for SQL databases, one for storage, one for messaging and caches, one for GraphQL, and so on. Each sub-agent pushes the findings it produces and may declare, in an enabled_by list, which earlier findings it used.

Two problems appear as soon as findings come from several agents. First, the links that matter most often cross agents: the cache agent finds credentials, the database agent uses them. Second, agents frequently link two findings that are really two symptoms of one weakness. This article reports what DarkMoon measured about both, using the error analysis published in the attack-paths research repository.

The problem

Cross-agent links need shared identifiers. An agent can only cite a finding it knows the id of. In DarkMoon, references are resolved campaign-wide, so citing another agent's finding is allowed. But ids cross agent boundaries in only two ways: the orchestrator writes them into delegation prompts ("Already pushed findings: …"), and sub-agents return them in task results. The push reply also lists recently exploited findings, capped at 200 characters. The server itself cannot add missing relations: a tool call carries no session identity, so the server knows the run but not which sub-agent made a given call.

Common causes look like chains. If Redis accepts unauthenticated commands, an agent may report CONFIG SET accepted, SLAVEOF accepted and EVAL accepted as three findings, then declare that one enabled the next. None did: all three were enabled by the missing authentication. In causal terms the structure is A ← C → B, and the agent reports A → B.

Methodology

  • Real campaigns on a multi-protocol lab whose intended chain is unauthenticated Redis → database credentials → PostgreSQL access or superuser → command execution or file read → SSH key → SSH. Campaigns c6 (orchestrator only) and c7 (orchestrator plus three sub-agents), then a final validation run with the same three sub-agents.
  • Independent oracles scoring every declared link, with error classes.
  • Per-link analysis of every same-cause error on c7.
  • Proxy-model simulations of prompt variants on the c7 transcripts and on independent synthetic corpora, run twice per variant.

Real results

CampaignObservation
c5 / c60 of 25 cited ids were cross-agent; every citation was intra-session
c77 of 9 expected links crossed agents; 4 of them were declared. 14 of 19 declared links were cross-agent, 4 of them true positives
c6, c7, final runthe critical spine link "PostgreSQL access → SSH key" was missed every time (on the final run the missed link was "database credentials ← Redis")

The orchestrator copying ids into delegation prompts was observed spontaneously on c7 (VERIFIED). It is what made cross-agent links possible at all. It also seeds the next problem.

Same-root-cause errors

  • On c7, 12 of 13 false links were same-cause facets: 4 Redis facets, 4 version-matched CVEs, 2 SMB facets, 2 state findings. All came from sub-agents; the orchestrator made 0 such errors on c6 and c7 (VERIFIED).
  • On the final lab run, about 12 of 19 declared links were same-cause (6 Redis facets, 6 SMB facets), approximate scoring (OBSERVED).

The per-link analysis identified the mechanisms:

  1. Loose sub-agent wording ("finding … access") invited citing the finding that gave context rather than the one that gave access.
  2. Precondition treated as progression: a version-matched CVE, confirmed but not exploited, linked to the unauthenticated service it would need.
  3. "Revealed" treated as "enabled".
  4. A state finding cited instead of the access step, for example "app is superuser" cited where the login gave the access.
  5. Content anchoring: the delegation prompt and the hint name the root weakness of the delegated service, and agents cite it. On c7, 0 citations followed the hint's first position when it was wrong, so this is anchoring on content, not on position.

What was tried, and the outcome

LeverResultDecision
Wording "the direct step actually used" (+54 characters)c7 0.316 vs c6 0.556, intervals overlap; transitive errors 3 → 0, but 12 same-cause errors appeared with sub-agentsreverted
Variant B: "obtained by exploiting it; not a finding sharing its root cause"c7 replay 27 % → 78 %; independent hard corpus 91.2 % → 79.4 % (SIMULATED)not applied
Micro-test V1 ("mental qualification") / V2 (typed label DIRECT / SAME_CAUSE / CONTEXT / NONE)c7 replay strict precision V0 36 %, V1 33 % (lost 2 true links, including a cross-agent one), V2 40 %; same-cause errors 14 / 10 / 11; variance ±20 points (SIMULATED)keep the current text

Neither variant reached the −50 % same-cause criterion set for the study, and pass-to-pass variance exceeded the differences. Variant B helped on the data that suggested it and hurt on the independent corpus, which is the classic sign of overfitting a prompt.

A second complication: the proxy model did not reproduce the same-cause errors on synthetic corpora (0 such errors). The failure seems to depend on real delegation prompts and long sessions, which makes it expensive to study.

Limits

  • All real figures are single runs on one lab with one model; cross-agent counts are small.
  • The oracle was built by the same team; mapping choices move c7 precision by about 10 points.
  • Simulations used a different model with a shorter context; their fidelity on c7 was close (28.6 % simulated vs 31.6 % real), but they missed the real failure mode elsewhere.
  • No separate inter-agent corroboration mechanism exists, because the server cannot distinguish sub-agents per call.
  • An untested direction from the repository: make the root cause a first-class node agents can link to, so "both enabled by C" becomes expressible instead of being forced into "A enabled B".

Figures

Diagram. Figure 1. The only channels through which finding ids cross agents (finding names are illustrative). The server sees the run, not which sub-agent made each call.
Figure 1. The only channels through which finding ids cross agents (finding names are illustrative). The server sees the run, not which sub-agent made each call.
Diagram. Figure 2. Same-cause facets versus a true enabling step on the multi-protocol lab, an illustration of the error class documented for c7.
Figure 2. Same-cause facets versus a true enabling step on the multi-protocol lab, an illustration of the error class documented for c7.

Scientific sources

The Who&When study reports a best method at 53.5 % agent-level and 14.2 % step-level attribution accuracy, a useful warning that asking an LLM which step caused which outcome is itself unreliable.

Research, source code & reproducibility


The common-root-cause problem is open. If you have a multi-agent system that tells "two symptoms of one weakness" apart from "one step enabling the next", a replication on comparable data would be worth more to us than another prompt variant.

Next
Run it against your own lab

Darkmoon is open source (AGPL-3.0) and self hosted. Clone it, point it at a target you own, and read every line.