fix: bound large-repo memory and traversal work by danusha2345 · Pull Request #1583 · colbymchenry/codegraph

danusha2345 · 2026-08-21T10:16:40Z

Summary

bound resolver and C function-pointer synthesis caches by retained bytes, release pass-local facts early, and merge sequential synthesis results incrementally
reject oversized package targets before UTF-8 decoding, preventing HarmonyOS .har archives and similar dependency blobs from exhausting V8 heap during resolution (Daemon OOMs (~4 GB heap) on small project during startup catch-up sync; stale daemon.pid + OS PID reuse then blocks all daemon restarts (unlock does not help) #1553)
replace repeated source-prefix scans in dynamic-dispatch synthesis with linear line lookup (folded from fix: avoid quadratic synthesis line lookups #1580)
recycle a loaded query-worker burst to one fresh worker after 60 seconds idle
make shortest-path BFS linear and bound impact traversal at SQL level with explicit MCP truncation
release tag-based CFML parse trees and prune Linux watchers for removed directory subtrees
apply the existing WAL pressure valve during incremental changed-file storage and both batched resolution paths; this wires the containment hook that sync() missed without claiming the reported 64 GiB incident is fully reproduced (v1.5.0: codegraph.db-wal grew to 64 GiB and filled disk on a Linux-kernel-sized repo #1539)
merge the maintainer implementation from fix(mcp): adopt a single indexed sub-project below the server root + say when no project resolves (#1606, #1607) #1614: MCP and its shared-daemon key adopt exactly one indexed child beneath an unindexed workspace/git root; ambiguous candidates are exposed in stderr and protocol responses, handshake instructions use the same resolution, and retry down-scans are throttled (MCP server ignores indexed sub-projects below cwd #1606, MCP server is silent when no project resolves #1607)
merge current upstream main (44e1812) while preserving all fork fixes

Validation

full suite after rebuilding the native kernel: 191 test files, 3,194 passed, 9 skipped
TypeScript build passes
focused WAL regression proves sync() invokes backpressure during changed-file storage and orphan resolution: 21/21
focused MCP/root/WAL regressions exercise a real spawned server: one child is opened as default, multiple children are listed through MCP and stderr, and no-index startup explains that live sync is disabled: 67/67
self-index after the merge/fixes: 594 files, 12,978 nodes, 46,052 edges, 0 pending refs, 0 pending changes, 0-byte WAL
native kernel build and focused archive/quadratic-synthesis regressions pass
290 MB sparse .har probe: rejected before decode, 58 MB peak RSS, 0.05 s
ArduPilot full index (13,633 files): peak PSS reduced from 4.09-4.26 GB to 3.316 GB with resolver workers disabled
ArduPilot graph remained identical to baseline: 177,869 nodes / 474,074 edges
100,000-node shortest path probe: 0.14 s, ~119 MB max RSS

Commits are separated by defect for review.

…-and-graph-bounds # Conflicts: # CHANGELOG.md

…say when no project resolves (colbymchenry#1606, colbymchenry#1607) The MCP server's root resolution only walked UP, so a host launched from a workspace root above its indexed children started healthy-looking but inert: no default project, no watcher, no daemon, and nothing said so. - resolveServerRoot(): up-walk, then the bounded colbymchenry#964 down-scan behind a manifest-or-.git gate (never $HOME / fs root); exactly one indexed sub-project is adopted, zero or several never guess. - doInitialize/retryInitializeSync/resolveDaemonRoot/handleInitialize all use it, so adoption comes with live sync, the shared daemon, and the matching instructions variant; the retry path picks up children indexed later (down-scan throttled per 5s). - The no-root branch now logs what was searched and which indexed sub-projects exist, and the no-default tool response lists them with projectPath guidance (still success-shaped, never isError). Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01LxZj6W6Y1SHXwvpT3uwJpK

…-and-graph-bounds # Conflicts: # CHANGELOG.md # __tests__/wal-deferral.test.ts # src/extraction/index.ts # src/index.ts

…-and-graph-bounds # Conflicts: # CHANGELOG.md

danusha2345 · 2026-09-08T14:36:04Z

Merged current main (3adf067, post-#1770) into this branch: head e681dcd. The only conflict was the CHANGELOG entry; no source conflict. tsc clean, the branch's tests pass.

…-and-graph-bounds # Conflicts: # CHANGELOG.md

danusha2345 · 2026-09-08T14:43:24Z

Merged current main (43271f3) into this branch: head 1b81c76. The only conflict was the CHANGELOG entry; no source conflict. tsc clean, the branch's tests pass.

…-and-graph-bounds # Conflicts: # CHANGELOG.md

danusha2345 · 2026-09-08T14:57:45Z

Merged current main (85550eb) into this branch: head c48e644. The only conflict was the CHANGELOG entry; no source conflict. tsc clean, the branch's tests pass.

…-and-graph-bounds # Conflicts: # CHANGELOG.md

danusha2345 · 2026-09-08T15:12:23Z

Merged current main (8733c28) into this branch: head ef854d5. The only conflict was the CHANGELOG entry; no source conflict. tsc clean, the branch's tests pass.

…-and-graph-bounds # Conflicts: # CHANGELOG.md

danusha2345 · 2026-09-08T15:55:07Z

Merged current main (8c04734) into this branch: head 68cc98f. The only conflict was the CHANGELOG entry; no source conflict. tsc clean, the branch's tests pass.

…-and-graph-bounds # Conflicts: # CHANGELOG.md

danusha2345 · 2026-09-08T16:33:03Z

Merged current main (ee83636) into this branch: head 8856408. The only conflict was the CHANGELOG entry; no source conflict. tsc clean, the branch's tests pass.

…-and-graph-bounds # Conflicts: # CHANGELOG.md

danusha2345 · 2026-09-08T16:54:10Z

Merged current main (e720f6c) into this branch: head a3c66ea. The only conflict was the CHANGELOG entry; no source conflict. tsc clean, the branch's tests pass.

…-and-graph-bounds # Conflicts: # CHANGELOG.md # src/resolution/index.ts

danusha2345 · 2026-09-08T19:09:13Z

Merged current main (de5adba, post-#1790) into this branch: head 5bbaec8. The only conflict was the js-builtins import line beside memory-budget in resolution/index.ts (plus the CHANGELOG) — both imports kept, no behaviour change. tsc clean; the branch's tests and resolution.test.ts pass.

…-and-graph-bounds # Conflicts: # CHANGELOG.md

danusha2345 · 2026-09-08T19:28:23Z

Merged current main (cece072) into this branch: head c47857c. The only conflict was the CHANGELOG entry; no source conflict. tsc clean, the branch's tests pass.

…-and-graph-bounds # Conflicts: # CHANGELOG.md

danusha2345 · 2026-09-08T20:14:32Z

Merged current main (040ba38) into this branch: head 1cf0ceb. The only conflict was the CHANGELOG entry; no source conflict. tsc clean, the branch's tests pass.

…-and-graph-bounds # Conflicts: # CHANGELOG.md

danusha2345 · 2026-09-08T20:52:12Z

Merged current main (374b3b4) into this branch: head b6749d7. The only conflict was the CHANGELOG entry; no source conflict. tsc clean, the branch's tests pass.

…-and-graph-bounds # Conflicts: # CHANGELOG.md

danusha2345 · 2026-09-08T21:56:47Z

Merged current main (71d049c) into this branch: head 8b17110. The only conflict was the CHANGELOG entry; no source conflict. tsc clean, the branch's tests pass.

…-and-graph-bounds # Conflicts: # CHANGELOG.md

danusha2345 · 2026-09-08T22:36:25Z

Merged current main (9181dd1) into this branch: head 5c6f6a3. The only conflict was the CHANGELOG entry; no source conflict. tsc clean, the branch's tests pass.

…-and-graph-bounds # Conflicts: # CHANGELOG.md

danusha2345 · 2026-09-08T22:48:35Z

Merged current main (64bd45c) into this branch: head 9fbbb8b. The only conflict was the CHANGELOG entry; no source conflict. tsc clean, the branch's tests pass.

…-and-graph-bounds # Conflicts: # __tests__/extraction.test.ts

danusha2345 · 2026-09-08T23:39:57Z

Merged current main (799f8b2, post-#1806) into this branch: head 810ce53. The only conflict was the import lines at the top of extraction.test.ts (#1806's scanDirectoryAsync / ScanSkipStats beside this branch's getParser); all kept. tsc clean; the branch's tests pass (758).

…-and-graph-bounds # Conflicts: # CHANGELOG.md

danusha2345 · 2026-09-09T00:08:33Z

Merged current main (748311f) into this branch: head c0c6354. The only conflict was the CHANGELOG entry; no source conflict. tsc clean, the branch's tests pass.

danusha2345 added 8 commits August 21, 2026 13:15

fix(resolution): bound synthesis memory

5de9639

fix(mcp): recycle idle query workers

e92fb8e

fix(graph): make shortest-path search linear

fa8d8cc

fix(graph): bound impact traversal

7e3823e

fix(cfml): release parser trees

fddc7d6

fix(watch): prune removed directory watches

16a74c5

fix: avoid quadratic synthesis line lookups

180c6ea

fix(resolution): skip oversized package targets before decoding

f3fd47e

This was referenced Aug 22, 2026

Daemon OOMs (~4 GB heap) on small project during startup catch-up sync; stale daemon.pid + OS PID reuse then blocks all daemon restarts (unlock does not help) #1553

Open

fix: avoid quadratic synthesis line lookups #1580

Closed

danusha2345 and others added 5 commits August 24, 2026 11:01

Merge remote-tracking branch 'origin/main' into fix/resolution-memory…

2c855f0

…-and-graph-bounds # Conflicts: # CHANGELOG.md

fix(sync): apply WAL backpressure throughout sync

51d3387

fix(mcp): resolve indexed workspace subprojects

7a19b99

Merge PR colbymchenry#1614 MCP root resolution into hardening branch

19a539b

maxmilian mentioned this pull request Aug 27, 2026

v1.5.0: codegraph.db-wal grew to 64 GiB and filled disk on a Linux-kernel-sized repo #1539

Closed

merge: current upstream main into fix/resolution-memory-and-graph-bounds

b3adfb0

colbymchenry mentioned this pull request Sep 8, 2026

fix(db): fail closed when WAL valve cannot checkpoint past caps (#1539) #1751

Merged

3 tasks

danusha2345 added 2 commits September 8, 2026 11:19

Merge remote-tracking branch 'origin/main' into fix/resolution-memory…

1107382

…-and-graph-bounds # Conflicts: # CHANGELOG.md # __tests__/wal-deferral.test.ts # src/extraction/index.ts # src/index.ts

Merge remote-tracking branch 'origin/main' into fix/resolution-memory…

e681dcd

…-and-graph-bounds # Conflicts: # CHANGELOG.md

Merge remote-tracking branch 'origin/main' into fix/resolution-memory…

1b81c76

…-and-graph-bounds # Conflicts: # CHANGELOG.md

Merge remote-tracking branch 'origin/main' into fix/resolution-memory…

c48e644

…-and-graph-bounds # Conflicts: # CHANGELOG.md

Merge remote-tracking branch 'origin/main' into fix/resolution-memory…

ef854d5

…-and-graph-bounds # Conflicts: # CHANGELOG.md

Merge remote-tracking branch 'origin/main' into fix/resolution-memory…

68cc98f

…-and-graph-bounds # Conflicts: # CHANGELOG.md

Merge remote-tracking branch 'origin/main' into fix/resolution-memory…

8856408

…-and-graph-bounds # Conflicts: # CHANGELOG.md

Merge remote-tracking branch 'origin/main' into fix/resolution-memory…

a3c66ea

…-and-graph-bounds # Conflicts: # CHANGELOG.md

Merge remote-tracking branch 'origin/main' into fix/resolution-memory…

5bbaec8

…-and-graph-bounds # Conflicts: # CHANGELOG.md # src/resolution/index.ts

Merge remote-tracking branch 'origin/main' into fix/resolution-memory…

c47857c

…-and-graph-bounds # Conflicts: # CHANGELOG.md

Merge remote-tracking branch 'origin/main' into fix/resolution-memory…

1cf0ceb

…-and-graph-bounds # Conflicts: # CHANGELOG.md

Merge remote-tracking branch 'origin/main' into fix/resolution-memory…

b6749d7

…-and-graph-bounds # Conflicts: # CHANGELOG.md

Merge remote-tracking branch 'origin/main' into fix/resolution-memory…

8b17110

…-and-graph-bounds # Conflicts: # CHANGELOG.md

Merge remote-tracking branch 'origin/main' into fix/resolution-memory…

5c6f6a3

…-and-graph-bounds # Conflicts: # CHANGELOG.md

Merge remote-tracking branch 'origin/main' into fix/resolution-memory…

9fbbb8b

…-and-graph-bounds # Conflicts: # CHANGELOG.md

Merge remote-tracking branch 'origin/main' into fix/resolution-memory…

810ce53

…-and-graph-bounds # Conflicts: # __tests__/extraction.test.ts

Merge remote-tracking branch 'origin/main' into fix/resolution-memory…

c0c6354

…-and-graph-bounds # Conflicts: # CHANGELOG.md

Conversation

danusha2345 commented Aug 21, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Summary

Validation

Uh oh!

danusha2345 commented Sep 8, 2026

Uh oh!

danusha2345 commented Sep 8, 2026

Uh oh!

danusha2345 commented Sep 8, 2026

Uh oh!

danusha2345 commented Sep 8, 2026

Uh oh!

danusha2345 commented Sep 8, 2026

Uh oh!

danusha2345 commented Sep 8, 2026

Uh oh!

danusha2345 commented Sep 8, 2026

Uh oh!

danusha2345 commented Sep 8, 2026

Uh oh!

danusha2345 commented Sep 8, 2026

Uh oh!

danusha2345 commented Sep 8, 2026

Uh oh!

danusha2345 commented Sep 8, 2026

Uh oh!

danusha2345 commented Sep 8, 2026

Uh oh!

danusha2345 commented Sep 8, 2026

Uh oh!

danusha2345 commented Sep 8, 2026

Uh oh!

danusha2345 commented Sep 8, 2026

Uh oh!

danusha2345 commented Sep 9, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

danusha2345 commented Aug 21, 2026 •

edited

Loading