Overview
| Comment: | Serve stored cfile containers verbatim on clone: reuse each artifact's already-compressed 4.1 container instead of recompressing it on every clone reply, moving the per-clone compression cost off the serve path to ingest and cutting clone-serve time ~76% with byte-identical wire output. |
|---|---|
| Timelines: | family | ancestors | descendants | both | trunk |
| Files: | files | file ages | folders |
| SHA3-256: |
f4fe62b160c14670a9e3799052b0aa20 |
| User & Date: | dmestas on 2026-07-16 03:57:29.376 |
| Other Links: | manifest | tags |
Context
|
2026-07-16
| ||
| 05:04 | Delta-encode cfiles on clone: store an artifact as a delta against its previous version when materially smaller, and serve that stored delta container verbatim with the reconstructed-size USIZE per sync 7.2, cutting clone reply size 58-87% on version-chained repos while full-form artifacts still serve unchanged. check-in: d7e16fadb1 user: dmestas tags: trunk | |
| 04:47 | Delta-encode blobs and manifests on ingest and serve them verbatim as section 7.2 delta cfiles on clone: store a commit's blob (against the same path's parent blob) and manifest (against the primary parent) as a delta when it comes in materially smaller and within the write-depth cap, carry the reconstructed-target size from the delta header as the cfile USIZE rather than the container's raw-delta-length prefix, and retransmit the stored delta container byte-for-byte so a chained-corpus clone reply drops 58-87 percent while a full-form corpus is byte-identical to before. check-in: 71235bf3be user: dmestas tags: delta | |
| 03:57 | Serve stored cfile containers verbatim on clone: reuse each artifact's already-compressed 4.1 container instead of recompressing it on every clone reply, moving the per-clone compression cost off the serve path to ingest and cutting clone-serve time ~76% with byte-identical wire output. check-in: f4fe62b160 user: dmestas tags: trunk | |
| 03:51 | Restrict verbatim cfile serving to the full form: the delta serve path had no production writer and wrote the delta's length as USIZE instead of the reconstructed artifact size (sync §7.2), so drop it and let delta-stored artifacts fall back to a conformant reconstructed full-form cfile. closed check-in: 8e430e7bd7 user: dmestas tags: perf | |
| 02:41 | Land the out-of-band sync clone benchmark on trunk: it splits clone time into build/frame/decode/respond/reframe/consume/persist/reopen phases behind a convergence-verified in-process clone, and attributes per-artifact cfile compression as a faithful share of the server respond phase, so the first clone-speed optimization targets measured work rather than a guess. check-in: 5f6f1286d1 user: dmestas tags: trunk | |
Changes
Modified src/logstore.zig
from [a68af5a57d]
to [0cdb0dc288].
[diff]
Modified src/logstore_test.zig
from [aea935e576]
to [81a7a05ea6].
[diff]
Modified src/main.zig
from [c466631b10]
to [d4472d0b2c].
[diff]
Modified src/repostate.zig
from [4448436c18]
to [4d41a05110].
[diff]
Modified src/repostate_test.zig
from [a3e29ec15b]
to [03e4132b06].
[diff]
Modified src/sync.zig
from [5ec5c1a1dc]
to [7cdaa4b69e].
[diff]
Modified src/sync_benchmark.zig
from [2cb9f8b0a6]
to [8892e159e5].
[diff]