Overview
| Comment: | collapse concurrent highlight misses into one tokenisation
A read-through memo only helps once a value exists: ten cold readers of sqlite's where.c each took 0.95s against 0.42s for one, all tokenising the same immutable bytes. Safe because the value is a pure function of its key. x/sync was already in the module graph. |
|---|---|
| Timelines: | family | ancestors | descendants | both | trunk |
| Files: | files | file ages | folders |
| SHA3-256: |
05dbba300d7a8d0328d09762362b9567 |
| User & Date: | quarry on 2026-08-31 12:34:25.973 |
| Other Links: | manifest | tags |
Context
|
2026-08-31
| ||
| 12:35 | licences: x/sync is now a direct dependency check-in: 335c4703c3 user: quarry tags: trunk | |
| 12:34 |
collapse concurrent highlight misses into one tokenisation
A read-through memo only helps once a value exists: ten cold readers of sqlite's where.c each took 0.95s against 0.42s for one, all tokenising the same immutable bytes. Safe because the value is a pure function of its key. x/sync was already in the module graph. check-in: 05dbba300d user: quarry tags: trunk | |
| 12:25 |
the highlight gate is a safety valve, not a policy
256KB turned ten of sqlite's src files permanently grey, which trades the feature for the fix. Raised to 2MB; the per-blob cache carries the cost until windowing removes the need for a threshold at all. check-in: 937b10d6de user: quarry tags: trunk | |
Changes
Modified go.mod
from [c233e90689]
to [715ba1cffb].
[diff]
Modified internal/highlight/gate_test.go
from [2f38a269c0]
to [533c50797e].
[diff]
Modified internal/highlight/highlight.go
from [51accc2099]
to [9deb4b0777].
[diff]