translation-meta-strong-token_alignment
The groupant beside tools/translate/src/strong.rs in the Mova repository: what the code computes, what it never does, how to go back from its outputs, its invariants, cost and checks.
Facts
Implementation material. A Mova code model describes this code at one source revision: partial models, finite checks and their stated scope. It is not a reviewed general exposition, and its labels are shown as written, never raised.
Components
| component | label | where |
|---|---|---|
| approximant | partial | approximant |
| ast | partial | ../syntax.json |
| cost | symbolic source derived | invariant |
| descriptant | present | descriptant |
| invariant | partial | invariant |
| tests | bounded native receipts | tests |
Obernants
The typed relations around the forward model: the behaviour complement (what the code never does), the reverse reconstruction (every input compatible with an output) and specialised views.
| id | type | label | where |
|---|---|---|---|
behavior_complement | behavior_complement | partial source derived model | behavior_complement |
reverse_reconstruction | reverse_reconstruction | partial source derived model | reverse_reconstruction |
unicode_lower | unicode_lower | partial source derived model | unicode_lower |
failure_state | failure_state | partial source derived model | failure_state |
first_label | first_label | partial source derived model | first_label |
lookahead_boundary | lookahead_boundary | partial source derived model | lookahead_boundary |
Model text
descriptant
Description and epoch memory
Flatten source alnum lowercase chars with per-word labels. For each normalized token scan up to40 start positions; first contiguous match emits start label and advances by token char length; failure emits None.
Prospective epoch 2026-10-31
Models predicted metadata loss, bounded coordinate transport and deterministic tie selection before test changes. Production bytes are preserved; only five inline synthetic tests were appended across the group.
Observation epoch 2026-10-31
Selected named native tests are bound in tests.md; raw receipts are external under $MOVA_DATA/runs/octopus-wave32-tr_meta-2026-10-31. Syntax is generated twice and byte-compared. This is partial syntax without macro expansion or semantic resolution.
Gaps
No real annotator/model loads, corpus translation, teacher calls, GPU, full training/evaluation, or language-accuracy claim. No executable percentage surrogate is supplied: an appropriate reference metric/domain is not established. Supported future caps are1/2/5/10 percent only. Residual reconstruction is conditional on retained diagnostics and is not persistent learning.
approximant
Forward relation
Flatten source alnum lowercase chars with per-word labels. For each normalized token scan up to40 start positions; first contiguous match emits start label and advances by token char length; failure emits None.
invariant
Invariant and cost
Domain and preservation
Character coordinates, not UTF-8 byte indices; finite strings and representable index arithmetic.
Cost
O(source_chars+40 sum normalized_token_chars), output O(tokens) and flattened source storage.
Counters and allocation arithmetic must remain representable. String/map costs include compared bytes; finite evidence is not a throughput estimate.
models
Typed models
Subject: exact source hash in manifest; observation is one call or the stated finite training pass. All models are partial source-derived relations, not universal proof. Domain and resource assumptions are in invariant.md. The baseline exclusion is an inner source-derived claim on that domain; reverse is a compatible-antecedent relation. Specialized relations hold fixed the parameters and tables unless stated otherwise. Evidence uses the named checks in tests.md; individual assertions cover only finite parts, other branches remain prospective.
behavior_complement
Empty normalized token returns None without search; a match starting40 ahead cannot be selected.
reverse_reconstruction
Labels admit every alnum string/word partition with matching first-character labels and valid cursor matches; removed case/punctuation cannot be recovered.
unicode_lower
flat_map lowercase may expand a Unicode character; coordinates follow expanded chars.
failure_state
Absent token leaves cursor unchanged, allowing a later token to match same remaining text.
first_label
A token spanning multiple source words inherits only first char label.
lookahead_boundary
Offset39 accepted, offset40 rejected by half-open range.
tests
Checks and evidence
- strong::tests::strong_words_and_tokens
- strong::wave32::window_and_numeric_boundaries
Exact cargo commands use package translate, binary translate, --offline --locked and -- --exact --test-threads=1. External native-commands.json lists every name; debug and release run twice, numerical status and named outcomes retained. Some tests target other portions of the file; this fragment has source reasoning plus only the overlapping assertions.
Compiled controls mutate production decision expressions and restore exact original bytes; see external mutations.json and restoration receipt. No assertion-only mutation is counted. The evidence summary is authoritative for completed receipts. Scoped source reasoning and finite tests do not establish total branch coverage.
This page in Markdown โ https://md.groupants.elamur.ai/free/en/mova/tools/translate/src/strong.rs.groupant/token_alignment.groupant/