---
title: "mathlib-robots — Mova code model"
description: "Mova code model of tools/mathlib/src/robots.rs: components with their labels, obernants and the model text."
url: "https://groupants.elamur.ai/free/en/mova/tools/mathlib/src/robots.rs.groupant/"
---
Elamur: [Mova](https://md.mova.elamur.ai/free/en/) · [Dictionary](https://md.dictionary.elamur.ai/free/en/) · [Research](https://md.research.elamur.ai/free/en/) · **Groupants**

This page as HTML: <https://groupants.elamur.ai/free/en/mova/tools/mathlib/src/robots.rs.groupant/>

# mathlib-robots

The groupant beside tools/mathlib/src/robots.rs in the Mova repository: what the code computes, what it never does, how to go back from its outputs, its invariants, cost and checks.

## Facts

- **kind:** groupant
- **status:** partial source bound model
- **source:** [`tools/mathlib/src/robots.rs`](https://github.com/ElamurAI/mova-free/blob/main/tools/mathlib/src/robots.rs)
- **source SHA-256:** `84539710d111a104…`
- **repository folder:** [`tools/mathlib/src/robots.rs.groupant`](https://github.com/ElamurAI/mova-free/tree/main/tools/mathlib/src/robots.rs.groupant)
- **repository commit:** `855da7bd4a7b`

> **Implementation material.** A Mova code model describes this code at one source revision: partial models, finite checks and their stated scope. It is not a reviewed general exposition, and its labels are shown as written, never raised.

## Components

| component | label | where |
|---|---|---|
| **approximant** | partial | `model.md` |
| **ast** | partial | `syntax.json` |
| **composition** | partial | [Composition](#composition) |
| **cost** | partial | [invariant-and-cost](#invariant-and-cost) |
| **descriptant** | present | [descriptant](#descriptant) |
| **invariant** | partial | [invariant-and-cost](#invariant-and-cost) |
| **tests** | bounded checks | [tests](#tests) |

## Obernants

The typed relations around the forward model: the behaviour complement (what the code never does), the reverse reconstruction (every input compatible with an output) and specialised views.

| id | type | label | where |
|---|---|---|---|
| `behavior_complement` | behavior_complement | partial source derived model | [behavior_complement](#behavior-complement) |
| `reverse_reconstruction` | reverse_reconstruction | partial source derived model | [reverse_reconstruction](#reverse-reconstruction) |
| `agent_selection` | agent_selection | partial source derived model | [agent_selection](#agent-selection) |
| `match_tie` | match_tie | partial source derived model | [match_tie](#match-tie) |
| `delay_domain` | delay_domain | partial source derived model | [delay_domain](#delay-domain) |
| `cache_origin_alias` | cache_origin_alias | partial source derived model | [cache_origin_alias](#cache-origin-alias) |

## Parts

- [mathlib-robots-rules](https://md.groupants.elamur.ai/free/en/mova/tools/mathlib/src/robots.rs.groupant/rules.groupant/)

## Model text


### descriptant

#### mathlib-robots

Robots parses user-agent groups, selects all matching specific agents else wildcard groups, compiles literal/glob path patterns, and evaluates longest byte-length match with allow tie. Gate caches host rules, rejects GitHub names/addresses, fetches robots on first host and paces approved requests.

##### Epoch 2026-10-31

Prospective model retained before changes. Existing production bytes are preserved; additions are bounded inline tests. Nine source groupants expose ingestion and routing boundaries; typed children bind exact source bytes and reuse their parent syntax projection. Native tests run twice per profile; behavior mutants run as compiled source changes and exact bytes are restored before positive checks.

Important retained observation: network-looking helpers are not all pure (DNS inside github_host and books build); selection deliberately excludes those effects. Mixed-format manifest order is not deterministic, and error paths do not imply rollback.

No network/DNS/download, real catalog/corpus/model/teacher or database execution. Effect paths are source-derived; finite helper tests are not universal verification. No executable percentage surrogate or speed claim; future caps require metric/domain/reference and remain 1/2/5/10%.

### approximant

## Forward relation

Robots parses user-agent groups, selects all matching specific agents else wildcard groups, compiles literal/glob path patterns, and evaluates longest byte-length match with allow tie. Gate caches host rules, rejects GitHub names/addresses, fetches robots on first host and paces approved requests.

Model observations include returns, retained state and ordered partial effects; on external failures the successful-prefix relation replaces a total-function claim.

### Composition

Robots parses user-agent groups, selects all matching specific agents else wildcard groups, compiles literal/glob path patterns, and evaluates longest byte-length match with allow tie. Gate caches host rules, rejects GitHub names/addresses, fetches robots on first host and paces approved requests.

Scoped children isolate the declared contiguous source intervals. Their operations compose only where the source calls them; costs of overlapping parent/child descriptions are not added twice. Remaining effect paths retain explicit gaps.

### catalog

### behavior_complement

Subject: mathlib-robots, source SHA-256 84539710d111a1045385202e26b845b3894fbd8883804cbcbdf39135d6d22897; finite transition observation.

Within valid finite-delay states, denied path cannot pass Gate.check; known GitHub host rejects before robots request. A 4xx robots response becomes allow-all, including 403/429, while 5xx/transport errors cache deny-all. No DNS or HTTP routes are executed here.

Domain: stated source predicates, bounded inputs and available resources; arithmetic assumptions and external effect gaps as in the invariant. Operator is the stated relation/projection; complement is a source-derived inner exclusion, reverse retains compatible antecedents. Other views are source-derived partial constraints, not inverse laws.

Evidence: tests.md identifies executed helpers and unexecuted paths. No universal guarantee follows from the finite fixtures.

### reverse_reconstruction

Subject: mathlib-robots, source SHA-256 84539710d111a1045385202e26b845b3894fbd8883804cbcbdf39135d6d22897; finite transition observation.

An allowed boolean has many compatible rule sets and paths; false constrains the maximal matching raw pattern length to a disallow with no tied allow. Gate result cannot reconstruct fetch history without cache/clock state.

Domain: stated source predicates, bounded inputs and available resources; arithmetic assumptions and external effect gaps as in the invariant. Operator is the stated relation/projection; complement is a source-derived inner exclusion, reverse retains compatible antecedents. Other views are source-derived partial constraints, not inverse laws.

Evidence: tests.md identifies executed helpers and unexecuted paths. No universal guarantee follows from the finite fixtures.

### agent_selection

Subject: mathlib-robots, source SHA-256 84539710d111a1045385202e26b845b3894fbd8883804cbcbdf39135d6d22897; finite transition observation.

Specific group is selected when lowercased agent contains any nonempty nonstar group token; all such groups combine, not longest agent token only. Otherwise all star groups combine. Header grouping ends on any non-user-agent parsed directive.

Domain: stated source predicates, bounded inputs and available resources; arithmetic assumptions and external effect gaps as in the invariant. Operator is the stated relation/projection; complement is a source-derived inner exclusion, reverse retains compatible antecedents. Other views are source-derived partial constraints, not inverse laws.

Evidence: tests.md identifies executed helpers and unexecuted paths. No universal guarantee follows from the finite fixtures.

### match_tie

Subject: mathlib-robots, source SHA-256 84539710d111a1045385202e26b845b3894fbd8883804cbcbdf39135d6d22897; finite transition observation.

Best=(max pattern byte length, allow preferred). Equal length allow defeats deny regardless rule order; no match allows. Terminal $ anchors end, * becomes .*, all remaining regex metacharacters escaped.

Domain: stated source predicates, bounded inputs and available resources; arithmetic assumptions and external effect gaps as in the invariant. Operator is the stated relation/projection; complement is a source-derived inner exclusion, reverse retains compatible antecedents. Other views are source-derived partial constraints, not inverse laws.

Evidence: tests.md identifies executed helpers and unexecuted paths. No universal guarantee follows from the finite fixtures.

### delay_domain

Subject: mathlib-robots, source SHA-256 84539710d111a1045385202e26b845b3894fbd8883804cbcbdf39135d6d22897; finite transition observation.

crawl-delay folds parsed f64 with max, then Gate delay=max(base,Duration::from_secs_f64(d)). Finite nonnegative representable d is required for no panic; parse alone does not enforce it. Tests use finite seconds and no sleeps.

Domain: stated source predicates, bounded inputs and available resources; arithmetic assumptions and external effect gaps as in the invariant. Operator is the stated relation/projection; complement is a source-derived inner exclusion, reverse retains compatible antecedents. Other views are source-derived partial constraints, not inverse laws.

Evidence: tests.md identifies executed helpers and unexecuted paths. No universal guarantee follows from the finite fixtures.

### cache_origin_alias

Gate keys robots/last/github by lowercased host string only. Two schemes with the same host share robots policy and last timestamp; a previously cached HTTP response can govern HTTPS requests in that Gate. This is actual key projection, not full origin isolation, and remains source-derived.

Subject and source identity: manifest.json. Domain: scoped forward/invariant; relation is source-derived and partial. Evidence: tests.md distinguishes actual checks from unexecuted effect paths; finite fixtures do not prove all inputs.

### tests

#### Bounded evidence

Selected actual source checks:

- mathlib::robots::wave33::tie_specificity_and_literal_pattern
- mathlib::robots::wave33::delay_and_url_without_dns

These checks are file-level evidence; fragment branches not reached by these names remain source-derived.

External wave33 mathlib receipt retains native-commands.json, numeric statuses, raw debug/release logs, sorted exact outcomes, mutation logs and original/restored hashes. Seventeen named checks pass twice per profile; six production behavior mutants reject in both profiles, with restored positives. Source syntax is regenerated twice after formatting and compared byte-for-byte. Structural validation tests bindings, not Rust semantics.

No network/DNS/download, real catalog/corpus/model/teacher or database execution. Effect paths are source-derived; finite helper tests are not universal verification. No executable percentage surrogate or speed claim; future caps require metric/domain/reference and remain 1/2/5/10%.

### invariant-and-cost

#### Invariant and cost

##### Invariant

Specific agent selection excludes wildcard groups when any specific match exists. Rule length counts raw pattern bytes including wildcard/end marker. Cache keys are lowercased host strings, not complete origins; clock pacing uses request-start timestamps at Gate and completion timestamps in Polite.

##### Cost

Parsing O(text+compiled regex bytes). allowed scans all rules, regex cost depends on pattern and path lengths. Gate storage O(hosts+rules); DNS, HTTP and sleeps unbounded externally. Nonfinite/negative crawl-delay can panic in Duration conversion.

##### Domain and gaps

No network/DNS/download, real catalog/corpus/model/teacher or database execution. Effect paths are source-derived; finite helper tests are not universal verification. No executable percentage surrogate or speed claim; future caps require metric/domain/reference and remain 1/2/5/10%.