model stringlengths 13 34 | layers int64 22 64 | stations int64 23 65 | focus float64 0.72 0.8 | direction_selectivity float64 0.01 0.05 | persistence float64 0.91 1.11 | hardware stringclasses 2
values | scan_date stringdate 2026-09-03 00:00:00 2026-09-03 00:00:00 | job stringlengths 32 32 |
|---|---|---|---|---|---|---|---|---|
microsoft/Phi-4-mini-instruct | 32 | 33 | 0.716 | 0.0273 | 0.9866 | workstation | 2026-09-03 | 7371d98b55a24b92ae8919e79b281e11 |
Qwen/Qwen2.5-0.5B | 24 | 25 | 0.7162 | 0.0481 | 1.0768 | workstation | 2026-09-03 | b833d080203643ac88eeb5fa3cae5ee4 |
allenai/OLMo-2-1124-7B | 32 | 33 | 0.723 | 0.0148 | 0.9078 | cloud pod | 2026-09-03 | 6aa6f15d6380480d8a34290c95eec547 |
meta-llama/Llama-3.1-8B-Instruct | 32 | 33 | 0.7322 | 0.0183 | 0.9622 | cloud pod | 2026-09-03 | ae3cd3b819e445c9b98ca4dc47cc7781 |
Qwen/Qwen2.5-1.5B | 28 | 29 | 0.7401 | 0.0538 | 1.054 | workstation | 2026-09-03 | fcab48f7b5934379b76cffa292290292 |
tiiuae/Falcon3-7B-Instruct | 28 | 29 | 0.7444 | 0.0405 | 0.9809 | cloud pod | 2026-09-03 | 1fccf85b70c24a45b3e492d103348715 |
Qwen/Qwen2.5-7B | 28 | 29 | 0.7473 | 0.0476 | 0.9571 | cloud pod | 2026-09-03 | d8d2358442cd4f79902a80dc93348a14 |
mistralai/Mistral-7B-v0.3 | 32 | 33 | 0.7539 | 0.015 | 0.937 | cloud pod | 2026-09-03 | b367a3c7fdf3427e8502fa815670ef66 |
TinyLlama/TinyLlama-1.1B-Chat-v1.0 | 22 | 23 | 0.7576 | 0.0275 | 0.9414 | workstation | 2026-09-03 | cad03373c0514802a0ba40c0fb4707a0 |
HuggingFaceTB/SmolLM2-1.7B | 24 | 25 | 0.7624 | 0.0517 | 0.9158 | workstation | 2026-09-03 | 65e33f4b97cb4665b2a5f6909f98f0e7 |
Qwen/Qwen3-8B | 36 | 37 | 0.7653 | 0.0399 | 1.0954 | cloud pod | 2026-09-03 | 9ddd0c584534434589283d75775ac0e0 |
Qwen/Qwen2.5-14B-Instruct | 48 | 49 | 0.7674 | 0.0357 | 1.0919 | cloud pod | 2026-09-03 | 2bd8350463e64bc9b6b5f8349a32e7df |
Qwen/Qwen2.5-3B | 36 | 37 | 0.7708 | 0.0403 | 0.9602 | workstation | 2026-09-03 | dc30a542ed204eb8b81116a01396cb6a |
Qwen/Qwen2.5-32B-Instruct | 64 | 65 | 0.8041 | 0.0381 | 1.1065 | cloud pod | 2026-09-03 | 9ed420ce23584fa2853ef4823b5bf875 |
Model X-Ray today (status of 11 November 2026)
Status on 11 November 2026: the correction is applied and the beta is open. The open beta reads public models from Hugging Face by name, up to the 7B class, and scans them on our own GPUs, free within a monthly allowance of 20 browser scans and five distinct source models per account. The eligible repositories are listed on the scope page. A 7B-class model runs as a quantization simulation of that one model. Larger models are scanned on request, outside the free beta. Results are research-stage and payments are disabled. This card's presence is not an eligibility grant.
Earlier status entry, 22 September 2026: the 7B class opened on 21 September 2026, and scans moved to Tetracta-operated local GPU workers; no cloud GPU is used in this beta. SmolLM3 (HuggingFaceTB/SmolLM3-3B-Base and HuggingFaceTB/SmolLM3-3B) was added on 22 September 2026; the instrument release of that date did not support this tokenizer contract, so write to us before submitting one.
A report describes its recorded artifacts and measurement conditions; it is not a model-quality ranking, safety certificate or deployment verdict. A quantization simulation does not create a deployable quantized model. Knowledge scans remain unavailable and earlier withdrawn claims remain withdrawn. Hallucination, undertraining and overtraining remain research questions, not measured product features.
Service status Β· Current scope and report guide Β· Correction record Β· Report examples
Legacy Model X-Ray materials β withdrawn
Correction dated 6 September 2026.
The Model X-Ray results previously distributed from this repository have been withdrawn. These files are historical artifacts, not current evidence, and must not be used to support location, knowledge, portrait, lesion-response, simulated-quantization, quality, safety or deployment claims.
The withdrawn historical interpretations remain withdrawn.
Correction record: https://www.tetracta.ai/model-xray/correction/
β Tetracta
Model X-Ray gallery: measurements, not weights
Signal-propagation measurements of public language models produced by the Tetracta Model X-Ray instrument
(an earlier probe set, scan configuration and metric version, not the current report contract; contributor-normalized difference profiles). Every record links to a signed
deletion/provenance attestation (attestation field) whose report_sha256 pins the exact report the numbers come from. Probe texts are withheld
(they are the instrument); everything else needed to recompute the summary statistics is here.
Families: HuggingFaceTB, Qwen, TinyLlama, allenai, meta-llama, microsoft, mistralai, tiiuae Β· Portraits: 14 Β· Before/after and simulated-quant pairs: 22 Β· Knowledge probes: 17
What the numbers mean (short)
- focus β participation ratio of the difference profile at an early strike position, normalized by the depth remaining after the strike, averaged over all strikes; lower = a nudge stays contained, higher = it spreads. Test-retest Β±0.7% (10 seeds, 1.5B-Instruct).
- direction_selectivity β how differently the network reacts to opposite nudge directions (Β±17% test-retest; read as a coarse band).
- persistence β matched-subset per-strike ratio of the response 10 layers after the strike vs 1 layer after (Β±1.2%).
- difference_profile (pairs) β per-station mean difference between model A and model B under identical probes, each station averaged only over the probes that can reach it (
contributing_probes).n80_stations= how many stations hold 80% of the difference mass;change_start_stationβ€ 4 is the detection floor (the first probe is injected at layer 2), not a property of the fine-tune. - Knowledge records: per-item correctness and output-level p(answer) on 20 known facts and 20 fabricated entities; the three-class judge (refusal / echo / fabricated answer) is what "avoidance" actually measures.
Gallery (portraits)
| model | layers | focus | direction-selectivity | persistence | hardware |
|---|---|---|---|---|---|
| microsoft/Phi-4-mini-instruct | 32 | 0.716 | 0.0273 | 0.9866 | workstation |
| Qwen/Qwen2.5-0.5B | 24 | 0.7162 | 0.0481 | 1.0768 | workstation |
| allenai/OLMo-2-1124-7B | 32 | 0.723 | 0.0148 | 0.9078 | cloud pod |
| meta-llama/Llama-3.1-8B-Instruct | 32 | 0.7322 | 0.0183 | 0.9622 | cloud pod |
| Qwen/Qwen2.5-1.5B | 28 | 0.7401 | 0.0538 | 1.054 | workstation |
| tiiuae/Falcon3-7B-Instruct | 28 | 0.7444 | 0.0405 | 0.9809 | cloud pod |
| Qwen/Qwen2.5-7B | 28 | 0.7473 | 0.0476 | 0.9571 | cloud pod |
| mistralai/Mistral-7B-v0.3 | 32 | 0.7539 | 0.015 | 0.937 | cloud pod |
| TinyLlama/TinyLlama-1.1B-Chat-v1.0 | 22 | 0.7576 | 0.0275 | 0.9414 | workstation |
| HuggingFaceTB/SmolLM2-1.7B | 24 | 0.7624 | 0.0517 | 0.9158 | workstation |
| Qwen/Qwen3-8B | 36 | 0.7653 | 0.0399 | 1.0954 | cloud pod |
| Qwen/Qwen2.5-14B-Instruct | 48 | 0.7674 | 0.0357 | 1.0919 | cloud pod |
| Qwen/Qwen2.5-3B | 36 | 0.7708 | 0.0403 | 0.9602 | workstation |
| Qwen/Qwen2.5-32B-Instruct | 64 | 0.8041 | 0.0381 | 1.1065 | cloud pod |
Pairs
| model A | model B | kind | N80 stations (fraction) | change start | behavior-change fraction |
|---|---|---|---|---|---|
| Qwen/Qwen2.5-0.5B | Qwen/Qwen2.5-0.5B-Instruct | before-after | 15/25 (0.60) | 4 (floor) | 1.00 |
| Qwen/Qwen2.5-0.5B-Instruct | Qwen/Qwen2.5-0.5B-Instruct (simulated int8) | simulated-quant | 16/25 (0.64) | 4 (floor) | 0.83 |
| Qwen/Qwen2.5-3B | Qwen/Qwen2.5-3B-Instruct | before-after | 19/37 (0.51) | 4 (floor) | 1.00 |
| Qwen/Qwen2.5-1.5B | Qwen/Qwen2.5-1.5B-Instruct | before-after | 13/29 (0.45) | 4 (floor) | 1.00 |
| Qwen/Qwen2.5-1.5B-Instruct | Qwen/Qwen2.5-1.5B-Instruct (simulated int8) | simulated-quant | 18/29 (0.62) | 4 (floor) | 0.50 |
| Qwen/Qwen2.5-14B | Qwen/Qwen2.5-14B-Instruct | before-after | 21/49 (0.43) | 4 (floor) | 1.00 |
| Qwen/Qwen2.5-14B-Instruct | Qwen/Qwen2.5-14B-Instruct (simulated int8) | simulated-quant | 30/49 (0.61) | 4 (floor) | 0.50 |
| Qwen/Qwen2.5-7B | Qwen/Qwen2.5-7B-Instruct | before-after | 14/29 (0.48) | 4 (floor) | 1.00 |
| Qwen/Qwen2.5-7B-Instruct | Qwen/Qwen2.5-7B-Instruct (simulated int8) | simulated-quant | 17/29 (0.59) | 4 (floor) | 0.33 |
| meta-llama/Llama-3.2-1B | meta-llama/Llama-3.2-1B-Instruct | before-after | 10/17 (0.59) | 4 (floor) | 1.00 |
| meta-llama/Llama-3.2-3B | meta-llama/Llama-3.2-3B-Instruct | before-after | 18/29 (0.62) | 4 (floor) | 1.00 |
| HuggingFaceTB/SmolLM2-1.7B | HuggingFaceTB/SmolLM2-1.7B-Instruct | before-after | 13/25 (0.52) | 4 (floor) | 1.00 |
| mistralai/Mistral-7B-v0.3 | mistralai/Mistral-7B-Instruct-v0.3 | before-after | 22/33 (0.67) | 4 (floor) | 1.00 |
| allenai/OLMo-2-1124-7B | allenai/OLMo-2-1124-7B-Instruct | before-after | 19/33 (0.58) | 4 (floor) | 1.00 |
| tiiuae/Falcon3-7B-Base | tiiuae/Falcon3-7B-Instruct | before-after | 17/29 (0.59) | 4 (floor) | 0.67 |
| Qwen/Qwen3-8B-Base | Qwen/Qwen3-8B | before-after | 23/37 (0.62) | 4 (floor) | 1.00 |
| meta-llama/Llama-3.1-8B | meta-llama/Llama-3.1-8B-Instruct | before-after | 21/33 (0.64) | 4 (floor) | 1.00 |
| HuggingFaceTB/SmolLM2-1.7B-Instruct | HuggingFaceTB/SmolLM2-1.7B-Instruct (simulated int8) | simulated-quant | 15/25 (0.60) | 4 (floor) | 0.67 |
| meta-llama/Llama-3.1-8B-Instruct | meta-llama/Llama-3.1-8B-Instruct (simulated int8) | simulated-quant | 22/33 (0.67) | 4 (floor) | 0.33 |
| mistralai/Mistral-7B-Instruct-v0.3 | mistralai/Mistral-7B-Instruct-v0.3 (simulated int8) | simulated-quant | 22/33 (0.67) | 4 (floor) | 0.67 |
| Qwen/Qwen2.5-32B-Instruct | Qwen/Qwen2.5-32B-Instruct (simulated int8) | simulated-quant | 35/65 (0.54) | 4 (floor) | 0.33 |
| Qwen/Qwen2.5-32B | Qwen/Qwen2.5-32B-Instruct | before-after | 26/65 (0.40) | 4 (floor) | 1.00 |
Knowledge probes
| pair / model | known facts correct | fake-name echo avoided (three-class) | trajectory AUROC | McNemar improved/regressed |
|---|---|---|---|---|
| HuggingFaceTB/SmolLM2-1.7B β HuggingFaceTB/SmolLM2-1.7B-Instruct | 15/20 β 15/20 | 11 β 15 (refusals 0β0, echo 9β5, fabricated 11β15) | 0.6000 β 0.9225 | 5/1, p=0.219 |
| Qwen/Qwen2-0.5B-Instruct β Qwen/Qwen2.5-0.5B-Instruct | 14/20 β 15/20 | 19 β 19 (refusals 0β2, echo 1β1, fabricated 19β17) | 0.9125 β 0.9850 | 1/1, p=1.000 |
| Qwen/Qwen2.5-0.5B β Qwen/Qwen2.5-0.5B-Instruct | 18/20 β 15/20 | 15 β 19 (refusals 0β2, echo 6β1, fabricated 14β17) | 0.9025 β 0.9850 | 4/0, p=0.125 |
| Qwen/Qwen2.5-1.5B β Qwen/Qwen2.5-1.5B-Instruct | 20/20 β 19/20 | 14 β 19 (refusals 0β0, echo 6β1, fabricated 14β19) | 0.9850 β 0.9925 | 6/1, p=0.125 |
| Qwen/Qwen2.5-14B β Qwen/Qwen2.5-14B-Instruct | 19/20 β 20/20 | 14 β 19 (refusals 2β9, echo 5β1, fabricated 13β10) | 0.9300 β 0.9450 | 5/0, p=0.062 |
| Qwen/Qwen2.5-14B-Instruct (single) | 20/20 | 19 (refusals 11, echo 1, fabricated 8) | 0.9450 | β |
| Qwen/Qwen2.5-32B β Qwen/Qwen2.5-32B-Instruct | 19/20 β 20/20 | 13 β 18 (refusals 2β6, echo 5β3, fabricated 13β11) | 0.9650 β 0.9600 | 6/1, p=0.125 |
| Qwen/Qwen2.5-3B β Qwen/Qwen2.5-3B-Instruct | 19/20 β 20/20 | 14 β 18 (refusals 0β3, echo 7β2, fabricated 13β15) | 0.9300 β 0.9500 | 5/1, p=0.219 |
| Qwen/Qwen2.5-7B β Qwen/Qwen2.5-7B-Instruct | 20/20 β 19/20 | 15 β 20 (refusals 2β3, echo 4β0, fabricated 14β17) | 0.9425 β 0.9775 | 5/0, p=0.062 |
| Qwen/Qwen2.5-7B-Instruct (single) | 19/20 | 20 (refusals 3, echo 0, fabricated 17) | 0.9775 | β |
| Qwen/Qwen3-8B-Base β Qwen/Qwen3-8B | 20/20 β 13/20 | 12 β 16 (refusals 0β0, echo 8β5, fabricated 12β15) | 0.9150 β 0.9750 | 5/1, p=0.219 |
| allenai/OLMo-2-1124-7B β allenai/OLMo-2-1124-7B-Instruct | 20/20 β 19/20 | 13 β 19 (refusals 0β0, echo 7β1, fabricated 13β19) | 0.8925 β 0.9900 | 6/0, p=0.031 |
| meta-llama/Llama-3.1-8B β meta-llama/Llama-3.1-8B-Instruct | 0/20 β 16/20 | 16 β 19 (refusals 0β8, echo 4β1, fabricated 16β11) | 0.0400 β 0.9825 | 3/0, p=0.250 |
| meta-llama/Llama-3.2-1B β meta-llama/Llama-3.2-1B-Instruct | 11/20 β 18/20 | 12 β 17 (refusals 0β5, echo 8β3, fabricated 12β12) | 0.4850 β 0.9225 | 7/2, p=0.180 |
| meta-llama/Llama-3.2-3B β meta-llama/Llama-3.2-3B-Instruct | 15/20 β 19/20 | 13 β 20 (refusals 2β3, echo 7β0, fabricated 11β17) | 0.7400 β 1.0000 | 7/0, p=0.016 |
| mistralai/Mistral-7B-v0.3 β mistralai/Mistral-7B-Instruct-v0.3 | 19/20 β 19/20 | 9 β 16 (refusals 1β1, echo 12β3, fabricated 7β16) | 0.9100 β 0.9625 | 9/2, p=0.065 |
| tiiuae/Falcon3-7B-Base β tiiuae/Falcon3-7B-Instruct | 19/20 β 20/20 | 11 β 16 (refusals 0β0, echo 9β4, fabricated 11β16) | 0.9100 β 0.9725 | 8/3, p=0.227 |
Provenance
- Each JSON carries
job,scan_date,hardware(own workstation GPUs for small models; single-tenant cloud pod for large ones, pod identity in the attestation) and the attestation URL. - Reference bands and the interpretation layer are described in the sample reports: https://huggingface.co/spaces/tetracta/model-xray-sample-reports
- Earlier measurements under older probe-set and metric versions are not comparable with these and are kept only as superseded comparisons in the Space.
- Corrections history and reviewer exchange: see the Space README ("Correction" and "Measurement update").
Produced by our own export script from the product's scan archive. Licence CC-BY-4.0 for the measurements.
History: earlier status notes
VG1 status Β· 12 September 2026 (Europe/Istanbul) (superseded by the status above)
VG1 has been deployed. Customer scan-to-report acceptance is still pending.
The free first-beta scope is eligible public models up to and including 7B, within the account allowance, for checkpoint comparisons and in-memory quantization simulations. Customer jobs run on RunPod. The service selector defines the supported revisions and scan types. Later Pro access above 7B requires an explicit grant and remains limited to the models and allowance enabled for that account.
This dataset remains a withdrawn historical gallery. The retained files and tables below are not current-release evidence. Deploying VG1 does not reinstate their interpretations or turn them into new customer reports.
A report describes its recorded artifacts and measurement conditions; it is not a model-quality ranking, safety certificate or deployment verdict. A quantization simulation does not create a deployable quantized model. Knowledge scans remain unavailable and earlier withdrawn claims remain withdrawn. Hallucination, undertraining and overtraining remain research questions, not measured product features.
Service status Β· Current scope and report guide Β· 12 September correction
Separate new Twin study Β· 12 September 2026. Read the current VG1 reports. Seven fresh scans of five checkpoints support two independent repeat controls, four within-family seed comparisons and two cross-family comparisons; two algebraic self-comparisons are additional consistency checks. The fresh repeats were unchanged, while the within-family and cross-family comparisons changed in measured response and generated token sequences. These ten comparisons share seven scans: they do not establish an architecture effect or model-quality ranking. The historical gallery and its withdrawal below remain unchanged. Pinned report archive.
- Downloads last month
- 134