Evidence register · labeled by source
Every number, its source, and its limits.
This page is the claims register. Independent evaluations, LuxiQuant and LuxiBook evidence, Luxi Inference research, and internal development results are kept in separate groups. Nothing here is merged into one system-wide win.
How to read our claims
Each result is labeled by source, workload, hardware, date, and validation status. Version tags such as 99, 100, or 101 are internal milestone tags, not product names.
Independent Evidence
Measured or operated by a third party (TestFort QA Lab) under its own protocol, with dated reports. The strongest evidence class on this page.
Internal Matched Evidence
Internal head-to-head measurement against a named comparator under a stated protocol. Independent validation is noted wherever it exists.
Research Evidence
Internal research-path measurements. Directional evidence about architecture and energy behavior. Not product claims, not production-serving evidence.
Maturity labels
Paid Confidential Evaluation marks the Risk State Engine engagement. LuxiBook is a public demonstration; H100 prefill remains research evidence, not a current commercial offer.
Group 1
Independent evaluations
Two separate TestFort QA Lab reports. The December 2025 report is a seven-function numerical engine. The July 2026 report is packed prefill. Neither is LuxiBook.
Numerical engine (not LuxiBook) · Independent Evidence · TestFort, December 2025
Numerical engine evaluation, TestFort, December 2025
TestFort QA Lab independently evaluated a defined seven-function numerical
suite on NVIDIA H100 hardware. This is not option-book pricing and not
example_book.csv. It is never applied to LuxiBook's receipt
check, and never applied to transformer results.
Reliability
- No failed requests in the specified load test
- Average GPU power of approximately 117.2 W during the reported load test
Determinism
- Five GPU and five CPU runs produced identical hashes for the tested workload
Luxi Inference · Prefill · Independent Evidence
Independent packed-prefill baseline, July 23, 2026
TestFort third-party measurement completed 2026-07-23. Workload: Qwen2-7B-Instruct packed prefill, batch 16, sequence length 128, one NVIDIA H100 80GB, measured in prefill positions. Preserved as dated independent evidence, reported separately from later internal prefill measurements. Full narrative also lives on Research.
| Configuration | Throughput (positions/sec) | Board J/position | Throughput ratio | Energy ratio |
|---|---|---|---|---|
| LuxiEdge prefill build | 28,374.7 | 0.018718 | - | - |
| vLLM (default) | 35,203.1 | 0.019316 | LuxiEdge 80.60% of vLLM | LuxiEdge 3.10% lower |
| vLLM (batch-invariant) | 30,914.3 | 0.020604 | LuxiEdge 91.78% of vLLM | LuxiEdge 9.15% lower |
Report: TestFort validation report, July 2026 (PDF) · Evidence pack
Group 2
Risk State Engine evidence
Risk State Engine is evaluated as a narrow state-maintenance and control layer around matrices produced by existing customer risk infrastructure. Evidence is organized around state equivalence, reconciliation against authoritative rebuilds, measured update and authentication cost, supporting lineage, and integration behavior. Fresh rebuilds remain comparators and reconciliation mechanisms; Luxi does not claim to eliminate them.
State equivalence and reconciliation
Tests compare incremental histories with fresh rebuilds of the same final matrix under the Luxi State Equivalence Contract.
Update-shape costs
Cell, column, scatter, and other declared update patterns are measured separately rather than collapsed into one performance claim.
Adaptive authentication
Evidence records when authentication remains on CPU and when the optional H100-tested CUDA tile-hashing path is used. GPU authentication does not price or compute VaR/ES.
Lineage and integration
Receipt verification and OCaml/C ABI tests support the state-control evidence; they do not define the product by themselves.
apply_cell, and
apply_column; the OCaml demo matches the C fixture. The library
provides handle-based C ABI access, Bigarray ingest, receipts, and
enable_accelerator, which correctly returns unsupported when
CUDA is not built and enabled. A dune file is included for integration into
a dune workspace. This is internal integration evidence, not desk-grade SDK
certification.
Version identity: v0.4.0 remains the docs freeze at
7639488. The additive OCaml library landed on main at
017ea08 without changing kernels or state_id; v0.4.0
was not retagged. Remaining integration work includes snapshot load/save
through C and OCaml, batch apply_cells, evaluation-package CI that
builds ocamlopt, CUDA control from OCaml, and opam packaging.
LuxiBook evidence
LuxiBook is the separate downloadable option-book pricer. Its verified public example-book result was reproduced on five machines (August 16, 2026). This is internal LuxiBook measurement, not Risk State Engine evidence and not a third-party evaluation. The TestFort December 2025 numerical-engine suite above is a different workload and does not cover LuxiBook.
LuxiBook · Internal Evidence · Cross-box receipt check
LuxiBook: one verified public example, five GPUs, four architecture generations
LuxiBook is the downloadable deterministic option-book pricer (European
Black-Scholes / Black-76 with five Greeks and a signed receipt per run).
Every run emits a signed receipt: a SHA-256 fingerprint of the output numbers,
sealed with an Ed25519 signature from the install that produced them.
Running the published example_book.csv through the published
v0.2.1 binaries on August 16, 2026 produced the same output hash on every
machine tested, on the LuxiBook CPU and CUDA pricing paths. All twenty signed
receipts from the original matrix remain published alongside the binaries.
| Field | Value |
|---|---|
| Book | example_book.csv (10 rows, published) |
| Output hash - example book | 4a21b1e708fa5c694bf48237df5e5bd3b94599e6273d07986283c6c6b8e3c97a |
| Book total - example book | 151.70016507843832 |
| ATM_CALL price | 10.4505835721856215 |
| Engine | v0.2.1. The stored receipts record engine_version 0.2.0 because they were measured before the version string was bumped. |
| Receipts published | 20, each Ed25519-signed, across 5 installs |
| Receipts folder | downloads/luxibook/evidence/v0.2.1-phi-fix-matrix |
| Date | August 16, 2026 |
| Machine | Architecture | Compute capability | CPU path | CUDA path |
|---|---|---|---|---|
| NVIDIA H200 | Hopper | 9.0 | match | match |
| NVIDIA H100 | Hopper | 9.0 | match | match |
| NVIDIA A100 | Ampere | 8.0 | match | match |
| NVIDIA RTX 5090 | Blackwell | 12.0 | match | match |
| NVIDIA RTX 4090 | Ada | 8.9 | match | match |
Every row is one physical machine with its own install key. The published folder preserves all 20 signed receipts from the original two-book matrix. Each machine's compute capability is recorded in its receipt. Apple Silicon has a published binary and was covered by an earlier check, but it is not part of this matrix; there is no macOS GPU binary.
example_book.csv, these boxes, and the LuxiBook pricing kernel.
It is not a universal cross-platform promise and is not evidence that Risk
State Engine numerical risk aggregation runs on these GPUs.
Each JSON receipt is Ed25519-signed. The payload field is the signed plaintext; the receipt field carries the signature. Verify in three lines of Python using only the standard cryptography package:
# pip install cryptography
import base64, json
from cryptography.hazmat.primitives.asymmetric.ed25519 import Ed25519PublicKey
from cryptography.exceptions import InvalidSignature
with open("receipt.json") as f:
data = json.load(f)
# Receipt blob layout: 5-byte header + 32-byte pubkey + 64-byte Ed25519 sig
s = data["receipt"][len("lxq2_"):]
pad = (-len(s)) % 4
raw = base64.urlsafe_b64decode(s + "=" * pad)
pubkey = Ed25519PublicKey.from_public_bytes(raw[5:37])
try:
pubkey.verify(raw[37:], data["payload"].encode())
print("PASS: signature valid")
except InvalidSignature:
print("FAIL: signature invalid")
The signer_pubkey field is the Ed25519 public key in hex, and the payload field lists every signed field in plain text, so you can audit what was covered before verifying. Note that the key travels with the receipt, so the check above proves the receipt is internally consistent. To prove it came from a specific machine, pin the key: pass --expect-pubkey <hex> to verify_receipt.py (view on GitHub, published in the LuxiDemo download folder) using a key you already trust from the published evidence.
Group 3
Luxi Inference research evidence
Transformer prefill and decode research. The independent TestFort prefill baseline is in Group 1 and is not repeated as a new fact here. Later internal matched and decode results stay labeled internal. This is not a production serving replacement. Batch-specific prefill is not end-to-end inference. Narrative: Research.
Luxi Inference · Prefill · Internal Matched Evidence
Internal matched comparison, batch 16
Matched internal comparison on the locked Flash, device-resident FP16 path. Qwen2-7B full-stack prefill, sequence length 128, batch 16, one NVIDIA H100 80GB-class GPU, sequential comparison arms, matched prefill positions. Internal, same-GPU, prefill-stage evidence. August 7, 2026. Separate from the July 23 TestFort baseline.
Luxi Inference · Decode/Generation · Internal Matched Evidence
Faithful full-model CUDA correctness
Faithful full-model Qwen2-7B CUDA path on NVIDIA H100, measured against CPU and Hugging Face references. Correctness contract: under the defined acceptance protocol, what repeats is the greedy token sequence. A pass/fail gate, not a performance claim.
Current status
- Full 28-layer Qwen2-7B CUDA path on NVIDIA H100: running
- CPU-versus-CUDA greedy-token match rate: 1.0 under the current acceptance protocol
- Hugging Face-versus-CUDA greedy-token match rate: 1.0 under the current test
- Logit cosine similarity: approximately 1.0. Top-10 overlap 10/10
- Four-request independent CUDA generation smoke test: passed
- All decoder mathematics runs on the GPU
- Current limitations: token embedding row gathering and final greedy argmax remain host-side
- Faithful-path performance, energy optimization, and production-serving validation: ongoing
Luxi Inference · Decode/Generation · Research Evidence
True-autoregressive decode, reference agreement achieved
Decode/generation produces output tokens. The GPU path matches the reference next-token result under the defined numerical audit. The next measurement milestone is post-audit end-to-end quality, throughput, and board energy.
Luxi Inference · Decode/Generation · Research Evidence
Fixed-window verifier research, evaluated positions
An evaluated-position/verifier primitive on the decode research path. Work unit: evaluated positions per second, never generated tokens.
Luxi Inference · Research archive · Research Evidence
Internal TRADE research vs Hugging Face FP16
Separate internal controlled benchmark: TRADE research stack vs Hugging Face Transformers FP16 reference. This is not a production-peer comparison. It uses a different execution path and a different baseline than the matched-vLLM measurements.
| Metric | LuxiEdge TRADE research stack | Hugging Face Transformers FP16 reference | Result |
|---|---|---|---|
| Board energy per processed token | ~0.00453 J/token | ~0.03296 J/token | ~86.3% reduction |
| Processed-stack throughput | ~32,083 stack-tokens/sec | ~9,026 stack-tokens/sec | ~3.56x |
| Median board power | ~145 W | ~298 W | ~51% lower |
NVIDIA H100 NVL. Qwen2-7B-Instruct. Sequence length 128. Sustained-load measurement. Controlled internal H100 research benchmark. Distinct from faithful-chat equivalence, vLLM comparisons, and production-serving evidence.
Research Evidence
Long-context research
Memory scaling for the selectable long-context research path.
| Sequence length | Waller state (MB) | Dense scores (MB) | Reduction |
|---|---|---|---|
| 1,024 | 0.52 | 8.4 | 16x |
| 4,096 | 2.1 | 134 | 64x |
| 8,192 | 4.2 | 537 | 128x |
| 32,768 | 16.8 | 4,295 | 256x |
Memory scales near-linearly vs dense O(N^2). Pack
Group 4
Internal development results
Absolute prefill champion, Llama 3.1 milestone, historical TRADE ladders, and version-lineage packs. Internal unless a third-party report is named.
Luxi Inference · Prefill · Internal Absolute Evidence
Internal absolute prefill champion, dual_gemm at B72
The fastest measured configuration of the prefill path to date, reported as an absolute internal result with no vLLM comparison arm attached. One NVIDIA H100 80GB HBM3; Qwen2-7B-Instruct-class weights; sequence length 128; batch 72; dual-GEMM; Flash attention; device-resident FP16 path; median of five 15-second runs. August 7, 2026.
Luxi Inference · Decode/Generation · Internal Matched Evidence
Faithful Llama 3.1 inference, internal milestone
Internal Llama 3.1 resident-inference milestone. Active-batch output matched the serial BF16 path on tested correctness gates. Independent validation of performance and energy is the next step.
| Metric | Internal result | Scope |
|---|---|---|
| Correctness | Active batch = serial | Exact on primary p32 and p128 gates |
| Cold process/model load | about 190 to 210 seconds | Current development startup path |
Research Evidence · historical
Historical research configurations
Earlier public benchmarks (LuxiDemo, 2026-07-11)
Earlier public evidence from a separate TRADE sustain protocol. Open any pack to inspect methods and raw traces.
7B-class TRADE, energy and throughput
Hardware: 1x NVIDIA H100 NVL. 28-layer stack. public pack.
| Sequence length | Tokens / sec | Joules / token | Median power (W) | Notes |
|---|---|---|---|---|
| 5 | ~44 | 3.560 +/- 0.005 | ~156 | Short-burst reference |
| 32 | ~221 | - | - | Throughput sweep |
| 64 | ~359 | - | - | Throughput sweep |
| 128 | ~403 | 0.630 +/- 0.002 | ~254 | Ladder primary (this protocol) |
| 256 | ~464 | ~0.604 | ~280 | Longer context |
| 512 | ~493 | - | - | Throughput sweep |
Multi-run at sequence length 128, from the earlier public sustain ladder.
A different protocol than the Qwen2-7B benchmark above; the two are not
directly comparable. Source: evidence/h100-7b-class-TRADE/
Head-to-head with a Flash baseline
12 layers. Sequence 1024. h=768. About 10 s each side.
| Metric | TRADE 12L | PyTorch + Flash 12L | Ratio |
|---|---|---|---|
| Median power (W) | 177.2 | 176.4 | ~1.0x |
| ms / stack forward | 74.32 | 3.90 | TRADE 19.1x slower |
| Prefill tok/s | 13778 | 262859 | PT 19.1x higher |
| Joules / token | 0.0129 | 0.0007 | TRADE 19.2x higher |
h100-stack12-H2H . We publish where a standard baseline wins on this shape.
Evidence packs
Open on GitHub. Read methods. Check traces.
Absolute championprefill_accel_lock_20260807T233111Z
Internal absolute prefill champion: dual-GEMM at batch 72, ~44,860 positions/s at ~0.01532 board J/position, median of five 15-second runs. Absolute internal result; no matched vLLM arm.
Matched comparisonprefill_freeze_matched_20260807T210749Z
Internal matched comparison at batch 16: ~1.18x the tested vLLM throughput at ~12% lower board J/position, with batch-32 supporting data. Qwen2-7B-Instruct FP16, seq 128, sequential comparison arms.
Independent baselineh100-qwen2-7b-v99-matched-prefill-2026-07-23
Independent TestFort prefill baseline (July 23, 2026): 28,374.7 positions/s at 0.018718 board J/position. 80.60% of default vLLM throughput at 3.10% lower board energy per position.
Milestone lineageversion-100-h100-gtm
Earlier internal matched prefill evidence from the internal milestone lineage (version tags are internal milestones, not products). Superseded as the current headline by the August 7, 2026 packs above.
Earlier protocolh100-7b-class-TRADE
Full 28-layer 7B-class TRADE stack from the earlier public sustain ladder. Multi-run throughput + energy (~0.63 J/tok @ seq=128, ~403 tok/s under that historical protocol).
Energyh100-stack12-TRADE-cuda
Device-resident 12-layer stack energy (GPT-2 width).
Honestyh100-stack12-H2H
TRADE vs PyTorch Flash. Complete head-to-head, both sides published.
AUDITh100-WNSM-free-ride
Null-space free-ride under GPU load.
Memoryh100-LONGCTX-scaling
O(N) vs O(N^2) memory ladder + CUDA 32k.
Microh100-BASELINE-vs-geo
Single-layer baseline wedges. Not a 7B throughput claim.
Serveh100-serve-sustain-2026-07-11
Continuous-batch serve sustain with power traces.
Download
Downloads live on the demo page: LuxiBook, the option-book pricer with a signed receipt on every run, and LuxiRisk, a free secondary position-sizing CLI.
The older numerical REST demo builds remain available in LuxiDemo releases.
Two different kinds of hashes appear around these builds: release-file checksums verify that the file you downloaded was not corrupted; evaluation-output receipts attest what a specific computation produced. They are not interchangeable.