Results: Qwen3.5 acceptance v1/v2 (execution failures) - #3
Draft
atimics wants to merge 11 commits into
Draft
Conversation
atimics
force-pushed
the
codex/qwen-experiment-rfc
branch
8 times, most recently
from
August 12, 2026 22:10
2b38d23 to
54967f0
Compare
atimics
force-pushed
the
codex/qwen-experiment-rfc
branch
from
August 13, 2026 00:04
4bec1b7 to
b456c98
Compare
…PIPELINE_MAP, FACULTY_MAP, DOC_MAP) [skip ci]
atimics
force-pushed
the
codex/qwen-experiment-rfc
branch
from
August 13, 2026 00:13
e20f6ea to
3ed8d53
Compare
… codex/qwen-experiment-rfc
…PIPELINE_MAP, FACULTY_MAP, DOC_MAP) [skip ci]
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Stacked experiment result
This PR is stacked on the implementation branch behind upstream leCore PR #31. PR AnOversizedMooseWithSocks#31 holds the proposed
0.2.11implementation; this PR holds the preregistration, terminal executions, ilxyr ledgers, evidence exports, permanent publication receipts, and committee discussion.Terminal status
COMPLETE — v2 ilxyr outcome:
execution_failure— no scientific acceptance/rejection resultThe authorized v2 run is over. It will not be retried under the same identity, and no v3 run is authorized.
V2 corrected the v1 interpreter-path bug and completed the substantive CPU work:
12/12ilxyr admission gates passed;4,097input tokens;4,097input tokens; andTransformers reported that the two prepended layers contain packed linear-attention tensors where the official model expects split projections, and that their MLP tensors use width 128 where the Qwen configuration declares 3,584:
This is the exact interoperability failure the mandatory reload gate was intended to expose. The leCore runtime accepts its own heterogeneous representation; the official Transformers architecture does not.
Because the exception happened before the runner's atomic metric envelope was emitted, ilxyr correctly recorded
execution_failurewith an empty metric set. Partial internal observations are not promoted into preregistered metrics. Official text generation and the vision-input smoke did not run.V2 result and permanent evidence
v2-20c3330d0b3e-execution-failuref35OgXuOoulk9EcndJBNWIgZ5tmaQ6DRzeINP7ARZTU21874555c7f9e73d20b9d11599c79236f8f40267ee975f703ffc053eb6b1f9abpublication-receipt.jsonartifact://sha256/15885a3e5fbb01a504473e3076c25c9d5d938c13f96faa340ed9600a245845ccartifact://sha256/dee0b19888937eb4b4109ef6558ce3e5c6a530469019b94f4905c01d144a6d8f15objects,16events,valid: true47transactions confirmed at0winc;publication-manifest.jsonandledger/events.jsonlwere downloaded through the public path manifest and matched their committed SHA-256 valuess3://zero-training-022118847419/qwen35-acceptance/2f32151-2fc06364-a6c9d113/v2-formal/qwen35-evidence.tgz, SHA-256df2ba31608f9039e9528a43a93d4766c8e8feb023668a1b9ffc1c85553210c1cThe
r7i.4xlargeformal execution ran from 00:26:36.737Z to 04:51:28.293Z (4h 24m 51.556s). Estimated on-demand compute is$4.71, plus a few cents of storage. The instance self-terminated, its encrypted root volume was deleted, and the temporary zero-ingress security group was removed. The total remained well below the$10ceiling.Execution history
i-0b49b8662723706f0i-0c549643b970e896aexecution_failurebefore model evaluationi-059aab8bf1d3d87c9Frozen v2 identity
lecore.qwen35.install.20c3330d0b3e.d6905f043e78.a6c9d1135a04.2f32151c6d44.v2.acceptance2f32151c6d44c80a7e2ff98c0696650cd1d9c6f1e92382ff2a5e8714466533a160f6609b4ef9cee8Qwen/Qwen3.5-0.8B@2fc06364715b967f1860aea9cf38778875588b17d6905f043e7856b93b2dd72dac5fa0dc593898c55d6c54c51f3153f4317d6b7fa6c9d1135a04d10955fe11d210b7f642e1c2341d4f2c8369b9a832cc97839d94Gate record
12/12)4,097input tokens)4,097input tokens)Validation
22 passed.15objects and16events.21874555…f9ab.Committee decision requested
Accept this PR as the terminal evidence record. Keep the Qwen loader, tokenizer, configuration parsing, text runtime, and diagnostics in the
0.2.11review. Keep spectral filtering research-only and keep the layer-prepending installer experimental; the official-reload failure is direct evidence that it is not ready for promotion.Any future run should require a new implementation that passes an official Transformers reload fixture before seeking explicit authorization for a new experiment identity.
PR AnOversizedMooseWithSocks#30 remains the separate long-term liblecore track.