facebook/opt-125m

huggingface-mic/opt-125m-mic@30dda77b685d ← facebook/opt-125m@27dcfa74d334 · OPTForCausalLM · random weights · built before the shrink rule (no recorded recipe)

Original125.2Mparameters

Fixture38.9Mparameters

Layer stacks1compared

Findings0to review

✓ Same architecture, smaller

Every module class, layer kind and checked property of the original is in the fixture.

One square per layer, colored by kind: the layer's module classes and type attributes. Hover a square for its index and kind.

Original · 12

Fixture · 2

Kind	Original	Fixture
DecoderLayer	12	2	✓ kept

Share of each model's parameters per component. Vocabulary and patch sizes are kept, so embeddings usually take a larger share of the fixture.

Original

Fixture

Component	Original	Share	Fixture	Share
model.decoder.layers	85.1M	67.9%	66.9K	0.2%
model.decoder	40.2M	32.1%	38.8M	99.8%

Config	Property	Original	Fixture
model	model_type	opt	opt	✓ kept
model	vocab_size	50272	50272	✓ kept
model	tie_word_embeddings	True	True	✓ kept
model	max_position_embeddings	2048	2048	✓ kept

Instances of each class in the built model (prefix OPT omitted).

Class	Original	Fixture
Linear	73	15
LayerNorm	25	5
Attention	12	2
DecoderLayer	12	2
ReLU	12	2
Embedding	1	1
ModuleList	1	1
Decoder	1	1
ForCausalLM	1	1
LearnedPositionalEmbedding	1	1
Model	1	1

4 fields changed, 28 unchanged.