google-t5/t5-small

huggingface-mic/t5-small-mic@4f5dcdc60406 ← google-t5/t5-small@df1b051c4962 · T5ForConditionalGeneration · random weights · built before the shrink rule (no recorded recipe)

Original60.5Mparameters

Fixture2.2Mparameters

Layer stacks2compared

Findings0to review

✓ Same architecture, smaller

Every module class, layer kind and checked property of the original is in the fixture.

One square per layer, colored by kind: the layer's module classes and type attributes. Hover a square for its index and kind.

Original · 6

Fixture · 2

Kind	Original	Fixture
Embedding	1	1	✓ kept
no Embedding	5	1	✓ kept

Original · 6

Fixture · 2

Kind	Original	Fixture
Embedding	1	1	✓ kept
no Embedding	5	1	✓ kept

Share of each model's parameters per component. Vocabulary and patch sizes are kept, so embeddings usually take a larger share of the fixture.

Original

Fixture

Component	Original	Share	Fixture	Share
decoder.block	25.2M	41.6%	98.8K	4.4%
encoder.block	18.9M	31.2%	65.9K	3.0%
shared	16.4M	27.2%	2.1M	92.6%
decoder.final_layer_norm	512	0.0%	64	0.0%
encoder.final_layer_norm	512	0.0%	64	0.0%

Config	Property	Original	Fixture
model	model_type	t5	t5	✓ kept
model	vocab_size	32128	32128	✓ kept
model	tie_word_embeddings	True	True	✓ kept

Instances of each class in the built model (prefix T5 omitted).

6 fields changed, 29 unchanged.