← MIC coverage of Transformers model types

Helsinki-NLP/opus-mt-fr-en

huggingface-mic/opus-mt-fr-en-mic@d09105cda74d ← Helsinki-NLP/opus-mt-fr-en@c4aed37b318c · MarianMTModel · overfit weights · built before the shrink rule (no recorded recipe)

CI: no failure on main in 30 days · MIC failures dashboard

Original75.1Mparameters
Fixture4.0Mparameters
Layer stacks2compared
Findings0to review

✓ Same architecture, smaller

Every module class, layer kind and checked property of the original is in the fixture.

Layer stacks

One square per layer, colored by kind: the layer's module classes and type attributes. Hover a square for its index and kind.

model.encoder.layers

Original · 6
Fixture · 2
KindOriginalFixture
MarianEncoderLayer62✓ kept

model.decoder.layers

Original · 6
Fixture · 2
KindOriginalFixture
MarianDecoderLayer62✓ kept

Where the parameters are

Share of each model's parameters per component. Vocabulary and patch sizes are kept, so embeddings usually take a larger share of the fixture.

Original
Fixture
ComponentOriginalShareFixtureShare
model.shared30.5M40.6%3.8M94.2%
model.decoder.layers25.2M33.6%100.5K2.5%
model.encoder.layers18.9M25.2%66.9K1.7%
model.encoder262.1K0.3%32.8K0.8%
model.decoder262.1K0.3%32.8K0.8%

Preserved properties

ConfigPropertyOriginalFixture
modelmodel_typemarianmarian✓ kept
modelvocab_size5951459514✓ kept
modeltie_word_embeddingsTrueTrue✓ kept
modelmax_position_embeddings512512✓ kept

Module classes

Instances of each class in the built model (prefix MarianMT omitted).

ClassOriginalFixture
Linear9733
LayerNorm3010
MarianAttention186
SiLU124
MarianDecoderLayer62
MarianEncoderLayer62
Embedding33
MarianSinusoidalPositionalEmbedding22
ModuleList22
MarianDecoder11
MarianEncoder11
Model11
MarianModel11

Config changes

7 fields changed, 38 unchanged.

FieldOriginalFixture
d_model51264
decoder_attention_heads84
decoder_ffn_dim2048128
decoder_layers62
encoder_attention_heads84
encoder_ffn_dim2048128
encoder_layers62