← MIC coverage of Transformers model types

hustvl/yolos-small

huggingface-mic/yolos-small-mic@908c43a6393a ← hustvl/yolos-small@3d8f7130d3ce · YolosForObjectDetection · overfit weights

CI: no failure on main in 30 days · MIC failures dashboard

Original30.7Mparameters
Fixture379.7Kparameters
Layer stacks1compared
Findings0to review

✓ Same architecture, smaller

Every module class, layer kind and checked property of the original is in the fixture.

Layer stacks

One square per layer, colored by kind: the layer's module classes and type attributes. Hover a square for its index and kind.

vit.encoder.layer

Original · 12
Fixture · 2
KindOriginalFixture
Layer122✓ kept

Where the parameters are

Share of each model's parameters per component. Vocabulary and patch sizes are kept, so embeddings usually take a larger share of the fixture.

Original
Fixture
ComponentOriginalShareFixtureShare
vit.encoder.layer21.3M69.4%66.9K17.6%
vit.encoder7.7M25.2%117.1K30.8%
vit.embeddings1.0M3.4%172.7K45.5%
class_labels_classifier.layers331.1K1.1%14.3K3.8%
bbox_predictor.layers297.2K1.0%8.6K2.3%
vit.layernorm7680.0%1280.0%

Preserved properties

ConfigPropertyOriginalFixture
modelmodel_typeyolosyolos✓ kept
modelhidden_actgelugelu✓ kept
modelimage_size[512, 864][512, 864]✓ kept
modelpatch_size1616✓ kept
modelnum_channels33✓ kept

Module classes

Instances of each class in the built model (prefix Yolos omitted).

ClassOriginalFixture
Linear7818
Dropout255
LayerNorm255
GELUActivation122
Attention122
Intermediate122
Layer122
Output122
SelfAttention122
SelfOutput122
ModuleList33
MLPPredictionHead22
Conv2d11
InterpolateInitialPositionEmbeddings11
InterpolateMidPositionEmbeddings11
Embeddings11
Encoder11
ForObjectDetection11
Model11
PatchEmbeddings11

Config changes

4 fields changed, 27 unchanged.

FieldOriginalFixture
hidden_size38464
intermediate_size1536128
num_attention_heads64
num_hidden_layers122