MoritzLaurer/mDeBERTa-v3-base-xnli-multilingual-nli-2mil7

Original278.8Mparameters

Fixture16.2Mparameters

Layer stacks1compared

Findings0to review

✓ Same architecture, smaller

Every module class, layer kind and checked property of the original is in the fixture.

One square per layer, colored by kind: the layer's module classes and type attributes. Hover a square for its index and kind.

Original · 12

Fixture · 2

Kind	Original	Fixture
Layer	12	2	✓ kept

Share of each model's parameters per component. Vocabulary and patch sizes are kept, so embeddings usually take a larger share of the fixture.

Original

Fixture

Component	Original	Share	Fixture	Share
deberta.embeddings	192.8M	69.1%	16.1M	99.4%
deberta.encoder.layer	85.1M	30.5%	66.9K	0.4%
pooler.dense	590.6K	0.2%	4.2K	0.0%
deberta.encoder	394.8K	0.1%	32.9K	0.2%
classifier	2.3K	0.0%	195	0.0%

Config	Property	Original	Fixture
model	model_type	deberta-v2	deberta-v2	✓ kept
model	vocab_size	251000	251000	✓ kept
model	tie_word_embeddings	True	True	✓ kept
model	hidden_act	gelu	gelu	✓ kept
model	max_position_embeddings	512	512	✓ kept

Instances of each class in the built model (prefix DebertaV2 omitted).

Class	Original	Fixture
Linear	74	14
Dropout	51	11
LayerNorm	26	6
Attention	12	2
Intermediate	12	2
Layer	12	2
Output	12	2
SelfOutput	12	2
DisentangledSelfAttention	12	2
GELUActivation	12	2
Embedding	2	2
ContextPooler	1	1
Embeddings	1	1
Encoder	1	1
ForSequenceClassification	1	1
Model	1	1
ModuleList	1	1

5 fields changed, 31 unchanged.