microsoft/speecht5_asr
Original151.2Mparameters
Fixture4.4Mparameters
Layer stacks3compared
Findings0to review
✓ Same architecture, smaller
Every module class, layer kind and checked property of the original is in the fixture.
Layer stacks
One square per layer, colored by kind: the layer's module classes and type attributes. Hover a square for its index and kind.
speecht5.encoder.prenet.feature_encoder.conv_layers
Original · 7
Fixture · 7
| Kind | Original | Fixture | |
|---|---|---|---|
| GroupNorm, GroupNormConvLayer | 1 | 1 | ✓ kept |
| NoLayerNormConvLayer | 6 | 6 | ✓ kept |
speecht5.encoder.wrapped_encoder.layers
Original · 12
Fixture · 2
| Kind | Original | Fixture | |
|---|---|---|---|
| EncoderLayer | 12 | 2 | ✓ kept |
speecht5.decoder.wrapped_decoder.layers
Original · 6
Fixture · 2
| Kind | Original | Fixture | |
|---|---|---|---|
| DecoderLayer | 6 | 2 | ✓ kept |
Where the parameters are
Share of each model's parameters per component. Vocabulary and patch sizes are kept, so embeddings usually take a larger share of the fixture.
Original
Fixture
| Component | Original | Share | Fixture | Share |
|---|---|---|---|---|
| speecht5.encoder.wrapped_encoder.layers | 85.1M | 56.3% | 66.9K | 1.5% |
| speecht5.decoder.wrapped_decoder.layers | 56.7M | 37.5% | 100.5K | 2.3% |
| speecht5.encoder | 5.1M | 3.4% | 72.1K | 1.6% |
| speecht5.encoder.prenet.feature_encoder.conv_layers | 4.2M | 2.8% | 4.2M | 94.5% |
| speecht5.decoder | 62.2K | 0.0% | 5.2K | 0.1% |
Preserved properties
| Config | Property | Original | Fixture | |
|---|---|---|---|---|
| model | model_type | speecht5 | speecht5 | ✓ kept |
| model | vocab_size | 81 | 81 | ✓ kept |
| model | tie_word_embeddings | True | True | ✓ kept |
| model | hidden_act | gelu | gelu | ✓ kept |
| model | num_mel_bins | 80 | 80 | ✓ kept |
Module classes
Instances of each class in the built model (prefix SpeechT5 omitted).
| Class | Original | Fixture |
|---|---|---|
| Linear | 134 | 34 |
| Dropout | 57 | 15 |
| LayerNorm | 44 | 12 |
| GELUActivation | 26 | 12 |
| Attention | 24 | 6 |
| FeedForward | 18 | 4 |
| EncoderLayer | 12 | 2 |
| Conv1d | 7 | 7 |
| DecoderLayer | 6 | 2 |
| NoLayerNormConvLayer | 6 | 6 |
| ModuleList | 3 | 3 |
| Embedding | 2 | 2 |
| SinusoidalPositionalEmbedding | 2 | 2 |
| GroupNorm | 1 | 1 |
| ModuleDict | 1 | 1 |
| ParametrizationList | 1 | 1 |
| ParametrizedConv1d | 1 | 1 |
| Decoder | 1 | 1 |
| DecoderWithTextPrenet | 1 | 1 |
| Encoder | 1 | 1 |
| EncoderWithSpeechPrenet | 1 | 1 |
| FeatureEncoder | 1 | 1 |
| FeatureProjection | 1 | 1 |
| ForSpeechToText | 1 | 1 |
| GroupNormConvLayer | 1 | 1 |
| Model | 1 | 1 |
| PositionalConvEmbedding | 1 | 1 |
| RelativePositionalEncoding | 1 | 1 |
| SamePadLayer | 1 | 1 |
| SpeechEncoderPrenet | 1 | 1 |
| TextDecoderPostnet | 1 | 1 |
| TextDecoderPrenet | 1 | 1 |
| _WeightNorm | 1 | 1 |
Config changes
7 fields changed, 60 unchanged.
| Field | Original | Fixture |
|---|---|---|
| decoder_attention_heads | 12 | 4 |
| decoder_ffn_dim | 3072 | 128 |
| decoder_layers | 6 | 2 |
| encoder_attention_heads | 12 | 4 |
| encoder_ffn_dim | 3072 | 128 |
| encoder_layers | 12 | 2 |
| hidden_size | 768 | 64 |