facebook/detr-resnet-50
Original41.5Mparameters
Fixture23.8Mparameters
Layer stacks2compared
Findings1to review
⚠ To review
- the fixture keeps 57% of the original's 41.5M parameters
Layer stacks
One square per layer, colored by kind: the layer's module classes and type attributes. Hover a square for its index and kind.
model.encoder.layers
Original · 6
Fixture · 2
| Kind | Original | Fixture | |
|---|---|---|---|
| EncoderLayer | 6 | 2 | ✓ kept |
model.decoder.layers
Original · 6
Fixture · 2
| Kind | Original | Fixture | |
|---|---|---|---|
| DecoderLayer | 6 | 2 | ✓ kept |
Where the parameters are
Share of each model's parameters per component. Vocabulary and patch sizes are kept, so embeddings usually take a larger share of the fixture.
Original
Fixture
| Component | Original | Share | Fixture | Share |
|---|---|---|---|---|
| model.backbone | 23.5M | 56.5% | 23.5M | 98.7% |
| model.decoder.layers | 9.5M | 22.8% | 100.5K | 0.4% |
| model.encoder.layers | 7.9M | 19.0% | 66.9K | 0.3% |
| model.input_projection | 524.5K | 1.3% | 131.1K | 0.6% |
| bbox_predictor.layers | 132.6K | 0.3% | 8.6K | 0.0% |
| model.query_position_embeddings | 25.6K | 0.1% | 6.4K | 0.0% |
| class_labels_classifier | 23.6K | 0.1% | 6.0K | 0.0% |
| 1 others | 512 | 0.0% | 128 | 0.0% |
Preserved properties
| Config | Property | Original | Fixture | |
|---|---|---|---|---|
| model | model_type | detr | detr | ✓ kept |
| model | max_position_embeddings | 1024 | 1024 | ✓ kept |
| model | num_channels | 3 | 3 | ✓ kept |
| backbone_config | model_type | timm_backbone | timm_backbone | ✓ kept |
| backbone_config | num_channels | 3 | 3 | ✓ kept |
Module classes
Instances of each class in the built model (prefix Detr omitted).
| Class | Original | Fixture |
|---|---|---|
| Linear | 100 | 36 |
| ReLU | 61 | 53 |
| Conv2d | 54 | 54 |
| FrozenBatchNorm2d | 53 | 53 |
| Identity | 32 | 32 |
| LayerNorm | 31 | 11 |
| Bottleneck | 16 | 16 |
| MLP | 12 | 4 |
| SelfAttention | 12 | 4 |
| Sequential | 8 | 8 |
| CrossAttention | 6 | 2 |
| DecoderLayer | 6 | 2 |
| EncoderLayer | 6 | 2 |
| ModuleList | 3 | 3 |
| ConvEncoder | 1 | 1 |
| Decoder | 1 | 1 |
| Encoder | 1 | 1 |
| ForObjectDetection | 1 | 1 |
| MLPPredictionHead | 1 | 1 |
| Model | 1 | 1 |
| SinePositionEmbedding | 1 | 1 |
| Embedding | 1 | 1 |
| FeatureListNet | 1 | 1 |
| MaxPool2d | 1 | 1 |
Config changes
10 fields changed, 48 unchanged.
| Field | Original | Fixture |
|---|---|---|
| backbone_config.out_features | null | ["layer4"] |
| backbone_config.out_indices | [1, 2, 3, 4] | [-1] |
| backbone_config.stage_names | — | ["act1", "layer1", "layer2", "layer3", "layer4"] |
| d_model | 256 | 64 |
| decoder_attention_heads | 8 | 4 |
| decoder_ffn_dim | 2048 | 128 |
| decoder_layers | 6 | 2 |
| encoder_attention_heads | 8 | 4 |
| encoder_ffn_dim | 2048 | 128 |
| encoder_layers | 6 | 2 |