File size: 37,060 Bytes
cef984d
 
 
 
523c2a7
 
cef984d
 
 
 
 
 
 
 
 
54e719b
cef984d
 
523c2a7
cef984d
2f9fd49
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
cef984d
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
523c2a7
cef984d
 
 
 
 
 
 
 
2f9fd49
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
cef984d
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
---
license: apache-2.0
base_model: microsoft/conditional-detr-resnet-50
tags:
- object-detection
- vision
- generated_from_trainer
model-index:
- name: microsoft-conditional-detr-resnet-50-finetuned-10k-cppe5-manual-pad
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

[<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/qubvel-hf-co/transformers-detection-model-finetuning-cppe5/runs/zldi4iq1)
# microsoft-conditional-detr-resnet-50-finetuned-10k-cppe5-manual-pad

This model is a fine-tuned version of [microsoft/conditional-detr-resnet-50](https://huggingface.co/microsoft/conditional-detr-resnet-50) on the cppe-5 dataset.
It achieves the following results on the evaluation set:
- Loss: 1.3721
- Map: 0.3104
- Map 50: 0.6106
- Map 75: 0.2705
- Map Coverall: 0.5609
- Map Face Shield: 0.3402
- Map Gloves: 0.1979
- Map Goggles: 0.1636
- Map Mask: 0.2893
- Map Large: 0.5049
- Map Medium: 0.2484
- Map Small: 0.1755
- Mar 1: 0.2951
- Mar 10: 0.4381
- Mar 100: 0.4488
- Mar 100 Coverall: 0.6473
- Mar 100 Face Shield: 0.4785
- Mar 100 Gloves: 0.3424
- Mar 100 Goggles: 0.3569
- Mar 100 Mask: 0.4187
- Mar Large: 0.6319
- Mar Medium: 0.3997
- Mar Small: 0.2478

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 5e-05
- train_batch_size: 8
- eval_batch_size: 1
- seed: 1337
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 100.0
- mixed_precision_training: Native AMP

### Training results

| Training Loss | Epoch | Step  | Validation Loss | Map    | Map 50 | Map 75 | Map Coverall | Map Face Shield | Map Gloves | Map Goggles | Map Mask | Map Large | Map Medium | Map Small | Mar 1  | Mar 10 | Mar 100 | Mar 100 Coverall | Mar 100 Face Shield | Mar 100 Gloves | Mar 100 Goggles | Mar 100 Mask | Mar Large | Mar Medium | Mar Small |
|:-------------:|:-----:|:-----:|:---------------:|:------:|:------:|:------:|:------------:|:---------------:|:----------:|:-----------:|:--------:|:---------:|:----------:|:---------:|:------:|:------:|:-------:|:----------------:|:-------------------:|:--------------:|:---------------:|:------------:|:---------:|:----------:|:---------:|
| 17.6568       | 1.0   | 107   | 2.4953          | 0.0339 | 0.0842 | 0.0227 | 0.1092       | 0.0002          | 0.0089     | 0.017       | 0.0342   | 0.0527    | 0.01       | 0.0165    | 0.0675 | 0.1549 | 0.1841  | 0.432            | 0.0051              | 0.1777         | 0.0585          | 0.2476       | 0.3078    | 0.1385     | 0.0262    |
| 2.2726        | 2.0   | 214   | 2.1154          | 0.0344 | 0.0841 | 0.0221 | 0.0897       | 0.0039          | 0.0166     | 0.0013      | 0.0606   | 0.0447    | 0.0213     | 0.0221    | 0.0802 | 0.206  | 0.2426  | 0.4324           | 0.1696              | 0.2518         | 0.0554          | 0.3036       | 0.3095    | 0.2163     | 0.0662    |
| 2.0505        | 3.0   | 321   | 2.0062          | 0.0536 | 0.1162 | 0.0434 | 0.1705       | 0.0076          | 0.0204     | 0.0011      | 0.0682   | 0.0579    | 0.0305     | 0.0214    | 0.1051 | 0.2384 | 0.2811  | 0.5896           | 0.1684              | 0.2603         | 0.0538          | 0.3333       | 0.3967    | 0.2222     | 0.0914    |
| 1.8348        | 4.0   | 428   | 1.8721          | 0.0741 | 0.1785 | 0.0559 | 0.2067       | 0.0218          | 0.0355     | 0.0117      | 0.0949   | 0.0939    | 0.0538     | 0.0238    | 0.1239 | 0.2861 | 0.3282  | 0.6284           | 0.2519              | 0.2817         | 0.1492          | 0.3298       | 0.5104    | 0.2702     | 0.0656    |
| 1.6955        | 5.0   | 535   | 1.7602          | 0.1034 | 0.2289 | 0.0816 | 0.2403       | 0.0467          | 0.0709     | 0.0071      | 0.1518   | 0.1379    | 0.0965     | 0.0413    | 0.1589 | 0.323  | 0.3676  | 0.6414           | 0.3                 | 0.3049         | 0.22            | 0.3716       | 0.5454    | 0.3134     | 0.1233    |
| 1.5709        | 6.0   | 642   | 1.6756          | 0.1543 | 0.3537 | 0.1194 | 0.4106       | 0.0641          | 0.0857     | 0.0102      | 0.2007   | 0.2414    | 0.1082     | 0.0484    | 0.1676 | 0.3411 | 0.377   | 0.5883           | 0.3392              | 0.2937         | 0.2892          | 0.3747       | 0.5802    | 0.3264     | 0.1353    |
| 1.4727        | 7.0   | 749   | 1.5794          | 0.1786 | 0.3785 | 0.1377 | 0.4591       | 0.0953          | 0.0999     | 0.0146      | 0.2244   | 0.2856    | 0.1422     | 0.0445    | 0.1881 | 0.3607 | 0.3864  | 0.6099           | 0.3696              | 0.3071         | 0.28            | 0.3653       | 0.5846    | 0.3654     | 0.0988    |
| 1.3995        | 8.0   | 856   | 1.5788          | 0.1908 | 0.4159 | 0.1574 | 0.4528       | 0.1007          | 0.1204     | 0.0378      | 0.2422   | 0.2724    | 0.1519     | 0.0759    | 0.1971 | 0.3636 | 0.3898  | 0.6117           | 0.4063              | 0.3009         | 0.2615          | 0.3684       | 0.6211    | 0.329      | 0.1343    |
| 1.3292        | 9.0   | 963   | 1.5187          | 0.1914 | 0.4178 | 0.148  | 0.4528       | 0.0844          | 0.1179     | 0.0415      | 0.2602   | 0.3182    | 0.1516     | 0.0579    | 0.2069 | 0.3783 | 0.4111  | 0.6068           | 0.4329              | 0.3022         | 0.3169          | 0.3964       | 0.661     | 0.3612     | 0.1544    |
| 1.2708        | 10.0  | 1070  | 1.4632          | 0.2162 | 0.453  | 0.1905 | 0.4807       | 0.121           | 0.1524     | 0.0665      | 0.2606   | 0.3165    | 0.1789     | 0.0758    | 0.225  | 0.3959 | 0.419   | 0.6378           | 0.4215              | 0.3254         | 0.3169          | 0.3933       | 0.6753    | 0.366      | 0.1667    |
| 1.239         | 11.0  | 1177  | 1.4840          | 0.2052 | 0.4409 | 0.1663 | 0.4863       | 0.1335          | 0.1338     | 0.0729      | 0.1992   | 0.3564    | 0.1622     | 0.0953    | 0.2304 | 0.3846 | 0.4105  | 0.6324           | 0.4304              | 0.3107         | 0.3446          | 0.3342       | 0.6558    | 0.3492     | 0.1948    |
| 1.1893        | 12.0  | 1284  | 1.4335          | 0.2266 | 0.4772 | 0.1934 | 0.4806       | 0.1614          | 0.1582     | 0.0738      | 0.2589   | 0.3835    | 0.174      | 0.1113    | 0.2327 | 0.3966 | 0.4218  | 0.6374           | 0.4127              | 0.3393         | 0.3246          | 0.3951       | 0.6436    | 0.3453     | 0.2243    |
| 1.1573        | 13.0  | 1391  | 1.4246          | 0.221  | 0.4715 | 0.1741 | 0.501        | 0.1494          | 0.1345     | 0.0744      | 0.2459   | 0.4129    | 0.1588     | 0.0798    | 0.2405 | 0.3808 | 0.4012  | 0.6333           | 0.3582              | 0.3116         | 0.3185          | 0.3844       | 0.6432    | 0.3325     | 0.1909    |
| 1.1162        | 14.0  | 1498  | 1.3995          | 0.2411 | 0.4955 | 0.1981 | 0.5029       | 0.1679          | 0.1707     | 0.0912      | 0.2728   | 0.4063    | 0.1949     | 0.0838    | 0.2434 | 0.4041 | 0.4229  | 0.623            | 0.4278              | 0.3585         | 0.3215          | 0.3836       | 0.6515    | 0.3785     | 0.1658    |
| 1.0907        | 15.0  | 1605  | 1.3640          | 0.2416 | 0.4875 | 0.1991 | 0.536        | 0.1697          | 0.1669     | 0.0821      | 0.2533   | 0.4098    | 0.1802     | 0.1059    | 0.2525 | 0.406  | 0.4357  | 0.6622           | 0.4342              | 0.3433         | 0.3554          | 0.3836       | 0.6634    | 0.3886     | 0.1862    |
| 1.0499        | 16.0  | 1712  | 1.3436          | 0.2481 | 0.5321 | 0.1994 | 0.5252       | 0.1767          | 0.1641     | 0.1141      | 0.2602   | 0.4198    | 0.1986     | 0.1268    | 0.2605 | 0.4142 | 0.4382  | 0.6541           | 0.438               | 0.3487         | 0.3538          | 0.3964       | 0.6637    | 0.3915     | 0.22      |
| 1.0233        | 17.0  | 1819  | 1.3491          | 0.2536 | 0.5073 | 0.2178 | 0.5374       | 0.1551          | 0.171      | 0.1216      | 0.2826   | 0.445     | 0.1893     | 0.1107    | 0.2539 | 0.4242 | 0.4465  | 0.6653           | 0.4494              | 0.3692         | 0.3431          | 0.4058       | 0.6824    | 0.3809     | 0.2184    |
| 1.0235        | 18.0  | 1926  | 1.3456          | 0.2626 | 0.5241 | 0.2438 | 0.5297       | 0.2344          | 0.175      | 0.0958      | 0.2782   | 0.4598    | 0.2052     | 0.0951    | 0.265  | 0.4291 | 0.4513  | 0.6464           | 0.5013              | 0.3634         | 0.3446          | 0.4009       | 0.6631    | 0.4071     | 0.2025    |
| 1.006         | 19.0  | 2033  | 1.3521          | 0.2655 | 0.5481 | 0.2342 | 0.5114       | 0.2176          | 0.1863     | 0.154       | 0.2583   | 0.4477    | 0.2157     | 0.1332    | 0.2689 | 0.42   | 0.4444  | 0.6387           | 0.4582              | 0.3643         | 0.3662          | 0.3947       | 0.6656    | 0.3946     | 0.2349    |
| 0.9926        | 20.0  | 2140  | 1.3951          | 0.262  | 0.5454 | 0.2149 | 0.5158       | 0.2245          | 0.1703     | 0.131       | 0.2684   | 0.4636    | 0.2118     | 0.0878    | 0.2565 | 0.4028 | 0.4294  | 0.6315           | 0.4152              | 0.3388         | 0.3815          | 0.38         | 0.6523    | 0.3863     | 0.1966    |
| 0.9899        | 21.0  | 2247  | 1.3274          | 0.2765 | 0.5713 | 0.24   | 0.5412       | 0.2674          | 0.1799     | 0.1284      | 0.2658   | 0.4725    | 0.2159     | 0.1493    | 0.2736 | 0.4196 | 0.4443  | 0.6559           | 0.4785              | 0.3531         | 0.3308          | 0.4031       | 0.6579    | 0.3927     | 0.2354    |
| 0.964         | 22.0  | 2354  | 1.3400          | 0.2692 | 0.5645 | 0.2201 | 0.5284       | 0.2252          | 0.1989     | 0.1176      | 0.2756   | 0.4348    | 0.2153     | 0.1263    | 0.2636 | 0.4074 | 0.4318  | 0.6505           | 0.4152              | 0.3701         | 0.3246          | 0.3987       | 0.6182    | 0.3853     | 0.2309    |
| 0.9667        | 23.0  | 2461  | 1.3043          | 0.2874 | 0.5701 | 0.2519 | 0.559        | 0.2777          | 0.2036     | 0.1204      | 0.2763   | 0.4895    | 0.2318     | 0.128     | 0.279  | 0.4278 | 0.4469  | 0.6716           | 0.4582              | 0.3616         | 0.3477          | 0.3956       | 0.6768    | 0.3903     | 0.2349    |
| 0.9338        | 24.0  | 2568  | 1.3279          | 0.2747 | 0.5597 | 0.234  | 0.5338       | 0.2431          | 0.1989     | 0.1385      | 0.2592   | 0.4913    | 0.208      | 0.105     | 0.2761 | 0.4198 | 0.4427  | 0.6464           | 0.4519              | 0.3719         | 0.3508          | 0.3924       | 0.6705    | 0.3814     | 0.246     |
| 0.9216        | 25.0  | 2675  | 1.3820          | 0.2616 | 0.5326 | 0.2269 | 0.5107       | 0.2591          | 0.1532     | 0.15        | 0.2351   | 0.4739    | 0.2108     | 0.1267    | 0.2597 | 0.4022 | 0.4283  | 0.6338           | 0.4557              | 0.329          | 0.3523          | 0.3707       | 0.6457    | 0.371      | 0.2289    |
| 0.9163        | 26.0  | 2782  | 1.3271          | 0.285  | 0.5686 | 0.2344 | 0.532        | 0.2534          | 0.1961     | 0.1737      | 0.27     | 0.4934    | 0.2195     | 0.1306    | 0.2805 | 0.4219 | 0.443   | 0.6365           | 0.4494              | 0.3679         | 0.3692          | 0.392        | 0.65      | 0.3955     | 0.1989    |
| 0.8966        | 27.0  | 2889  | 1.3206          | 0.287  | 0.58   | 0.2502 | 0.541        | 0.2498          | 0.1969     | 0.1794      | 0.2679   | 0.4865    | 0.2336     | 0.1694    | 0.2772 | 0.4273 | 0.446   | 0.6423           | 0.4658              | 0.3683         | 0.3569          | 0.3964       | 0.6458    | 0.4048     | 0.2276    |
| 0.8961        | 28.0  | 2996  | 1.3924          | 0.2735 | 0.5468 | 0.2348 | 0.5331       | 0.2492          | 0.1776     | 0.1476      | 0.2598   | 0.4491    | 0.2151     | 0.151     | 0.268  | 0.4136 | 0.4364  | 0.6356           | 0.4646              | 0.354          | 0.3385          | 0.3893       | 0.6288    | 0.3888     | 0.2323    |
| 0.881         | 29.0  | 3103  | 1.3549          | 0.2774 | 0.5754 | 0.2403 | 0.5262       | 0.2546          | 0.1861     | 0.1322      | 0.2876   | 0.479     | 0.214      | 0.1403    | 0.2634 | 0.4081 | 0.434   | 0.6306           | 0.4367              | 0.3692         | 0.3292          | 0.404        | 0.6574    | 0.3649     | 0.2436    |
| 0.8557        | 30.0  | 3210  | 1.3429          | 0.2797 | 0.5698 | 0.2423 | 0.5272       | 0.2706          | 0.1946     | 0.1308      | 0.275    | 0.4581    | 0.2313     | 0.1306    | 0.2712 | 0.4254 | 0.4493  | 0.6351           | 0.4544              | 0.3848         | 0.3662          | 0.4058       | 0.6492    | 0.3974     | 0.2533    |
| 0.8594        | 31.0  | 3317  | 1.3327          | 0.2774 | 0.5727 | 0.2397 | 0.5515       | 0.2655          | 0.1812     | 0.1353      | 0.2533   | 0.4598    | 0.22       | 0.1441    | 0.274  | 0.4106 | 0.4273  | 0.6505           | 0.4038              | 0.3518         | 0.3462          | 0.3844       | 0.6478    | 0.3701     | 0.2079    |
| 0.842         | 32.0  | 3424  | 1.3370          | 0.2791 | 0.5773 | 0.229  | 0.5437       | 0.2617          | 0.1788     | 0.1568      | 0.2543   | 0.4562    | 0.2142     | 0.1545    | 0.2743 | 0.4108 | 0.4313  | 0.6527           | 0.4532              | 0.3513         | 0.3231          | 0.3764       | 0.631     | 0.3834     | 0.2092    |
| 0.8255        | 33.0  | 3531  | 1.3559          | 0.2852 | 0.5765 | 0.2366 | 0.5361       | 0.2591          | 0.1973     | 0.1456      | 0.288    | 0.4829    | 0.2308     | 0.1392    | 0.2786 | 0.4195 | 0.4385  | 0.6378           | 0.4519              | 0.3652         | 0.3369          | 0.4004       | 0.6556    | 0.3925     | 0.2252    |
| 0.8113        | 34.0  | 3638  | 1.3142          | 0.2813 | 0.5843 | 0.2478 | 0.5419       | 0.2532          | 0.1844     | 0.1569      | 0.2703   | 0.504     | 0.2088     | 0.1556    | 0.2788 | 0.4256 | 0.4484  | 0.6523           | 0.4646              | 0.3643         | 0.3646          | 0.3964       | 0.6623    | 0.4064     | 0.2367    |
| 0.8204        | 35.0  | 3745  | 1.3551          | 0.2884 | 0.5732 | 0.2521 | 0.5432       | 0.2726          | 0.1793     | 0.164       | 0.2828   | 0.5103    | 0.2154     | 0.1341    | 0.2787 | 0.4176 | 0.4362  | 0.6437           | 0.4658              | 0.3371         | 0.34            | 0.3947       | 0.6734    | 0.39       | 0.1963    |
| 0.795         | 36.0  | 3852  | 1.2942          | 0.291  | 0.5763 | 0.2627 | 0.5471       | 0.3036          | 0.1778     | 0.147       | 0.2794   | 0.4803    | 0.2412     | 0.1615    | 0.2893 | 0.4332 | 0.4501  | 0.6554           | 0.4785              | 0.3576         | 0.3569          | 0.4022       | 0.6524    | 0.4066     | 0.2563    |
| 0.7839        | 37.0  | 3959  | 1.3312          | 0.2792 | 0.5541 | 0.2309 | 0.5464       | 0.2328          | 0.1921     | 0.141       | 0.2836   | 0.4562    | 0.2221     | 0.18      | 0.2783 | 0.4296 | 0.447   | 0.6527           | 0.4392              | 0.3661         | 0.3662          | 0.4107       | 0.6637    | 0.3846     | 0.2661    |
| 0.7852        | 38.0  | 4066  | 1.3136          | 0.2894 | 0.5913 | 0.2499 | 0.5364       | 0.2877          | 0.1999     | 0.147       | 0.2763   | 0.4798    | 0.236      | 0.1421    | 0.2768 | 0.4195 | 0.4383  | 0.6374           | 0.462               | 0.3509         | 0.3415          | 0.3996       | 0.6582    | 0.3844     | 0.2245    |
| 0.7821        | 39.0  | 4173  | 1.3303          | 0.2893 | 0.5808 | 0.2493 | 0.541        | 0.2832          | 0.1896     | 0.1281      | 0.3046   | 0.4619    | 0.238      | 0.1658    | 0.2881 | 0.4395 | 0.4563  | 0.6446           | 0.5076              | 0.3487         | 0.3585          | 0.4222       | 0.6699    | 0.4019     | 0.2395    |
| 0.7806        | 40.0  | 4280  | 1.3082          | 0.3004 | 0.597  | 0.2685 | 0.5461       | 0.2978          | 0.1875     | 0.1662      | 0.3046   | 0.4939    | 0.2597     | 0.1656    | 0.2937 | 0.4288 | 0.4506  | 0.6676           | 0.4709              | 0.3513         | 0.3492          | 0.4142       | 0.6703    | 0.4056     | 0.2188    |
| 0.7456        | 41.0  | 4387  | 1.3027          | 0.2925 | 0.5982 | 0.2462 | 0.5538       | 0.287           | 0.1788     | 0.1698      | 0.273    | 0.506     | 0.2356     | 0.1438    | 0.2835 | 0.4278 | 0.4467  | 0.6685           | 0.4557              | 0.3469         | 0.3615          | 0.4009       | 0.6879    | 0.3959     | 0.2174    |
| 0.7375        | 42.0  | 4494  | 1.2844          | 0.3029 | 0.6032 | 0.2652 | 0.5428       | 0.3001          | 0.1924     | 0.1788      | 0.3003   | 0.4969    | 0.2519     | 0.1534    | 0.2993 | 0.4335 | 0.4544  | 0.6486           | 0.4658              | 0.367          | 0.3615          | 0.4289       | 0.6631    | 0.4078     | 0.2517    |
| 0.7436        | 43.0  | 4601  | 1.2853          | 0.3106 | 0.6179 | 0.2576 | 0.562        | 0.3038          | 0.2        | 0.1828      | 0.3044   | 0.4968    | 0.2594     | 0.1734    | 0.289  | 0.4349 | 0.4613  | 0.6685           | 0.4759              | 0.3821         | 0.3585          | 0.4213       | 0.6595    | 0.4223     | 0.2639    |
| 0.7251        | 44.0  | 4708  | 1.3116          | 0.3023 | 0.5867 | 0.2709 | 0.5617       | 0.2734          | 0.2051     | 0.1816      | 0.2895   | 0.499     | 0.2489     | 0.1543    | 0.2853 | 0.435  | 0.4525  | 0.6622           | 0.4367              | 0.3884         | 0.3662          | 0.4089       | 0.6615    | 0.3953     | 0.2351    |
| 0.7068        | 45.0  | 4815  | 1.2828          | 0.3039 | 0.6035 | 0.2734 | 0.5536       | 0.3082          | 0.1953     | 0.1657      | 0.2966   | 0.5417    | 0.2353     | 0.1772    | 0.2927 | 0.4373 | 0.4601  | 0.6743           | 0.4886              | 0.3754         | 0.3462          | 0.416        | 0.6844    | 0.4062     | 0.2327    |
| 0.7012        | 46.0  | 4922  | 1.3041          | 0.2979 | 0.6    | 0.2602 | 0.5483       | 0.3326          | 0.1768     | 0.1364      | 0.2954   | 0.4817    | 0.2446     | 0.168     | 0.2923 | 0.4252 | 0.4446  | 0.6595           | 0.4633              | 0.3442         | 0.3554          | 0.4009       | 0.6279    | 0.4003     | 0.245     |
| 0.691         | 47.0  | 5029  | 1.3613          | 0.291  | 0.5768 | 0.2549 | 0.5418       | 0.3051          | 0.1824     | 0.1397      | 0.2858   | 0.4959    | 0.227      | 0.1538    | 0.2831 | 0.4247 | 0.4437  | 0.6473           | 0.4734              | 0.3527         | 0.3369          | 0.408        | 0.6462    | 0.398      | 0.2257    |
| 0.6788        | 48.0  | 5136  | 1.2981          | 0.3069 | 0.6091 | 0.2697 | 0.5592       | 0.3108          | 0.1914     | 0.179       | 0.2942   | 0.4958    | 0.2427     | 0.174     | 0.2931 | 0.4285 | 0.4445  | 0.6563           | 0.4532              | 0.358          | 0.3508          | 0.404        | 0.6548    | 0.3785     | 0.2394    |
| 0.6686        | 49.0  | 5243  | 1.3091          | 0.3042 | 0.6092 | 0.2661 | 0.5485       | 0.2999          | 0.2021     | 0.1767      | 0.2935   | 0.4948    | 0.2477     | 0.1776    | 0.2902 | 0.4318 | 0.4479  | 0.6509           | 0.4582              | 0.3723         | 0.3369          | 0.4209       | 0.6412    | 0.3926     | 0.2623    |
| 0.6581        | 50.0  | 5350  | 1.3058          | 0.3049 | 0.6004 | 0.2652 | 0.5365       | 0.2952          | 0.1997     | 0.1931      | 0.3002   | 0.5173    | 0.2472     | 0.1605    | 0.2943 | 0.4304 | 0.4547  | 0.6432           | 0.4582              | 0.3679         | 0.3785          | 0.4258       | 0.6647    | 0.4006     | 0.2449    |
| 0.6626        | 51.0  | 5457  | 1.3289          | 0.2979 | 0.5867 | 0.2674 | 0.5626       | 0.2893          | 0.1845     | 0.166       | 0.2871   | 0.4978    | 0.2412     | 0.1518    | 0.2932 | 0.4294 | 0.4494  | 0.6581           | 0.4544              | 0.3455         | 0.3785          | 0.4107       | 0.6758    | 0.401      | 0.2275    |
| 0.6561        | 52.0  | 5564  | 1.2867          | 0.3142 | 0.6067 | 0.2769 | 0.5532       | 0.3268          | 0.1937     | 0.1922      | 0.3053   | 0.5119    | 0.2662     | 0.1689    | 0.3035 | 0.4412 | 0.4638  | 0.6559           | 0.4886              | 0.3603         | 0.3892          | 0.4249       | 0.6548    | 0.4191     | 0.2652    |
| 0.6437        | 53.0  | 5671  | 1.3071          | 0.3045 | 0.5936 | 0.2761 | 0.5495       | 0.3066          | 0.1881     | 0.1806      | 0.2977   | 0.4799    | 0.2546     | 0.1626    | 0.297  | 0.4415 | 0.463   | 0.6658           | 0.4684              | 0.3585         | 0.3938          | 0.4284       | 0.6654    | 0.407      | 0.2577    |
| 0.6464        | 54.0  | 5778  | 1.2750          | 0.3038 | 0.6037 | 0.2641 | 0.5534       | 0.2888          | 0.1921     | 0.1796      | 0.3052   | 0.4945    | 0.2486     | 0.1579    | 0.2973 | 0.4386 | 0.4586  | 0.664            | 0.4646              | 0.3562         | 0.3862          | 0.4222       | 0.6732    | 0.3952     | 0.2589    |
| 0.6137        | 55.0  | 5885  | 1.2895          | 0.3015 | 0.5944 | 0.2633 | 0.5509       | 0.2864          | 0.1955     | 0.1784      | 0.2963   | 0.5175    | 0.2394     | 0.1619    | 0.2962 | 0.4376 | 0.4547  | 0.6554           | 0.4354              | 0.3692         | 0.4015          | 0.412        | 0.6569    | 0.3984     | 0.2524    |
| 0.6086        | 56.0  | 5992  | 1.3076          | 0.3032 | 0.5974 | 0.2722 | 0.5495       | 0.2951          | 0.1972     | 0.1811      | 0.2929   | 0.5145    | 0.2431     | 0.168     | 0.2947 | 0.4373 | 0.4541  | 0.6423           | 0.4759              | 0.3603         | 0.3877          | 0.4044       | 0.6605    | 0.3992     | 0.2598    |
| 0.6189        | 57.0  | 6099  | 1.3197          | 0.303  | 0.597  | 0.271  | 0.5518       | 0.2878          | 0.1943     | 0.1692      | 0.3118   | 0.5042    | 0.2437     | 0.1745    | 0.2929 | 0.4412 | 0.4573  | 0.6545           | 0.443               | 0.3728         | 0.4031          | 0.4129       | 0.6597    | 0.417      | 0.2682    |
| 0.6284        | 58.0  | 6206  | 1.3357          | 0.2991 | 0.6012 | 0.2619 | 0.5462       | 0.3024          | 0.1919     | 0.1575      | 0.2975   | 0.5082    | 0.2401     | 0.1646    | 0.2946 | 0.438  | 0.4536  | 0.655            | 0.4937              | 0.3612         | 0.3585          | 0.3996       | 0.6601    | 0.4006     | 0.2342    |
| 0.609         | 59.0  | 6313  | 1.3311          | 0.3019 | 0.5995 | 0.2766 | 0.5547       | 0.2903          | 0.1887     | 0.168       | 0.3077   | 0.5124    | 0.2485     | 0.1684    | 0.2909 | 0.4377 | 0.45    | 0.6536           | 0.4608              | 0.3603         | 0.3615          | 0.4138       | 0.6493    | 0.4023     | 0.2437    |
| 0.6045        | 60.0  | 6420  | 1.3433          | 0.3019 | 0.5885 | 0.259  | 0.5443       | 0.2862          | 0.1889     | 0.1871      | 0.3031   | 0.5115    | 0.2401     | 0.1699    | 0.2899 | 0.4268 | 0.4436  | 0.641            | 0.4316              | 0.3607         | 0.3677          | 0.4169       | 0.6624    | 0.3853     | 0.2524    |
| 0.6099        | 61.0  | 6527  | 1.3523          | 0.2969 | 0.5912 | 0.2611 | 0.5598       | 0.2626          | 0.1973     | 0.1712      | 0.2933   | 0.509     | 0.2357     | 0.1572    | 0.277  | 0.4226 | 0.4408  | 0.6509           | 0.4228              | 0.3612         | 0.3569          | 0.4124       | 0.6423    | 0.3845     | 0.2633    |
| 0.5861        | 62.0  | 6634  | 1.3354          | 0.3057 | 0.5999 | 0.269  | 0.5641       | 0.296           | 0.2004     | 0.167       | 0.301    | 0.503     | 0.2357     | 0.1758    | 0.2923 | 0.4348 | 0.4498  | 0.6617           | 0.4671              | 0.3571         | 0.3508          | 0.4124       | 0.6529    | 0.3946     | 0.2423    |
| 0.585         | 63.0  | 6741  | 1.3022          | 0.3087 | 0.6067 | 0.2633 | 0.5583       | 0.3118          | 0.1948     | 0.163       | 0.3156   | 0.4967    | 0.2518     | 0.1736    | 0.2897 | 0.4379 | 0.4582  | 0.6631           | 0.4886              | 0.371          | 0.3492          | 0.4191       | 0.6421    | 0.4167     | 0.2614    |
| 0.5621        | 64.0  | 6848  | 1.3480          | 0.3068 | 0.6013 | 0.2707 | 0.5616       | 0.3032          | 0.1885     | 0.1639      | 0.3169   | 0.5079    | 0.2469     | 0.1719    | 0.2893 | 0.4394 | 0.4554  | 0.6495           | 0.4608              | 0.3549         | 0.38            | 0.4316       | 0.649     | 0.3978     | 0.2735    |
| 0.5707        | 65.0  | 6955  | 1.3343          | 0.3073 | 0.6073 | 0.2752 | 0.55         | 0.3149          | 0.1969     | 0.1719      | 0.3029   | 0.5146    | 0.2496     | 0.1676    | 0.2951 | 0.4327 | 0.4516  | 0.6559           | 0.4772              | 0.3683         | 0.3492          | 0.4076       | 0.6649    | 0.3961     | 0.2503    |
| 0.5585        | 66.0  | 7062  | 1.3624          | 0.3008 | 0.601  | 0.2562 | 0.5594       | 0.2869          | 0.193      | 0.1628      | 0.3017   | 0.5058    | 0.2336     | 0.1721    | 0.2876 | 0.4264 | 0.4436  | 0.6523           | 0.4608              | 0.3607         | 0.3338          | 0.4107       | 0.6468    | 0.3776     | 0.2523    |
| 0.5519        | 67.0  | 7169  | 1.3701          | 0.2932 | 0.5902 | 0.2571 | 0.5449       | 0.2934          | 0.1897     | 0.1451      | 0.2929   | 0.5024    | 0.2281     | 0.1705    | 0.292  | 0.4263 | 0.44    | 0.6505           | 0.4443              | 0.3598         | 0.3431          | 0.4022       | 0.6348    | 0.381      | 0.2691    |
| 0.5496        | 68.0  | 7276  | 1.3509          | 0.3043 | 0.6112 | 0.2653 | 0.5516       | 0.3041          | 0.1995     | 0.1655      | 0.3007   | 0.5101    | 0.2506     | 0.1734    | 0.2914 | 0.4311 | 0.4454  | 0.6626           | 0.4671              | 0.3625         | 0.3262          | 0.4089       | 0.6464    | 0.4039     | 0.2374    |
| 0.5397        | 69.0  | 7383  | 1.3480          | 0.3026 | 0.6123 | 0.2568 | 0.545        | 0.321           | 0.1926     | 0.1605      | 0.2938   | 0.4958    | 0.241      | 0.1686    | 0.2939 | 0.4302 | 0.4477  | 0.6505           | 0.4646              | 0.3607         | 0.3477          | 0.4151       | 0.6395    | 0.3922     | 0.2432    |
| 0.5242        | 70.0  | 7490  | 1.3460          | 0.3061 | 0.6069 | 0.2684 | 0.5569       | 0.3133          | 0.196      | 0.1597      | 0.3047   | 0.5008    | 0.2383     | 0.1726    | 0.2946 | 0.4378 | 0.455   | 0.655            | 0.4747              | 0.3683         | 0.3585          | 0.4187       | 0.6292    | 0.4094     | 0.2516    |
| 0.5235        | 71.0  | 7597  | 1.3534          | 0.3072 | 0.6033 | 0.2743 | 0.5589       | 0.316           | 0.1996     | 0.1685      | 0.2932   | 0.5113    | 0.2421     | 0.1732    | 0.297  | 0.4352 | 0.4492  | 0.6523           | 0.457               | 0.3598         | 0.3631          | 0.4138       | 0.6328    | 0.4037     | 0.2595    |
| 0.5174        | 72.0  | 7704  | 1.3735          | 0.3009 | 0.6115 | 0.2618 | 0.5509       | 0.3186          | 0.188      | 0.1636      | 0.2834   | 0.4879    | 0.2333     | 0.1791    | 0.2953 | 0.431  | 0.4479  | 0.6477           | 0.4759              | 0.3411         | 0.3646          | 0.4102       | 0.6396    | 0.3958     | 0.2528    |
| 0.5122        | 73.0  | 7811  | 1.3526          | 0.3078 | 0.6129 | 0.2707 | 0.5484       | 0.3256          | 0.2031     | 0.1592      | 0.3026   | 0.4938    | 0.2438     | 0.1844    | 0.3001 | 0.437  | 0.4488  | 0.6577           | 0.4734              | 0.3589         | 0.34            | 0.4142       | 0.6363    | 0.3928     | 0.2521    |
| 0.5058        | 74.0  | 7918  | 1.3602          | 0.2959 | 0.5941 | 0.2574 | 0.5562       | 0.2956          | 0.194      | 0.1429      | 0.2907   | 0.5187    | 0.2318     | 0.1769    | 0.2948 | 0.4289 | 0.4443  | 0.6509           | 0.4354              | 0.3638         | 0.3615          | 0.4098       | 0.6445    | 0.3871     | 0.2544    |
| 0.4987        | 75.0  | 8025  | 1.3553          | 0.3034 | 0.5964 | 0.2713 | 0.5519       | 0.3014          | 0.2065     | 0.1633      | 0.2941   | 0.5055    | 0.241      | 0.1781    | 0.299  | 0.4377 | 0.4501  | 0.6514           | 0.4671              | 0.3737         | 0.3462          | 0.412        | 0.6548    | 0.4051     | 0.2498    |
| 0.4926        | 76.0  | 8132  | 1.3653          | 0.3046 | 0.6112 | 0.2752 | 0.5497       | 0.3246          | 0.1985     | 0.1579      | 0.2921   | 0.4911    | 0.2414     | 0.1839    | 0.2927 | 0.4323 | 0.4466  | 0.65             | 0.4671              | 0.35           | 0.3508          | 0.4151       | 0.6253    | 0.3907     | 0.2599    |
| 0.4885        | 77.0  | 8239  | 1.3816          | 0.3023 | 0.6023 | 0.2742 | 0.548        | 0.315           | 0.1962     | 0.1605      | 0.2918   | 0.4972    | 0.2401     | 0.1777    | 0.293  | 0.4307 | 0.4451  | 0.6477           | 0.4696              | 0.3496         | 0.3492          | 0.4093       | 0.6271    | 0.3959     | 0.2453    |
| 0.493         | 78.0  | 8346  | 1.3648          | 0.3014 | 0.5999 | 0.2713 | 0.5493       | 0.3168          | 0.1929     | 0.1541      | 0.2941   | 0.5039    | 0.2422     | 0.1865    | 0.2929 | 0.4374 | 0.4498  | 0.6455           | 0.4709              | 0.3504         | 0.3585          | 0.4236       | 0.6348    | 0.3949     | 0.2552    |
| 0.4819        | 79.0  | 8453  | 1.3878          | 0.3069 | 0.5988 | 0.274  | 0.552        | 0.3248          | 0.1948     | 0.1608      | 0.3019   | 0.4952    | 0.2494     | 0.181     | 0.299  | 0.436  | 0.4489  | 0.6509           | 0.4747              | 0.3487         | 0.3554          | 0.4151       | 0.6316    | 0.4079     | 0.2449    |
| 0.4748        | 80.0  | 8560  | 1.3725          | 0.3042 | 0.5927 | 0.2657 | 0.5512       | 0.3187          | 0.1969     | 0.1517      | 0.3023   | 0.5014    | 0.2398     | 0.1802    | 0.2938 | 0.432  | 0.4479  | 0.6432           | 0.4759              | 0.3531         | 0.3492          | 0.4178       | 0.6461    | 0.3976     | 0.2552    |
| 0.4723        | 81.0  | 8667  | 1.3718          | 0.2997 | 0.5946 | 0.2603 | 0.5406       | 0.3067          | 0.2006     | 0.1545      | 0.2959   | 0.4987    | 0.2364     | 0.187     | 0.2924 | 0.432  | 0.4433  | 0.6392           | 0.4658              | 0.3518         | 0.34            | 0.4196       | 0.6169    | 0.3988     | 0.2552    |
| 0.4653        | 82.0  | 8774  | 1.3623          | 0.3044 | 0.6039 | 0.2684 | 0.5495       | 0.3252          | 0.1942     | 0.1588      | 0.2944   | 0.5066    | 0.2405     | 0.1793    | 0.295  | 0.4399 | 0.4527  | 0.6486           | 0.4772              | 0.3513         | 0.3662          | 0.42         | 0.6394    | 0.4066     | 0.2461    |
| 0.459         | 83.0  | 8881  | 1.3512          | 0.3061 | 0.6051 | 0.2725 | 0.5629       | 0.3122          | 0.2017     | 0.1626      | 0.2912   | 0.5149    | 0.2351     | 0.1678    | 0.2982 | 0.4329 | 0.4487  | 0.6572           | 0.4481              | 0.3522         | 0.3662          | 0.42         | 0.6379    | 0.4013     | 0.2417    |
| 0.4513        | 84.0  | 8988  | 1.3729          | 0.3063 | 0.6091 | 0.2648 | 0.5598       | 0.3177          | 0.1956     | 0.1648      | 0.2937   | 0.5081    | 0.2414     | 0.1756    | 0.2948 | 0.4367 | 0.4506  | 0.6554           | 0.4709              | 0.3518         | 0.3538          | 0.4209       | 0.6284    | 0.401      | 0.255     |
| 0.4641        | 85.0  | 9095  | 1.3579          | 0.3093 | 0.6129 | 0.2714 | 0.5621       | 0.3127          | 0.2035     | 0.1766      | 0.2917   | 0.5073    | 0.2449     | 0.1837    | 0.2945 | 0.4438 | 0.4545  | 0.6541           | 0.4696              | 0.3643         | 0.3615          | 0.4231       | 0.6304    | 0.4025     | 0.2649    |
| 0.4512        | 86.0  | 9202  | 1.3691          | 0.3074 | 0.6095 | 0.2721 | 0.5558       | 0.3079          | 0.2021     | 0.1694      | 0.3017   | 0.5088    | 0.2398     | 0.1833    | 0.295  | 0.4371 | 0.4512  | 0.65             | 0.457               | 0.3487         | 0.3738          | 0.4267       | 0.6322    | 0.3985     | 0.2531    |
| 0.4474        | 87.0  | 9309  | 1.3729          | 0.3083 | 0.6122 | 0.2697 | 0.5627       | 0.3161          | 0.2016     | 0.1751      | 0.2859   | 0.5032    | 0.2428     | 0.1786    | 0.2968 | 0.4326 | 0.442   | 0.6505           | 0.4532              | 0.3469         | 0.3446          | 0.4151       | 0.6346    | 0.3862     | 0.237     |
| 0.4422        | 88.0  | 9416  | 1.3734          | 0.3111 | 0.6086 | 0.2676 | 0.5594       | 0.3357          | 0.2003     | 0.1722      | 0.2878   | 0.5086    | 0.2475     | 0.1813    | 0.2969 | 0.4368 | 0.4462  | 0.6514           | 0.4734              | 0.3424         | 0.3523          | 0.4116       | 0.6372    | 0.3976     | 0.2391    |
| 0.446         | 89.0  | 9523  | 1.3712          | 0.3085 | 0.6081 | 0.2744 | 0.5605       | 0.3339          | 0.1896     | 0.1713      | 0.2873   | 0.5004    | 0.2447     | 0.1761    | 0.2955 | 0.4358 | 0.4481  | 0.6505           | 0.4835              | 0.3446         | 0.3477          | 0.4142       | 0.6293    | 0.3991     | 0.2441    |
| 0.4424        | 90.0  | 9630  | 1.3704          | 0.3074 | 0.6102 | 0.2807 | 0.5591       | 0.3329          | 0.1979     | 0.1621      | 0.2852   | 0.5178    | 0.2451     | 0.179     | 0.3009 | 0.4391 | 0.4496  | 0.6518           | 0.4785              | 0.3487         | 0.3492          | 0.42         | 0.6428    | 0.4032     | 0.2394    |
| 0.4253        | 91.0  | 9737  | 1.3607          | 0.3109 | 0.6076 | 0.275  | 0.5597       | 0.3338          | 0.2005     | 0.1733      | 0.2871   | 0.508     | 0.2519     | 0.1884    | 0.3003 | 0.4418 | 0.4529  | 0.6495           | 0.4747              | 0.3607         | 0.3662          | 0.4133       | 0.6421    | 0.4024     | 0.2544    |
| 0.4251        | 92.0  | 9844  | 1.3659          | 0.3046 | 0.6052 | 0.2693 | 0.5568       | 0.3272          | 0.1937     | 0.1607      | 0.2847   | 0.4935    | 0.2448     | 0.176     | 0.296  | 0.4377 | 0.4495  | 0.6482           | 0.4785              | 0.3509         | 0.3538          | 0.416        | 0.6267    | 0.4036     | 0.2518    |
| 0.4237        | 93.0  | 9951  | 1.3676          | 0.3125 | 0.6086 | 0.2752 | 0.5596       | 0.3327          | 0.1996     | 0.175       | 0.2957   | 0.5042    | 0.2557     | 0.1803    | 0.2996 | 0.4388 | 0.4527  | 0.6518           | 0.4759              | 0.3598         | 0.3538          | 0.4222       | 0.6285    | 0.4135     | 0.25      |
| 0.4175        | 94.0  | 10058 | 1.3663          | 0.3097 | 0.6062 | 0.2743 | 0.5572       | 0.3296          | 0.1951     | 0.174       | 0.2925   | 0.5068    | 0.2495     | 0.1728    | 0.2955 | 0.4394 | 0.4482  | 0.6486           | 0.4747              | 0.346          | 0.3585          | 0.4133       | 0.6366    | 0.4038     | 0.2461    |
| 0.4248        | 95.0  | 10165 | 1.3646          | 0.3136 | 0.6154 | 0.2802 | 0.5654       | 0.3486          | 0.1987     | 0.1662      | 0.289    | 0.5023    | 0.2511     | 0.1783    | 0.2996 | 0.4447 | 0.4547  | 0.655            | 0.4911              | 0.3482         | 0.36            | 0.4191       | 0.6457    | 0.4057     | 0.255     |
| 0.4212        | 96.0  | 10272 | 1.3659          | 0.312  | 0.616  | 0.2705 | 0.5629       | 0.3432          | 0.1985     | 0.1667      | 0.2885   | 0.5093    | 0.2493     | 0.179     | 0.2968 | 0.4421 | 0.4546  | 0.6505           | 0.4911              | 0.3504         | 0.36            | 0.4209       | 0.6421    | 0.4021     | 0.2628    |
| 0.4052        | 97.0  | 10379 | 1.3720          | 0.311  | 0.617  | 0.276  | 0.5682       | 0.3364          | 0.1976     | 0.1653      | 0.2874   | 0.502     | 0.2513     | 0.1753    | 0.2987 | 0.4404 | 0.4511  | 0.6541           | 0.481               | 0.35           | 0.3523          | 0.4182       | 0.6339    | 0.4083     | 0.2454    |
| 0.408         | 98.0  | 10486 | 1.3707          | 0.3128 | 0.6174 | 0.2723 | 0.5627       | 0.3392          | 0.1993     | 0.1719      | 0.291    | 0.5123    | 0.2549     | 0.1778    | 0.2973 | 0.4406 | 0.4509  | 0.6477           | 0.481               | 0.3509         | 0.3554          | 0.4196       | 0.6325    | 0.408      | 0.2492    |
| 0.4153        | 99.0  | 10593 | 1.3719          | 0.3121 | 0.6158 | 0.2729 | 0.5647       | 0.3407          | 0.1957     | 0.169       | 0.2903   | 0.5058    | 0.2523     | 0.1749    | 0.2959 | 0.4414 | 0.4515  | 0.6518           | 0.4823              | 0.3429         | 0.3615          | 0.4191       | 0.6331    | 0.407      | 0.2539    |
| 0.4156        | 100.0 | 10700 | 1.3721          | 0.3104 | 0.6106 | 0.2705 | 0.5609       | 0.3402          | 0.1979     | 0.1636      | 0.2893   | 0.5049    | 0.2484     | 0.1755    | 0.2951 | 0.4381 | 0.4488  | 0.6473           | 0.4785              | 0.3424         | 0.3569          | 0.4187       | 0.6319    | 0.3997     | 0.2478    |


### Framework versions

- Transformers 4.41.0.dev0
- Pytorch 1.13.0+cu117
- Datasets 2.18.0
- Tokenizers 0.19.0