Experiments / Detail
Run #2 test1
Status
Completed
Loss: 0.89150
Hyperparameters
Input Dimension
768
Expansion Factor
4x
Latent Dimension
3072
K-Sparsity
32
Alpha Aux
0.03
Learning Rate
0.0001
Epochs
20
Training Log
20 steps| Epoch | Loss Value | Timestamp |
|---|---|---|
| #1 |
1.03797
|
|
| #2 |
1.02986
|
|
| #3 |
1.02257
|
|
| #4 |
1.01569
|
|
| #5 |
1.00905
|
|
| #6 |
1.00265
|
|
| #7 |
0.99626
|
|
| #8 |
0.98982
|
|
| #9 |
0.98327
|
|
| #10 |
0.97655
|
|
| #11 |
0.96964
|
|
| #12 |
0.96249
|
|
| #13 |
0.95487
|
|
| #14 |
0.94704
|
|
| #15 |
0.93874
|
|
| #16 |
0.93007
|
|
| #17 |
0.92100
|
|
| #18 |
0.91165
|
|
| #19 |
0.90171
|
|
| #20 |
0.89150
|