Unsuperivsed Mixup

• MNIST 0-7 binary cross entropy
• Test with data mixture
• Equal Accuracy as metric

baseline

Epoch=46: crput=0 test-loss=0.00 test-acc=1.00 Epoch=46: crput=1 test-loss=0.65 test-acc=0.87 Epoch=46: crput=2 test-loss=1.61 test-acc=0.76 Epoch=46: crput=3 test-loss=2.56 test-acc=0.66

data aug

Epoch=46: crput=0 test-loss=0.03 test-acc=0.99 Epoch=46: crput=1 test-loss=0.07 test-acc=0.98 Epoch=46: crput=2 test-loss=0.23 test-acc=0.92 Epoch=46: crput=3 test-loss=0.53 test-acc=0.83

mix-up

Epoch=46: crput=0 test-loss=0.01 test-acc=1.00 Epoch=46: crput=1 test-loss=0.20 test-acc=0.97 Epoch=46: crput=2 test-loss=0.58 test-acc=0.91 Epoch=46: crput=3 test-loss=0.85 test-acc=0.86

unsupervised mix-up

Epoch=46: crput=0 test-loss=0.07 test-acc=0.99 Epoch=46: crput=1 test-loss=0.29 test-acc=0.96 Epoch=46: crput=2 test-loss=0.71 test-acc=0.90 Epoch=46: crput=3 test-loss=0.91 test-acc=0.85

prob weighted addition

Epoch=46: crput=0 test-loss=0.25 test-acc=1.00 Epoch=46: crput=1 test-loss=0.45 test-acc=0.97 Epoch=46: crput=2 test-loss=0.80 test-acc=0.91 Epoch=46: crput=3 test-loss=0.76 test-acc=0.87

linear logit linear addition

Epoch=46: crput=0 test-loss=0.15 test-acc=0.97 Epoch=46: crput=1 test-loss=0.38 test-acc=0.89 Epoch=46: crput=2 test-loss=0.84 test-acc=0.83 Epoch=46: crput=3 test-loss=1.64 test-acc=0.79