Dec. 2, 2023, 3:05 p.m. | /u/joshjson

Machine Learning www.reddit.com

I'm making an implementation of the softmax regression and I'm struggling to understand the nature behind the problem of increasing value of Cross-Entropy **\[1\]**, along with an increasing accuracy (on the "iris" dataset):

https://preview.redd.it/eo3654zwbw3c1.png?width=688&format=png&auto=webp&s=52916d56029e6e8aa1e9594bbcb02c7075009206

This is utmost confusing to me, because there's no class imbalance:

https://preview.redd.it/rqs7i6jybw3c1.png?width=389&format=png&auto=webp&s=6ca668f1cc70aae7a125a6b9c48c511eadc6d562

I am not entirely sure whether the **sample size** of N = 112 is at fault. I will appreciate any help on the matter. Thank you in advance.



[\[1\]](https://preview.redd.it/ezuc2at8cw3c1.png?width=378&format=png&auto=webp&s=aadd5bd86fc39dd1d82690c018b70131021c0751)

accuracy cross-entropy dataset entropy implementation machinelearning making nature regression sample softmax value

Founding AI Engineer, Agents

@ Occam AI | New York

AI Engineer Intern, Agents

@ Occam AI | US

AI Research Scientist

@ Vara | Berlin, Germany and Remote

Data Architect

@ University of Texas at Austin | Austin, TX

Data ETL Engineer

@ University of Texas at Austin | Austin, TX

Lead GNSS Data Scientist

@ Lurra Systems | Melbourne