Dec. 2, 2023, 3:05 p.m. | /u/joshjson

Machine Learning www.reddit.com

I'm making an implementation of the softmax regression and I'm struggling to understand the nature behind the problem of increasing value of Cross-Entropy **\[1\]**, along with an increasing accuracy (on the "iris" dataset):

https://preview.redd.it/eo3654zwbw3c1.png?width=688&format=png&auto=webp&s=52916d56029e6e8aa1e9594bbcb02c7075009206

This is utmost confusing to me, because there's no class imbalance:

https://preview.redd.it/rqs7i6jybw3c1.png?width=389&format=png&auto=webp&s=6ca668f1cc70aae7a125a6b9c48c511eadc6d562

I am not entirely sure whether the **sample size** of N = 112 is at fault. I will appreciate any help on the matter. Thank you in advance.



[\[1\]](https://preview.redd.it/ezuc2at8cw3c1.png?width=378&format=png&auto=webp&s=aadd5bd86fc39dd1d82690c018b70131021c0751)

accuracy cross-entropy dataset entropy implementation machinelearning making nature regression sample softmax value

Data Scientist (m/f/x/d)

@ Symanto Research GmbH & Co. KG | Spain, Germany

Data Analyst

@ S&P Global | IN - HYDERABAD SKYVIEW

EY GDS Internship Program - Junior Data Visualization Engineer (June - July 2024)

@ EY | Wrocław, DS, PL, 50-086

Staff Data Scientist

@ ServiceTitan | INT Armenia Yerevan

Master thesis on deterministic AI inference on-board Telecom Satellites

@ Airbus | Taufkirchen / Ottobrunn

Lead Data Scientist

@ Picket | Seattle, WA