Dec. 2, 2023, 3:05 p.m. | /u/joshjson

Machine Learning

I'm making an implementation of the softmax regression and I'm struggling to understand the nature behind the problem of increasing value of Cross-Entropy **\[1\]**, along with an increasing accuracy (on the "iris" dataset):

This is utmost confusing to me, because there's no class imbalance:

I am not entirely sure whether the **sample size** of N = 112 is at fault. I will appreciate any help on the matter. Thank you in advance.


accuracy cross-entropy dataset entropy implementation machinelearning making nature regression sample softmax value

Data Scientist (m/f/x/d)

@ Symanto Research GmbH & Co. KG | Spain, Germany

Data Analyst


EY GDS Internship Program - Junior Data Visualization Engineer (June - July 2024)

@ EY | Wrocław, DS, PL, 50-086

Staff Data Scientist

@ ServiceTitan | INT Armenia Yerevan

Master thesis on deterministic AI inference on-board Telecom Satellites

@ Airbus | Taufkirchen / Ottobrunn

Lead Data Scientist

@ Picket | Seattle, WA