Backtesting vs cross validation model results (I really need help)

I am working building a classification model. I have built a model and baselined it with pycaret and the results looked promising given the limited 7 months of data. Around 0.7 MCC and auc 0.92-94.

I started building an actual model and the results were ok on cross-validation in general for model performance. However as I move into model backtesting the situation changes the model performs slightly better than random probability. MCC and Kappa 0.2 and auc of 0.6.

I …

auc backtesting building classification classification model data datascience general pycaret validation