[D] Quality Ranking of LLM Training Data

Is anyone out there working on training models with data that is qualitatively ranked, and dynamically adjusting the learning rate / weight decay based on the quality of each individual training input?

It occurred to me today that one can reasonably expect training data quality to vary drastically, and one might want to bias or debias training against certain kinds of inputs. One could conceivably assess a 'quality score' against each individual training input, and dynamically modify the learning rate …

adjusting bias data data quality llm machinelearning quality ranking rate training training data