Teaching LLMs to be more reasonable

Based on a bit of research and a lot of gut feeling, I offer the following speculation:

* if you self-trained an LLM with a Python interpreter or Java compiler in a feedback loop where it learned from its own mistakes then it could become dramatically better at coding. It's actually a miracle that they are "decent" at coding despite getting virtually no feedback from an interpreter or compiler.
* one could train not merely on input and output, but …

artificial become coding compiler feedback java llm llms loop mistakes python research speculation teaching