AI Reasoning: New Method by Apple, Google

Apple's new contextual understanding benchmark (February 2024) provide new insight into AI reasoning. Especially the ICL (in-context learning prompt) from retrieved and augmented data, and their non-performance on low-complexity pre-trained LLMs. I build upon Apple's insights to discuss a new complexity class of synthetic pre-training data sets for better pre-trained LLMs.

Q: is the core of AI reasoning build upon the pre-trained LLM and what can a coherent-complexity-class fine-tuned dataset for the SFT achieve? Strong indications that AI reasoning is …

ai reasoning apple augmented data benchmark build class complexity context data data sets discuss google in-context learning insight insights llms low performance pre-training prompt reasoning synthetic training training data understanding