[D] Phi-3 to be released soon

Heard from two independent sources at MSFT (one close to Sebastien Bubeck) about the upcoming Phi-3 models:

* Three different sized models (up to 14B)
* Again, mostly synthetic and LLM-augmented training data
* Apparently some upscaling techniques on the training side
* No more Apache 2 but more restrictive license (similar to llama3)
* Mixtral level performance with much fewer parameters

I wanted to see if anyone has more insider information about the models.

apache data independent license llama3 llm machinelearning msft phi restrictive synthetic training training data upscaling