In an interview, Ilya from OpenAI mentions that many areas of research are understanding constrained. Understanding what the NN is doing and why. Are there any published open examples of NNs along with open questions about what it's doing and why, th

"I would say it's a combination. Coming up with whole new ideas is a modest part of the work. Certainly coming up with new ideas is important but even more important is to understand the results, to understand the existing ideas, to understand what's going on.

​

A neural net is a very complicated system, right? And you ran it, and you get some behavior, which is hard to understand. What's going on? Understanding the results, figuring out what next …

combination examples ideas ilya interview neural net neuralnetworks nns openai part questions research understanding work