Kylie Robison / The Verge:

During his NeurIPS talk, Ilya Sutskever says “Pre-training as we know it will end”, as “we’ve achieved peak data and there’ll be no more”  —  OpenAI’s cofounder and former chief scientist, Ilya Sutskever, made headlines earlier this year after he left start …