Going bigger will not work indefinitely

OpenAI CEO, Sam Altman, says further progress will not come from making LLMs bigger. “I think we’re at the end of the era where it’s going to be these, like, giant, giant models,” he told an audience at an event held at MIT late last week. “We’ll make them better in other ways.” Altman’s declaration suggests an unexpected twist in the race to develop and deploy new AI algorithms. Link