A recently leaked Google document contains “We Have No Moat, And Neither Does OpenAI”. This is quite a big claim against OpenAI, the mastermind behind society’s enchanting creative LLM, ChatGPT. The document is mostly referring to the significant rise of boutique indie open source model developers and tweakers who took a leap frog towards deploying models that are fractionally less effective than renowned LLMs but have significantly less computational cost. Even OpenAI CEO Sam Altman acknowledged that the era of large language models is over. In this paper, some of the open-source language models that are posing significant challenges to LLMs will be analyzed. The analysis will look at the underlying technology, results of these models and answer questions like what these open source models are doing differently to challenge the norms and why they have fewer computational requirements.

This entry is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license.