RedPajama replicates LLaMA dataset to build open source, state-of-the-art LLMs

RedPajama is a new project to create leading, fully open-source large language models, beginning with yesterday’s release of a 1.2 trillion token dataset that follows the LLaMA recipe.
RedPajama is a new project to create leading, fully open-source large language models, beginning with yesterday’s release of a 1.2 trillion token dataset that follows the LLaMA recipe.Read More