The open-access, open-science, open-governance 15 billion parameter StarCoder LLM makes generative AI more transparent and accessible to enable responsible innovation at scale.
ServiceNow has released a strongest-performing open-access large language model (LLM) for code generation. It is led by ServiceNow Research and Hugging Face. The 15 billion parameter StarCoder LLM makes generative AI more transparent and accessible to enable responsible innovation at scale.
The StarCoder model is designed to level the playing field so developers from organizations of all sizes can harness the power of generative AI and maximize the business impact of automation with the proper governance, safety, and compliance protocols. This new LLM marks the next major milestone in the BigCode Project, an ambitious initiative to develop state-of-the-art AI systems for code in an open and responsible manner with the support of the open-scientific AI research community.
“ServiceNow’s collaboration with Hugging Face expands our longstanding commitment to AI excellence. New, responsible AI practices to train and share large language models are vital to ensuring the right protocols, safeguards, and permissive licenses are in place for our customers, and StarCoder is making this possible,” said Harm de Vries, lead of the LLM Lab, ServiceNow Research and co-lead, BigCode.
“The joint efforts led by Hugging Face and ServiceNow enable the release of powerful base models that empower the community to build a wide range of applications more efficiently than a single company could come up with,” said Leandro von Werra, machine learning engineer at Hugging Face and co-lead of BigCode.
ServiceNow Research and Hugging Face, which works on some of the world’s largest AI and LLM initiatives, launched the joint BigCode Project in September 2022. The project continues to operate as an open scientific collaboration, as the two companies harness the collective brainpower and resources from the open-source community through BigCode working groups, task forces, and meetups.
Through partnerships with leading research organizations like Hugging Face, ServiceNow is fueling the development of state-of-the-art generative AI with socially responsible contributions back to the AI research and development community. This includes the company’s partnership with Mila, the Quebec AI Institute, to bridge the demands of advanced AI research.