Open Source Implementations of ChatGPT Training Algorithm Released

AI research groups LAION and CarperAI and independent AI developer Phil Wang have all released open source implementations of the algorithm used to train ChatGPT, reports Anthony Alford. 

And, according to HuggingFace CTO Julien Chaumond on Twitter, in six months there will be "10 open reproductions of ChatGPT,” Alford says. 

LAION’s project is OpenAssistant, which is a “chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so,” according to the GitHub page. CarperAI is working on trlX, “a library made for training large language models using reinforcement learning.”

Alford notes that, although these projects “include implementations of ChatGPT's training methods, they do not have any trained models currently available.” 

Read more at InfoQ.

Ready to find a job? Check out the latest job listings at Open Source JobHub.

FOSSlife Newsetter





Contact FOSSlife to learn about partnership and sponsorship opportunities.