A tiny GPT language model (~540M parameters) designed to be trained from scratch on consumer laptop hardware, with pretraining on Fineweb-edu and chat finetuning capabilities.
OPEN SOURCE, OPEN TO EVERYONE
Open source. Open possibilities.
Discover quality open-source projects, submit projects anonymously, and claim and edit your own project.
✳Human-curated · Discover open source4102discovered
A little curiosity. A world of open source.
THE FIRST COLLECTIONTopic: from-scratch清除
planckgptnguyenphuminh
ADDEDai-engineering-from-scratchrohitg00
ADDEDFree, open-source AI engineering curriculum from first principles: 523 lessons in 20 phases (~342 hours), with math-to-production coverage in Python, TypeScript, Rust, and Julia. Every lesson ships a reusable prompt, skill, agent, or MCP server; includes an installable AI tutor and Claude certification prep.
llms-from-scratchrasbt
ADDEDOfficial code repository for 'Build a Large Language Model (From Scratch)': step-by-step PyTorch implementation of GPT-like models, covering pretraining and finetuning with notebooks and exercises.