OPEN SOURCE, OPEN TO EVERYONE

Open source. Open possibilities.

Discover quality open-source projects, submit projects anonymously, and claim and edit your own project.

✳Human-curated · Discover open source4102discovered

A little curiosity. A world of open source.

THE FIRST COLLECTION

Topic: finetuning清除

ADDED

A tiny GPT language model (~540M parameters) designed to be trained from scratch on consumer laptop hardware, with pretraining on Fineweb-edu and chat finetuning capabilities.

AI & MLTraining & evaluation

☆ 9Python

♡↗

llms-from-scratchrasbt

ADDED

Official code repository for 'Build a Large Language Model (From Scratch)': step-by-step PyTorch implementation of GPT-like models, covering pretraining and finetuning with notebooks and exercises.

AI & MLTraining & evaluation

☆ 105.0kJupyter Notebook

♡↗