GitHub Trending

KellerJordan/modded-nanogpt — Star KellerJordan / modded-nanogpt

29 sec read8 views0 listens

4,646 stars | 630 forks | Python

Star

    KellerJordan /

  modded-nanogpt  


  NanoGPT (124M) in 2 minutes

What it does

Modded-NanoGPT is an optimized implementation of NanoGPT that dramatically reduces training time for language models using advanced techniques. It achieves a target cross-entropy loss of 3.28 on the FineWeb dataset in under 90 seconds with 8 NVIDIA H100 GPUs.

Why it matters: Discover how Modded-NanoGPT is revolutionizing language model training speed with cutting-edge techniques!

View on GitHub

Want to create content about this repo? Use Nemati AI tools to generate articles, tutorials, and social posts.

You Might Like

GitHub Trending2 days ago31 sec read

marin-community/marin — Open-source framework for the research and development of foundation models.

1,898 stars | 184 forks | Python Open-source framework for the research and development of foundation models. What it does Marin is an open-source framework for developing foundation models, focusing on training large language and multimodal models w...

Ali Nemati

GitHub Trending3 days ago45 sec read

AgriciDaniel/claude-obsidian — Self-organizing AI second brain for Obsidian + Claude Code. Drop any source and

11,454 stars | 1,311 forks | Python Self-organizing AI second brain for Obsidian + Claude Code. Drop any source and Claude reads, links, and files it into one connected knowledge graph of plain Markdown you own. AI note-taking, personal knowledge man...

Ali Nemati

GitHub Trending3 days ago41 sec read

MadsLorentzen/ai-job-search — The job search that runs on your machine. AI job application framework built on

33,380 stars | 11,730 forks | Python The job search that runs on your machine. AI job application framework built on Claude Code: evaluate postings, tailor CVs, write cover letters, prep interviews. Fork it and own it. What it does AI Job Search is a...

Ali Nemati