NanoChat – The best ChatGPT that $100 can buy

NanoChat is a ChatGPT implementation available for $100, designed to run on a single 8XH100 node using a script that handles the entire pipeline from tokenization to web serving. The project aims to provide a ChatGPT-like experience with minimal dependencies. Different tiers of models are discussed, with the $100 tier being the most accessible. Instructions are provided for running the model and interacting with it via a web UI. The article also touches on larger models that require more resources and adjustments to the training script. Contributions to the project are encouraged to enhance micro models' accessibility and performance.