About this project

CPU-SLM is a Rust-based project designed to help users understand and explore Sparse Language Models (SLM) and Large Language Models (LLM) through efficient CPU-only inference. It leverages AVX2 instruction sets for faster performance and supports Windows, Linux, and macOS. The application provides a user-friendly interface, cross-platform compatibility, and includes learning resources about AVX2, Transformers, and SIMD. Installation involves downloading a ZIP file, extracting it, and running the executable. System requirements include AVX2-capable CPU, 4 GB RAM, and 100 MB disk space. Troubleshooting tips and support via GitHub issues are provided.