About this project
JouleWise provides a governed framework for measuring the energy consumption of LLM inference phases. It implements a strict evidence-based pipeline where measurement sessions (windows) are recorded into immutable run bundles containing normalized configurations, event logs, and raw power traces.
Key capabilities include:
- A runnable harness with a CLI for executing runs, validating bundles, reducing raw data to summary metrics, and generating static HTML reports.
- Support for multiple telemetry adapters, including MLX runtime with powermetrics for Apple Silicon and a vLLM-based stack for NVIDIA GPUs.
- Strict validation tools (`validate-bundle`) to ensure the integrity of recorded evidence and provenance.
- A typed configuration system with JSON-Schema export and validation.
- Support for both gross measured energy and idle-subtracted energy views to allow for cross-device and cross-configuration comparisons.
Comments
0 Rating appears after 10 ratings
Sign in to join the discussion.