TX · Utils
Utilities
Small interactive tools I've generated for my own use.
ls /tx/utils/
-
Transformer GPU Memory Calculator
Estimate parameter count and weight memory for a GPT-style decoder-only transformer. Pick a historical preset or dial in layers, hidden size, precision, and GQA.
model.size() -
LLM Training Data Calculator
If your model has N parameters, how much text does it need? Quick estimates using Chinchilla-optimal and legacy GPT-2 era scaling ratios.
data.tokens(N) -
Model Training Accelerator Reference
Peak memory and FLOPs for an RTX 3070 vs. Google Colab accelerators, with relative speed vs. the local baseline.
accel.ref()