parameter-golf

Parameter Golf challenge - minimizing bits-per-byte on language modeling with severe parameter budgets. Techniques include quantization (GPTQ), EMA, sliding window eval, BigramHash tokenization, and novel architectures.