BitTransformerLM
Binary transformer architecture
A novel binary transformer for low-resource settings using 9-bit encoding (8 data + 1 parity). Features a reversible architecture enabling exact gradient computation, and built-in safety telemetry for alignment research.