A independent contribution was pointed out the place a user made a fused GEMM for int4, which happens to be powerful for training with set sequence lengths, giving the fastest Alternative.