INT4 LoRA fantastic-tuning vs QLoRA: A user inquired about the distinctions amongst INT4 LoRA fantastic-tuning and QLoRA in terms of accuracy and speed. An additional member explained that QLoRA with HQQ includes frozen quantized weights, isn't going to use tinnygemm, and utilizes dequantizing along with torch.matmulNightly MAX repo lags behind Moj