low-rank decomposition

SoLA tries to shrink an LLM without cutting its nerves

SoLA is interesting because it does not promise another smaller model trained from scratch, but tries to compress an existing LLM without extra training or special hardware.