Ok for some ungodly reason, https://huggingface.co/CalderaAI/13B-Legerdemain-L2 is in fp32... who even uses fp32 anyways?
but I went through the trouble to convert to a much more sensible fp16 so people can.. actually use it!
Ok for some ungodly reason, https://huggingface.co/CalderaAI/13B-Legerdemain-L2 is in fp32... who even uses fp32 anyways?
but I went through the trouble to convert to a much more sensible fp16 so people can.. actually use it!