BitNet.cpp sounds promising, but it needs to support a lot more open source LLMs to gain wider adoption, hope its developers make that a priority.