Large Language Models
768GB Optane RAM Runs 1 Trillion Param LLM: A Cheap Hack
Forget pristine server racks. Someone just crammed a trillion-parameter LLM into a humble PC using bargain-bin Optane memory. The speed? Barely a crawl, but who's complaining?