10^7-Dimensional LLM Memory, but Only If it Stays Sparse
A BDH seminar summary circulating in recent technical discussion frames LLM memory as a tradeoff between the familiar transformer KV…
spiking neural network
A type of artificial neural network that processes information through discrete spike events over time, often used to model brain-like computation.