How small can Small Language Models (SLMs) get before they stop being useful?

This is a critical question for edge AI. Currently, even small models waste valuable space memorising an extensive, if lossy, "offline Wikipedia" of facts. Is this embedded knowledge an asset, or just bloat?

I believe we must …

more ...