The kind of specs that would enable local LLM usage were available on laptops since 2020. The floor for acceptable performance for LLMs stopped literally just before 24+gb of VRAM would have become pretty common in consumer applications. The reason this technology isn’t more ubiquitously available is because ‘they’ thought it would be more profitable to hoover up literally every byte of RAM and GPU in the world rather than let the technology continue to naturally evolve to a place where any consumer could have run useful models on their home computers. In other words, your anger is misplaced.
Probably Qwen Flash. Supposedly the 27b is nearly to capacity when it comes to training potential, while the Flash has still quite undercooked. Despite this, Flash is pretty dang good at understanding my goals and implementing my will, most of the time.
The kind of specs that would enable local LLM usage were available on laptops since 2020. The floor for acceptable performance for LLMs stopped literally just before 24+gb of VRAM would have become pretty common in consumer applications. The reason this technology isn’t more ubiquitously available is because ‘they’ thought it would be more profitable to hoover up literally every byte of RAM and GPU in the world rather than let the technology continue to naturally evolve to a place where any consumer could have run useful models on their home computers. In other words, your anger is misplaced.
Yeah the cross over point right now sis somewhere between qwen3.8 27b and glm 5.2/5.3
Like qwen is so close to being good.
Probably Qwen Flash. Supposedly the 27b is nearly to capacity when it comes to training potential, while the Flash has still quite undercooked. Despite this, Flash is pretty dang good at understanding my goals and implementing my will, most of the time.
What’s your assumption about where my anger is directed?