Posted inLocal LLMs
Qwen3.6-27B on RTX 3090: tested 12 GGUF quants across HumanEval+, MBPP+, perplexity, throughput and needle-in-haystack. First-timer results.
Comprehensive Benchmarking of Qwen 3.6-27B GGUF Quantizations on RTX 3090: An Initial Exploration Introduction As a newcomer to local Large Language Models (LLMs), I embarked on an exploratory benchmarking journey…
