I did some model hacks, and got GLM5.2 from about 2.5 tok/s to >50 tok/s on my GH200 system.

The author successfully modified the GLM-5.2 model to achieve significant performance improvements, increasing throughput from approximately 2.5 tokens/second to over 55 tokens/second on a custom GH200 system equipped with dual Hopper H100 GPUs and dual Grace CPUs. The optimization involved merging the MTP head from zai's GLM-5.2-FP8 repository with CyanKiwi's AWQ quantized version, requiring specific adjustments to the vLLM framework. This achievement highlights the potential for practitioners to enhance model performance through architectural tweaks and custom configurations, particularly in high-performance computing environments.