LLM Token Service Performance Monitoring Report 2026
大模型词元服务性能监测报告（2026年）
English summary
Independent monitoring of 30+ platforms and 100+ models, Jan-Aug 2026: domestic avg TPS 78.23 in Aug (2025 avg 38.25) vs foreign 112.82; latency rising; domestic normalised price up from 6.8 RMB (H2 2025) to 13.46 RMB in 2026 (foreign about 117.8); 47.8% of models at 1M context; same open model varies widely across third-party hosts; official-platform success rate 99.18% (Aug). Daily tokens about 500T in June 2026 (4x Dec 2025).
Read the original on ithome.com
Chinese·Web page·opens ithome.com
- Tags
- Lane a, Inference cost