AWS: P-EAGLE Parallel Speculative Decoding Accelerates Inference Up to 3.97×
AWS introduced P-EAGLE, a parallel speculative decoding method that predicts all speculative tokens in a single model pass. On Qwen3-Coder-30B-A3B and NVIDIA B200 in FP8, P-EAGLE achieves 1,167 tokens per second versus 955 for EAGLE-3 (+22%), and up to 3.97× faster than baseline inference on HumanEval. Pre-trained P-EAGLE heads are available for GPT-OSS-120B, GPT-OSS-20B, Qwen3-Coder-30B-A3B, and Gemma-4-31B on Amazon SageMaker AI.