AWS: Fine-Tuning FLOPs Meter for SageMaker automates EU AI Act compliance threshold tracking

Amazon Web Services released the Fine-Tuning FLOPs Meter on May 12, 2026 — an open toolkit for Amazon SageMaker AI that automates tracking of European AI Act compute thresholds during fine-tuning of large language models. The tool is activated with a single configuration flag in the recipe YAML and records all necessary metrics for audit documentation.

Which thresholds does the EU AI Act apply?

The toolkit implements three thresholds through the determine_compliance_threshold() function. The default 3.3×10²² FLOPs applies when pretraining compute is unknown or below 10²³ FLOPs. The relative threshold of 30% of actual pretraining compute activates when pretraining is documented above 10²³ FLOPs. The Systemic Risk threshold of 3.3×10²⁴ FLOPs applies to models with pretraining compute above 10²⁵ FLOPs — the highest obligation category in the Act.

What does exceeding the threshold mean for an organization?

An organization that exceeds its applicable threshold transitions from “downstream user” to “GPAI model provider” status. The new classification creates additional obligations: detailed disclosure of architecture and training process, a public list of data sources used, and proof of compliance with EU copyright regulations. AWS emphasizes that a status change is the biggest compliance shift a fine-tuning organization can undergo.

How does the Meter integrate with SageMaker?

Activation is a single YAML flag: compute_flops: true in the SageMaker training recipe. The toolkit operates as a standard Hugging Face TrainerCallback, meaning it integrates into an existing SageMaker Training pipeline without architectural changes. Results are automatically uploaded to Amazon S3 and stored in DynamoDB as a permanent compliance record.

The output flops_meter.json contains architecture-based and hardware-based FLOPs calculations, the applied threshold type and compliance status, model parameters, training duration, GPU specifications, and training job identifiers for audit trail linkage. AWS recommends Flops_architecture as the primary compliance metric because it “accurately reflects your actual training configuration.”

The tool is part of AWS’s broader decision to raise regulatory obligations from the level of consulting advice to the level of cloud platform — turning compliance from a manual project into a feature toggle.