Concept card

Audio and Speech Foundation Models in SAP Workflows

As of 2026-07-24T14:00:00Z

Edited by Cédric-Olivier Mâry, sole editor and publication director — 27 years in the SAP ecosystem. How these pages are produced, and where automation is used.

What is Audio and Speech Foundation Models in SAP Workflows?

Whisper-based transcription cuts SAP Concur expense-note submission time from 4.2 to 1.1 minutes per line item by turning voice notes that were previously invisible to SAP analytics into structured fields.

Audio and speech foundation models convert spoken language into structured text—automatic speech recognition, or ASR—and increasingly perform semantic tasks directly on the audio signal itself, such as speaker diarisation, emotion detection, and language identification. The model that defines this category is Whisper, released by OpenAI in 2022: a transformer sequence-to-sequence model trained on 680,000 hours of multilingual audio, achieving word-error rates competitive with commercial ASR APIs at essentially zero marginal cost once self-hosted. The SAP pain point Whisper addresses is structural: audio generated by field technicians, call-centre agents, expense-report narration, and meeting recordings is invisible to SAP analytics for one simple reason—it lives in MP3 or WAV files, not in table fields, and nothing in a standard S/4HANA landscape can query an audio waveform.

Four recurring integration patterns

Why it matters

Whisper is trained on 680,000 hours of multilingual audio and matches commercial ASR APIs at zero marginal cost once self-hosted.
Call-centre QA diarises and scores every call against a compliance checklist, feeding structured scores into a CRM case field and an SAC dashboard.
Field-service voice notes get transcribed and entity-extracted to pre-fill S/4HANA PM notifications, removing manual data entry for technicians.

Key points

Whisper large-v3: trained on 680k hours multilingual audio, open-source, runs 50× realtime on A10G GPU.
No native diarisation — chain pyannote.audio for speaker separation in call-centre QA use cases.
SAP Concur expense narration: 4.2 min → 1.1 min per line item in enterprise pilots.
Streaming latency: 300-800 ms additional buffering vs batch — avoid for real-time IVR.
SAP Meeting Insights (GA H1 2025) is the SAP-native wrapper for meeting transcription + structured output.
Audio and Speech Foundation Models in SAP Workflows is mastered only when it changes a named buyer decision.
Start with the semantic contract and control model before demonstrating the tool.
Use current SAP, analyst, study, KG, and news signals as evidence, not decoration.
Separate verified facts from directional trends and modeled assumptions.
Define owner, metric, threshold, support path, and rollback before scaling.

Terms used on this page

Whisper: OpenAI 2022 sequence-to-sequence ASR model. Trained on 680,000 hours of multilingual audio. Available as open-source weights (small/medium/large-v3). No native diarisation.
WER: Word Error Rate — the standard ASR accuracy metric. WER = (substitutions + deletions + insertions) / reference word count. Whisper large-v3 achieves ~2.7 % WER on English LibriSpeech clean.
Diarisation: Separating audio by speaker identity — 'who spoke when'. Whisper does not include this natively; pyannote.audio is the standard companion library.
SAP Meeting Insights: SAP BTP service (GA H1 2025) that transcribes, summarises and extracts action items from meeting recordings, writing structured output to linked SAP collaboration records.
Decision owner: The accountable person who accepts the trade-off and funds the next action.
Semantic contract: The shared definition of business terms, metrics, entities, and access rules used by tools and teams.
Control plane: The layer that applies policy, access, lineage, monitoring, and escalation across the operating model.
Evidence grade: A label that separates verified fact, directional signal, modeled assumption, and field observation.

Sources

Full card available to members. What the full card adds: the full decision framework · the SAP vs Snowflake / Databricks / Fabric comparison · the common pitfalls and their fix · the cheat sheet · the architecture schemas · the code blocks · the facts worth quoting.

Open in the app →