SAP Generative AI Hub

What it is — and what it is not

SAP documents the generative AI hub as "a capability of SAP AI Core and SAP AI Launchpad that enables access to and orchestration of generative AI models within a governed, enterprise-ready runtime environment". It "doesn't replace SAP AI Core; it extends it": model execution, resource management, quotas and billing all remain AI Core mechanics (C026). It is available only on the AI Core extended plan; a 30-day trial exists for exploration. SAP's marketing pages call it SAP Generative AI Hub; the name "SAP AI Hub" used on earlier versions of this card is not an SAP product, and SAP documents no Development → Staging → Production promotion gate, EU AI Act model cards or automatic drift alerts in the hub. What it does provide is concrete and worth learning in detail.

Why it matters

• Without the extended plan there is no generative AI hub — the plan decision precedes every GenAI design decision.
• Model versions deprecate on fixed dates: a pinned deployment stops working, a ‘latest’ deployment changes behaviour — both need an owner.
• Orchestration v1 is decommissioned on 31 October 2026; any integration still calling /completion breaks that day.

Key points

• Capability of SAP AI Core + SAP AI Launchpad, extended plan only; 30-day trial for exploration. ‘SAP AI Hub’ is not an SAP product name.
• Two global scenarios: foundation-models (one deployment per model/version) and orchestration (one deployment, harmonized OpenAI-style API).
• Model catalogue of record = SAP Note 3437766 + discovery endpoint /v2/lm/scenarios/foundation-models/models.
• Model lifecycle: pinned versions stop on their deprecation date; ‘latest’ auto-upgrades.
• Orchestration v2 modules: prompt_templating (mandatory) + optional grounding, filtering, masking, translation; SAP fixes the execution order.
• Fallbacks switch configuration on regional unavailability, 408, 429 or 5xx (non-streaming); model allow/deny lists per deployment.
• AI Launchpad: Model Library (catalog, leaderboard, model cards), chat and prompt editor, orchestration builder, Grounding Management, Optimizations; roles genai_* and grounding_*.
• Ops: RPM rate limits per model/tenant (429 + Retry-After), quota-management API, batch consumption, opt-in inference observability.

Terms used on this page

Generative AI hub

Capability of SAP AI Core and SAP AI Launchpad for governed access to and orchestration of generative AI models; extended plan only.

Harmonized API

Orchestration interface that uses the OpenAI API as the standard and maps other providers' messages, parameters and responses to it.

Orchestration config

JSON description of the modules of an orchestration call; can be inline or stored and versioned in the prompt registry.

Fallback configuration

Ordered list of module configurations; orchestration moves to the next on regional unavailability or 408/429/5xx errors.

Model restriction

Allow or deny list (modelFilterList, modelFilterListType) set on an orchestration deployment to enforce approved models.

Model Library

AI Launchpad app with catalog, leaderboard and chart modes and a model card per model.

Inference observability

Opt-in storage of inference payloads, metadata, labels and feedback, triggered by request headers.

Batch consumption

Asynchronous processing of a file of LLM requests at reduced cost, with results written to an object store.

Sources

1. SAP AI Core — Generative AI Hub (SAP-docs)
2. SAP AI Core — Orchestration (SAP-docs)
3. SAP AI Core — Orchestration Workflow V2 (SAP-docs)
4. SAP AI Core — Orchestration with Fallbacks (SAP-docs)
5. SAP AI Core — Model Lifecycle (SAP-docs)
6. SAP AI Core — Rate Limit Management (SAP-docs)
7. SAP AI Launchpad — Model Library (SAP-docs)
8. SAP AI Core service guide incl. What's New (PDF, 4 Sep 2026)
9. SAP Cloud SDK for AI — orchestration chat completion (JS)
10. SAP Community — Passed SAP Generative AI Developer (C_AIG_2604) (16 Sep 2026)
11. SAP Help — Generative AI hub overview
12. SAP Help — Metering and pricing for generative AI (SAP AI Core service guide)
13. SAP Community — SAP-RPT-1.6, Tabular Orchestration and RPT Playground API now available (2026-09)
14. SAP News Center — TabPFN-3.5 Plus now available in SAP AI Core (2026-09-15)