AI & Analytics Legends The knowledge platform for SAP Analytics
Concept card

BARC — Benchmark: How fast is your BI platform, really?

BARC — Benchmark: How fast is your BI platform, really? — Analytics Legends section illustration for the SAP Analytics knowledge base (concepts, studies, Academy)

As of 2026-10-06

What is BARC?

The four dimensions that separate enterprise BI platforms — query latency, rendering, concurrency at 10-500 users, and 10M-1B row scaling — are what fail on a laptop demo but decide the RFP.

What it is

BARC's 'Benchmark — How fast is your BI platform, really?' is a lab-style performance study comparing BI platforms on representative enterprise workloads. The URL slug references Qlik and Power BI as the primary subjects, which is instructive: the benchmark is designed to address the Qlik vs. Power BI vs. the field performance debate that dominates large-enterprise BI evaluations.

The benchmark methodology covers four dimensions: query latency (time to first row under defined data volumes), dashboard rendering time (full-screen time-to-interactive under concurrent user load), concurrency behaviour (how latency degrades as simultaneous users increase from 10 to 100 to 500), and data-volume scaling (how each platform performs as the fact table grows from 10M to 1B rows). These four dimensions are what discriminate BI platforms at the enterprise tier — any platform is fast on a 1M-row test dataset on a developer laptop.

Why it matters

  • Concurrency behaviour (10 to 500 simultaneous users) is the dimension that decides operations-analytics deployments, not raw query speed.
  • Citing BARC's neutral lab methodology beats trading marketing claims when a client's IT team makes an unverifiable competitor performance claim.
  • The benchmark's four dimensions double as the acceptance-test checklist for scoping a concurrency-sensitive SAC deployment.

Key points

  • BARC lab-style performance benchmark of BI platforms.
  • URL slug references Qlik and Power BI — likely primary subjects.
  • Methodology categories: query latency, dashboard rendering, concurrency, data-volume scaling.
  • Use when defending SAC Live in a multi-vendor RFP — gives an independent comparator.
  • Numeric results and vendor rankings paywalled.
  • None of BARC's four dimensions was designed to measure AI-agent query traffic (Joule 'just ask', MCP-connected LLM clients) — a platform sized for human concurrency can still be stressed by a much smaller number of agents firing several queries per question.
  • Microsoft's own DirectQuery documentation states a one-million-row intermediate result limit per query and a default 10-connection concurrency cap per data source for Power BI Pro — concrete, sourced constraints worth checking before citing a Power BI benchmark number.
  • A benchmark's headline number is only as transferable as its test configuration — schema complexity, concurrency curve (not just headcount), and sponsorship disclosure all change what the number is evidence of.

Terms used on this page

In-memory BI
BI platform that pre-loads data into RAM for sub-second query response — the Qlik and SAC Live architecture. Contrast with Direct Query / Pass-through, where every dashboard interaction fires a database query.
Direct Query
Power BI's architecture for connecting live to a database (e.g. Azure SQL, Fabric, SAP HANA) without import — lower latency on fresh data, but concurrency and size constraints apply.
Concurrency test
Benchmark scenario simulating multiple simultaneous users querying the same dashboard — the most discriminating test for enterprise BI performance because it reflects production load.
Intermediate result-set limit
A cap on the number of rows a single query (or intermediate operation) may return before failing — Power BI DirectQuery enforces one million rows per Microsoft's own documentation, a concrete constraint independent of any lab benchmark.
Query folding
The process by which a BI tool's transformation steps are translated into a single native query pushed to the source, rather than being executed client-side — required for DirectQuery to scale; breaking folding is a common cause of a 'slow DirectQuery' complaint.
Agent query pattern
The distinct load shape generated by an AI agent (Joule, an MCP-connected LLM client) answering a single natural-language question with several rapid exploratory queries — structurally different from the human click-and-wait pattern BARC's concurrency dimension was designed around.

Sources

  1. BARC — Benchmark: How fast is your BI platform, really?
  2. SAP Help — SAC Live Data Connection: HANA performance considerations
  3. Microsoft — Power BI Direct Query overview
  4. BARC / BI-Survey — benchmark methodology
  5. BARC — Research hub
  6. Microsoft Learn — Power BI performance optimization guidance
  7. はじめてのSAP Analytics Cloud BI - しきい値の設定 — SAP Community (Technology Blog Posts by SAP)
  8. はじめてのSAP Analytics Cloud BI - 差異の表示 — SAP Community (Technology Blog Posts by SAP)
  9. SAP Analytics Cloud Performance Monitoring and Analysis Tools — SAP Community (Technology Blog Posts by SAP)
  10. Optimizing SAP Analytics Cloud – Best Practices and Performance — SAP Community (Technology Blog Posts by SAP)
  11. Embedded Analytics - How to Analyze System/Browser/Network Performance ? — SAP Community (Technology Blog Posts by SAP)
  12. Types of ATC Errors in CDS views — SAP Community (Application Development and Automation Blog Posts)
  13. はじめてのSAP Analytics Cloud BI - リンク付き分析 — SAP Community (Technology Blog Posts by SAP)
  14. はじめてのSAP Analytics Cloud BI - 共有方法 — SAP Community (Technology Blog Posts by SAP)
  15. はじめてのSAP Analytics Cloud BI - 差異の表示 — SAP Community (Technology Blog Posts by SAP)
  16. はじめてのSAP Analytics Cloud BI - データの切り替えボタンの作成 — SAP Community (Technology Blog Posts by SAP)
  17. はじめてのSAP Analytics Cloud BI - スマートインサイト — SAP Community (Technology Blog Posts by SAP)
  18. はじめてのSAP Analytics Cloud BI - 用語入門 — SAP Community (Technology Blog Posts by SAP)
  19. Online Session Available: Unlock the Power of SAP HANA Cloud — SAP Community (Technology Blog Posts by SAP)
  20. はじめてのSAP Analytics Cloud BI - フィルタの作成 — SAP Community (Technology Blog Posts by SAP)
  21. CDS Views Vs Traditional ABAP Logic Performance — SAP Community (Technology Blog Posts by Members)
  22. はじめてのSAP Analytics Cloud BI - 基準線の作成 — SAP Community (Technology Blog Posts by SAP)
  23. はじめてのSAP Analytics Cloud BI - サンプルモデル/ストーリーの作成 — SAP Community (Technology Blog Posts by SAP)
  24. はじめてのSAP Analytics Cloud BI - シリーズまとめ — SAP Community (Technology Blog Posts by SAP)
  25. Restricting the BW queries exposed to Microsoft Power BI from B4HANA system — SAP Community (Technology Blog Posts by Members)
  26. Ensuring Performance in CDS Views with ATC: Tools & Test System Strategies — SAP Community (Application Development and Automation Blog Posts)
  27. Connect SAP S/4HANA Custom CDS Views to Power BI via Odata API — SAP Community (Enterprise Resource Planning Blog Posts by Members)
  28. SAP User Experience Q1/2025 Update – Part 6: SAP Analytics Cloud & SAP Business Technology Platform — SAP Community (Technology Blog Posts by SAP)
  29. Boosting Performance in SAP Analytics Cloud: Simple and Efficient Strategies — SAP Community (Technology Blog Posts by Members)
  30. SAP EIM Information Steward Data Quality Scorecard on Power BI — SAP Community (Technology Blog Posts by Members)

Full card available to members. What the full card adds: the full decision framework · the SAP vs Snowflake / Databricks / Fabric comparison · the common pitfalls and their fix · the cheat sheet · the architecture schemas · the code blocks · the facts worth quoting.

Open in the app →