Power BI Copilot’s semantic layer has a 200-character metadata budget—and some logic stays invisible
A new practitioner checklist turns Microsoft’s model-preparation guidance into an operational rule: fix relationships and measures first, then spend scarce description space on meaning, units and exclusions.
A Power BI semantic model can be perfectly usable by a human analyst and still be ambiguous to Copilot. The practical reason is not just prompt quality: the agent sees a curated and lossy representation of the model.
An October 12 checklist from BI Pixie puts that constraint into deployment terms. It recommends fixing relationships and fact-table grain before adding instructions, defining reviewed measures for business-critical calculations, curating the AI data schema, and testing the answers against a small set of known questions. The sequence matters because a fluent answer can conceal a wrong join or aggregation rather than exposing it as an error. BI Pixie’s checklist is vendor-authored practitioner guidance, not a benchmark, but its key platform claims are independently documented by Microsoft.
Two hard metadata limits
Microsoft says Copilot uses only the first 200 characters of the description attached to a measure, table or column. Its guidance is therefore unusually specific: put the business meaning, unit and important exclusions first. A long description may help a maintainer, but text after that boundary does not help Copilot choose the right field. Microsoft’s model-evaluation guidance also says calculation items are absent from model metadata; authors must list and explain them in the calculation-group column description, under the same 200-character constraint.
That creates a small but consequential design problem. A time-intelligence group might contain current, month-to-date, quarter-to-date, year-to-date, prior-year and year-over-year variants. If those items are not named compactly at the front of the description, the agent cannot infer them from metadata alone. BI Pixie’s recommendation is to treat the opening text as an interface contract rather than documentation prose.
Instructions cannot repair the model
The larger lesson is that AI Instructions are not a substitute for semantic modeling. Microsoft explicitly says additional instructions cannot correct inaccurate relationships or inappropriate aggregations. It advises teams to define clear table relationships and grain, create reviewed measures for important calculations, distinguish row counts from business-event counts, and avoid summing point-in-time balances across dates. Microsoft Learn frames those as prerequisites for answer quality, not optional prompt tuning.
BI Pixie extends that into a useful troubleshooting order: inspect the generated query before adding another instruction. A wrong measure points toward names, descriptions, schema selection or default-metric instructions; a wrong period points toward filters, date relationships and aggregation; missing categories can instead indicate stale data, inconsistent values or row-level security.
For rollout teams, the actionable test is simple. Build a small question set with validated answers, record the expected measure, grouping, date basis and filters, run it before changing the model, and rerun it afterward. Microsoft recommends that focused-question approach, while BI Pixie argues that every later model change can move the answers again. The result is a regression suite for the semantic contract—not proof that Copilot is universally accurate, but evidence that a particular model answers the questions its users actually ask.
sources
comments · 0