cloudscape, design-system-agent-tasks/1.0.0, Publication-ready
Scope: Results cover the recorded actor profile, task suite, evidence snapshot, runtime, and run count.
43.3% functional task success. 82.5% citation accuracy; 90% provenance accuracy.
Outputs varied substantially even when outcomes succeeded. Exact-answer reproducibility was 36.7%, while outcome agreement was 88.3%. Exact-answer reproducibility measures whether repeated runs produced the same normalized structured answer; it is not functional reliability. Different valid implementations, wording, or citation selections can lower it even when a task completes and its runtime checks pass.
| Area | Task | Functional success | Exact answer | Outcome agreement |
|---|---|---|---|---|
| Foundations | cloudscape-visual-mode-token-mapping-v2 | 0% | 33.3% | 100% |
| Bindings | cloudscape-table-selection-api-binding-v2 | 100% | 33.3% | 100% |
| Components | cloudscape-controlled-toggle-preference | 33.3% | 33.3% | 66.7% |
| Structure | cloudscape-resource-inventory-empty-state-v2 | 66.7% | 33.3% | 66.7% |
| Structure | cloudscape-create-configure-save-flow | 0% | 33.3% | 100% |
| Governance | cloudscape-release-evidence-governance-v2 | 0% | 33.3% | 100% |
| Foundations | cloudscape-focus-visible-semantic-pair-v1 | 100% | 33.3% | 100% |
| Foundations | cloudscape-responsive-content-spacing-v1 | 100% | 66.7% | 100% |
| Foundations | cloudscape-dark-surface-token-boundary-v1 | 0% | 66.7% | 100% |
| Bindings | cloudscape-modal-api-binding-v2 | 66.7% | 33.3% | 66.7% |
| Components | cloudscape-flashbar-recovery-message-v2 | 0% | 33.3% | 100% |
| Governance | cloudscape-accessibility-regression-governance-v2 | 66.7% | 33.3% | 66.7% |
| Bindings | cloudscape-navigation-follow-binding-v3 | 0% | 33.3% | 100% |
| Bindings | cloudscape-required-name-input-binding-v2 | 0% | 33.3% | 100% |
| Components | cloudscape-modal-open-close-behavior-v3 | 33.3% | 33.3% | 66.7% |
| Structure | cloudscape-filtered-inventory-empty-state-v1 | 0% | 33.3% | 100% |
| Governance | cloudscape-accessibility-fix-review-governance-v1 | 66.7% | 33.3% | 66.7% |
| Components | cloudscape-button-pending-label-behavior-v2 | 100% | 33.3% | 100% |
| Structure | cloudscape-load-more-success-flow-v4 | 33.3% | 33.3% | 66.7% |
| Governance | cloudscape-public-change-review-governance-v3 | 100% | 33.3% | 100% |
These measurements cover one recorded actor profile on controlled tasks using the captured evidence.