Comparing the Three Frameworks
| Framework | Focus | Key Dimensions |
|---|---|---|
| DORA | Delivery performance | Deployment frequency, lead time, failure rate, MTTR |
| SPACE | Developer productivity | Satisfaction, Performance, Activity, Communication, Efficiency |
| DevEx | Developer experience | Flow, feedback, cognitive load |
How AI4SE Changes Measurement
- DORA: Agents compress the inner loop → the bottleneck shifts to review and planning
- SPACE: Activity metrics explode (agent-generated commits are no longer a signal of human initiative)
- DevEx: Agents reduce repetitive labor → more flow time, but cognitive load shifts to “understanding what the agent did”
A Proposed Integrated Framework
Delivery performance (DORA) → what happened
Productivity (SPACE) → what people did
Experience (DevEx) → how people felt
Agent effectiveness → what the agent did, and how well
You need to measure all four dimensions simultaneously to understand the real impact of AI4SE.