Rosenverse

This video is only accessible to Gold members. Log in or register for a free Gold Trial Account to watch.

Log in Register

Most conference talks are accessible to Gold members, while community videos are generally available to all logged-in members.

Meters, Miles, and Madness: New Frameworks to Measure the (Elusive) Value of DesignOps
Gold
Tuesday, September 24, 2024 • DesignOps Summit 2024
Share the love for this talk
Meters, Miles, and Madness: New Frameworks to Measure the (Elusive) Value of DesignOps
Speakers: John Calhoun and Rachel Posman
Link:

Summary

Measuring DesignOps value is surprisingly complicated. Many practitioners would agree with the sentiment that measuring their impact feels aspirational at best, and theoretical at worst. Anecdotal evidence and praise from partners (“I don't know what we’d do without you!”) is nice, but doesn’t add up to proof that DesignOps is a worthy return on investment. In this talk, we’ll share two novel approaches to measuring DesignOps success from our upcoming book, The Design Conductors: Your Essential Guide to Design Operations. These methods–the “Jobs to Be Done” and “HEROES” frameworks–can be used to uncover and define measures of value that more accurately capture the impact DesignOps (and design) has on a business and its stakeholders. We will also share some tested rubrics that DesignOps can use to prioritize and implement these new measures.

Key Insights

  • Measuring design ops value is crucial yet complex.

  • Many design ops teams lack clearly defined metrics and outcomes.

  • Traditional business frameworks are inadequate for measuring design ops.

  • The Jobs to Be Done framework helps to uncover customer needs in design ops.

  • The Heroes framework categorizes impacts of design ops into six areas: health, effectiveness, readiness, outcomes, ecosystem, and sentiment.

  • Design ops should focus on making their work visible to ensure organizational investment.

  • Tailored metrics can enhance the understanding and appreciation of design ops.

  • Each framework offers a unique approach to measuring design ops effectiveness.

  • Organizational context should guide measure prioritization.

  • Fostering a culture of measurement empowers design ops teams.

Notable Quotes

"Measuring wrong can cost you a half billion dollars."

"We need to broaden our shared definition of design ops value."

"Design and design ops value are often defined by traditional frameworks, but applying these is like trying to fit a star in a box."

"These frameworks are just not good enough for design ops."

"If designers can use the Jobs to Be Done framework, design ops practitioners can too."

"Healthy teams are the foundation of a healthy organization."

"The Heroes framework acts more like a questionnaire rather than a step-by-step guide."

"Design ops can make a significant difference by tracking specific health metrics."

"Measuring sentiment is crucial to reflect the value placed on design."

"Doing good work is what's most important."

More Videos

Tiffany Cheng

"When I am in a lockdown due to an epidemic and need food, I want to order groceries online and get them delivered so I can stay safe."

Tiffany Cheng

Designing in a Pandemic: Integrating Speed and Rigor

June 9, 2022

Jay Bustamante

"Rushing through a release that results in unfair biases can shift your reputation and brand entirely."

Jay Bustamante

Navigating the Ethical Frontier: DesignOps Strategies for Responsible AI Innovation

October 2, 2023

Sarah Williams

"Experience principles articulate how our experiences feel and behave."

Sarah Williams

Verizon_A Framework for CX Transformation

January 8, 2024

Jane Reid

"You may not have all the answers, and that's okay—admit it respectfully."

Jane Reid Janice Hannaway

Self-care in User Research

April 2, 2020

Sandra Camacho

"Technology reproducing biases isn't merely about individuals; it's a systemic issue."

Sandra Camacho

Creating More Bias-Proof Designs

January 22, 2025

JD Buckley

"We had to act fast; if we didn't benchmark the current experience right then, we would lose that opportunity."

JD Buckley

Communicating the ROI of UX within a large enterprise and out on the streets

June 14, 2018

Samuel Proulx

"Audiobooks were first about printing books for the blind on phonograph records, highlighting the evolution of accessibility."

Samuel Proulx

Designing for Disability, Innovating for Everyone

March 11, 2025

John Maeda

"Art school doesn't teach you anything about making money"

John Maeda Alison Rand

About Design Organizations

May 13, 2019

Peter Morville

"It's hard to change course, whether for ships or organizations."

Peter Morville

The Architecture of Understanding

May 13, 2015