Measurementality Series

Measurementality is a new series of podcasts, webinars and reports created by the IEEE Standards Association (IEEE SA) in collaboration with The Radical AI Podcast focused on defining what counts in the Algorithmic Age. While it’s critical that Artificial Intelligence Systems (AIS) are transparent, responsible, and trustworthy, Measurementality will explore the deeper issues around what measurements of success we’re optimizing for in the first place.

Tweet #measurementality

At the end of each month we’ll be hosting a Webinar featuring the same guests who were on the Radical AI Measurementality podcast. We’ll also invite additional guests who are working in IEEE SA committees, Standards Working Groups, or other programs. That way we can further explore the themes and issues brought up on the podcasts to best grow our work with relevance and specificity.

The launch of the IEEE 7000™-2021 standard that integrates ethical and functional requirements to mitigate risk and increase innovation in systems engineering product design has set a new bar in honoring end user values.  Beyond the need to avoid harm and provide market value for what we build, it’s imperative that people’s cultural and societal values are considered as metrics for design for modern Responsible Innovation.

Join Measurementality host, John C. Havens, as he interviews: Konstantinos Karachalios, Managing Director of the IEEE Standards Association; Sarah Spiekermann, Chair, The Institute for Information Systems & Society at Vienna University of Economics and Business at WU Vienna; and, Gisele Waters, Director of Design Research at Design Run Group and learn why and how to address ethical issues in AI as a design necessity.

We’re delighted to be working with the hosts and creators of The Radical AI Podcast to collaborate on and sponsor this series.

The first ten episodes of the Measurementality podcast will be hosted on Jess and Dylan’s site as a way to help cross pollinate awareness between the Radical AI and IEEE SA communities. Episodes will begin in January, 2021 and will be posted on the Radical AI site in the beginning of each month.

iTunes

Spotify

iHeartRadio

Jess and Dylan from The Radical AI podcast interview Sandy Pentland of MIT and Baroness Beeban Kidron of the 5Rights Foundation in their latest installment of Measurementality. Focusing on the key goal of our series, “defining what counts in the algorithmic age,” Sandy and Beeban discuss issues including data privacy for children, data agency for all, and how metrics like the United Nations Sustainable Development Goals and other human rights oriented metrics are being utilized in the design of Artificial Intelligence Systems (AIS).

Join Jess and Dylan from The Radical AI podcast as the Measurementality series continues to define “what counts in the algorithmic age” with guests including Dr. Riane Eisler, president of the Center for Partnership Studies (CPS) and author of The Real Wealth of Nations: Creating a Caring Economics, hailed by Archbishop Desmond Tutu as “a template for the better world we have been so urgently seeking” and Amandeep Gill, Director of the Global Health Centre project on International Digital Health & AI Research Collaborative (I-DAIR), and former Executive Director and co-Lead of the Secretariat of the UN Secretary General’s High-Level Panel on Digital Cooperation. Questions discussed on the show include, What metrics do you trust that guide your efforts to improve your mental health; How do you value the caregivers in your lives; and, how does the fact that caregiving metrics aren’t a part of GDP/ economic Indicators affect how society and AI Systems design prioritize mental health and caregivers – or not?

In this episode we’ll be “identifying what counts in the algorithmic age” by analyzing how existing metrics regarding human wellbeing along with environmental flourishing are being globally measured today.

While it’s often assumed that human “wellbeing” refers to moods or emotions that can’t be measured, the fields of positive psychology and happiness indicators provide multiple objective and subjective ways to measure long term human flourishing that can and should be utilized in the design of AI. Likewise, environmental metrics that often are used solely as ways to minimize harms after a product or service are built are not keeping our planet from deterioration faster than we can address it via normal means of Corporate Social Responsibility (CSR) or Environmental, Social, and Governance (ESG) reporting. So how can we better understand what we’re optimizing for in the AI we create to include people and planet in design measures at the outset of everything we create?

Join Jess and Dylan, hosts of the Radical AI podcast as they interview Laura Musikanski, Executive Director of The Happiness Alliance ;and Chair of IEEE 7010-2020; and Jonathan Stray, former research partner at The Partnership on AI and author of Aligning AI to Human Values means Picking the Right Metrics to learn more.

The question of defining what counts needs as much feedback as we can receive from as many people in as many different regions of the world from as many backgrounds as possible.

We’ll be creating a first draft of our report after Episode Six to be released in the summer of 2021, and a second / final draft to be released at the end of the year. Both reports will feature answers from our podcasts, webinars, and your responses.

1. How is success measured today in AIS? What issues (positive and negative) do you see with these measures with an eye towards human welfare, environmental sustainability, responsibility, technology, economics and ethics?
2. What is the positive future you’re working to build with AIS? Answers here can be submitted in short story form as well as prose.;
3. What are the measures of success for that positive future? Please be as specific as possible, utilizingsample Indicators criteria.

We will be posting all submissions received in two public documents available from the IEEE SA website featuring Measurementality at approximately the same time as our two Measurementality reports are published. We will email all people who provided submissions before the reports or documents featuring feedback are published.

For the co-hosts of The Radical AI Podcast, Dylan and Jess, two PhD students rooted in values of curiosity, humility, and hope for a better world, they began to interview dozens of scholars in the responsible tech community about a concept they coined “radical AI” and what it means to them, and what unconventional work might look like in AI. Their goal with this project became to resist harmful technologies and how they are created today through community building and collective storytelling, and to continue to co-define this concept. Their Radical AI Podcast and community is still in active exploration of what this work really is in the AI field.

For IEEE SA, we serve as a convener around critical ideas related to technology. When The IEEE Global Initiative on Ethics of Autonomous and Intelligent Systems gathered more than seven hundred global thinkers to create Ethically Aligned Design, many of the ideas that stemmed from that work may have seemed unconventional or “radical.” Prioritizing values-based design in systems engineering, for instance. But the multi-disciplinary process of bringing volunteers together from the US, EU, UK, China, Japan, Korea, Australia, India and many other countries meant that one person’s definition of one word or concept meant something completely different to someone else.

So while it may seem simple, actually listening to other people with consensus and curiosity can be one of the most unconventional things anyone can do.

So with the help of Jess and Dylan, our global experts and interviewees, and all of you, that’s exactly what we’re going to do. Start listening to your answer to a the question:

“What counts most in your life?”

Read the Full Article on the Beyond Standards Blog