Measurementality

Defining What Counts in the Algorithmic Age
Measurementality is a new series of podcasts, webinars and reports created by the IEEE Standards Association (IEEE SA) in collaboration with The Radical AI Podcast focused on defining what counts in the Algorithmic Age.  While it’s critical that Artificial Intelligence Systems (AIS) are transparent, responsible, and trustworthy, Measurementality will explore the deeper issues around what measurements of success we’re optimizing for in the first place.
 
WEBINARS

At the end of each month we’ll be hosting a Webinar featuring the same guests who were on the Radical AI Measuremenality podcast.  We’ll also invite additional guests who are working in IEEE SA committees, Standards Working Groups, or other programs.  That way we can further explore the themes and issues brought up on the podcasts to best grow our work with relevance and specificity.

Latest Webinars

Webinar #2:  Measurementality: Children's Data and Sustainability
Date: 25 February @ 12:00 PM ET - 1:00 PM ET
If we don't honor how we measure and protect children's data or take measures of the environment, we have no sustainable future.

Join host John C. Havens from IEEE SA as he interviews Sandy Pentland of MIT, Baroness Beeban Kidron of the 5Rights Foundation, and Branka Panic, Founder of AI for Peace in our latest installment of Measurementality.  Focusing on the key goal of our series, "defining what counts in the algorithmic age," guests will discuss issues like data privacy for children, data agency for all, and how metrics like the United Nations Sustainable Development Goals and other human rights oriented metrics are being utilized in the design of Artificial Intelligence Systems (AIS).
View Webinar

Webinar #3:  Measurementality: Counting Mental Health and Caregiving
Date:  25 March @ 12:00 PM ET - 1:00 PM ET
What metrics do you trust that guide your efforts to improve your mental health? And how do you value the caregivers in your lives?  How does the fact that caregiving metrics aren't a part of GDP/ economic Indicators affect how society and AI Systems design prioritize mental health and caregivers - or not?

Join host John C. Havens from IEEE SA as the Measurementality series continues to define "what counts in the algorithmic age" with guests including Dr. Riane Eisler, president of the Center for Partnership Studies (CPS) and author of The Real Wealth of Nations: Creating a Caring Economics, hailed by Archbishop Desmond Tutu as “a template for the better world we have been so urgently seeking”; Amandeep Gill, Director of the Global Health Centre project on International Digital Health & AI Research Collaborative (I-DAIR), and former Executive Director and co-Lead of the Secretariat of the UN Secretary General’s High-Level Panel on Digital Cooperation; and, Maria Palombini, Director, Emerging Communities & Opportunities Development, Healthcare & Life Sciences Practice Lead at IEEE SA.
View Webinar

Webinar #4:  Measurementality: What are We Optimizing For? 
Date:  29 April @ 12:00 PM ET - 1:00 PM ET
In this episode we'll be "identifying what counts in the algorithmic age" by analyzing how existing metrics regarding human wellbeing along with environmental flourishing are being globally measured today. 

While it's often assumed that human "wellbeing" refers to moods or emotions that can't be measured, the fields of positive psychology and happiness indicators provide multiple objective and subjective ways to measure long term human flourishing that can and should be utilized in the design of AI.   Likewise, environmental metrics that often are used solely as ways to minimize harms after a product or service are built are not keeping our planet from deterioration faster than we can address it via normal means of Corporate Social Responsibility (CSR) or Environmental, Social, and Governance (ESG) reporting.  So how can we better understand what we're optimizing for in the AI we create to include people and planet in design measures at the outset of everything we create?

Join John C. Havens of IEEE as he interviews Laura Musikanski, Executive Director of The Happiness Alliance and Chair of IEEE 7010-2020Jonathan Stray, Visiting Scholar at Center for Human-Compatible AI and former research partner at The Partnership on AI and author of Aligning AI to Human Values means Picking the Right MetricsMaike Luiken, Past President, IEEE Canada and the founding director of the Bluewater Technology Access Centre; and, Nell Watson, Tech Ethicist and Chair, IEEE ECPAIS Transparency Experts Focus Group on April 29th at noon Eastern to learn more.
View Webinar

 

PODCASTS

We’re delighted to be working with the hosts and creators of The Radical AI Podcast to collaborate on and sponsor this series. 

The first ten episodes of The Measurementality podcast will be hosted on Jess and Dylan’s site as a way to help cross pollinate awareness between the Radical AI and IEEE SA communities.  Episodes will begin in January, 2021 and will be posted on the Radical AI site in the beginning of each month. 

iTunes | Spotify | iHeartRadio

Latest Episodes

Episode #2:  Measurementality: Children's Data and Sustainability
Date: 22 March 2021
Jess and Dylan from The Radical AI podcast interview Sandy Pentland of MIT and Baroness Beeban Kidron of the 5Rights Foundation in their latest installment of Measurementality.  Focusing on the key goal of our series, "defining what counts in the algorithmic age," Sandy and Beeban discuss issues including data privacy for children, data agency for all, and how metrics like the United Nations Sustainable Development Goals and other human rights oriented metrics are being utilized in the design of Artificial Intelligence Systems (AIS).

Podcast #3:  Measurementality: Counting Mental Health and Caregiving
Join Jess and Dylan from The Radical AI podcast as the Measurementality series continues to define "what counts in the algorithmic age" with guests including Dr. Riane Eisler, president of the Center for Partnership Studies (CPS) and author of The Real Wealth of Nations: Creating a Caring Economics, hailed by Archbishop Desmond Tutu as “a template for the better world we have been so urgently seeking” and Amandeep Gill, Director of the Global Health Centre project on International Digital Health & AI Research Collaborative (I-DAIR), and former Executive Director and co-Lead of the Secretariat of the UN Secretary General’s High-Level Panel on Digital Cooperation.  Questions discussed on the show include, What metrics do you trust that guide your efforts to improve your mental health; How do you value the caregivers in your lives; and, how does the fact that caregiving metrics aren't a part of GDP/ economic Indicators affect how society and AI Systems design prioritize mental health and caregivers - or not?

Podcast #4:  Measurementality: What are We Optimizing For?
In this episode we'll be "identifying what counts in the algorithmic age" by analyzing how existing metrics regarding human wellbeing along with environmental flourishing are being globally measured today. 

While it's often assumed that human "wellbeing" refers to moods or emotions that can't be measured, the fields of positive psychology and happiness indicators provide multiple objective and subjective ways to measure long term human flourishing that can and should be utilized in the design of AI.   Likewise, environmental metrics that often are used solely as ways to minimize harms after a product or service are built are not keeping our planet from deterioration faster than we can address it via normal means of Corporate Social Responsibility (CSR) or Environmental, Social, and Governance (ESG) reporting.  So how can we better understand what we're optimizing for in the AI we create to include people and planet in design measures at the outset of everything we create?

Join Jess and Dylan, hosts of the Radical AI podcast as they interview Laura Musikanski, Executive Director of The Happiness Alliance and Chair of IEEE 7010-2020; and Jonathan Stray, former research partner at The Partnership on AI and author of Aligning AI to Human Values means Picking the Right Metrics to learn more.
 

MAKE A CONTRIBUTION BY SUBMITTING YOUR FEEDBACK

The question of defining what counts needs as much feedback as we can receive from as many people in as many different regions of the world from as many backgrounds as possible. 

We’ll be creating a first draft of our report after Episode Six to be released in the summer of 2021, and a second / final draft to be released at the end of the year.  Both reports will feature answers from our podcasts, webinars, and your responses.

The Measurementality program poses the following three questions: 

  1. How is success measured today in AIS?  What issues (positive and negative) do you see with these measures with an eye towards human welfare, environmental sustainability, responsibility, technology, economics and ethics? 
  2. What is the positive future you’re working to build with AIS? Answers here can be submitted in short story form as well as prose. 
  3. What are the measures of success for that positive future? Please be as specific as possible, utilizing sample Indicators or criteria.


But we would also like to hear from you!

We will be posting all submissions received in two public documents available from the IEEE SA website featuring Measurementality at approximately the same time as our two Measurementality reports are published.  We will email all people who provided submissions before the reports or documents featuring feedback are published.  Submission Guidelines (PDF).

UNCONVENTIONAL THINKING

For the co-hosts of The Radical AI Podcast, Dylan and Jess, two PhD students rooted in values of curiosity, humility, and hope for a better world, they began to interview dozens of scholars in the responsible tech community about a concept they coined “radical AI” and what it means to them, and what unconventional work might look like in AI.  Their goal with this project became to resist harmful technologies and how they are created today through community building and collective storytelling, and to continue to co-define this concept. Their Radical AI Podcast and community is still in active exploration of what this work really is in the AI field.

For IEEE SA, we serve as a convener around critical ideas related to technology.  When The IEEE Global Initiative on Ethics of Autonomous and Intelligent Systems gathered more than seven hundred global thinkers to create Ethically Aligned Design, many of the ideas that stemmed from that work may have seemed unconventional or “radical.”  Prioritizing values-based design in systems engineering, for instance.  But the multi-disciplinary process of bringing volunteers together from the US, EU, UK, China, Japan, Korea, Australia, India and many other countries meant that one person’s definition of one word or concept meant something completely different to someone else.  

So while it may seem simple, actually listening to other people with consensus and curiosity can be one of the most unconventional things anyone can do. 

So with the help of Jess and Dylan, our global experts and interviewees, and all of you, that’s exactly what we’re going to do.  Start listening to your answer to a the question: 

“What counts most in your life?"

Read the full article on the Beyond Standards blog