Measurementality

Defining What Counts in the Algorithmic Age
Measurementality is a new series of podcasts, webinars and reports created by the IEEE Standards Association (IEEE SA) in collaboration with The Radical AI Podcast focused on defining what counts in the Algorithmic Age.  While it’s critical that Artificial Intelligence Systems (AIS) are transparent, responsible, and trustworthy, Measurementality will explore the deeper issues around what measurements of success we’re optimizing for in the first place.
 
PODCASTS

We’re delighted to be working with the hosts and creators of The Radical AI Podcast to collaborate on and sponsor this series. 

The first ten episodes of The Measurementality podcast will be hosted on Jess and Dylan’s site as a way to help cross pollinate awareness between the Radical AI and IEEE SA communities.  Episodes will begin in January, 2021 and will be posted on the Radical AI site in the beginning of each month. 

Latest Episodes

Episode #1: Measurementality: Defining What Counts in the Algorithmic Age
Date: Feb 14, 2021
Join John C. Havens of the IEEE Standards Association along with Jess and Dylan, the co-hosts of the popular podcast, Radical AI as they discuss the new Measurementality content series, including topics such as: How is success measured today in the world of Artificial Intelligence Systems (AIS)? What is the positive future we’re working to build with AIS? And, what are the measures of success for that future? We'll also be discussing how the Measurementality series features a call to action for listeners and the AIS community at large to respond to these questions to contribute to two reports helping us define and frame 'what counts in the algorithmic age.'

iTunes | Spotify | iHeart Radio

Episode #2:  Measurementality: Children's Data and Sustainability
Date: TBD
If we don't honor how we measure and protect children's data or take measures of the environment, we have no sustainable future. 

 

WEBINARS

At the end of each month we’ll be hosting a Webinar featuring the same guests who were on the Radical AI Measuremenality podcast.  We’ll also invite additional guests who are working in IEEE SA committees, Standards Working Groups, or other programs.  That way we can further explore the themes and issues brought up on the podcasts to best grow our work with relevance and specificity.

Latest Webinars

Webinar #1:  Measurementality: Defining What Counts in the Algorithmic Age
Date: 28 January @ 12:00 PM ET - 1:00 PM ET
Join John C. Havens of the IEEE Standards Association as he interviews Jess and Dylan, the co-hosts of the popular podcast, Radical AI.  John, Jess and Dylan will be discussing the Measurementality content series, including topics such as: How is success measured today in the world of Artificial Intelligence Systems (AIS)? What is the positive future we’re working to build with AIS?  And, what are the measures of success for that future?  We'll also be discussing how the Measurementality series features a call to action for listeners and the AIS community at large to respond to these questions to contribute to two reports helping us define and frame 'what counts in the algorithmic age.'
View Webinar

Webinar #2:  Measurementality: Children's Data and Sustainability
Date: 25 February @ 12:00 PM ET - 1:00 PM ET
If we don't honor how we measure and protect children's data or take measures of the environment, we have no sustainable future.

Join host John C. Havens from IEEE SA as he interviews Sandy Pentland of MIT, Baroness Beeban Kidron of the 5Rights Foundation, and Branka Panic, Founder of AI for Peace in our latest installment of Measurementality.  Focusing on the key goal of our series, "defining what counts in the algorithmic age," guests will discuss issues like data privacy for children, data agency for all, and how metrics like the United Nations Sustainable Development Goals and other human rights oriented metrics are being utilized in the design of Artificial Intelligence Systems (AIS).

REPORTS

We’ve created three key questions (below) that Jess and Dylan will be asking all our podcast guests that we’ll also pose to the experts in our webinars.  But we’d also like to hear from you. 

The question of defining what counts needs as much feedback as we can receive from as many people in as many different regions of the world from as many backgrounds as possible. 

We’ll be creating a first draft of our report after Episode Six to be released in the summer of 2021, and a second / final draft to be released at the end of the year.  Both reports will feature answers from our podcasts, webinars, and your responses.

The Measurementality program poses the following three questions: 

  1. How is success measured today in AIS?  What issues (positive and negative) do you see with these measures with an eye towards human welfare, environmental sustainability, responsibility, technology, economics and ethics? 
  2. What is the positive future you’re working to build with AIS? Answers here can be submitted in short story form as well as prose. 
  3. What are the measures of success for that positive future? Please be as specific as possible, utilizing sample Indicators or criteria.


But we would also like to hear from you!

We will be posting all submissions received in two public documents available from the IEEE SA website featuring Measurementality at approximately the same time as our two Measurementality reports are published.  We will email all people who provided submissions before the reports or documents featuring feedback are published. 

UNCONVENTIONAL THINKING

For the co-hosts of The Radical AI Podcast, Dylan and Jess, two PhD students rooted in values of curiosity, humility, and hope for a better world, they began to interview dozens of scholars in the responsible tech community about a concept they coined “radical AI” and what it means to them, and what unconventional work might look like in AI.  Their goal with this project became to resist harmful technologies and how they are created today through community building and collective storytelling, and to continue to co-define this concept. Their Radical AI Podcast and community is still in active exploration of what this work really is in the AI field.

For IEEE SA, we serve as a convener around critical ideas related to technology.  When The IEEE Global Initiative on Ethics of Autonomous and Intelligent Systems gathered more than seven hundred global thinkers to create Ethically Aligned Design, many of the ideas that stemmed from that work may have seemed unconventional or “radical.”  Prioritizing values-based design in systems engineering, for instance.  But the multi-disciplinary process of bringing volunteers together from the US, EU, UK, China, Japan, Korea, Australia, India and many other countries meant that one person’s definition of one word or concept meant something completely different to someone else.  

So while it may seem simple, actually listening to other people with consensus and curiosity can be one of the most unconventional things anyone can do. 

So with the help of Jess and Dylan, our global experts and interviewees, and all of you, that’s exactly what we’re going to do.  Start listening to your answer to a the question: 

“What counts most in your life?"

Read the full article on the Beyond Standards blog

GET INVOLVED

Sign Up for our Newsletter

Whether you have been involved with our work or are new to it, we are asking everyone to register for our newsletter so we can better communicate with you moving forward.
 

Fill out my online form.