Measurementality Podcasts & Webinars

Defining What Counts in the Algorithmic Age

Measurementality is a new series of podcasts, webinars and reports created by the IEEE Standards Association (IEEE SA) in collaboration with The Radical AI Podcast focused on defining what counts in the Algorithmic Age. Please view the Podcasts and Webinars below.

Webinar Series

Webinar #1: Measurementality: Defining What Counts in the Algorithmic Age

Date: 28 January @ 12:00 PM ET - 1:00 PM ET

Join John C. Havens of the IEEE Standards Association as he interviews Jess and Dylan, the co-hosts of the popular podcast, Radical AI. John, Jess and Dylan will be discussing the Measurementality content series, including topics such as: How is success measured today in the world of Artificial Intelligence Systems (AIS)? What is the positive future we’re working to build with AIS? And, what are the measures of success for that future? We’ll also be discussing how the Measurementality series features a call to action for listeners and the AIS community at large to respond to these questions to contribute to two reports helping us define and frame ‘what counts in the algorithmic age.’

View Webinar

Webinar #2: Measurementality: Children's Data and Sustainability

Date: 25 February @ 12:00 PM ET - 1:00 PM ET

If we don’t honor how we measure and protect children’s data or take measures of the environment, we have no sustainable future.

Join host John C. Havens from IEEE SA as he interviews Sandy Pentland of MIT, Baroness Beeban Kidron of the 5Rights Foundation, and Branka Panic, Founder of AI for Peace in our latest installment of Measurementality. Focusing on the key goal of our series, “defining what counts in the algorithmic age,” guests will discuss issues like data privacy for children, data agency for all, and how metrics like the United Nations Sustainable Development Goals and other human rights oriented metrics are being utilized in the design of Artificial Intelligence Systems (AIS).

View Webinar

Webinar #3: Measurementality: Counting Mental Health and Caregiving

Date: 25 March @ 12:00 PM ET - 1:00 PM ET

What metrics do you trust that guide your efforts to improve your mental health? And how do you value the caregivers in your lives? How does the fact that caregiving metrics aren’t a part of GDP/ economic Indicators affect how society and AI Systems design prioritize mental health and caregivers – or not?

Join host John C. Havens from IEEE SA as the Measurementality series continues to define “what counts in the algorithmic age” with guests including Dr. Riane Eisler, president of the Center for Partnership Studies (CPS) and author of The Real Wealth of Nations: Creating a Caring Economics, hailed by Archbishop Desmond Tutu as “a template for the better world we have been so urgently seeking”; Amandeep Gill, Director of the Global Health Centre project on International Digital Health & AI Research Collaborative (I-DAIR), and former Executive Director and co-Lead of the Secretariat of the UN Secretary General’s High-Level Panel on Digital Cooperation; and, Maria Palombini, Director, Emerging Communities & Opportunities Development, Healthcare & Life Sciences Practice Lead at IEEE SA.

View Webinar

Webinar #4: Measurementality: What are We Optimizing For?

Date: 29 April @ 12:00 PM ET - 1:00 PM ET

In this episode we’ll be “identifying what counts in the algorithmic age” by analyzing how existing metrics regarding human wellbeing along with environmental flourishing are being globally measured today.

While it’s often assumed that human “wellbeing” refers to moods or emotions that can’t be measured, the fields of positive psychology and happiness indicators provide multiple objective and subjective ways to measure long term human flourishing that can and should be utilized in the design of AI.  Likewise, environmental metrics that often are used solely as ways to minimize harms after a product or service are built are not keeping our planet from deterioration faster than we can address it via normal means of Corporate Social Responsibility (CSR) or Environmental, Social, and Governance (ESG) reporting. So how can we better understand what we’re optimizing for in the AI we create to include people and planet in design measures at the outset of everything we create?

Join Laura Musikanski, Executive Director of The Happiness Alliance and Chair of IEEE 7010-2020Jonathan Stray, former research partner at The Partnership on AI and author of Aligning AI to Human Values means Picking the Right MetricsMaike Luiken, Past President, IEEE Canada and the founding director of the Bluewater Technology Access Centre; and, Andre Uhl, Chair of The IEEE Earth Lab and Executive Member of The Council on Extended Intelligence on April 29th at noon Eastern to learn more.

View Webinar

Webinar #5: Measurementality: Planning for The Planet

Date: 27 May @ 12:00 PM ET - 1:00 PM ET

What does it mean to truly care for the planet? While many people use the word, “sustainability” in the context of business or policy, the concept of long-term stewardship for our ecosystems is often not the top priority for technological or policy oriented planning. How would the world look different, literally, if what counted most was the long term flourishing of our planet as a primary metric of success for all the AI and tech we design and build? And what does “sustainability” look like in practical ways versus just abstract concepts in regards to AI and in various industries and applications?

Join John C. Havens, host of Measurementality and Director, Emerging Technology & Strategic Development at the IEEE Standards Association as he interviews four top thought leaders working in the world of technology, sustainability, and wellbeing, including: Deborah Hagar, President of The Foundation for Sustainable Communities; Sinead Bovell, Founder of WAYE bridging the gap between young entrepreneurs and the digital future; Melodena Stephens, Professor of Innovation Management, Mohammed Bin Rashid School of Government in Dubai; and, Benjamin Koo from Tsinghua University currently working as part of Kura Kura Bali’s work on Sustainable Development.

View Webinar

Webinar #6: Measurementality: Redefining Impact for Genuine Accountability

Date: 29 July @ 12:00 PM ET - 1:00 PM ET

“Without impacts as a common object to act upon, there are no accountability relationships.” In this episode of Measurementality, host John C. Havens discusses the recent (quoted) report from Data & Society, Assembling Accountability — Algorithmic Impact Assessment for the Public Interest and how accountability cannot be defined solely by the creators of AI Systems. Rather, the entire value chain being affected by any algorithm must define all positive or negative impacts in unison at the outset of design of all AI Systems to avoid confusion, manipulation, or harm.

For this month’s episode, John is joined by: Emmanuel Moss, co-author of the report and Researcher at Data & Society and Doctoral Candidate in Anthropology at CUNY Graduate Center; Liz O’Sullivan, CEO of Parity, which was first incorporated by Dr. Rumman Chowdhury; and Yoav Schlesinger, Principal, Ethical AI Practice at Salesforce.

View Webinar

Webinar #7: Measurementality: Why AI Registries are Critical for Metrics of Accountability

Date: 26 August @ 12:00 PM ET - 1:00 PM ET

To know the consequences of an organization’s use of Artificial Intelligence Systems (AIS), it is essential that they know what AIS models they are deploying and where. At present, not all AIS companies using AIS can point to each of their models, metrics, data sources, personnel controls, and deployment documentation. To get to a state where all AIS could be accounted for and all of the channels through which the power of AIS flows, companies and governments should explore the concept of an AIS or AI registry. In this episode of Measurementality, we discuss registries, including their content, purpose, and the personnel who are best positioned to create and maintain these for their organizations. Knowing more about AIS / AI registries will help organizations improve their AIS governance, integrate AIS governance with an overall corporate sustainability and strategy effort, and prepare for coming regulatory changes in the AIS space. As a form of Responsible Innovation, metrics regarding these registries may or should become the new norm in AI Governance.

Join Measurementality host John C. Havens as he interviews Dr. Sara R. Jordan, Senior Researcher, Artificial Intelligence and Ethics at the Future of Privacy Forum and Ilana Golbin, Director of Emerging Technologies & AI and Global Responsible AI Leader at PwC.

View Webinar

Webinar #8: A Vision for Values: IEEE 7000 and the new metrics of Responsible Innovation

Date: 30 September @ 12:00 PM ET - 1:00 PM ET

The launch of the IEEE 7000™-2021 standard that integrates ethical and functional requirements to mitigate risk and increase innovation in systems engineering product design has set a new bar in honoring end user values. Beyond the need to avoid harm and provide market value for what we build, it’s imperative that people’s cultural and societal values are considered as metrics for design for modern Responsible Innovation.

Join Measurementality host, John C. Havens, as he interviews: Konstantinos Karachalios, Managing Director of the IEEE Standards Association; Sarah Spiekermann, Chair, The Institute for Information Systems & Society at Vienna University of Economics and Business at WU Vienna; and, Gisele Waters, Director of Design Research at Design Run Group and learn why and how to address ethical issues in AI as a design necessity.

View Webinar

Webinar #9: IEEE's New CertifAIEd Program

Date: TBD

Join us as we speak with architects behind this landmark work helping organizations provide accountability for their entire stakeholder chair with ‘the mark of AI Ethics.’

Webinar #10: Measurementality: Taking our Measure (Recap and Report)

Date: TBD

Jess, Dylan and John C. Havens wrap up the series with updates on our report(s) and a recap on what can or should be the new “Measurementality” for AIS Design.

Podcast Series

Episode #1: Measurementality: Defining What Counts in the Algorithmic Age

Date: 14 February 2021

Join John C. Havens of the IEEE Standards Association along with Jess and Dylan, the co-hosts of the popular podcast, Radical AI as they discuss the new Measurementality content series, including topics such as: How is success measured today in the world of Artificial Intelligence Systems (AIS)? What is the positive future we’re working to build with AIS? And, what are the measures of success for that future? We’ll also be discussing how the Measurementality series features a call to action for listeners and the AIS community at large to respond to these questions to contribute to two reports helping us define and frame ‘what counts in the algorithmic age.’

Episode #2: Measurementality: Children's Data and Sustainability

Date: 22 March 2021

Jess and Dylan from The Radical AI podcast interview Sandy Pentland of MIT and Baroness Beeban Kidron of the 5Rights Foundation in their latest installment of Measurementality. Focusing on the key goal of our series, “defining what counts in the algorithmic age,” Sandy and Beeban discuss issues including data privacy for children, data agency for all, and how metrics like the United Nations Sustainable Development Goals and other human rights oriented metrics are being utilized in the design of Artificial Intelligence Systems (AIS).

Episode #3: Measurementality: Counting Mental Health and Caregiving

Join Jess and Dylan from The Radical AI podcast as the Measurementality series continues to define “what counts in the algorithmic age” with guests including Dr. Riane Eisler, president of the Center for Partnership Studies (CPS) and author of The Real Wealth of Nations: Creating a Caring Economics, hailed by Archbishop Desmond Tutu as “a template for the better world we have been so urgently seeking” and Amandeep Gill, Director of the Global Health Centre project on International Digital Health & AI Research Collaborative (I-DAIR), and former Executive Director and co-Lead of the Secretariat of the UN Secretary General’s High-Level Panel on Digital Cooperation. Questions discussed on the show include, What metrics do you trust that guide your efforts to improve your mental health; How do you value the caregivers in your lives; and, how does the fact that caregiving metrics aren’t a part of GDP/ economic Indicators affect how society and AI Systems design prioritize mental health and caregivers – or not?

Episode #4: Measurementality: What are We Optimizing For?

In this episode we’ll be “identifying what counts in the algorithmic age” by analyzing how existing metrics regarding human wellbeing along with environmental flourishing are being globally measured today.

While it’s often assumed that human “wellbeing” refers to moods or emotions that can’t be measured, the fields of positive psychology and happiness indicators provide multiple objective and subjective ways to measure long term human flourishing that can and should be utilized in the design of AI.  Likewise, environmental metrics that often are used solely as ways to minimize harms after a product or service are built are not keeping our planet from deterioration faster than we can address it via normal means of Corporate Social Responsibility (CSR) or Environmental, Social, and Governance (ESG) reporting. So how can we better understand what we’re optimizing for in the AI we create to include people and planet in design measures at the outset of everything we create?

Join Jess and Dylan, hosts of the Radical AI podcast as they interview Laura Musikanski, Executive Director of The Happiness Alliance and Chair of IEEE 7010-2020; and Jonathan Stray, former research partner at The Partnership on AI and author of Aligning AI to Human Values means Picking the Right Metrics to learn more.Understanding New Zealand’s Wellbeing Budget and AIS alignment / How can we optimize for AIS in data science and wellbeing?

Episode #5: Measurementality: Planning for The Planet

How can AIS design directly incorporate the environment to truly account for the planet?

Episode #6: Measurementality: Designing for Trust and Agency for the End User

How do you design AIS to honor trust and agency for multiple parts of the world?

Episode #7: Measurementality: New Imaginaries to Holistically Empower AIS Design

How can we be honest about existing structures of power for AIS to account for a positive future with AIS design?

Episode #8: Measurementality: Whose Ethics Are We Optimizing For? (Western, Eastern, Global)

Ubuntu ethics and the Global South – how to incorporate global measures of AIS design for greater cooperation, collaboration, and social harmony.

Episode #9: IEEE's New CertifAIEd Program

Join us as we speak with architects behind this landmark work helping organizations provide accountability for their entire stakeholder chair with ‘the mark of AI Ethics.’

Episode #10: Measurementality: Taking our Measure (Recap and Report)

Jess, Dylan and JCH wrap up the series with updates on our report(s) and a recap on what can or should be the new “Measurementality” for AIS Design.

Subscribe to our Newsletter

Sign up for our monthly newsletter to learn about new developments, including resources, insights and more.