ICANN Accountability Indicators: Difference between revisions
| Line 5: | Line 5: | ||
==ATRT3 Critique of Accountability Indicators== | ==ATRT3 Critique of Accountability Indicators== | ||
The [[Third Accountability and Transparency Review]] found that the Accountability Indicators were ineffective in conveying information relevant to ICANN's strategic goals. In survey responses, only half of ICANN's constituent organizations ([[Supporting Organizations|SOs]], [[Advisory Committee|ACs]], [[Regional At-Large | The [[Third Accountability and Transparency Review]] found that the Accountability Indicators were ineffective in conveying information relevant to ICANN's strategic goals. In survey responses, only half of ICANN's constituent organizations ([[Supporting Organizations|SOs]], [[Advisory Committee|ACs]], [[Regional At-Large Organization|RALOs]], and the constituency groups within the [[GNSO Houses]]) were aware of the existence of the Accountability Indicators dashboard.<ref name="atrt3">[https://www.icann.org/en/system/files/files/atrt3-report-29may20-en.pdf ATRT3 Final Report], May 29, 2020 (PDF)</ref> | ||
The review team's assessment of the Accountability Indicators dashboard was starkly negative: | The review team's assessment of the Accountability Indicators dashboard was starkly negative: | ||
Latest revision as of 22:30, 9 July 2021
ICANN's Accountability Indicators attempt to refine and better communicate ICANN's success in meeting its objectives and commitments to transparency, accountability, and serving the public interest. A beta test version of the Accountability Indicators was introduced in summer 2017[1]
Creation & Refinement
The assessment of ICANN's success with regard to accountability and transparency has been an ongoing subject of discussion throughout the history of the organization, and is the subject of a specific review (ATRT). The Accountability Indicators were a replacement for a Key Performance Indicators (KPI) dashboard, and sought to refine the focus on ICANN's unique structure and processes.[1] The data visualization features were updated in an official "Version 1" in spring 2018.[2] Based on community feedback, additional improvements were rolled out in July 2018[3] and November 2018.[4]
ATRT3 Critique of Accountability Indicators
The Third Accountability and Transparency Review found that the Accountability Indicators were ineffective in conveying information relevant to ICANN's strategic goals. In survey responses, only half of ICANN's constituent organizations (SOs, ACs, RALOs, and the constituency groups within the GNSO Houses) were aware of the existence of the Accountability Indicators dashboard.[5]
The review team's assessment of the Accountability Indicators dashboard was starkly negative:
Accountability indicators, which are the main mechanism for updating the community on the progress of ICANN org versus the Operational and Strategic Plans, are unknown to a significant portion of the community and contain a significant number of elements which are neither relevant nor useful as accountability indicators. These problems create a significant accountability and transparency issue for ICANN.[5]
The review team assessed each of the forty-eight Accountability Indicators available on ICANN.org's website using a rubric that it developed for that purpose. They found that the majority of the indicators were not suited for purpose based on "no" or "not clear" responses to the following questions:
- Is the accountability indicator crucial to achieving the main objective?
- 31 (65%) No
- 9 (19%) Not Clear
- 8 (16%) Yes
- Is there a goal or objective against which the data provided can be assessed?
- 27 (56%) No
- 15 (31%) Not clear
- 6 (13%) Yes
- Is there information on how the goal or objective is defined?
- 34 (71%) No
- 14 (29%) Yes
- Is what is being measured clear?
- 28 (58%) Yes
- 13 (28%) No
- 7 (14%) Not Clear
- Is there information on where the data comes from?
- 41 (85%) No
- 6 (13%) Yes
- 1 (2%) Not Clear
- Is the information being kept up to date?
- 39 (81%) No
- 5 (10%) Yes
- 4 (9%) Not Clear
Integration into Quarterly and Annual Reports
ICANN's blog post from November 2018 is the last mention of the Accountability Indicators as a stand-alone feature on the ICANN.org website. It appears from the ATRT3 Final Report that the Accountability Indicators dashboard was still operational as of March 2020.[5] ICANN's "Accountability and Transparency" page states that Accountability Indicators are still operative, and that "Dashboard efforts continue to evolve."[6] All links to the "Accountability Indicators" page currently redirect to the ICANN President and CEO's Corner, where a heading entitled "Accountability Indicators" contains the following notice:
To find data about progress against ICANN's goals and objectives, please read my quarterly CEO Report to the ICANN Board found below or review ICANN's Annual Report.[7]
Accountability Indicators are not separately called out in quarterly reports to the board, nor in ICANN's annual reports. However, both of these reports present extensive reports on organizational activities, deliberations, and progress toward strategic goals and objectives. ICANN's annual reports also contain a "Transparency Report" that highlights operations around publication of ICANN documents, meeting minutes, redaction of sensitive or confidentiatl information, and other matters related to transparency.[8]
References
- ↑ 1.0 1.1 ICANN.org Blog - Introducing the New Accountability Indicators, August 28, 2017
- ↑ ICANN.org Blog - Accountability Indicators goes from beta to Version 1, May 31, 2018
- ↑ ICANN.org Blog - Accountability Indicators Feedback, July 30, 2018
- ↑ Accountability Indicators Feedback, November 7, 2018
- ↑ 5.0 5.1 5.2 ATRT3 Final Report, May 29, 2020 (PDF)
- ↑ ICANN.org - Accountability and Transparency, retrieved July 9, 2021
- ↑ ICANN.org - President and CEO's Corner, retrieved July 9, 2021
- ↑ See e.g. ICANN's 2020 Annual Report (PDF)