3,197
edits
Changes
Jump to navigation
Jump to search
Created page with "The '''Second RSSAC Organizational Review''' was conducted between 2017 and 2020 by Interisle Consulting Group, LLC. ==Background== Pursuant to Article 4, Section 4.4 of the..."
The '''Second RSSAC Organizational Review''' was conducted between 2017 and 2020 by Interisle Consulting Group, LLC.
==Background==
Pursuant to Article 4, Section 4.4 of the [[ICANN Bylaws]], [[ICANN]] initiated a second RSSAC independent review process on April 19, 2017.<ref>[https://www.icann.org/resources/board-material/resolutions-2017-04-19-en#1.a Approved Board Resolutions - ICANN Special Board Meeting, April 19, 2017]</ref> The [[Operational Effectiveness Committee]] of the [[ICANN Board]] drafted and distributed a Request for Proposals for this review.<ref>[https://www.icann.org/news/announcement-2017-06-05-en Request for Proposals for the RSSAC Organizational Review]</ref>
==Scope of Review==
In both the announcement and the RFP, ICANN presented a broad scope of subjects for review. For example, the announcement stated that the goal was a "comprehensive assessment" of the RSSAC, "<nowiki>includ[ing], but [...] </nowiki>not limited to:
* The continued purpose of RSSAC within the ICANN structure;
* How effectively RSSAC fulfills its purpose;
* Whether any change in structure or operations is needed; and
* The extent to which RSSAC as a whole is accountable to the wider ICANN community."<ref>[https://www.icann.org/news/announcement-2017-06-05-en Request for Proposal for the RSSAC Organizational Review]</ref>
The RFP echoed the need to investigate those issues, and also provided a "non-comprehensive" list of proposed questions to be addressed regarding the RSSAC's composition, mission, procedures, transparency, and communication.<ref>[https://www.icann.org/en/system/files/files/rfp-rssac-review-05jun17-en.pdf Project Overview to the
Request for Proposal For REVIEW OF THE ICANN Root Server System Advisory Committee - June 5, 2017 (PDF)]</ref> On April 18, 2017, on behalf of RSSAC, Carlos Reyes submitted comments to ICANN requesting more specificity in some of the proposed questions.<ref>[https://mm.icann.org/pipermail/rssac-review2/2017-April/000002.html Email: Carlos Reyes to Lars Hoffman, April 18 2017]</ref> In correspondence back to the RSSAC, ICANN submitted a draft "Self Assessment" tool for the committee utilizing the RFP's proposed questions as part of the assessment template, with changes to some questions that appear to align with the RSSAC requests for clarity.<ref>[https://mm.icann.org/pipermail/rssac-review2/2017-May/000003.html Email: Angie Graves to RSSAC-Review2 listserv, May 4, 2017]</ref>
==Selection of Independent Examiner==
After accepting and reviewing proposals through the RFP process, [[ICANN]] contracted with [[Interisle Consulting Group, LLC]] to conduct the second independent review of RSSAC.<ref>[https://www.icann.org/news/announcement-2017-09-28-en ICANN Announcement of Selection of Independent Examiner, Interisle - September 28, 2017]</ref> Interisle assembled a team of three consultants for the review, [[Lyman Chapin]], [[Jim Reid]], and [[Colin Strutt]]<ref>[https://community.icann.org/display/ACCRSSAC/Independent+Examiner ICANN's RSAAC2 Dashboard - Independent Examiner]</ref>
==Assessment Report & Findings==
Interisle's review included attendance at RSSAC meetings, [[ICANN Meetings|ICANN meeting]] sessions, and conference calls during the autumn of 2017 and winter of 2018.<ref name="finalreport2">[https://www.icann.org/en/system/files/files/rssac-review-final-02jul18-en.pdf Independent Review of the ICANN Root Server System Advisory Committee: Final Report; July 2, 2018 (PDF)]</ref> In addition, they conducted 48 interviews with individuals connected to or working within the RSSAC.<ref name="finalreport2" /> At the end of 2017, Interisle conducted an online survey "to collect input from those who have interacted with RSSAC and/or have ideas for ways to improve it."<ref>[https://www.icann.org/news/announcement-2017-11-27-en ICANN Announcement of RSSAC Survey - November 27, 2017]</ref> In addition to publishing notice of the survey, ICANN specifically solicited responses from the [[RSSAC Caucus]].<ref name="finalreport2" /> The survey, which did not require participants to identify themselves, garnered 74 visits and 39 responses.<ref name="finalreport2" />
Other data utilized by Interisle came from:
* RSSAC's Self-Assessment, completed in September 2017;<ref>[https://mm.icann.org/pipermail/rssac-review2/2017-September/000014.html Email: Carlos Reyes to MSSI staff, September 8, 2017]</ref><ref>[http://mm.icann.org/pipermail/rssac-review2/attachments/20170908/af910e0d/RSSACOrganizationalReview2Self-Assessment.pdf RSSAC Organizational Review 2: Self-Assessment (PDF)]</ref>
* publicly available documents from a wide variety of sources that discuss the RSSAC and related activities; and
* Interisle's "own extensive knowledge of ICANN, the RSSAC, and the DNS root server system."<ref name="finalreport2" />
Interisle subjected this data to a structured qualitative analysis<ref>For a primer on structured qualitative analysis, see [https://www.qualitative-research.net/index.php/fqs/article/view/2092/3904 Herz, Peters, & Truschkat: "How to Do Qualitative Structural Analysis: The Qualitative Interpretation of Network Maps and Narrative Interviews;" Forum: Qualitative Social Research, Vol. 16 No. 1, January 2015]</ref> and presented its findings in an Initial Assessment Report to ICANN.<ref>[https://www.icann.org/news/announcement-2018-02-27-en RSSAC2 Review: Assessment Report Published - ICANN announcement, February 27, 2018]</ref> The draft assessment report was the topic of meetings between members of RSSAC's Review Work Party and Interisle's consultants.<ref>[https://participate.icann.org/p2zrcgd41jl/ Recording of RSSAC Review2 Work Party, February 15, 2018]</ref><ref>[https://community.icann.org/display/ACCRSSAC/RSSAC+Work+Party+Meetings The RSSAC Work Party Meetings Archive] lists a meeting on February 20, intended to cover feedback provided by the RWP. However, a recording is presently not available.</ref>
The Assessment Report listed a total of forty-two findings in response to the issues and questions posed by ICANN.<ref name="assessment">[https://www.icann.org/en/system/files/files/rssac-review-assessment-report-22feb18-en.pdf RSSAC Review - Assessment Report for Public Consultation]</ref> Of these, Interisle identified eight principal findings, which they highlighted in the report and its executive summary<ref>[https://www.icann.org/en/system/files/files/rssac-review-assessment-report-exec-summary-22feb18-en.pdf]</ref> of the assessment:
# The ongoing RSSAC reformation that began in 2013—revised RSSAC charter, new operating procedures, and creation of the RSSAC Caucus—has substantially improved the structure and operation of the RSSAC.
# The RSSAC has become more open, transparent, and accessible since the last review, but this has not been widely recognized by outside observers.
# As the only visible interface between ICANN and the RSOs, the RSSAC is expected to deal with every root service issue that arises within ICANN, whether or not the issue is properly within its scope.
# The RSSAC’s ability to serve as a shared space for RSO–ICANN communication and cooperation is complicated by a persistent legacy of distrust of ICANN by some of its members.
# The current RSSAC membership model excludes non-RSO participants and their different skills and perspectives.
# The RSSAC’s continuing purpose in the ICANN structure may include serving as the focal point for issues of mutual concern to ICANN and the RSOs, such as future operational and funding scenarios for serving the root.
# Because RSSAC members do not agree on who its stakeholders should be, it is not clear for what and to whom it should be accountable.
# The relative roles and responsibilities of the RSSAC, the RSSAC Caucus, the RZERC, and the SSAC are unclear to both outsiders and insiders.<ref name="assessment" />
==Response to Assessment Report==
The Assessment Report was submitted for public comment and response prior to the development of recommendations. At an open meeting on March 14, 2018 at [[ICANN 61]],<ref>[https://61.schedule.icann.org/meetings/647791 ICANN 61 Meeting Archive]</ref> Lyman Chapin explained:
<blockquote>And this reflects a process that MSSI has fairly recently adopted for doing organizational reviews, which is to divide them into two distinct phases. The first phase is an assessment phase in which the idea is not to anticipate what recommendations might be made but simply to report on what the independent examiner found after conducting interviews, and surveys, and document reviews, and so forth.<ref name="icann61transcript">[https://static.ptbl.co/static/attachments/172550/1523576427.pdf?1523576427 Transcript of RSSAC Organizational Review Session at ICANN 61]</ref> </blockquote>Chapin presented the principal findings at the ICAAN 61 meeting, and received no questions from the attendees.<ref name="icann61transcript" />
On March 28, 2018, RSSAC issued '''RSSAC032:''' Feedback on the Independent Review of the Root Server System Advisory Committee (RSSAC) Assessment Report for Public Consultation.<ref name="assessfb">[https://www.icann.org/en/system/files/files/rssac-032-28mar18-en.pdf RSSAC032]</ref> RSSAC032 begins with a discussion of the [[ICANN Bylaws]] and the committee's expectation of the focus of the review:
<blockquote>RSSAC’s interpretation of the stated assessment report’s purpose is that an organizational review would look at the ''organization'' – its chairs, its procedures, its guiding documents including charter and bylaws, its meetings, and the publications it has produced.<ref name="assessfb" /></blockquote>
This interpretation substantially diminished the scope of ICANN's announcement of the review, and the parameters defined in the RFP. Based on that narrow definition of scope, the committee found "three...surprising categories of findings" that they viewed as outside the purpose of the review:
<blockquote>However, we found that the initial assessment report included three additional surprising categories of findings.
i. Out of Scope Findings: Findings related to items that RSSAC could never include within its charter, such as items related to the technical day-to-day operation of the Root Server System (RSS) or the confusion surrounding a contributor’s lack of understanding of multiple ICANN bodies such as SSAC.
ii. Factually Incorrect Findings: Findings that are factually incorrect about RSSAC and/or the RSS.
iii. Tone: Findings and tone related to public opinion and sensational anonymous quotes about RSSAC or its purpose, but not providing any other insight.<ref name="assessfb" /></blockquote>
The committee argued that it is only empowered to do that which is within its [[RSSAC Charter|charter]], and that any findings or recommendations should specifically address the tenets of that charter, the ICANN Bylaws, and RSSAC's "structure and procedures, <nowiki>[...]</nowiki> in line with relevant process documents and bylaws."
==Final Report & Recommendations==
Interisle received and incorporated feedback from the Assessment Report, and presented draft recommendations to the Review Work Party on April 3, 2018.<ref>[https://mm.icann.org/pipermail/rssac-review2/2018-April/000117.html Email from April Graves to RSSAC Review2 listserv]</ref><ref>[http://mm.icann.org/pipermail/rssac-review2/attachments/20180403/471b08dd/RSSACReviewDraftRecommendationsforRWP20180402.pdf RSSAC Review Draft Recommendations (PDF)]</ref> The draft recommendations were the subject of a teleconference meeting between Interisle, MMSI, and the RWP on April 12, 2018.<ref>[https://community.icann.org/download/attachments/71601202/RSSAC%20Review2%2012%20april%202018.m4a?version=1&modificationDate=1523572608000&api=v2 Archive audio, Meeting #10, April 12, 2018 (M4A)]</ref><ref>[https://community.icann.org/display/ACCRSSAC/RSSAC+Work+Party+Meetings?preview=/71601202/84214879/Interisle%20RWP%20Status%20Update%20Presentation%2020180412.pdf Independent Examiner Slide Presentation - Draft Recommendations (PDF)]</ref>
On April 20, RSSAC issued its feedback on the draft recommendations to Interisle.<ref>[https://mm.icann.org/pipermail/rssac-review2/2018-April/000121.html Email from Carlos Reyes to RSSAC Review2 listserv]</ref><ref>[http://mm.icann.org/pipermail/rssac-review2/attachments/20180420/4e798b0f/RSSACRWPFeedbackonDraftRecommendations1-0001.pdf RSSAC RWP Feedback on Draft Recommendations (PDF)]</ref> Interisle responded on April 25 with comments appended to the RWP's feedback document.<ref>[https://mm.icann.org/pipermail/rssac-review2/2018-April/000124.html Email from Angie Graves to the RSSAC Review2 listserv, April 25, 2020]</ref><ref>[http://mm.icann.org/pipermail/rssac-review2/attachments/20180425/d861da4d/RSSACRWPFeedbackonDraftRecommendations-IEresponse-0001.docx Independent Examiner's Response (DOCX)]</ref>
On May 1, 2018, Interisle released its Draft Final Report for public comment.<ref>[https://www.icann.org/public-comments/rssac2-review-final-2018-05-01-en Draft Final Report for Public Comment]</ref>
The final report listed six principal recommendations; there was no change from the draft to the final report.
# Modify the RSSAC membership criteria to allow the RSSAC to recruit a variety of skills, perspectives, and interests that include but are not limited to those available from the root server operator organizations.
# Resolve the apparent mismatch between the charter and operational procedures of the RSSAC and the requirements and expectations of the ICANN Board and Community for interaction with the root server system.
# Formalize the responsibilities of the RSSAC to the ICANN Board and Community in a work plan that is periodically reviewed and published, and hold the RSSAC accountable for work plan deliverables.
# Develop and implement a leadership training and succession plan.
# Engage more actively with the rest of ICANN and its Community.
# Clarify the role and responsibility of the RSSAC with respect to other groups with adjacent or overlapping remits, including the SSAC, the RZERC, and the RSSAC Caucus.<ref>[https://www.icann.org/en/system/files/files/rssac-review-final-02jul18-en.pdf RSSAC Organizational Review Final Report (PDF)]</ref>
The Draft Final Report received public comments from a variety of sources. On June 8, 2018, RSSAC published '''RSSAC036''': RSSAC Statement on the Draft Final Report of the Second Organizational Review of the RSSAC.<ref>[https://www.icann.org/en/system/files/files/rssac-036-14jun18-en.pdf RSSAC Statement on the Draft Final Report of the Second Organizational Review of the RSSAC (PDF)]</ref> The RSSAC repeated its objections to the scope and focus of the review in its statement. [[ALAC]] published a response that commented on three of the proposed recommendations.<ref>[https://atlarge.icann.org/advice_statements/11539 ALAC Statement Regarding RSSAC Organizational Review]</ref> Notably, its response to Recommendation 2 strongly favored action to ensure that ICANN had a sufficiently robust relationship with [[RSO|RSOs]]:
<blockquote>Although there is no clear way to address the issue, since ICANN has a part to play in ensuring that the DNS is a trusted and reliable resource, then it must have the ability to interact with all players who have a role in carrying that out and that must include the Root Server Operators. Simply lowering expectations does not address the issue. Whether this is done by widening the scope of the RSSAC or through some other mechanism is less important than noting that the current chasm must be bridged.<ref>[https://community.icann.org/download/attachments/84219445/AL-ALAC-ST-0618-01-01-EN.pdf?version=1&modificationDate=1546864796000&api=v2 Draft Statement of ALAC - ratified without change (PDF)]</ref></blockquote>
The [[BC|Business Constituency]] agreed: "The BC requests that this recommendation be prioritized, noting it is 'highly concerned...that RSSAC does not consider itself accountable to ICANN Board and Community.<ref>[https://www.icann.org/en/system/files/files/report-comments-rssac2-review-final-15jun18-en.pdf Summary Report of Public Comment Proceeding, p.4 (PDF)]</ref>'"
RSSAC, for its part, "conclude<nowiki>[d]</nowiki> that neither the ICANN Board nor the ICANN community harbor the mismatch raised in the draft final report."<ref>[https://www.icann.org/en/system/files/files/rssac-036-14jun18-en.pdf RSSAC Statement on the Draft Final Report of the Second Organizational Review of the RSSAC, p. 4 (PDF)]</ref>
After the public comment period closed, the draft final report was a topic of an open session at ICANN 62.<ref name="icann62">[https://participate.icann.org/p4ynjd8bp6s/ Adobe Connect Archive - ICANN 62]</ref> Interisle released its final report on July 2, 2018.<ref>[https://www.icann.org/en/system/files/files/rssac-review-final-02jul18-en.pdf RSSAC Organizational Review Final Report (PDF)]</ref>
==Implementation Phase==
The [[ICANN Board]] instructed RSSAC to develop a Feasibility Assessment & Initial Implementation Plan in the wake of the publication of the Final Report.<ref name="icann62" /> The RWP released its plan on October 2, 2018.<ref name="faiip">[https://www.icann.org/en/system/files/files/rssac2-review-faiip-02oct18-en.pdf RSSAC2 Review - Feasibility Assessment & Initial Implementation Plan]</ref>
Implementation of the recommendations continued until December 2020, when RSSAC submitted its final status report on implementation.<ref>[https://www.icann.org/en/system/files/files/rssac2-org-review-implementation-report-09dec20-en.pdf RSSAC2 Review Implementation Report], December 9, 2020.</ref> The RSSAC2 process has been marked as complete on the RSSAC review dashboard.<ref>[https://www.icann.org/resources/reviews/org/rssac ICANN.org - RSSAC Organizational Reviews], retrieved May 19, 2021</ref>
==Background==
Pursuant to Article 4, Section 4.4 of the [[ICANN Bylaws]], [[ICANN]] initiated a second RSSAC independent review process on April 19, 2017.<ref>[https://www.icann.org/resources/board-material/resolutions-2017-04-19-en#1.a Approved Board Resolutions - ICANN Special Board Meeting, April 19, 2017]</ref> The [[Operational Effectiveness Committee]] of the [[ICANN Board]] drafted and distributed a Request for Proposals for this review.<ref>[https://www.icann.org/news/announcement-2017-06-05-en Request for Proposals for the RSSAC Organizational Review]</ref>
==Scope of Review==
In both the announcement and the RFP, ICANN presented a broad scope of subjects for review. For example, the announcement stated that the goal was a "comprehensive assessment" of the RSSAC, "<nowiki>includ[ing], but [...] </nowiki>not limited to:
* The continued purpose of RSSAC within the ICANN structure;
* How effectively RSSAC fulfills its purpose;
* Whether any change in structure or operations is needed; and
* The extent to which RSSAC as a whole is accountable to the wider ICANN community."<ref>[https://www.icann.org/news/announcement-2017-06-05-en Request for Proposal for the RSSAC Organizational Review]</ref>
The RFP echoed the need to investigate those issues, and also provided a "non-comprehensive" list of proposed questions to be addressed regarding the RSSAC's composition, mission, procedures, transparency, and communication.<ref>[https://www.icann.org/en/system/files/files/rfp-rssac-review-05jun17-en.pdf Project Overview to the
Request for Proposal For REVIEW OF THE ICANN Root Server System Advisory Committee - June 5, 2017 (PDF)]</ref> On April 18, 2017, on behalf of RSSAC, Carlos Reyes submitted comments to ICANN requesting more specificity in some of the proposed questions.<ref>[https://mm.icann.org/pipermail/rssac-review2/2017-April/000002.html Email: Carlos Reyes to Lars Hoffman, April 18 2017]</ref> In correspondence back to the RSSAC, ICANN submitted a draft "Self Assessment" tool for the committee utilizing the RFP's proposed questions as part of the assessment template, with changes to some questions that appear to align with the RSSAC requests for clarity.<ref>[https://mm.icann.org/pipermail/rssac-review2/2017-May/000003.html Email: Angie Graves to RSSAC-Review2 listserv, May 4, 2017]</ref>
==Selection of Independent Examiner==
After accepting and reviewing proposals through the RFP process, [[ICANN]] contracted with [[Interisle Consulting Group, LLC]] to conduct the second independent review of RSSAC.<ref>[https://www.icann.org/news/announcement-2017-09-28-en ICANN Announcement of Selection of Independent Examiner, Interisle - September 28, 2017]</ref> Interisle assembled a team of three consultants for the review, [[Lyman Chapin]], [[Jim Reid]], and [[Colin Strutt]]<ref>[https://community.icann.org/display/ACCRSSAC/Independent+Examiner ICANN's RSAAC2 Dashboard - Independent Examiner]</ref>
==Assessment Report & Findings==
Interisle's review included attendance at RSSAC meetings, [[ICANN Meetings|ICANN meeting]] sessions, and conference calls during the autumn of 2017 and winter of 2018.<ref name="finalreport2">[https://www.icann.org/en/system/files/files/rssac-review-final-02jul18-en.pdf Independent Review of the ICANN Root Server System Advisory Committee: Final Report; July 2, 2018 (PDF)]</ref> In addition, they conducted 48 interviews with individuals connected to or working within the RSSAC.<ref name="finalreport2" /> At the end of 2017, Interisle conducted an online survey "to collect input from those who have interacted with RSSAC and/or have ideas for ways to improve it."<ref>[https://www.icann.org/news/announcement-2017-11-27-en ICANN Announcement of RSSAC Survey - November 27, 2017]</ref> In addition to publishing notice of the survey, ICANN specifically solicited responses from the [[RSSAC Caucus]].<ref name="finalreport2" /> The survey, which did not require participants to identify themselves, garnered 74 visits and 39 responses.<ref name="finalreport2" />
Other data utilized by Interisle came from:
* RSSAC's Self-Assessment, completed in September 2017;<ref>[https://mm.icann.org/pipermail/rssac-review2/2017-September/000014.html Email: Carlos Reyes to MSSI staff, September 8, 2017]</ref><ref>[http://mm.icann.org/pipermail/rssac-review2/attachments/20170908/af910e0d/RSSACOrganizationalReview2Self-Assessment.pdf RSSAC Organizational Review 2: Self-Assessment (PDF)]</ref>
* publicly available documents from a wide variety of sources that discuss the RSSAC and related activities; and
* Interisle's "own extensive knowledge of ICANN, the RSSAC, and the DNS root server system."<ref name="finalreport2" />
Interisle subjected this data to a structured qualitative analysis<ref>For a primer on structured qualitative analysis, see [https://www.qualitative-research.net/index.php/fqs/article/view/2092/3904 Herz, Peters, & Truschkat: "How to Do Qualitative Structural Analysis: The Qualitative Interpretation of Network Maps and Narrative Interviews;" Forum: Qualitative Social Research, Vol. 16 No. 1, January 2015]</ref> and presented its findings in an Initial Assessment Report to ICANN.<ref>[https://www.icann.org/news/announcement-2018-02-27-en RSSAC2 Review: Assessment Report Published - ICANN announcement, February 27, 2018]</ref> The draft assessment report was the topic of meetings between members of RSSAC's Review Work Party and Interisle's consultants.<ref>[https://participate.icann.org/p2zrcgd41jl/ Recording of RSSAC Review2 Work Party, February 15, 2018]</ref><ref>[https://community.icann.org/display/ACCRSSAC/RSSAC+Work+Party+Meetings The RSSAC Work Party Meetings Archive] lists a meeting on February 20, intended to cover feedback provided by the RWP. However, a recording is presently not available.</ref>
The Assessment Report listed a total of forty-two findings in response to the issues and questions posed by ICANN.<ref name="assessment">[https://www.icann.org/en/system/files/files/rssac-review-assessment-report-22feb18-en.pdf RSSAC Review - Assessment Report for Public Consultation]</ref> Of these, Interisle identified eight principal findings, which they highlighted in the report and its executive summary<ref>[https://www.icann.org/en/system/files/files/rssac-review-assessment-report-exec-summary-22feb18-en.pdf]</ref> of the assessment:
# The ongoing RSSAC reformation that began in 2013—revised RSSAC charter, new operating procedures, and creation of the RSSAC Caucus—has substantially improved the structure and operation of the RSSAC.
# The RSSAC has become more open, transparent, and accessible since the last review, but this has not been widely recognized by outside observers.
# As the only visible interface between ICANN and the RSOs, the RSSAC is expected to deal with every root service issue that arises within ICANN, whether or not the issue is properly within its scope.
# The RSSAC’s ability to serve as a shared space for RSO–ICANN communication and cooperation is complicated by a persistent legacy of distrust of ICANN by some of its members.
# The current RSSAC membership model excludes non-RSO participants and their different skills and perspectives.
# The RSSAC’s continuing purpose in the ICANN structure may include serving as the focal point for issues of mutual concern to ICANN and the RSOs, such as future operational and funding scenarios for serving the root.
# Because RSSAC members do not agree on who its stakeholders should be, it is not clear for what and to whom it should be accountable.
# The relative roles and responsibilities of the RSSAC, the RSSAC Caucus, the RZERC, and the SSAC are unclear to both outsiders and insiders.<ref name="assessment" />
==Response to Assessment Report==
The Assessment Report was submitted for public comment and response prior to the development of recommendations. At an open meeting on March 14, 2018 at [[ICANN 61]],<ref>[https://61.schedule.icann.org/meetings/647791 ICANN 61 Meeting Archive]</ref> Lyman Chapin explained:
<blockquote>And this reflects a process that MSSI has fairly recently adopted for doing organizational reviews, which is to divide them into two distinct phases. The first phase is an assessment phase in which the idea is not to anticipate what recommendations might be made but simply to report on what the independent examiner found after conducting interviews, and surveys, and document reviews, and so forth.<ref name="icann61transcript">[https://static.ptbl.co/static/attachments/172550/1523576427.pdf?1523576427 Transcript of RSSAC Organizational Review Session at ICANN 61]</ref> </blockquote>Chapin presented the principal findings at the ICAAN 61 meeting, and received no questions from the attendees.<ref name="icann61transcript" />
On March 28, 2018, RSSAC issued '''RSSAC032:''' Feedback on the Independent Review of the Root Server System Advisory Committee (RSSAC) Assessment Report for Public Consultation.<ref name="assessfb">[https://www.icann.org/en/system/files/files/rssac-032-28mar18-en.pdf RSSAC032]</ref> RSSAC032 begins with a discussion of the [[ICANN Bylaws]] and the committee's expectation of the focus of the review:
<blockquote>RSSAC’s interpretation of the stated assessment report’s purpose is that an organizational review would look at the ''organization'' – its chairs, its procedures, its guiding documents including charter and bylaws, its meetings, and the publications it has produced.<ref name="assessfb" /></blockquote>
This interpretation substantially diminished the scope of ICANN's announcement of the review, and the parameters defined in the RFP. Based on that narrow definition of scope, the committee found "three...surprising categories of findings" that they viewed as outside the purpose of the review:
<blockquote>However, we found that the initial assessment report included three additional surprising categories of findings.
i. Out of Scope Findings: Findings related to items that RSSAC could never include within its charter, such as items related to the technical day-to-day operation of the Root Server System (RSS) or the confusion surrounding a contributor’s lack of understanding of multiple ICANN bodies such as SSAC.
ii. Factually Incorrect Findings: Findings that are factually incorrect about RSSAC and/or the RSS.
iii. Tone: Findings and tone related to public opinion and sensational anonymous quotes about RSSAC or its purpose, but not providing any other insight.<ref name="assessfb" /></blockquote>
The committee argued that it is only empowered to do that which is within its [[RSSAC Charter|charter]], and that any findings or recommendations should specifically address the tenets of that charter, the ICANN Bylaws, and RSSAC's "structure and procedures, <nowiki>[...]</nowiki> in line with relevant process documents and bylaws."
==Final Report & Recommendations==
Interisle received and incorporated feedback from the Assessment Report, and presented draft recommendations to the Review Work Party on April 3, 2018.<ref>[https://mm.icann.org/pipermail/rssac-review2/2018-April/000117.html Email from April Graves to RSSAC Review2 listserv]</ref><ref>[http://mm.icann.org/pipermail/rssac-review2/attachments/20180403/471b08dd/RSSACReviewDraftRecommendationsforRWP20180402.pdf RSSAC Review Draft Recommendations (PDF)]</ref> The draft recommendations were the subject of a teleconference meeting between Interisle, MMSI, and the RWP on April 12, 2018.<ref>[https://community.icann.org/download/attachments/71601202/RSSAC%20Review2%2012%20april%202018.m4a?version=1&modificationDate=1523572608000&api=v2 Archive audio, Meeting #10, April 12, 2018 (M4A)]</ref><ref>[https://community.icann.org/display/ACCRSSAC/RSSAC+Work+Party+Meetings?preview=/71601202/84214879/Interisle%20RWP%20Status%20Update%20Presentation%2020180412.pdf Independent Examiner Slide Presentation - Draft Recommendations (PDF)]</ref>
On April 20, RSSAC issued its feedback on the draft recommendations to Interisle.<ref>[https://mm.icann.org/pipermail/rssac-review2/2018-April/000121.html Email from Carlos Reyes to RSSAC Review2 listserv]</ref><ref>[http://mm.icann.org/pipermail/rssac-review2/attachments/20180420/4e798b0f/RSSACRWPFeedbackonDraftRecommendations1-0001.pdf RSSAC RWP Feedback on Draft Recommendations (PDF)]</ref> Interisle responded on April 25 with comments appended to the RWP's feedback document.<ref>[https://mm.icann.org/pipermail/rssac-review2/2018-April/000124.html Email from Angie Graves to the RSSAC Review2 listserv, April 25, 2020]</ref><ref>[http://mm.icann.org/pipermail/rssac-review2/attachments/20180425/d861da4d/RSSACRWPFeedbackonDraftRecommendations-IEresponse-0001.docx Independent Examiner's Response (DOCX)]</ref>
On May 1, 2018, Interisle released its Draft Final Report for public comment.<ref>[https://www.icann.org/public-comments/rssac2-review-final-2018-05-01-en Draft Final Report for Public Comment]</ref>
The final report listed six principal recommendations; there was no change from the draft to the final report.
# Modify the RSSAC membership criteria to allow the RSSAC to recruit a variety of skills, perspectives, and interests that include but are not limited to those available from the root server operator organizations.
# Resolve the apparent mismatch between the charter and operational procedures of the RSSAC and the requirements and expectations of the ICANN Board and Community for interaction with the root server system.
# Formalize the responsibilities of the RSSAC to the ICANN Board and Community in a work plan that is periodically reviewed and published, and hold the RSSAC accountable for work plan deliverables.
# Develop and implement a leadership training and succession plan.
# Engage more actively with the rest of ICANN and its Community.
# Clarify the role and responsibility of the RSSAC with respect to other groups with adjacent or overlapping remits, including the SSAC, the RZERC, and the RSSAC Caucus.<ref>[https://www.icann.org/en/system/files/files/rssac-review-final-02jul18-en.pdf RSSAC Organizational Review Final Report (PDF)]</ref>
The Draft Final Report received public comments from a variety of sources. On June 8, 2018, RSSAC published '''RSSAC036''': RSSAC Statement on the Draft Final Report of the Second Organizational Review of the RSSAC.<ref>[https://www.icann.org/en/system/files/files/rssac-036-14jun18-en.pdf RSSAC Statement on the Draft Final Report of the Second Organizational Review of the RSSAC (PDF)]</ref> The RSSAC repeated its objections to the scope and focus of the review in its statement. [[ALAC]] published a response that commented on three of the proposed recommendations.<ref>[https://atlarge.icann.org/advice_statements/11539 ALAC Statement Regarding RSSAC Organizational Review]</ref> Notably, its response to Recommendation 2 strongly favored action to ensure that ICANN had a sufficiently robust relationship with [[RSO|RSOs]]:
<blockquote>Although there is no clear way to address the issue, since ICANN has a part to play in ensuring that the DNS is a trusted and reliable resource, then it must have the ability to interact with all players who have a role in carrying that out and that must include the Root Server Operators. Simply lowering expectations does not address the issue. Whether this is done by widening the scope of the RSSAC or through some other mechanism is less important than noting that the current chasm must be bridged.<ref>[https://community.icann.org/download/attachments/84219445/AL-ALAC-ST-0618-01-01-EN.pdf?version=1&modificationDate=1546864796000&api=v2 Draft Statement of ALAC - ratified without change (PDF)]</ref></blockquote>
The [[BC|Business Constituency]] agreed: "The BC requests that this recommendation be prioritized, noting it is 'highly concerned...that RSSAC does not consider itself accountable to ICANN Board and Community.<ref>[https://www.icann.org/en/system/files/files/report-comments-rssac2-review-final-15jun18-en.pdf Summary Report of Public Comment Proceeding, p.4 (PDF)]</ref>'"
RSSAC, for its part, "conclude<nowiki>[d]</nowiki> that neither the ICANN Board nor the ICANN community harbor the mismatch raised in the draft final report."<ref>[https://www.icann.org/en/system/files/files/rssac-036-14jun18-en.pdf RSSAC Statement on the Draft Final Report of the Second Organizational Review of the RSSAC, p. 4 (PDF)]</ref>
After the public comment period closed, the draft final report was a topic of an open session at ICANN 62.<ref name="icann62">[https://participate.icann.org/p4ynjd8bp6s/ Adobe Connect Archive - ICANN 62]</ref> Interisle released its final report on July 2, 2018.<ref>[https://www.icann.org/en/system/files/files/rssac-review-final-02jul18-en.pdf RSSAC Organizational Review Final Report (PDF)]</ref>
==Implementation Phase==
The [[ICANN Board]] instructed RSSAC to develop a Feasibility Assessment & Initial Implementation Plan in the wake of the publication of the Final Report.<ref name="icann62" /> The RWP released its plan on October 2, 2018.<ref name="faiip">[https://www.icann.org/en/system/files/files/rssac2-review-faiip-02oct18-en.pdf RSSAC2 Review - Feasibility Assessment & Initial Implementation Plan]</ref>
Implementation of the recommendations continued until December 2020, when RSSAC submitted its final status report on implementation.<ref>[https://www.icann.org/en/system/files/files/rssac2-org-review-implementation-report-09dec20-en.pdf RSSAC2 Review Implementation Report], December 9, 2020.</ref> The RSSAC2 process has been marked as complete on the RSSAC review dashboard.<ref>[https://www.icann.org/resources/reviews/org/rssac ICANN.org - RSSAC Organizational Reviews], retrieved May 19, 2021</ref>