Changes

==2017-19 Independent Review of RSSAC by Interisle Consulting Group, LLC==

==2017-19 Independent Review of RSSAC by Interisle Consulting Group, LLC==

Pursuant to Article 4, Section 4.4 of the [[ICANN Bylaws]], [[ICANN]] initiated a second RSSAC independent review process on April 19, 2017.<ref>[https://www.icann.org/resources/board-material/resolutions-2017-04-19-en#1.a Approved Board Resolutions - ICANN Special Board Meeting, April 19, 2017]</ref> ICANN drafted and distributed a Request for Proposals for this review. In both the announcement and the RFP, ICANN presented a broad scope of subjects for review. For example, the announcement stated that the goal was a "comprehensive assessment" of the RSSAC, "<nowiki>includ[ing], but [...] </nowiki>not limited to:

Pursuant to Article 4, Section 4.4 of the [[ICANN Bylaws]], [[ICANN]] initiated a second RSSAC independent review process on April 19, 2017.<ref>[https://www.icann.org/resources/board-material/resolutions-2017-04-19-en#1.a Approved Board Resolutions - ICANN Special Board Meeting, April 19, 2017]</ref> ICANN drafted and distributed a Request for Proposals for this review.<ref>[https://www.icann.org/news/announcement-2017-06-05-en Request for Proposal for the RSSAC Organizational Review]</ref>

 

In both the announcement and the RFP, ICANN presented a broad scope of subjects for review. For example, the announcement stated that the goal was a "comprehensive assessment" of the RSSAC, "<nowiki>includ[ing], but [...] </nowiki>not limited to:

* The continued purpose of RSSAC within the ICANN structure;

* The continued purpose of RSSAC within the ICANN structure;

* How effectively RSSAC fulfills its purpose;

* How effectively RSSAC fulfills its purpose;

* The extent to which RSSAC as a whole is accountable to the wider ICANN community."<ref>[https://www.icann.org/news/announcement-2017-06-05-en Request for Proposal for the RSSAC Organizational Review]</ref>

* The extent to which RSSAC as a whole is accountable to the wider ICANN community."<ref>[https://www.icann.org/news/announcement-2017-06-05-en Request for Proposal for the RSSAC Organizational Review]</ref>

The RFP echoed the need to investigate those issues, and also provided a non-comprehensive list of proposed questions to be addressed regarding the RSSAC's composition, mission, procedures, transparency, and communication.<ref>[https://www.icann.org/en/system/files/files/rfp-rssac-review-05jun17-en.pdf Project Overview to the

The RFP echoed the need to investigate those issues, and also provided a "non-comprehensive" list of proposed questions to be addressed regarding the RSSAC's composition, mission, procedures, transparency, and communication.<ref>[https://www.icann.org/en/system/files/files/rfp-rssac-review-05jun17-en.pdf Project Overview to the

Request for Proposal For REVIEW OF THE ICANN Root Server System Advisory Committee - June 5, 2017 (PDF)]</ref> After accepting and reviewing proposals through the RFP process, [[ICANN]] contracted with [[Interisle Consulting Group, LLC]] to conduct the second independent review of RSSAC.<ref>[https://www.icann.org/news/announcement-2017-09-28-en ICANN Announcement of Selection of Independent Examiner, Interisle - September 28, 2017]</ref>  

Request for Proposal For REVIEW OF THE ICANN Root Server System Advisory Committee - June 5, 2017 (PDF)]</ref> On April 18, 2017, on behalf of RSSAC, Carlos Reyes submitted comments to ICANN requesting more specificity in some of the proposed questions.<ref>[https://mm.icann.org/pipermail/rssac-review2/2017-April/000002.html Email: Carlos Reyes to Lars Hoffman, April 18 2017]</ref> However, in correspondence back to the RSSAC, ICANN submitted a draft "Self Assessment" tool for the committee utilizing the RFP's proposed questions as part of the assessment template, with changes to some questions that appear to align with the RSSAC requests.<ref>[https://mm.icann.org/pipermail/rssac-review2/2017-May/000003.html Email: Angie Graves to RSSAC-Review2 listserv, May 4, 2017]</ref>

 

After accepting and reviewing proposals through the RFP process, [[ICANN]] contracted with [[Interisle Consulting Group, LLC]] to conduct the second independent review of RSSAC.<ref>[https://www.icann.org/news/announcement-2017-09-28-en ICANN Announcement of Selection of Independent Examiner, Interisle - September 28, 2017]</ref> Interisle assembled a team of three consultants for the review, [[Lyman Chapin]], [[Jim Reid]], and [[Colin Strutt]]<ref>[https://community.icann.org/display/ACCRSSAC/Independent+Examiner ICANN's RSAAC2 Dashboard - Independent Examiner]</ref>

===Review Methodology & Data Sources===

===Review Methodology & Data Sources===

Interisle's review included attendance at RSSAC meetings, [[ICANN Meeting]] sessions, and conference calls during the autumn of 2017 and winter of 2018.<ref name="finalreport2">[https://www.icann.org/en/system/files/files/rssac-review-final-02jul18-en.pdf Independent Review of the ICANN Root Server System Advisory Committee: Final Report; July 2, 2018 (PDF)]</ref> In addition, they conducted 48 interviews with individuals connected to or working within the RSSAC.<ref name="finalreport2" /> At the end of 2017, Interisle conducted an online survey "to collect input from those who have interacted with RSSAC and/or have ideas for ways to improve it."<ref>[https://www.icann.org/news/announcement-2017-11-27-en ICANN Announcement of RSSAC Survey - November 27, 2017]</ref> In addition to publishing notice of the survey, ICANN specifically solicited responses from the [[RSSAC Caucus]].<ref name="finalreport2" /> The survey, which did not require participants to identify themselves, garnered 74 visits and 39 responses.<ref name="finalreport2" />

Interisle's review included attendance at RSSAC meetings, [[ICANN Meeting]] sessions, and conference calls during the autumn of 2017 and winter of 2018.<ref name="finalreport2">[https://www.icann.org/en/system/files/files/rssac-review-final-02jul18-en.pdf Independent Review of the ICANN Root Server System Advisory Committee: Final Report; July 2, 2018 (PDF)]</ref> In addition, they conducted 48 interviews with individuals connected to or working within the RSSAC.<ref name="finalreport2" /> At the end of 2017, Interisle conducted an online survey "to collect input from those who have interacted with RSSAC and/or have ideas for ways to improve it."<ref>[https://www.icann.org/news/announcement-2017-11-27-en ICANN Announcement of RSSAC Survey - November 27, 2017]</ref> In addition to publishing notice of the survey, ICANN specifically solicited responses from the [[RSSAC Caucus]].<ref name="finalreport2" /> The survey, which did not require participants to identify themselves, garnered 74 visits and 39 responses.<ref name="finalreport2" />

Other data utilized by Interisle came from:

Other data utilized by Interisle came from:

* RSSAC's Self-Assessment, completed in September 2017 using the questions outlined in the RFP as a framework;

* RSSAC's Self-Assessment, completed in September 2017;<ref>[https://mm.icann.org/pipermail/rssac-review2/2017-September/000014.html Email: Carlos Reyes to MSSI staff, September 8, 2017]</ref><ref>[http://mm.icann.org/pipermail/rssac-review2/attachments/20170908/af910e0d/RSSACOrganizationalReview2Self-Assessment.pdf RSSAC Organizational Review 2: Self-Assessment (PDF)]</ref>

* publicly available documents from a wide variety of sources that discuss the RSSAC and related activities; and

* publicly available documents from a wide variety of sources that discuss the RSSAC and related activities; and

* Interisle's "own extensive knowledge of ICANN, the RSSAC, and the DNS root server system."<ref name="finalreport2" />  

* Interisle's "own extensive knowledge of ICANN, the RSSAC, and the DNS root server system."<ref name="finalreport2" />  

Interisle subjected this data to a structured qualitative analysis<ref>[https://www.qualitative-research.net/index.php/fqs/article/view/2092/3904 For a primer on structured qualitative analysis, see Herz, Peters, & Truschkat: "How to Do Qualitative Structural Analysis: The Qualitative Interpretation of Network Maps and Narrative Interviews;" Forum: Qualitative Social Research, Vol. 16 No. 1, January 2015]</ref> and presented its findings and recommendations in an initial assessment report to ICANN.<ref>[https://www.icann.org/news/announcement-2018-02-27-en RSSAC2 Review: Assessment Report Published - ICANN announcement, February 27, 2018]</ref>

Interisle subjected this data to a structured qualitative analysis<ref>[https://www.qualitative-research.net/index.php/fqs/article/view/2092/3904 For a primer on structured qualitative analysis, see Herz, Peters, & Truschkat: "How to Do Qualitative Structural Analysis: The Qualitative Interpretation of Network Maps and Narrative Interviews;" Forum: Qualitative Social Research, Vol. 16 No. 1, January 2015]</ref> and presented its findings in an initial Assessment Report to ICANN.<ref>[https://www.icann.org/news/announcement-2018-02-27-en RSSAC2 Review: Assessment Report Published - ICANN announcement, February 27, 2018]</ref>

===Response to Assessment Report===

===Response to Assessment Report===

Public comment was solicited on the Assessment Report.  

Public comment was solicited on the Assessment Report.