[Wgwseval] Kick-off of the Working Group Workshop Evaluation!

Tue Feb 12 10:04:53 EST 2019

Thank you, Chengetai, for sending these along.

Ben, thanks kindly for your email. Re the mock proposals, I support your idea of using previous examples.  The examples would probably need to be adapted to whatever new criteria or format we develop within the WG, but I don't imagine that being a heavy lift. Once we have our WG work plan established, I imagine that we could reach out to volunteers to help with that...

Sincerely,
Susan

Susan Elizabeth Chalmers
Internet Policy Specialist
Office of International Affairs
National Telecommunications and Information Administration
U.S. Department of Commerce
202.482.6789

-----Original Message-----
From: Chengetai Masango <chengetai.masango at un.org> 
Sent: Tuesday, February 12, 2019 9:09 AM
To: Ben Wallis (CELA) <bewallis at microsoft.com>; Jutta Croll <jcroll at digitale-chancen.de>; wgwseval at intgovforum.org
Subject: Re: [Wgwseval] Kick-off of the Working Group Workshop Evaluation!

Dear Ben,

Please find attached a pdf of the highest scoring proposals (as marked)

The highest scoring workshop proposals where(out of 5) :

Rank

ID

Title

SCORE

VARIANCE

1

231

AI: Ethical and Legal Challenges for Emerging Economies

4.5

0.1250

2

172

Accessibility Improved: building inclusive societies with AI

4.4444

0.2747

3

40

Internet Mega-Trends' Impact on the Internet’s Architecture

4.4167

0.3333

4

279

Investment Strategies to Scale Community Networks

4.4167

0.0972

5

146

Hidden aspects of digital inclusion

4.3611

0.1127

6

104

Well-being in the Digital Age (OECD Going Digital Project)

4.3438

0.3115

7

217

I Can't Use This App: Closing The Web Accessibility Gap

4.3333

0.1944

8

308

Community Networks meet Blockchains: Friends or Foes?

4.3333

0.0556

9

45

1.3 Billion Reasons for Making Technology Accessible

4.2778

0.4090

10

180

Net neutrality and beyond: ensuring freedom of choice online

4.2778

0.2701

Below are links to theme as presented as workshops with workshop reports below them.

  1.  https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.intgovforum.org%2Fmultilingual%2Fcontent%2Figf-2018-ws-231-ai-ethical-and-legal-challenges-for-emerging-economies&data=02%7C01%7Cschalmers%40ntia.doc.gov%7Cd4fb8408c9e24ec4d8cb08d690f3e1a3%7Cd6cff1bd67dd4ce8945dd07dc775672f%7C0%7C0%7C636855774474710414&sdata=t6%2B3x4dRUJ8daW2Kzwi7klHeDqJURR1Q7KlEagqyZgw%3D&reserved=0
  2.  https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.intgovforum.org%2Fmultilingual%2Fcontent%2Figf-2018-ws-172-accessibility-improved-building-inclusive-societies-with-ai&data=02%7C01%7Cschalmers%40ntia.doc.gov%7Cd4fb8408c9e24ec4d8cb08d690f3e1a3%7Cd6cff1bd67dd4ce8945dd07dc775672f%7C0%7C0%7C636855774474710414&sdata=oi4gSPuZBovQNQYAhCf4XcP4v1jL6BPm9KYGDSBDmuY%3D&reserved=0
  3.  https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.intgovforum.org%2Fmultilingual%2Fcontent%2Figf-2018-ws-40-internet-mega-trends-impact-on-the-internet%25E2%2580%2599s-architecture&data=02%7C01%7Cschalmers%40ntia.doc.gov%7Cd4fb8408c9e24ec4d8cb08d690f3e1a3%7Cd6cff1bd67dd4ce8945dd07dc775672f%7C0%7C0%7C636855774474710414&sdata=Y4ytMN%2FHGMHCnOTbVQLtbwkSewu8%2B%2FrreHogGojeaTg%3D&reserved=0
  4.  https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.intgovforum.org%2Fmultilingual%2Fcontent%2Figf-2018-ws-279-investment-strategies-to-scale-community-networks&data=02%7C01%7Cschalmers%40ntia.doc.gov%7Cd4fb8408c9e24ec4d8cb08d690f3e1a3%7Cd6cff1bd67dd4ce8945dd07dc775672f%7C0%7C0%7C636855774474710414&sdata=WTbWctmh0IPTlQ%2F8l5zEXmk8Y8op0Ts6LnYq2oqNYMc%3D&reserved=0
  5.  https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.intgovforum.org%2Fmultilingual%2Fcontent%2Figf-2018-ws-146-hidden-aspects-of-digital-inclusion&data=02%7C01%7Cschalmers%40ntia.doc.gov%7Cd4fb8408c9e24ec4d8cb08d690f3e1a3%7Cd6cff1bd67dd4ce8945dd07dc775672f%7C0%7C0%7C636855774474710414&sdata=wIPwQt3MSDJfaa3eRvJTZ0uImt1LqoKJF9WXf9nX1DE%3D&reserved=0
  6.  https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.intgovforum.org%2Fmultilingual%2Fcontent%2Figf-2018-ws-104-well-being-in-the-digital-age-oecd-going-digital-project&data=02%7C01%7Cschalmers%40ntia.doc.gov%7Cd4fb8408c9e24ec4d8cb08d690f3e1a3%7Cd6cff1bd67dd4ce8945dd07dc775672f%7C0%7C0%7C636855774474710414&sdata=M1j4Me6hI2VqiJFC%2FWOkvKaO7YwvD3YAgx8BanwbPSE%3D&reserved=0
  7.  https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.intgovforum.org%2Fmultilingual%2Fcontent%2Figf-2018-ws-217-i-cant-use-this-app-closing-the-web-accessibility-gap&data=02%7C01%7Cschalmers%40ntia.doc.gov%7Cd4fb8408c9e24ec4d8cb08d690f3e1a3%7Cd6cff1bd67dd4ce8945dd07dc775672f%7C0%7C0%7C636855774474710414&sdata=Hu2HGKPvTtDmnpmZL%2Fhmefatl%2Bgvl1FHDZAHQGenYSE%3D&reserved=0
  8.  https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.intgovforum.org%2Fmultilingual%2Fcontent%2Figf-2018-ws-308-community-networks-meet-blockchains-friends-or-foes&data=02%7C01%7Cschalmers%40ntia.doc.gov%7Cd4fb8408c9e24ec4d8cb08d690f3e1a3%7Cd6cff1bd67dd4ce8945dd07dc775672f%7C0%7C0%7C636855774474720419&sdata=zeXUSpHMeTfGj1BRiZ%2FKT5XafWJfs1napuUaK3UmUhw%3D&reserved=0
  9.  https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.intgovforum.org%2Fmultilingual%2Fcontent%2Figf-2018-ws-45-13-billion-reasons-for-making-technology-accessible&data=02%7C01%7Cschalmers%40ntia.doc.gov%7Cd4fb8408c9e24ec4d8cb08d690f3e1a3%7Cd6cff1bd67dd4ce8945dd07dc775672f%7C0%7C0%7C636855774474720419&sdata=CtoXx2pizP16ycuL1kTefW%2Blg5dzWNp834L%2F5U3slzU%3D&reserved=0
  10. https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.intgovforum.org%2Fmultilingual%2Fcontent%2Figf-2018-ws-180-net-neutrality-and-beyond-ensuring-freedom-of-choice-online&data=02%7C01%7Cschalmers%40ntia.doc.gov%7Cd4fb8408c9e24ec4d8cb08d690f3e1a3%7Cd6cff1bd67dd4ce8945dd07dc775672f%7C0%7C0%7C636855774474720419&sdata=0R1pkt1stm1eUq9qbNI12jNGr2nAqbY6j%2F%2FJK%2B47m5E%3D&reserved=0

Best regards

Chengetai

On 2/12/19, 12:42 AM, "Ben Wallis (CELA)" <bewallis at microsoft.com> wrote:

    Many thanks Jutta, Susan and Sylvia

    I think you have identified the right steps, and helpfully separated those relating to material required before the call work workshop proposals can be launched on 4th March (clearly the priority) from those relating to guidance for MAG members in evaluating proposals (needed by early May and therefore can be put to one side for now).

    There is a lot to be done in the next three weeks, so a few quick comments / suggestions:

    - presumably you will use as a starting point the WG-WREP 2018 report that Rasha circulated on 16th January (attached)

    - my understanding is that we can leave work on the narratives of the three themes to the three groups (inclusion at intgovforum.org; datagovernance at intgovforum.org; security-safety at intgovforum.org). Maybe you want to leave a space for those narrative descriptions in / at the bottom of the proposal form, or just provide a link to them in a separate document.

    - I like the idea of mock proposals but it might be time-consuming to develop them in the short time we have. I wonder instead if we can just link to selected proposals from previous years. I think the proposals are put in the public domain. We could ask the secretariat to send us links to the five or 10 (?) highest-scoring proposals and then the group could decide which ones to link to as demonstrations of a good proposal. It could be diplomatic to provide examples from at least two different stakeholder groups.

    Ben

    -----Original Message-----

    From: Jutta Croll <jcroll at digitale-chancen.de>

    Sent: Monday, February 11, 2019 9:40 AM

    To: wgwseval at intgovforum.org

    Subject: [Wgwseval] Kick-off of the Working Group Workshop Evaluation!

    Greetings everyone and welcome to the Workshop Review and Evaluation Group (WG-WREP).

    Our first step for this group is to clarify the scope of our work.  As the title of the WG indicates, we will review and update the evaluation process for the workshop proposals submitted by the community.  This includes both the independent evaluation of workshops by MAG members, as well as the process that will be used during our in-person meeting in June to finalize the workshop selection for IGF2019.

    First, however, we must decide upon the criteria against which workshop proposals will be assessed, in order to enable workshop proposers to submit quality proposals. The criteria will depend in part upon the three narratives that are being developed on cybersecurity, data, and inclusion, as well as their subthemes.

    We will update last year's submission form as needed.  We may also wish to develop mock proposals, as discussed during the MAG meeting, as guidance for proposers.  Finally, we may wish to develop a FAQ - or frequently asked questions list for the community, and translate it into several languages.

    Here is a rough outline of the steps:

    • Clarify work of WG-WREP and develop a Terms of Reference • Review workshop evaluation criteria and modify as needed • Based upon workshop evaluation criteria, develop a new form for proposal submission, including the narratives • Develop mock proposals • Submit to Secretariat for implementation

    Call for Workshop proposals - March 4th

    • Review individual and in-person workshop evaluation process • Recommend changes as needed • Submit to Secretariat and MAG chair for implementation

    Individual MAG review - [Date]

    In-person evaluation - June meeting

    We would like to take this week, including during the Virtual Meeting, to raise and discuss any questions about the above, and to circulate a draft Terms of Reference for review next Monday.  Please share any questions you may have.

    With kind regards

    Jutta Croll, Susann Chalmers and Sylvia Cadena

    **********************************

    Jutta Croll M. A.

    Stiftung Digitale Chancen

    - Projektleitung Kinderschutz und Kinderrechte in der digitalen Welt -

    - Vorsitzende des Vorstands / Chairwoman of the board - Chausseestr. 15

    D-10115 Berlin

    Germany

    Skype: jcrollSDC

    Tel.: ++ 49(0)30-43727730

    Mobil: ++ 49(0)163-5493-773

    E-Mail: jcroll at digitale-chancen.de<mailto:jcroll at digitale-chancen.de>

    URL: https://na01.safelinks.protection.outlook.com/?url=www.digitale-chancen.de&data=02%7C01%7Cschalmers%40ntia.doc.gov%7Cd4fb8408c9e24ec4d8cb08d690f3e1a3%7Cd6cff1bd67dd4ce8945dd07dc775672f%7C0%7C0%7C636855774474720419&sdata=C9vdtNQ1p2G146H498ovTkh357iSHtF7jDz74LAeNpo%3D&reserved=0

    English Version:

    https://na01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.digitale-chancen.de%2Findex.cfm%2Flang.2&data=02%7C01%7Cschalmers%40ntia.doc.gov%7Cd4fb8408c9e24ec4d8cb08d690f3e1a3%7Cd6cff1bd67dd4ce8945dd07dc775672f%7C0%7C0%7C636855774474720419&sdata=2E59sZoFJIBwCEFWTbWDGWuo3TI1obB%2Fa3lbZ9yv9W8%3D&reserved=0

    **********************************

    _______________________________________________

    wgwseval mailing list

    wgwseval at intgovforum.org

    To unsubscribe and other options please go to https://na01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fintgovforum.org%2Fmailman%2Flistinfo%2Fwgwseval_intgovforum.org&data=02%7C01%7Cschalmers%40ntia.doc.gov%7Cd4fb8408c9e24ec4d8cb08d690f3e1a3%7Cd6cff1bd67dd4ce8945dd07dc775672f%7C0%7C0%7C636855774474720419&sdata=q4CX3zJ7BAY3QmNEgORNzVX3NwlCO9wNnUgVhmOdFwY%3D&reserved=0