Learning and Evaluation/Archive/Connect/Questions: Difference between revisions

Revision as of 18:05, 29 May 2014

Latest revision as of 21:31, 12 December 2023

(17 intermediate revisions by 9 users not shown)

Line 1:

<div style="margin:2px 0 0;background:#2E2C2C;border-radius:1em 1em 0 0;padding: 1em 2em 0;font-family:'Hoefler Text',Constantia,Gabriola,Georgia,Cambria,'Palatino Linotype','Baskerville Old Face',Garamond,'Times New Roman',serif;font-size:1.2em;color:#F7F6F1;opacity:85%;">

<languages/>

{{TNT|Evaluation/Header

<div style="float:right;margin-left:0.5em;width:47%;text-align:right;">

|page summary=This is the parlor discussion page.

<!--

|links=

-->[[Special:MyLanguage/Grants:Evaluation/Library|<!--

|more content=<div style="color: #2E2C2C; text-align:center">{{Programs:Evaluation_portal/Parlor/Questions/Question-form}}</div>

--><span<!--

}}

--> style="font-size: {{{top font-size}}}; color: #F7F6F1; border-bottom: 1px dotted #F7F6F1;"<!--

{{TOCright|width=40%}}

--> <!--

{{archive box auto|auto=dated}}

-->><span title="

{{User:MiszaBot/config

Links to case studies and evaluation resources">

Library</span><!--

--></span><!--

-->]]<!--

-->&nbsp;'''·''' <!--

-->[[Special:MyLanguage/Grants:Evaluation/Tools|<!--

--><span<!--

--> style="font-size: {{{top font-size}}}; color: #F7F6F1; border-bottom: 1px dotted #F7F6F1;"<!--

--> <!--

-->><span title="

Tools for evaluation">

Tools</span><!--

--></span><!--

-->]]<!--

-->&nbsp;'''·''' <!--

-->[[Special:MyLanguage/Grants:Evaluation/Parlor|<!--

--><span<!--

--> style="font-size: {{{top font-size}}}; color: #F7F6F1; border-bottom: 1px dotted #F7F6F1;"<!--

--> <!--

-->><span title="

Introduce yourself and interact with people in evaluation">

Parlor</span><!--

--></span><!--

-->]]<!--

-->&nbsp;'''·''' <!--

-->[[Special:MyLanguage/Grants:Evaluation/News|<!--

--><span<!--

--> style="font-size: {{{top font-size}}}; color: #F7F6F1; border-bottom: 1px dotted #F7F6F1;"<!--

--> <!--

-->><span title="

Current events, blogs and news">

News</span><!--

--></span><!--

-->]]<!--

-->&nbsp;'''·''' <!--

-->[[Special:MyLanguage/Grants:Evaluation/Boiler room|<!--

--><span<!--

--> style="font-size: {{{top font-size}}}; color: #26A9E0; border-bottom: 1px dotted #26A9E0;"<!--

--> <!--

-->><span title="

Portal planning and maintenance area">

Leave feedback</span><!--

--></span><!--

-->]]<!--

-->

[[File:Three white gear shapes.svg|75px|right|link=Special:MyLanguage/Grants:Evaluation]]

{{clear}}

[[File:Internet-group-chat.svg|20px|link=Special:MyLanguage/Grants:Evaluation/Parlor/Questions]]

<!--

-->[[Special:MyLanguage/Grants:Evaluation/Parlor/Questions|<!--

--><span<!--

--> style="font-size: {{{top font-size}}}; color: #26A9E0; border-bottom: 1px dotted #26A9E0;"<!--

--> <!--

-->><span title="

Ask questions and discuss program evaluation">

Ask questions and discuss program evaluation</span><!--

--></span><!--

-->]]<!--

-->

</div>

<div style="float:left;margin-left:0.5em;width:49%;">

This is the parlor discussion page.

[[File:Two white gear shapes.svg|55px|left|link=Special:MyLanguage/Grants:Evaluation]]

</div>

<div style="color: #2E2C2C; text-align:center">{{TNT|Grants:Evaluation/Parlor/Questions/Question-form| uselang={{uselang}} }}</div>

{{clear}}

</div>{{Historical|category=[[Category:Evaluation archive]]}}

{{TOCright|width=auto}}

{{archive box auto|base=Grants:Evaluation/Parlor/Questions/Archives/|auto=dated}}<!--

-->{{User:MiszaBot/config

|minthreadsleft = 2

|minthreadstoarchive = 1

|algo = old(30d)

|archive = ProgramsGrants:Evaluation portal/Parlor/Questions/Archives/%(year)d-%(month)02d

}}

== Rationale for the privacy form ==

I can not understand the rationale for having participants in a course/event/edit-a-thon to [[ProgramsGrants:Evaluation_portalEvaluation/Shop/Wikimetrics/Forms|fill a form to opt-in in Wikimetrics]]. In principle I could get any set of random user names from the history of any page, create a CSV file, upload it on Wikimetrics and analyse the users' activity. Without even meeting anybody. So why for events do we need an opt-in form? Again, in principle I could do this kind of analysis downloading the complete dump of a given edition of Wikipedia and write some tools to calculate the some things that Wikimetrics does. All that without asking anybody.

Given this premise, with Wikimedia Italia we organized recently a course for librarians (see the [[:w:it:Progetto:GLAM/Biblioteche/Progetti/Wikipedia_e_bibliotecari:_un_incontro_possibil|project page]]) where every participant created a personal account. We then asked everybody to put their usernames in that page so that we could monitor their progress with Wikimetrics. We did not know about this opt-in form until today and so they have not signed it, even if they have been explicitly warned during the course. What can we do? Thank you. -- [[User:CristianCantoro|CristianCantoro]] ([[User talk:CristianCantoro|talk]]) 11:37, 10 December 2013 (UTC)

:Thank you [[User:CristianCantoro|Cristian]] for your comment and chance for clarification. You are correct that, in many cases, participant user names are a matter of public record, in that case it may not be necessary, but a matter of operating in a completely open manner in which participants actually approve of their being tracked and monitored via Wikimetrics which make it rather simple to do so. Importantly, Wikimetrics increases accessibility to metric data in a way that user names are transferred to Wikimedia Foundation (internationally to the United States) and to best cover everyones privacy interests and protections we need to allow them to opt in, as well as out, of this monitoring when we know we are collecting usernames explicitly for this purpose. The particular language and guidance for disclosing the who, what, where, and why that have been thoughtfully crafted by the WMF legal team to be sure privacy interests are protected and transparency is upheld. This is a shift in practice that we are working to assist program leaders in coordinating so that the future collection of usernames will best protect all parties interested. The usernames you already have public record of are still useable, we just recommend that you also allow people to opt out should they become aware of this usage of their usernames and wish to be excluded from monitoring (you may want to post the language and possibly instructions for "opting out" on the page they added their names to). I hope this helps, please let me know if I can answer any further. [[User:JAnstee (WMF)|JAnstee (WMF)]] ([[User talk:JAnstee (WMF)|talk]]) 21:58, 10 December 2013 (UTC)

Line 38 ⟶ 123:

::::Can you perhaps expand on the point you're implying by adding this citation needed tag, Nemo? It's not very helpful on its own. [[User:Jtmorgan|Jtmorgan]] ([[User talk:Jtmorgan|talk]]) 21:43, 18 December 2013 (UTC)

==Wikimania evaluation ==

I am curious, how is Program Evaluation planning to instrument Wikimania and evaluate Wikimania this year? Also, will Program Evaluation provide a guide to Wikimania participants about how to maximize the "impact" of their participation? Some informal discussion about how to get value out of the Wikimania hackathon has already happened on the tech mailing list. Thanks, --<font style="white-space:nowrap;text-shadow:#008C3A 0.1em 0.1em 1.5em,#01796F -0.1em -0.1em 1.5em;color:#000000">[[User:Pine|<font color="#01796F"><b>Pine</b></font>]][[User talk:Pine|<font color="#01796F">^✉</font>]]</font> 19:16, 23 July 2014 (UTC)

:Hello Pine. Somehow missed this question. We have been working with the organizers of this year's Wikimania to develop an exit survey similar to that which was done following the Wikimedia Conference in Berlin (View their very recent reporting and link to survey data [[Wikimedia_Conference_2014/Feedback_evaluation|here]]). Similarly, the Wikimania survey targets goals of learning, networking and collaboration and will include measurement of the conference content overall; the organization and logistics of the conference; evaluation of the themes and their related content presented in terms of usefulness; participant networking and collaboration; overall learning outcomes; participant satisfaction and basic background demographics. The items are currently under final review and comment with a number of current, past, and future Wikimania planning stakeholders. This survey will also link to an optional set of items to assess survey-based outcomes for hackathon participants as well. While also still in the planning stage with the planning team, those items will likely include measurement of perceptions about the structure of hackathon days and projects, opportunities for mentoring, guidance, and collaboration and the usefulness and outcomes and/or potential outcomes of those opportunities. In addition to this exit survey, Ed Saperia is arranging for participation counts to be taken at each of the sessions and pushing to have people share lessons learned and hot conversations via twitter to the conference hashtag for potential content analysis. [[User:JAnstee (WMF)|JAnstee (WMF)]] ([[User talk:JAnstee (WMF)|talk]]) 19:24, 28 July 2014 (UTC)

::Thanks [[User:JAnstee (WMF)]]. This is good to hear. Will you also be evaluating the online impact of Wikimania particularly as it relates to active editor statistics and editor diversity? Also, would you be willing to adapt or create a survey to evaluate the Research Hackathon next week? If you can draft a survey I can review it with the other event organizers. It may be possible for us to simply adapt the dev hackathon survey for the Research Hackathon. Thanks, --<font style="white-space:nowrap;text-shadow:#008C3A 0.1em 0.1em 1.5em,#01796F -0.1em -0.1em 1.5em;color:#000000">[[User:Pine|<font color="#01796F"><b>Pine</b></font>]][[User talk:Pine|<font color="#01796F">^✉</font>]]</font> 07:32, 31 July 2014 (UTC)

:::That is a good follow-up point. As we do not directly evaluate, but work to support self-evaluation of programs, I cannot speak to those goals and related evaluation strategies except for the portion of the conference for which organizers have shared goals for direct online impact, the hackathon. For the hackathon days, organizers plan to track the product of hackathon efforts in terms of the bugs fixed, templates created/added, analyses run, citations added, and the like, however this tracking is the responsibility of the organizers. As for tracking online activity of all Wikimania conference participants, that ''would'' be possible with usernames, and Wikimetrics at appropriate follow-up points, however, since the primary goals of Wikimania have not been stated in terms of intermediate behavior outcomes specific to online activity, there is currently no plan for that at this time, only immediate outcomes and short-term learning, networking, and motivation outcomes as targeted by the existing survey draft items. As for that draft, I would be happy to also send your way for input as well (I will share that draft to your inbox). [[User:JAnstee (WMF)|JAnstee (WMF)]] ([[User talk:JAnstee (WMF)|talk]]) 17:34, 31 July 2014 (UTC)