Learning patterns/Calculating global metrics: Difference between revisions
Content deleted Content added
mNo edit summary |
|||
| (44 intermediate revisions by 14 users not shown) | |||
Line 1:
__NOTOC__
{{Probox
|pattern=Calculating global metrics
|problem=You need to measure your project's output according to the global metrics specified by the Wikimedia Foundation.
|solution=Begin documenting your process and planning data collection before you begin your project or host your event. Use the resources made available by WMF, and reach out early if you have questions.
|pattern_type1=
|pattern_type2=
|image=File:Vitruvian_Man_Measurements_he.JPG
|portal=Patterns
|translations=Probox/Patterns/Content
|more_participants=NO
|status=
|timestamp = 27 August, 2014
|creator = EGalvez (WMF)
}}
{| class="wikitable" style="background:#696969"
|
:[[Grants:Learning patterns/Calculating global metrics|<span style="font-size:18px;color:azure">'''Global Metrics'''</span>]]<br>
:<span style="font-size:14px;color:white"> This is the overview for seven global metrics learning patterns.
:<span style="color:white">Learn what's behind Global metrics - read the [[Grants:Learning & Evaluation/Global Metrics|<span style="color:white;border-bottom:dotted 1px white">''overview page''.</span>]]
|}
== What problem does this solve? ==
This learning pattern describes how to '''successfully gather the 7 global metrics'''. Grant-funded projects and programs will need to include these metrics in their project reports beginning in late 2014.
Some project leaders have experience reporting these metrics, while others are encountering these reporting requirements for the first time. These metrics can be calculated accurately and relatively painlessly for all projects, as long as you understand the metrics and plan ahead.
== What is the solution? ==
The steps below are intended to help make sure that you are able to report your project's outcomes in terms of the 7 global metrics. You should make sure that you know how you are going to collect and calculate the data you need to report before you start. If you have questions about global metrics, you can ask your [[Grantmaking_and_Programs#Grants_programs|grants officer]], post to the [[Grants talk:Learning_&_Evaluation/Global_metrics|global metrics talk page]], or email eval@wikimedia.org.
===''Before you start your event, project, or program''===
===<span style="background:#4682B4;color:white;padding:5px;">Create event or project pages</span>===
Project or event pages can help you organize your project or event. They provide a public place for you to record the relevant information and it serves as a central ___location for participants to sign up, ask questions, and begin participating. Some things you may list in a project page include:
* Project or event name
* Project duration or event dates and times
* Project or event details (description, focus, target audience)
* Opt-out information for getting user data (more on this below)
* Sign-up list for participants
* Any
* Pages edited
* Follow-up information about other upcoming events or who to go for questions.
Line 47 ⟶ 49:
{| cellspacing="10" style="background:white;width:70%"
|-
! style="width:50%;background:#696969;color:white"|Online <br><span style="font-weight:normal"> ''e.g. Wikipedia Adventure, International Hackathon''</span> !! style="width:50%;background:#696969;color:white"|In-person <br><span style="font-weight:normal">''e.g. Editing workshop, Local Editathon''</span>
|-
! colspan="2" style="background:#DCDCDC;text-align:left" | '''1. Obtain a list of usernames'''
|-
| For most online
|| Set up an event page on wiki two weeks before, and invite new users to create accounts. If your event is in one building with one Wifi connection, only 6 accounts can be created that day. If you are unable or do not need to create an event page on wiki, have a sign-up sheet prepared at the event date with a column for username and a column for email address in case they do not have a username yet or their username is illegible.
|-
Line 67 ⟶ 69:
|}
===<span style="background:#4682B4;color:white;padding:5px;">For
{{clear}}
<div style="float:left;width:70%">
Line 73 ⟶ 75:
* Step 1: Come up with a category name, (''e.g. Wikimania 2014 Hackathon'')
* Step 2: [https://commons.wikimedia.org/w/index.php?title=Special%3ASearch&profile=advanced&search=&fulltext=Search&ns14=1&profile=advanced Search categories in commons to make sure the one you want to use does not exist]
* Step 3: Create a category by creating a category page: ''<nowiki>https://commons.wikimedia.org/wiki/
==== ... and promote the USE of images on Wikimedia projects ====
*If your program is based on images and media, be sure to tell participants to add images to Wikimedia projects!
Line 84 ⟶ 86:
Use the [[Grants:Learning patterns/Global Metrics:Learning Question|Learning Question]] Learning pattern to review the different ways you can collect this information. How you collect this is up to you!! We hope this metric will give you interesting insights about your event, project, or program.
=== ''During or After Your Project or Event'' ===
===<span style="background:#4682B4;color:white;padding:5px;">Take or Review the Wikimetrics Learning Module ===
Line 90 ⟶ 93:
===<span style="background:#4682B4;color:white;padding:5px;">Follow the learning patterns to report your Global Metrics===
The learning patterns associated with the Global Metrics are not meant to be exhaustive. However, these resources are being developed to provide support to a wide range of projects, programs, and events. Consult the patterns below for guidance on how to collect and report global metrics for your project. Feel free to improve the pattern to make it more relevant to others to may perform similar activities in the future. Post questions or comments on the pattern talk page.
<br>
* '''Not all programs will include all 7 global metrics''' - for some programs a metric may not be applicable. That is, while all programs have participants, not all programs focus to add or remove text or code (bytes added and/or removed) or to upload media files for instances. Just explain why it does apply and that is perfectly okay.
* '''Global metrics are not the only measures''' - in fact, exploring and reporting other metrics beyond the 7 global metrics is ''encouraged''.
<br>
#[[Grants:Learning patterns/Number_of_newly_registered_users|Number of newly registered users]]
#[[Grants:Learning patterns/
#[[Grants:Learning patterns/Number of individuals involved|Number of individuals involved]]
#[[Grants:Learning patterns/Number_of_images_or_media_used_in_Wikimedia_projects|Number of images or media used in Wikimedia projects]]
#[[Grants:Learning patterns/Number_of_articles_created_or_improved_in_Wikimedia_projects|Number of articles created or improved in Wikimedia projects]]
#[[Grants:Learning_patterns/Bytes_added_to_or_removed_from_Wikimedia_projects|Number of bytes added and removed from Wikimedia projects]]
#[[Grants:Learning patterns/Learning question|Learning question: Did your work increase the motivation of contributors, and how do you know?]]
=== Example report form ===
''This is an example of how to report global metrics. Your data might change depending on your project. Some of these number might even be zero - this is perfectly ok. It is important to provide clear explanations for '''how''' you arrived your numbers in the explanation column, and any other notes or information that you feel is relevant.''
<br><br>
<!---GLOBAL METRICS--->
{{Grants/Reports/Globalmetrics/Header}}
{{Grants/Reports/Globalmetrics/Rows
| metric = 1. Number of active editors involved
| achieved outcome = 15
| explanation = All the users who had at least 5 or more edits from July 1 to July 30 (the event was July 31)
}}
{{Grants/Reports/Globalmetrics/Rows
| metric = 2. Number of new editors
| achieved outcome = 3
| explanation = These were editors who created usernames two weeks before the event, up to the end of the event.
}}
{{Grants/Reports/Globalmetrics/Rows
| metric = 3. Number of individuals involved
| achieved outcome = 21
| explanation = All new and active editors who attended, plus volunteers who organized the event.
}}
{{Grants/Reports/Globalmetrics/Rows
| metric = 4a. Number of new media added to Wikimedia articles.
| achieved outcome = 7
| explanation = 7 images out of the 100 images uploaded were used in wikimedia projects.
}}
{{Grants/Reports/Globalmetrics/Rows
| metric = 4b. Number of new media uploaded to Wikimedia Commons. ''(Optional)''
| achieved outcome = 100
| explanation = 100 images uploaded were uploaded to Wikimedia Commons.
}}
{{Grants/Reports/Globalmetrics/Rows
| metric = 5. Number of articles added or improved on Wikimedia projects
| achieved outcome = 3
| explanation = 1 new article + 2 stubs expanded
}}
{{Grants/Reports/Globalmetrics/Rows
| metric = 6. Absolute value of bytes added to or deleted from Wikimedia projects
| achieved outcome = 1,200
| explanation = (absolute value) {1,000 Bytes Added} + {200 Bytes Removed} = 1,200
}}
{{Grants/Reports/Globalmetrics/Table/End}}
;Learning question: Did your work increase the motivation of contributors, and how do you know?
* Yes, we sent out a survey after the event and asked "To what extent did this event increase your motivation to contribute?". 16 participants (76%) said "a lot" or "some".
<br>
You can use this [[Grants:Learning_%26_Evaluation/Global_metrics/Template| template]] to create a table for reporting global metrics as above.
<br>
=== General considerations ===
While global metrics are required for all grantees, they may be collected differently depending on the project. For example, while many will use Wikimetrics to obtain data, some may need to use MySQL because their project requires different technical skills. Also, some metrics might be zero and that is ok. If you are a grantee, speak with your [[Grantmaking_and_Programs#Grants_programs|grants officer]] if you have questions. If you are a volunteer interested in collecting this data, but need additional help, email {{NoSpamEmail|eval|wikimedia.org}}.<!--optional. a bulleted list of things someone should keep in mind when using this pattern-->
=== When to use ===
<!--optional. examples of situations where you would apply this pattern, or real-world situations where it has been used (links and images are encouraged!-->
==Endorsements==
* [[User:EGalvez (WMF)|EGalvez (WMF)]]
* [[User:Wolliff (WMF)|Wolliff (WMF)]]
*This is helpful. [[User:Satdeep Gill|Satdeep Gill]] ([[User talk:Satdeep Gill|talk]]) 17:47, 14 December 2015 (UTC)
* This learning pattern is really helpful, even when its the first time you use global metrics. Thank you for sharing this.<ref>https://meta.wikimedia.org/wiki/Grants:PEG/Open_Labs/Wikipedia_Weekend_2015/Report</ref> --[[User:Margott|Margott]] ([[User talk:Margott|talk]]) 08:34, 23 December 2015 (UTC)
*VERY enlightening! [[User:Saintfevrier|Saintfevrier]] ([[User talk:Saintfevrier|talk]]) 22:04, 20 February 2016 (UTC)
== See also ==
{{Education toolkit learning pattern}}
=== Related patterns ===
#[[Grants:Learning patterns/Number_of_newly_registered_users|Number of newly registered users]]
#[[Grants:Learning patterns/Number_of_active_editors_involved|Number of active editors involved]]
#[[Grants:Learning patterns/Number of individuals involved|Number of individuals involved]]
#[[Grants:Learning patterns/Number_of_articles_created_or_improved_in_Wikimedia_projects|Number of articles created or improved in Wikimedia projects]]
#[[Grants:Learning patterns/Number_of_images_or_media_used_in_Wikimedia_projects|Number of images or media used in Wikimedia projects]]
#[[Grants:Learning_patterns/Bytes_added_to_or_removed_from_Wikimedia_projects|Number of bytes added and removed from Wikimedia projects]]
#[[Grants:Learning patterns/Learning question|Learning question: Did your work increase the motivation of contributors, and how do you know?]]
=== External links ===
Line 115 ⟶ 193:
=== References ===
{{Reflist}}
[[Category:Reporting patterns]]
[[Category:Global metrics patterns]]
[[Category:Evaluation learning patterns]]
[[Category:Learning patterns ready for translation]]
[[Category:Wikimetrics learning patterns]]
[[Category:Reporting patterns]]
[[Category:Moderate complexity patterns]]
[[Category:Evaluation measurement learning patterns]]
| |||