Data editing: Difference between revisions

Revision as of 23:12, 20 June 2014

Revision as of 13:29, 25 June 2014

Line 1:

'''Data editing''' is defined as the process involving the review and adjustment of collected [[survey data]]. The purpose is to control the quality of the collected data.<ref>[http://www.unece.org/stats/editing.html UNECE]</ref> Data editing can be performed manually, with the assistance of a computer or a combination of both.<ref>http://www.statcan.gc.ca/edu/power-pouvoir/ch3/editing-edition/5214781-eng.htm</ref>

== Editing Methodsmethods ==

=== Interactive editing ===

The term interractiveinteractive editing is commonly used for modern computer-assisted manual editing. Most interactive data editing tools applied at 'National Statistical Institutes' (NSIs) allow one to check the specified editsduring or after data entry, and if necessary to correct erroneous data immediatedly. Several approaches can be followed to correct erroneous data:

*Recontact the respondent

*Compare the respondent's data to his data from previous year

*Compare the respondent's data to data from similar respondents

*Use the subject matter knowledge of the human editor

InterractiveInteractive editing is a standard way to edit data. It can be used to edit both [[categorical]] and [[continuous]] data.<ref>Waal, Ton de et al. "Handbook of Statistical Data Editing and Imputation". Wiley publication, 2011,p.15.</ref> Interractive editing reduces the time frame needed to complete the cyclical process of review and adjustment.<ref>http://www.unece.org/fileadmin/DAM/stats/publications/editing/SDE1chA.pdf</ref>

=== Selective editing ===

Selective editing is an umbrella term for several methods to identify the influential errors, <ref group=note>the errors that have substatial impact on the publication figures</ref> and [[outliers]].<ref group=note>values that do not fit a model of data well</ref> Selective editing techniques aim to apply interactive editing to a well-chosen subset of the records, such that the limited time and resources available for interactive editing are allocated to those records where it has the most effect on the quality of the final estimates of publication figures. In selective editing, data is split into two streams:

*The critical stream

*The noncriticalnon-critical stream

The critical stream consists of records that are more likely to contain influential errors. These critical records are edited in a traditional interactive manner. The records in the non -critical stream which are unlikely to contain influential errors are not edited in a computer assisted manner.<ref>Waal, Ton de et al. "Handbook of Statistical Data Editing and Imputation". Wiley publication, 2011,p.16.</ref>

=== Macro editing ===

There are two formsmethods of macro editing:<ref>Waal, Ton de et al. "Handbook of Statistical Data Editing and Imputation". Wiley publication, 2011,p.16.</ref>

==== Aggregation method ====

Line 29:

==== Distribution method ====

Data available is used to characterize the [[Coefficient of variation|distribution of the variables]]. Then all individual values are compared with the distribution. Records containing values that could be considered uncommon (given the distribution) are candidates for further inspection and possibly for editing.<ref>Bethlehem,J. "Applied Survey Methods A Statistical Perspective ". Wiley publication, 2009,p.205.</ref>

=== Automatic editing ===

Line 42:

{{reflist}}

[[Category:Survey methodology]]

[[Category:Data collection]]

{{uncategorised|date=June 2014}}

[[Category:Quantitative research]]