Conformance testing: Difference between revisions

Revision as of 06:34, 31 March 2020

Revision as of 20:01, 19 April 2020

Line 1:

{{short description|Type of testing for standards, contracts and regulations}}

'''Conformance testing''' — an element of '''conformity assessment''', and also known as '''compliance testing''', or '''type testing''' — is [[Test method|testing]] or other activities that determine whether a process, product, or service complies with the requirements of a [[specification]], [[technical standard]], [[contract]], or [[regulation]].<ref name="TrenkaevInter03">{{cite book |chapter-url=https://books.google.com/books?id=9ta5rLb1CkkC&pg=PA226 |chapter=Interoperability Testing Based on a Fault Model for a System of Communicating FSMs |title=Testing of Communicating Systems: 15th IFIP International Conference, TestCom 2003 |author1=Trenkaev, V. |author2=Kim, M. |author3=Seol, S. |editor1=Hogrefe, D. |editor2=Wiles, A. |publisher=Springer Science & Business Media |year=2003 |pages=226–242 |isbn=9783540401230}}</ref><ref name="WareTheNeed90">{{cite book |chapter-url=https://books.google.com/books?id=2FQf_pCCUeUC&pg=PA14 |chapter=Chapter 2: The Need for Mutual Recognition of Test Laboratories |title=Test Quality for Construction, Materials and Structures: Proceedings of the International RILEM/ILAC Symposium |author=Ware, J.E. |editor=Fickelson, M. |publisher=CRC Press |year=1990 |pages=12–18 |isbn=9780412394508}}</ref><ref name="WerstiukRelay07">{{cite book |chapter-url=https://books.google.com/books?id=HCMDxjJnnF8C&pg=PA13 |chapter=Chapter 2: Relay Testing Fundamentals |title=The Relay Testing Handbook: Relay Testing Fundamentals |author=Werstiuk, C. |publisher=Valence Electrical Training Services |year=2007 |pages=13–52 |isbn=9781934348017}}</ref><ref name="INCITSReport05">{{cite web |url=http://www.incits.org/tc_home/m1htm/docs/m1050067.pdf |archiveurl=https://web.archive.org/web/20061213213606/http://www.incits.org/tc_home/m1htm/docs/m1050067.pdf |format=PDF |title=Report on Issues for Harmonizing Conformity Assessment to Biometric Standards |author=M1 Ad-Hoc Group on Issues for Harmonizing Conformity Assessment to Biometric Standards |publisher=InterNational Committee for Information Technology Standards |date=16 March 2005 |archivedate=13 December 2006 |accessdate=22 February 2018}}</ref><ref name="ISOWhatIs">{{cite web |url=https://www.iso.org/conformity-assessment.html |title=What is conformity assessment? |publisher=International Organization for Standardization |accessdate=22 February 2018}}</ref> Testing is often either [[event condition action|logical test]]ing or [[physical test]]ing. The test procedures may involve other criteria from [[test functions for optimization|mathematical testing]] or [[chemical test]]ing. Beyond simple conformance, other requirements for efficiency, interoperability or compliance may apply. Conformance testing is performed by an [[accredited]] independent organization, which can sometimes be the author of the standard (UL, FM for example). When testing is accompanied by [[Certification]], the products or services may then be advertised as being certified in compliance with the referred [[technical standard]]. Manufacturers and suppliers of products and services rely on such certification including listing on the certification body's website, to assure quality to the end user and that competing suppliers are on the same level.

Aside from the various types of testing, related conformance testing activities include:

Line 12:

== Typical areas of application ==

Conformance testing is applied in various industries where a product or service must meet specific quality and/or regulatory standards. This includes areas such as:<ref name="TrenkaevInter03" /><ref name="WerstiukRelay07" /><ref name="INCITSReport05" /><ref name="W3CConform02">{{cite web |url=https://www.w3.org/QA/2002/01/Note-qa-certif-20020102.html |title=Conformance Testing and Certification Model for W3C Specifications |editor=Dardailler, D. |publisher=W3C |date=January 2002 |accessdate=22 February 2018}}</ref><ref name="EvansSpec05">{{cite book |chapter-url=https://books.google.com/books?id=0e295yPUBPMC&pg=PA74 |chapter=Chapter 4: Specifications and Quality |title=Pharmaceutical Packaging Technology |author=Evans, E.R. |editor1=Dean, D.A.|editor2=Evans, E.R.|editor3=Hall, I.H. |publisher=CRC Press |pages=73–105 |year=2005 |isbn=9780203301814}}</ref>

* biocompatibility proofing

Line 27:

=== Software engineering ===

In [[software testing]], conformance testing verifies that a product performs according to its specified standards. [[Compiler]]s, for instance, are extensively tested to determine whether they meet the recognized standard for that language.<ref name="GoerigkTowards99">{{cite book |chapter-url=https://books.google.com/books?id=gM6AS9_XwtgC&pg=PA62 |chapter=Towards Rigorous Compiler Implementation Verification |title=Collaboration Between Human and Artificial Societies: Coordination and Agent-Based Distributed Computing |author1=Goerigk, W. |author2=Simon, F. |editor=Padget, J.A. |publisher=Springer Science & Business Media |pages=62–73 |year=1999 |isbn=9783540669302}}</ref><ref name="CuginiACent01">{{cite book |chapter-url=https://books.google.com/books?id=hrizEY2BWOoC&pg=PA258 |chapter=FORTRAN Test Programs |title=A Century of Excellence in Measurements, Standards, and Technology |author=Cugini, J. |editor=Lide, D.R. |publisher=CRC Press |pages=258–259 |year=2001 |isbn=9780849312472}}</ref>

=== Electronic and electrical engineering ===

Line 33:

In [[electronic engineering]] and [[electrical engineering]], some countries and business environments (such as telecommunication companies) require that an electronic product meet certain requirements before they can be sold.<ref name="WerstiukRelay07" /><ref name="RyanHigh01">{{cite book |title=High Voltage Engineering and Testing |editor=Ryan, H.M. |publisher=The Institution of Electrical Engineers |edition=2nd |year=2001 |pages=726 |isbn=9780852967751}}</ref> Standards for telecommunication products written by standards organizations such as [[American National Standards Institute|ANSI]], the [[Federal Communications Commission|FCC]], and [[International Electrotechnical Commission|IEC]] have certain criteria that a product must meet before compliance is recognized. In countries such as Japan, China, Korea, and some parts of Europe, products cannot be sold unless they are known to meet those requirements specified in the standards.<ref name="COCIRHowDoes">{{cite web |url=https://www.bomcheck.net/rohs/how-does-bomcheck-manage-compliance-with-rohs-restrictions-in-china-korea-japan |title=How does BOMcheck manage compliance with RoHS restrictions in China, Korea and Japan? |work=BOMcheck.net |publisher=COCIR |accessdate=22 February 2018}}</ref><ref name="EURLex31993">{{cite web |url=http://eur-lex.europa.eu/LexUriServ/LexUriServ.do?uri=CELEX:31993L0068:en:HTML |title=EUR-Lex - 31993L0068 - EN |work=EUR-Lex |publisher=European Union |date=30 August 1993 |accessdate=22 February 2018}}</ref> Usually, manufacturers set their own requirements to ensure product quality, sometimes with levels much higher than what the governing bodies require. Compliance is realized after a product passes a series of tests without occurring some specified mode of failure.

Compliance testing for electronic devices include emissions tests, immunity tests, and safety tests.<ref name="ECMAAGuide99">{{cite web |url=https://www.ecma-international.org/publications/files/ECMA-TR/ECMA%20TR-074.PDF |format=PDF |title=ECMA Technical Report TR/74: A Guide to the Application of the EMC Directive to ITE |publisher=ECMA |date=June 1999 |accessdate=22 February 2018}}</ref> Emissions tests ensure that a product will not emit harmful electromagnetic interference in communication and power lines. Immunity tests ensure that a product is immune to common electrical signals and [[electromagnetic interference]] (EMI) that will be found in its operating environment, such as [[electromagnetic radiation]] from a local radio station or interference from nearby products. Safety tests ensure that a product will not create a safety risk from situations such as a failed or shorted power supply, blocked cooling vent, and powerline [[voltage spike]]s and dips.

For example, [[Ericsson]]'s telecommunications research and development subsidiary [[Telcordia Technologies]] publishes conformance standards for telecommunication equipment to pass the following tests:<ref name="EricssonElectro17">{{cite web |url=http://telecom-info.telcordia.com/site-cgi/ido/docs.cgi?ID=SEARCH&DOCUMENT=GR-1089& |title=Electromagnetic Compatibility and Electrical Safety - Generic Criteria for Network Telecommunications Equipment |publisher=Ericsson |date=December 2017 |accessdate=22 February 2018}}</ref>

Line 48:

== Standardization and agreements ==

Several international standards relating to conformance testing are published by the [[International Organization for Standardization]] (ISO) and covered in the divisions of ICS 03.120.20 for management<ref name=pccc>{{cite web |last = [[International Organization for Standardization]] |first = |authorlink = |author2 = |title = 03.120.20: Product and company certification. Conformity assessment |work = |publisher = |date = |url = http://www.iso.org/iso/products/standards/catalogue_ics_browse.htm?ICS1=03&ICS2=120&ICS3=20& |format = |doi = |accessdate=2009-04-10}}</ref> and ICS 23.040.01 for technical.<ref name=pcpg>{{cite web |last = [[International Organization for Standardization]] |first = |authorlink = |author2 = |title = 23.040.01: Pipeline components and pipelines in general |work = |publisher = |date = |url = http://www.iso.org/iso/products/standards/catalogue_ics_browse.htm?ICS1=23&ICS2=040&ICS3=01& |format = |doi = |accessdate=2009-04-10}}</ref> Other standalone ISO standards include:

* ''ISO/TR 13881:2000 Petroleum and natural gas industries—Classification and conformity assessment of products, processes and services''<ref name=pngi>{{cite web |last = [[International Organization for Standardization]] |first = |authorlink = |author2 = |title = ISO/TR 13881:2000 Petroleum and natural gas industries -- Classification and conformity assessment of products, processes and services |work = |publisher = |date = |url = http://www.iso.org/iso/iso_catalogue/catalogue_tc/catalogue_detail.htm?csnumber=23137 |format = |doi = |accessdate=2009-04-10}}</ref>

* ''ISO 18436-4:2008 Condition monitoring and diagnostics of machines—Requirements for qualification and assessment of personnel—Part 4: Field lubricant analysis''<ref name=cmdm>{{cite web |last = [[International Organization for Standardization]] |first = |authorlink = |author2 = |title = ISO 18436-4:2008 Condition monitoring and diagnostics of machines -- Requirements for qualification and assessment of personnel -- Part 4: Field lubricant analysis |work = |publisher = |date = |url = http://www.iso.org/iso/iso_catalogue/catalogue_tc/catalogue_detail.htm?csnumber=37395 |format = |doi = |accessdate=2009-04-10}}</ref>

* ''ISO/IEC 18009:1999 Information technology—Programming languages—Ada: Conformity assessment of a language processor'' <ref name=itpl>{{cite web |last = [[International Organization for Standardization]] |first = |authorlink = |author2 = |title = ISO/IEC 18009:1999 Information technology -- Programming languages -- Ada: Conformity assessment of a language processor |work = |publisher = |date = |url = http://www.iso.org/iso/iso_catalogue/catalogue_tc/catalogue_detail.htm?csnumber=31051 |format = |doi = |accessdate=2009-04-10}}</ref>

===Conformity assessment and mutual recognition agreements===