Random testing: Difference between revisions

Revision as of 07:15, 16 November 2018

Revision as of 07:16, 16 November 2018

Line 64:

The following weaknesses are typically pointed out by detractors:

*Some think itIt only finds basic bugs (f.ex. [[null pointer]] dereferencing).

*It is only as precise as the specification and specifications are typically imprecise.

*Some think itIt compares poorly with other techniques to find bugs (f.ex. [[static program analysis]]).

*Some argue it is more readable to describe relevant cases with manually constructed tests in a white-box fashion, than to rely on randomness.<ref name="so" />

*If different inputs are randomly selected on each test run, (bythis usingcan ancreate unseededproblems randomfor number[[continuous generator),integration]] because the same tests will pass or fail randomly.<ref name="so">. {{cite web|url=http://stackoverflow.com/questions/636353/is-it-a-bad-practice-to-randomly-generate-test-data|title=Is it a bad practice to randomly-generate test data?|website=stackoverflow.com|accessdate=15 November 2017}}</ref>

*Some think it compares poorly with other techniques to find bugs (f.ex. [[static program analysis]]).

*Some argue that it iswould morebe readablebetter to describethoughtfully cover all relevant cases with manually constructed tests in a white-box fashion, than to rely on randomness.<ref name="so" />

*Some think it only finds basic bugs (f.ex. [[null pointer]] dereferencing).

*If different inputs are randomly selected on each test run (by using an unseeded random number generator), the same tests will pass or fail randomly<ref name="so">. {{cite web|url=http://stackoverflow.com/questions/636353/is-it-a-bad-practice-to-randomly-generate-test-data|title=Is it a bad practice to randomly-generate test data?|website=stackoverflow.com|accessdate=15 November 2017}}</ref>

==Types of random testing==