Content deleted Content added
Citation bot (talk | contribs) Alter: pages. Add: url, pages, s2cid, authors 1-1. Removed proxy/dead URL that duplicated identifier. Removed parameters. Formatted dashes. Some additions/deletions were parameter name changes. Upgrade ISBN10 to ISBN13. | Use this bot. Report bugs. | Suggested by AManWithNoPlan | #UCB_webform 398/2198 |
adding journal ISSN to the reference |
||
Line 79:
In C, the Manybugs benchmark collected by GenProg authors contains 69 real world defects and it is widely used to evaluate many other bug-fixing tools for C.<ref name=genprog2012 /><ref name=prophet /><ref name=spr /><ref name=angelix />
In Java, the main benchmark is Defects4J, initially explored by Martinez et al.,<ref name="martinezdefects4j" /> and now extensively used in most research papers on program repair for Java.<ref name="capgen">{{Cite journal |last1=Wen |first1=Ming |last2=Chen |first2=Junjie |last3=Wu |first3=Rongxin |last4=Hao |first4=Dan |last5=Cheung |first5=Shing-Chi |date=2018 |title=Context-aware patch generation for better automated program repair |journal=Proceedings of the 40th International Conference on Software Engineering - ICSE '18 |___location=New York, New York, USA |publisher=ACM Press |pages=1–11 |doi=10.1145/3180155.3180233 |isbn=9781450356381 |s2cid=3374770|url=http://repository.ust.hk/ir/Record/1783.1-92186 }}</ref><ref>{{Cite journal |last1=Hua |first1=Jinru |last2=Zhang |first2=Mengshi |last3=Wang |first3=Kaiyuan |last4=Khurshid |first4=Sarfraz |date=2018 |title=Towards practical program repair with on-demand candidate generation |journal=Proceedings of the 40th International Conference on Software Engineering - ICSE '18 |___location=New York, New York, USA |publisher=ACM Press |pages=12–23 |doi=10.1145/3180155.3180245 |isbn=9781450356381 |s2cid=49666327|doi-access=free }}</ref> Alternative benchmarks exist, such as the Quixbugs benchmark,<ref>{{Cite journal |last1=Lin |first1=Derrick |last2=Koppel |first2=James |last3=Chen |first3=Angela |last4=Solar-Lezama |first4=Armando |date=2017 |title=QuixBugs: a multi-lingual program repair benchmark set based on the quixey challenge |journal=Proceedings Companion of the 2017 ACM SIGPLAN International Conference on Systems, Programming, Languages, and Applications: Software for Humanity - SPLASH Companion 2017 |___location=New York, New York, USA |publisher=ACM Press |pages=55–56 |doi=10.1145/3135932.3135941 |isbn=9781450355148 |doi-access=free}}</ref> which contains original bugs for program repair.<ref>{{Cite journal |last1=Ye |first1=He |last2=Martinez |first2=Matias |last3=Durieux |first3=Thomas |last4=Monperrus |first4=Martin |date=2021 |title=A comprehensive study of automatic program repair on the QuixBugs benchmark |url=https://arxiv.org/pdf/1805.03454 |journal=Journal of Systems and Software |language=en |volume=171 |pages=110825 |arxiv=1805.03454 |doi=10.1016/j.jss.2020.110825|issn=0164-1212 |s2cid=221978135 }}</ref> Other benchmarks of Java bugs include Bugs.jar,<ref>{{Cite journal |last1=Saha |first1=Ripon K. |last2=Lyu |first2=Yingjun |last3=Lam |first3=Wing |last4=Yoshida |first4=Hiroaki |last5=Prasad |first5=Mukul R. |date=2018 |title=Bugs.jar: a large-scale, diverse dataset of real-world Java bugs |url=http://dl.acm.org/citation.cfm?doid=3196398.3196473 |journal=Proceedings of the 15th International Conference on Mining Software Repositories |series=MSR '18 |language=en |pages=10–13 |doi=10.1145/3196398.3196473 |isbn=9781450357166 |s2cid=50770093}}</ref> based on past commits, and BEARS<ref>{{Cite book |last1=Madeiral |first1=Fernanda |title=2019 IEEE 26th International Conference on Software Analysis, Evolution and Reengineering (SANER) |last2=Urli |first2=Simon |last3=Maia |first3=Marcelo |last4=Monperrus |first4=Martin |year=2019 |isbn=978-1-7281-0591-8 |pages=468–478 |chapter=BEARS: An Extensible Java Bug Benchmark for Automatic Program Repair Studies |arxiv=1901.06024 |doi=10.1109/SANER.2019.8667991 |s2cid=58028949}}</ref> which is a benchmark of continuous integration build failures.
== Example tools ==
| |||