Experimental software engineering: Difference between revisions

Revision as of 22:51, 18 February 2012

Latest revision as of 15:29, 5 March 2024

(39 intermediate revisions by 28 users not shown)

Line 1:

{{Short description|Methodology of software-engineering research}}

'''Experimental software engineering''' is a sub-___domain of [[software engineering]] focusing on [[experiment]]s on [[software system]]s (software products, processes, and resources). It is interested in devising experiments on software, in collecting data from these experiments, and in devising laws and theories from this data. Proponents of experimental software engineering advocate that experimentation is an important method in contributing to accumulation of knowledge in software engineering.

{{more footnotes|date=February 2013}}

{{see also|Software development process}}

'''Experimental software engineering''' involves running [[experiment]]s on the processes and procedures involved in the creation of [[software system]]s,{{citation needed|date=February 2013}} with the intent that the data be used as the basis of theories about the processes involved in [[software engineering]] (theory backed by data is a fundamental tenet of the [[scientific method]]). A number of [https://shape-of-code.com/2021/10/24/evidence-based-se-groups-doing-interesting-work-2021-version/ research groups] primarily use empirical and experimental techniques.

Empirical software engineering is a related concept, sometimes used synonymously with experimental software engineering. Empirical software engineering is a field of research that emphasizes the use of empirical studies of all kinds to accumulate knowledge. Methods used include experiments, variety of case studies, surveys, and statistical analyses.

EmpiricalThe softwareterm engineering is a related concept, sometimes used synonymously with experimental[[empirical software engineering. Empirical software engineering is a field of research that]] emphasizes the use of empirical studies of all kinds to accumulate knowledge. Methods used include experiments, variety of case studies, surveys, and statisticalusing whatever data is analysesavailable.

==Rationale==

The [[scientific method]] suggests a cycle of observations, laws, and theories to advance science. Experimental software engineering applies this method to software.

== Empirical software engineering research ==

==Achievements==

{{Empty section|date=June 2008}}

In a keynote at the [http://www.esem-conferences.org/ International Symposium on Empirical Software Engineering and Measurement] Prof. Wohlin recommended ten commitments that the research community should follow to increase the relevance and impact of empirical software engineering research.<ref>{{Cite book |doi=10.1145/2961111.2962641|isbn=9781450344272|chapter=Is there a Future for Empirical Software Engineering?|title=Proceedings of the 10th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement - ESEM '16|pages=1|year=2016|last1=Wohlin|first1=Claes|s2cid=25883722 }}</ref> However, at the same conference Dr. Ali effectively argued that solely following these will not be enough and we need to do more than just show the evidence substantiating the claimed benefits of our interventions but instead what is required for practical relevance and potential impact is the evidence for cost-effectiveness.<ref>{{Cite book |doi=10.1145/2961111.2962631|isbn=9781450344272|chapter=Is effectiveness sufficient to choose an intervention?|title=Proceedings of the 10th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement - ESEM '16|pages=1–6|year=2016|last1=Ali|first1=Nauman bin|s2cid=3208211 }}</ref>

==Research Labs==

The [http://isern.iese.de/ International Software Engineering Research Network (ISERN)] is a global community of research groups who are active in experimental software engineering. Its purpose is to advance the practice of and foster university and industry collaborations within experimental software engineering. ISERN holds annual meetings in conjunction with the [http://www.esem-conferences.org/ International Symposium on Empirical Software Engineering and Measurement (ESEM)] conference.

There are a number of labs at Universities, research institutes, and in industry that specialise in empirical software engineering, these include:

* [http://isern.iese.de/ International Software Engineering Research Network (ISERN)]

* [http://www.iese.fraunhofer.de/fhg/iese/ Fraunhofer Institute for Experimental Software Engineering (IESE)]

* [[Sheffield Software Engineering Observatory]]

* [http://www.simula.no Simula Research Laboratory]

* [http://lens-ese.cos.ufrj.br/ese/index.php?lang=en COPPE/UFRJ Experimental Software Engineering Group]

* [http://www.mn.uio.no/ifi/english/ University of Oslo]

==References==

{{Reflist}}

* [[Barry Boehm]], Hans Dieter Rombach, and Marvin V. Zelkowitz (eds.), ''[http://www.springer.com/sgw/cda/frontpage/0,11855,4-40007-22-51432795-0,00.html Foundations of Empirical Software Engineering — The Legacy of Victor R. Basili]'', [[Springer-Verlag]], 2005, ISBN 3-540-24547-2.

* H. Dieter Rombach, Victor R. Basili and Richard W. Selby (eds.), ''[Experimental Software Engineering Issues: Critical Assessment and Future Directions]'', [[Springer-Verlag]], 1993, ISBN 3-540-57092-6.

==Bibliography==

*Basili, V.; Rombach, D.; Schneider, K.; Kitchenham, B.; Pfahl, D.; Selby, R. (Eds.),''[http://www.springer.com/computer/programming/book/978-3-540-71300-5 Empirical Software Engineering Issues. Critical Assessment and Future Directions]'', [[Springer-Verlag]], 2007, ISBN 978-3-540-71300-5.

* [[Victor Basili]], Richard W. Selby, David H. Hutchens, "Experimentation in Software Engineering", IEEE Transactions on Software Engineering, Vol. SE-12, No.7, July 1986

*Basili, V.; Rombach, D.; Schneider, K.; [[Barbara Kitchenham|Kitchenham, B.]]; Pfahl, D.; Selby, R. (Eds.),''[httphttps://www.springer.com/computer/programming/book/978-3-540-71300-5 Empirical Software Engineering Issues. Critical Assessment and Future Directions]'', [[Springer-Verlag]], 2007, {{ISBN |978-3-540-71300-5}}.

* [[Barry Boehm]], Hans Dieter Rombach, and [[Marvin Victor Zelkowitz|Marvin V. Zelkowitz]] (eds.), ''[httphttps://www.springer.com/sgw/cda/frontpage/0,11855,4-40007-22-51432795-0,00.html Foundations of Empirical Software Engineering — The Legacy of Victor R. Basili]'', [[Springer-Verlag]], 2005, {{ISBN |3-540-24547-2}}.

* Jones, D. [http://www.knosof.co.uk/ESEUR/ESEUR.pdf Evidence-based Software Engineering based on the publicly available data], 2020, {{ISBN|978-1-8382913-0-3}}

* H. Dieter Rombach, Victor R. Basili and Richard W. Selby (eds.), ''[Experimental Software Engineering Issues: Critical Assessment and Future Directions]'', [[Springer-Verlag]], 1993, {{ISBN |3-540-57092-6}}.

{{DEFAULTSORT:Experimental Software Engineering}}

[[Category:{{Software engineering]]}}

[[Category:Software engineering folklore]]

[[Category:Science experiments|Software engineering]]

{{compu-sci-stub}}

[[ar:هندسة البرمجيات التجريبية]]