Systematic reviews and maps Avoiding plagiarismusers.jyu.fi/~antkaij/opetus/gradusem/2016/slr-plag-2016-01.pdf · Systematic reviews and maps Avoiding plagiarism Antti-Juhani Kaijanaho

Systematic reviewsand mapsAvoidingplagiarism

Antti-JuhaniKaijanaho

Systematic reviewsand maps

Avoidingplagiarism

Systematic reviews and mapsAvoiding plagiarism

Antti-Juhani Kaijanaho

TIETOTEKNIIKAN LAITOS

TIES501 Master’s Thesis SeminarJanuary 26, 2016




Avoidingplagiarism

There are two kinds of studies

I primary studies

– studies that directly observe,manipulate, create etc. the phenomena of interest

I secondary studies

– studies that summarise, analyze,consolidate, categorise etc. other (usually primary)studies

I It is also possible to have tertiary studies, which are likesecondary studies but they summarise etc. secondarystudies. They are, however, fairly rare.1

1E. g. Fabio Q. B. da Silva et al: Six years of systematic literaturereviews in software engineering: An updated tertiary study , 2011. Note: Inorder to save space in these slides, I omit bibliography data from most source citations. The title will, inthose cases, be a clickable hyperlink.

http://dx.doi.org/10.1016/j.infsof.2011.04.004





Avoidingplagiarism

There are two kinds of studies

I primary studies – studies that directly observe,manipulate, create etc. the phenomena of interest

I secondary studies – studies that summarise, analyze,consolidate, categorise etc. other (usually primary)studies

I It is also possible to have tertiary studies, which are likesecondary studies but they summarise etc. secondarystudies. They are, however, fairly rare.1

1E. g. Fabio Q. B. da Silva et al: Six years of systematic literaturereviews in software engineering: An updated tertiary study , 2011. Note: Inorder to save space in these slides, I omit bibliography data from most source citations. The title will, inthose cases, be a clickable hyperlink.






Avoidingplagiarism

There are three main kinds of secondary studies

I traditional (narrative) reviewsI Ville will discuss these later in this seminar

I systematic literature reviews (systematic reviews)

I systematic mapping studies (systematic maps)




Avoidingplagiarism

What is so systematic about systematic reviewsand maps?

I planned

I documented

I follow current best practice




Avoidingplagiarism

Current best practice in software engineering

I Barbara Kitchenham & Stuart Charters: Guidelines forperforming Systematic Literature Reviews in SoftwareEngineering , 2007.

I Barbara Kitchenham & Pearl Brereton: A systematicreview of systematic review process research in softwareengineering , 2013.

I Kai Petersen et al: Systematic Mapping Studies inSoftware Engineering , 2008.

I Kai Petersen & Sairam Vakkalanka & Ludwik Kuzniarz:Guidelines for conducting systematic mapping studies insoftware engineering: An update, 2015.

I See also Chapter 5 of Antti-Juhani Kaijanaho:Evidence-based programming language design: aphilosophical and methodological exploration, 2015.

http://community.dur.ac.uk/ebse/resources/guidelines/Systematic-reviews-5-8.pdf






http://ewic.bcs.org/content/ConWebDoc/19543

http://ewic.bcs.org/content/ConWebDoc/19543



https://jyx.jyu.fi/dspace/handle/123456789/47698





Avoidingplagiarism

Suggested reading for CSE

I Petticrew & Roberts: Systematic Reviews in the SocialSciences. A Practical Guide. Malden, MA: Blackwell,2006.

I Campbell Collaboration Systematic Reviews. Policiesand Guidelines. Version 1.0. Campbell SystematicReviews supplement 1, 2014.

I What Works Clearinghouse Procedures and StandardsHandbook. Version 3.0. 2014.

I see also the SE recommendations on the previous slide

http://www.campbellcollaboration.org/lib/download/3308/C2_Policies_Guidelines_Version_1_0.pdf

http://www.campbellcollaboration.org/lib/download/3308/C2_Policies_Guidelines_Version_1_0.pdf

http://ies.ed.gov/ncee/wwc/pdf/reference_resources/wwc_procedures_v3_0_standards_handbook.pdf

http://ies.ed.gov/ncee/wwc/pdf/reference_resources/wwc_procedures_v3_0_standards_handbook.pdf




Avoidingplagiarism

Basic process for systematic reviews and maps

1. plan the studyI research questions you want to answerI a detailed plan for each of the following steps

2. keep detailed records of your actions in steps 3–6

3. search for potentially relevant publications

4. decide which publications found by your search toinclude in your study, and which to exclude

5. extract relevant information from included publications

6. synthesize answers to your research questions

7. evaluate the threats to validity of your study

8. report your study to all relevant stakeholders

, e. g.I whoever paid for your studyI academic creditI the research community at largeI the practitioner community at large




Avoidingplagiarism

Basic process for systematic reviews and maps

1. plan the studyI research questions you want to answerI a detailed plan for each of the following steps

2. keep detailed records of your actions in steps 3–6

3. search for potentially relevant publications

4. decide which publications found by your search toinclude in your study, and which to exclude

5. extract relevant information from included publications

6. synthesize answers to your research questions

7. evaluate the threats to validity of your study

8. report your study to all relevant stakeholders, e. g.I whoever paid for your studyI academic creditI the research community at largeI the practitioner community at large




Avoidingplagiarism

The difference between a review and a map

I A systematic (literature) review asks and answersspecific questions that are relevant to practitioners, andusually aims to resolve uncertainty about best practiceand to generate practical advice based on the researchliterature. It always includes a well-founded synthesis ofthe research results reported in the literature.

I A systematic mapping study asks and answers broadquestions about the state of research in a particularfield, and usually aims to give an overview of, andidentify gaps in, the research literature. It rarelyincludes a synthesis of research results.

However, many researchers call their studies systematicreviews even though they are properly classified as mappingstudies.




Avoidingplagiarism

Recent examples

I Antti-Juhani Kaijanaho: Evidence-based programminglanguage design: a philosophical and methodologicalexploration, 2015.

I Upulee Kanewala & James M. Bieman: Testingscientific software: A systematic literature review , 2014.

I Birgit Penzenstadler & others: Systematic mappingstudy on software engineering for sustainability (SE4S),2014.

I Juan A. Vargas & others: A systematic mapping studyon serious game quality , 2014.






http://dx.doi.org/10.1145/2601248.2601256

http://dx.doi.org/10.1145/2601248.2601256

http://dx.doi.org/10.1145/2601248.2601261

http://dx.doi.org/10.1145/2601248.2601261




Avoidingplagiarism

A mapping study design

ScientificLiterature

Systematicdocumented

search

Pool ofPotentially Relevant

Studies

Systematicdocumented

selection

SelectedStudies

Identification ofrelevant quotes

“. . . ”“. . . ”“. . . ”“. . . ”

Coding

DebuggingEffortCaseStudy

ConditionalsStaticTypingExperimentCodes

ThematicSynthesis

ThematicModel

Adapted from Chapter 7, p. 111, of Kaijanaho 2015




Avoidingplagiarism

What do they have to do with Master’s Theses?

I A proper systematic review is a huge amount of work(several person-years).

I A Master’s ThesisI can be a systematic review or a map (but take care to

keep it manageable)I can also include a systematic review or map (but that’s

even more challenging to keep manageable)I is not expected to be up to academic publication

standards – you can get a good MSc thesis even if you(intelligently) cut corners

I just be honest about it in your thesis




Avoidingplagiarism

Past BSc and MSc theses using these ideas2

I Olli Kauppinen: Mobiilipohjaisen halytysjarjestelmanhyodyntaminen viranomaisviestinnassa jakriisinhallinnassa: interaktiivinen lahestyminen. MSc(mobile systems) 2012.

I Jaakko Pallari: Multithread concurrency in a singlethread environment. MSc (software andtelecommunication technology) 2015.

I Rauno Raiha: Abstrakti luokka vai rajapintauudelleenkaytettavyyden nakokulmasta. BSc (softwareengineering) 2013.

I Ari Tuhkala: Taulutietokoneet opettajan tyossa. BSc(education) 2012.

2I make no comment on their quality or on the grade they received.

http://urn.fi/URN:NBN:fi:jyu-201306111942











Avoidingplagiarism

Further reading

I Andy Oram & Greg Wilson (eds): Making Software:What Really Works, and Why We Believe It. O’Reilly,2011.

I Gordon C. S. Smith & Jill P. Pell: Hazardous journeys:Parachute use to prevent death and major traumarelated to gravitational challenge: systematic review ofrandomised controlled trials. BMJ 327:1459, 2003.

I Patrick Czorlich & Till Burkhardt et al: Does usage of aparachute in contrast to free fall prevent major trauma?A prospective randomised-controlled trial in rag dolls.European Spine Journal, online first, 14 January 2016.

I John P. A. Ioannidis: Why Most Published ResearchFindings Are False. PLoS Medicine 2 (8) e124, 2005.

I John P. A. Ioannidis: Why Most Discovered TrueAssociations Are Inflated . Epidemiology 19 (5)p. 640–648, 2008.

http://www.ncbi.nlm.nih.gov/pmc/articles/PMC300808/




http://dx.doi.org/10.1371/journal.pmed.0020124

http://dx.doi.org/10.1371/journal.pmed.0020124

http://dx.doi.org/10.1097/EDE.0b013e31818131e7

http://dx.doi.org/10.1097/EDE.0b013e31818131e7




Avoidingplagiarism

Let’s ponder silently for a minute

1. How would you define plagiarism in the context ofuniversity studies and theses?

2. How can you avoid plagiarizing in your thesis?

3. What happens if a student is caught plagiarizing in theirstudies or thesis?




Avoidingplagiarism

Discuss among your neighbors

1. How would you define plagiarism in the context ofuniversity studies and theses?

2. How can you avoid plagiarizing in your thesis?

3. What happens if a student is caught plagiarizing in theirstudies or thesis?




Avoidingplagiarism

Academic fraud is a serious offense3

“Plagiarism or any other academic fraud by astudent is not only an offence to the student’steachers and supervisors but also an offence to thewhole University community and the ethicalprinciples the community follows.”

“The University and everyone operating in itmust take even the slightest fraud very seriously. Ifany teacher, other employee or student noticesacademic fraud, they must inform therepresentative of the unit. All proven cases ofacademic fraud will lead to consequences.”

3Quotes from the unofficial translation of the Rector’s decision onJune 13, 2013, entitled Code of conduct for preventing and dealing withacademic fraud and plagiarism.

https://www.jyu.fi/yliopistopalvelut/opiskelijoille/how-to/vilppi

https://www.jyu.fi/yliopistopalvelut/opiskelijoille/how-to/vilppi




Avoidingplagiarism

Definitions4

“In the context of studies, fraud refers to anydishonest activity a student uses to give a falseimpression of his/her own or someone else’s skillsin order to affect the approval or evaluation of astudy unit.”

“Plagiarism is a form of academic fraud. It isgenerally defined as activity in which a personrepresents the work of another person as his/herown original work.”

4Quotes continue from the Rector’s decision.




Avoidingplagiarism

Penalties5

“Section 45 of the Universities Act (558/2009)states that if a student breaches the rules ofteaching, he/she may, depending on theseriousness of the breach, be cautioned orsuspended from the University for a fixed period ofone year, at the most.”

Also, a thesis that is known to contain plagiarism or otherfraud cannot be accepted before the issue has been fixed.

5Quotes continue from the Rector’s decision.




Avoidingplagiarism

Law versus ethics

What the law allows and what is academically ethical aretwo different things.

I It is possible to commit plagiarism even if there is nocopyright infringement.

I It is possible to infringe copyright even if there is no(academic) plagiarism.

In your academic pursuits (studies and research), you areexpected to comply with both the law and your academicethical obligations.6

6In certain situations, a lawful obligation may be so grossly unjust asto make breaking it ethical or even morally compelled. For a well knownexample, see the Nuremberg trials shortly after the Second World War.The current intellectual property system (copyrights, patents andtrademarks) does not, in my opinion, involve that level of injustice.




Avoidingplagiarism

Avoiding plagiarism

You should always follow the following four guidelines:I If you use ideas, expressions, or anything else from

someone else, you must include a proper attribution.I In most cases, this means a correct citation to the

literature.

I If you use more or less the words written or uttered bysomeone else in more or less the same sequence, youmust indicate that you are quoting.

I Even if you translate it from another language!

I If you are quoting, you must take care to either quoteverbatim, or clearly indicate any changes you made.

I If you are quoting, you must take care not tomisrepresent the original author’s writing.




Avoidingplagiarism

Quoting appropriately

I Paraphrasing instead of quoting is usually preferable.I Quoting is appropriate, when

I it is important to show the reader the exact originalphrasing, or

I there is no other way to phrase it (modulo minorchanges)

Be prepared to defend your choice to your supervisor!I Modifying a quote (with changes indicated) is

appropriate, when the goal is toI shorten itI make it fit grammatically to the surrounding textI avoid misleading the reader




Avoidingplagiarism

Indicating a quote

There are two standard ways to indicate a quote:

I Use quotation marks (“like this”)

I Use blank lines and indentation to clearly set a quoteapart from the rest of the text:

Like this.

It may be a good idea to use quotation marks eventhen, just to be sure.

I For example:

”Even at this date, computing was not thesole domain of women. It was really the job ofthe dispossessed, the opportunity granted tothose who lacked the financial or societalstanding to pursue a scientific career.”7

7David Alan Grier: When Computers Were Human. PrincetonUniversity Press, 2005. Page 276.




Avoidingplagiarism

Indicating changes to a quote

I If you replace one or more words in a quote with others,or add words to a quote, you must put the new words inbrackets.

“Even at this date, [the profession of]computing was not the sole domain ofwomen.”8

I If you leave out words from the middle of a quote, youmust replace them with an ellipsis (. . . ); it may be agood idea to add brackets around it. For Finnish text,use two en dashes (– –) instead.

”Even at this date, computing [. . . ] was reallythe job of [. . . ] those who lacked the financialor societal standing to pursue a scientificcareer.”

8David Alan Grier: When Computers Were Human. PrincetonUniversity Press, 2005. Page 276.




Avoidingplagiarism

More about quoting

I If you quote a passage that includes italics or otheremphasis, indicate verbally whether or not you haveretained it. Use:

I “emphasis in the original”, orI “emphasis omitted”

I If you add emphasis to a quote, indicate this verbally(“my emphasis”).

I If you translate a passage from a source and include thetranslation directly in your text, treat it as a quotation.Also indicate that it is your translation (“mytranslation”).

I It’s better to use a published translation, if one exists.




Avoidingplagiarism

Using someone else’s code in your programs

I Your ethical obligation to avoid plagiarism applies alsoto any program code you write during your studies andresearch.

I Acknowledge in comments the source of any code youhave copied from someone else.

I Place the comment as close to the copied code aspracticable.

I Make sure that it is clear to someone reading your codewhat code is yours and what is from others.

I Remember to comply with the copyright law, as well.

Documents

Systematic reviews and maps Avoiding plagiarismusers.jyu.fi/~antkaij/opetus/gradusem/2016/slr-plag-2016-01.pdf · Systematic reviews and maps Avoiding plagiarism Antti-Juhani Kaijanaho