5 Essentials of Writing Research Reports

7/28/2019 5 Essentials of Writing Research Reports

1/64

Essentials of Writing and

Reviewing Research Papers

PTJ PRESENTS:


2/64

Objectives

List the top 5 essentials of high-quality research papers. Identify weaknesses that can slow the review process and

reduce chances of publication success.

Review a manuscript using systematic approaches. Use PTJs new submission guidelines to enhance the

preparation of your research reports and the quality of yourreviews, regardless of the journal.

Explain how CONSORT, clinical trials registry, and othersubmission guidelines impact EBP and day-to-day PT

practice.


3/64

PTJs Submission Guidelines

Totally revised and in effect as of January 1, 2008. Makes authors and reviewers lives easier. Specifies expectations for both authors and reviewers. Will enhance quality, readability, and usefulness.


4/64

PTJs Submission Guidelines

You can find them at http://www.ptjournal.org

Goal is TRANSPARENCY.authors know what the journal expects.readers know what authors have done.


5/64

The Biggest Changes

Weve adopted the CONSORT (Consolidated Standards ofReporting Trials) Statement and CONSORT Statement

extension for nonpharmacologic treatment (NPT)

interventions, which takes into account issues that physicaltherapist researchers face, eg, blinding difficulties,

intervention complexity, care provider expertise level,

volume of care. (www.consort-statement.org)

Authors must submit the modified CONSORT flowdiagram for individual randomized, controlled trials of

nonpharmacologic treatment when reporting clinical trials.


6/64

The Biggest Changes

Clinical Trial Registration(ClinicalTrials.gov) Trials that begin enrollment after January 1, 2009,

must be registered at or before the onset of patientenrollment.

Trials that began enrollment before January 1, 2009,must be registered before authors submit their

manuscripts, effective for manuscripts submitted on orafter January 1, 2009.

Its free and takes about a half hour to do!


7/64

Types of Research Reports in PTJ

Research Reports Clinical TrialsDiagnostic Test StudiesMeasurement StudiesObservational StudiesQualitative StudiesSystematic Reviews and Meta-analyses


8/64

Research Reports

The Information for Authors contains: General Instructions Data presentation (eg. CI for the point estimates) Strategies for common analytical approaches Specific format requirements for different article types


9/64

General Instructions

People-first language

AMA Manual of Style (10th edition)

Measurements use International System

Related articles must submit any other articlesthat have been published or submitted to other

journals that report from the same data set


10/64

5 Essentials of High-Quality Papers

What should authors consider when writing amanuscript?

What is a Reviewer looking for when conductingthe review?

Remember, the purpose of peer review is to ensurethe integrity of the science that is published.


11/64


Relevance Originality Importance High-quality design and methods

High-quality analysis and interpretation


12/64

1. Relevance

The manuscript should be relevant to theprofession (not necessarily the practice) ofphysical therapy.

The relevance to physical therapy should bestated in the manuscript.


13/64

2. Originality

The manuscript should provide new, originalinformation and thus should make a distinctcontribution to the profession of physical

therapy.


14/64

3. Importance

The manuscript should contain information thatis considered to be important to the profession ofphysical therapy.

In general, investigators should ask importantquestions if they expect to find important

answers.


15/64

4. Quality of Design and Methods

To ensure the validity of an investigation, thequality of the design and methods must bewritten and evaluated according to specified

criteria, if available.


16/64

5. Quality of Analysis and Interpretation

The quality of the analysis and interpretation ensuresthat the findings of the investigation are analyzedappropriately and that the data are interpreted in thecontext of the investigations.

It is important to ensure that the findings of theinvestigation have not been overstated.

Reviewers refer manuscript to PTJ statistician forreview if uncomfortable evaluating the statisticalapproach.


17/64

One Strategy for Manuscript Review(Authors: Write as Though You Were a Reviewer!)

1. Read the entire manuscript through prior to beginningthe appraisal so you have a sense of the complete

manuscript.

2. Develop a preliminary opinion of the Relevance,Originality, and Importance of the investigation.

3. Review the manuscript section by section.4. Compile your appraisal according to the 5 essentials of

high quality papers.

5. Be specific6. Do not line edit


18/64

Tone of the Manuscript or Review

When writing your manuscript or review, useprofessional, non-emotional language.

Authors:Avoid clinical documentation jargon andsuperlatives

Reviewers: Be objective, not judgmental, and avoid:You failed toUsing exclamation points!Presenting poor English usage as the first

concern


19/64

Line Editing

Authors: Have a colleague read your manuscript for line editing

prior to submission.

Reviewers: Its tempting to focus on line editing. But this isnt

necessary in the early stages of the review process,especially if the decision is likely to be a Reject or MajorRewrite.

Its much more appropriate for the Reviewer to focus onthe 5 essentials of high quality papers.


20/64

TITLE

Be descriptive.Example:

Instead of The Effect of ., state the finding as asentence.

Intervention X Improves Y.

Should be no more than 150 characters(including punctuation and spaces).


21/64

ABSTRACT

This is the most widely read section of themanuscript.

Should be consistent with manuscript! 250-word limit


22/64

ABSTRACT

In general, these are the sections to include in aResearch Report:BackgroundObjectiveDesignMethodsResultsLimitationsConclusions


23/64

Questions for PTJ:Title and Abstract


24/64

INTRODUCTION

Describe the nature, scope, and severity of the problembeing investigated.

Start with a focused sentence rather than broadstatements related to the issue.

Provide a solid rationale for the study: Previously documented benefits of the intervention Plausible explanation for effects of intervention

State specific objectives and hypotheses at end ofIntroduction.


25/64

INTRODUCTION

In developing the rationale, provide the followinginformation:

What is known?What is not known?How will this study fill the gap in our

knowledge?


26/64

Questions for PTJ:Introduction


27/64

METHODS

ParticipantsStudy Design and ProtocolOutcome MeasuresInterventionsStatistical AnalysisRole of the Funding Source


28/64

METHODS: Participants

Describe eligibility criteria for participants: Describe recruitment procedures. Include inclusion criteria:

Age, sex, clinical diagnosis, and co-morbid conditions Include exclusion criteria:

Exclusion criteria often used to ensure patient safety

Describe setting where data were collected: Country, city, immediate environment, number of

locations, transportation issues


29/64

METHODS: Study Design and Protocol

Describe the study design and protocol:Describe the sequence of events, including

follow-up.

Include that the study was approved by theIRB.

If approval was not sought, provide evidencethat this was acceptable to the institution.


30/64

METHODS: Outcome Measures

Clearly identify and define primary andsecondary outcome measures.

Provide references for validity and reliability

Clearly detail the methods used for datacollection, including personnel (assessors andindividuals providing the intervention),

equipment and functional tests.


31/64

METHODS: Interventions

Describe the interventions thoroughly. Important if you want your trial included in systematic

reviews

Use informative figures.

Videos can be posted on the PTJWeb site.


32/64

METHODS: Statistical Analysis

Sample size: How was it determined? Describethe power analysis, if used.

Examine between-group differences.

Specify the statistical procedure for eachanalysis and the comparison it was used for.

Avoid multiple single comparisons. Describe subgroup analyses. Describe adjusted analyses.


33/64

METHODS: Statistical Analysis

State statistical software used.

See Web site for specific guidelines.

Consider adding a biostatistician to yourresearch team.


34/64

Identify the funding source for the study and itsrole in the studys design, conduct, andreporting.

METHODS: Role of Funding Source


35/64

Will the Methods used answer the questions being asked? Are the measurement tools relevant for the questions? Are the measurement tools sufficiently explained? Are the interventions explained in enough detail to be replicated

by a physical therapist?

Are the statistics appropriate for the study design? (if you areunsure dont worry PTJhas statisticians who can help))

METHODS: Reviewers


36/64

Questions for PTJ:Methods


37/64

RESULTS: Participants

Present demographics and relevantdescriptive data

Provide baseline demographics and clinicalcharacteristics of each group:

Tables are very useful for this information. Normally distributed data

Use mean (SD) Data that are not normally distributed

Use median (min, max), orUse median (25th, 75th percentile)


38/64

RESULTS: Participants

State the number of participants in eachgroup that were included in each analysis.

Include the CONSORT Flow Diagram if study is aclinical trial

Always report the frequency of missing data.


39/64

RESULTS: Findings

For each of the primary and secondaryvariables, provide:

Preferred Summary of results (usually means) 95% confidence intervals (CIs) preferred over SDs

for clinical trial

estimated effect sizeAlternative

Summary of resultsp values


40/64

RESULTS: Data Presentation

If the sample mean estimates individual values: The uncertainty with which the mean estimates

individual values is given by the SD.

95% Confidence Interval (95% CI) Range of values that you can be 95% certain contains

the true mean of the population.


41/64

SD

Standard deviation Measure of data variabilityAssumes Gaussian distribution


42/64

95% Confidence Intervals

A 95% confidence interval is a range of valuesthat you can be 95% certain contains the truemean of the population. This is not the same as

a range that contains 95% of the values.


43/64

SD vs 95% CIs


44/64

Confidence Intervals

Use confidence intervals rather than P values

"... imperfectly understood confidence intervalsare more useful and less dangerous than

incorrectly understood P values and hypothesistests."


45/64

Standard Error of Measurement

Refers to variability of a test score: Standard error of measurement on a test is the

standard deviation of test scores that would havebeen obtained from a single student had that student

been tested multiple times. It is a measure of the

"spread" of scores within a student had the student

been tested repeatedly.


46/64

Effect Size

a measure of the strength of the relationship betweentwo variables

helps to determine whether a statistically significantdifference is a difference of practical concern

most commonly used standardized measures of effectsize are r, Cohen's d, odds ratio, etc.

Effect Sizes (Cohens d) d= 0.2 small d= 0.5 medium d= 0.8 large


47/64


TrendAvoid using the term trend to describe data

with a p value near but above 0.05.

Percentagesn < 200, do not use decimal placen 200, use one decimal place


48/64


Video


49/64

RESULTS: Findings

Present findings in a logical sequence.

Use Tables and Figures appropriately. Do not repeat data in the text if it is in a figure or

table.

Describe subgroup analyses and adjustedanalyses.


50/64

RESULTS: Adverse Events

Describe all important adverse events and sideeffects occurring in each treatment group.


51/64

RESULTS: Writing Clarity

Do not introduce bias or interpretation. Include ONLY the Results. Write in past tense. Have an outside reader prior to submission

to ensure clarity of reporting.

Include a comparison group in allstatements. (X was greater in the experimental group

compared with the control group)


52/64

Questions for PTJ:Results


53/64

DISCUSSION: General

Take into account study hypotheses.

Discuss sources of potential bias or imprecision.

Do not overstate the findings!

Do not restate the Results.


54/64

DISCUSSION: Guidelines

Start with a brief synopsis of key findings. Consider possible mechanisms and explanations. Compare with other relevant published studies:

Present both sides of the literature (agreement andconflicting evidence)

When possible, compare study results to results insystematic reviews.

Discuss limitations.

In a subsection, summarize the clinical andresearch implications.


55/64

DISCUSSION: Generalizability

External validity (generalizability, applicability) isthe extent to which the results of a study can begeneralized to other circumstances.

Matter of judgment based on: Characteristics of the trial participants Trial setting Treatment regimens tested Outcomes assessed


56/64

Questions for PTJ:Discussion


57/64

REFERENCES

Cite no more than 75 references. Cite primary studies or systematic reviews. Textbooks and lay Web sites are discouraged. Indicate by superscript numbers in the body of

the manuscript.

Use AMA referencing style. List references in order of appearance in text.


58/64

TABLES

Tables are a very informative way to presentdemographic data.

Number consecutively.

Start a new page for each table.


59/64

FIGURE LEGENDS

Provide a descriptive title and legend for eachfigure.

Define any symbols and abbreviations used.


60/64

FIGURES

Color photographs are encouraged.

Electronic format is preferred.

Minimum 300 dpi resolution.

Lettering should be large, sharp, and clear.


61/64

APPENDIXES

Use for essential material not suitable for figures,tables, or text.

Excellent for such documents as surveys andquestionnaires.

Editorial Board may recommend that appendixesappear online only, or that nonessential tables and

figures appear online only.

Videos, data dumps, and other content also maybe provided online only.


62/64

Questions for PTJ: End Materials


63/64


Does your manuscript contain these 5essentials?

Relevance Originality Importance

High-quality design and methods High-quality analysis and interpretation


64/64

Contact Us

Editorial Office800-999-2782, ext 3187 or 3182

Managing [email protected]

Information for Authorswww.ptjournal.org/misc/ifora.dtl

Information for Reviewerswww.ptjournal.org/misc/iforr.dtl

Documents

5 Essentials of Writing Research Reports