How a Study How a Study Section worksSection works

Robert Freund, Ph.D.Robert Freund, Ph.D.Scientific Review AdministratorScientific Review Administrator

Virology B Study SectionVirology B Study SectionCenter of Scientific ReviewCenter of Scientific Review

Freundr@csr.nih.gov301-435-1050301-435-1050

• Submitting an application

• Review of the application The study section

• After the study sectionWhat next?

Subjects we will cover:

Dual Review System for Grant Dual Review System for Grant ApplicationsApplications

Second Level of ReviewSecond Level of ReviewCouncil/InstituteCouncil/Institute

Assesses Quality of SRGAssesses Quality of SRG Review of Grant ApplicationsReview of Grant Applications Makes Recommendation toMakes Recommendation to Institute Staff on FundingInstitute Staff on Funding Evaluates Program PrioritiesEvaluates Program Priorities and Relevanceand Relevance Advises on PolicyAdvises on Policy

First Level of ReviewScientific Review Scientific Review

GroupGroup Provides Initial Scientific Provides Initial Scientific

MeritMerit Review of Grant ApplicationsReview of Grant Applications Rates Applications and Rates Applications and

Makes Recommendations Makes Recommendations for Appropriate Level of for Appropriate Level of Support and Duration of Support and Duration of AwardAward

Center for Scientific Center for Scientific ReviewReview Division of Receipt and Referral: Division of Receipt and Referral:

Central receipt point for most PHS Central receipt point for most PHS grant applicationsgrant applications Institute assignmentInstitute assignment Assignment to Scientific Review GroupAssignment to Scientific Review Group

Study Section: Conducts initial Study Section: Conducts initial scientific merit review of most scientific merit review of most research applications submitted to research applications submitted to the NIHthe NIH

Applications Submitted to Applications Submitted to NIHNIH

Over 60,000 Over 60,000 grant grant applications are applications are submitted to NIH submitted to NIH each year.each year.

CSR Study SectionsCSR Study Sections

Standing Study Sections Standing Study Sections when the subject when the subject matter of the application matches the referral matter of the application matches the referral guidelines for the study section. guidelines for the study section.

Each study section has 20 - 30 membersEach study section has 20 - 30 members..

Approximately 80 applications are reviewed at each Approximately 80 applications are reviewed at each study study section meetingsection meeting

Ad Hoc Special Emphasis Panels (SEPs) Ad Hoc Special Emphasis Panels (SEPs) when when the subject matter does not fit into any study the subject matter does not fit into any study section, or when assignment of an application section, or when assignment of an application to the most appropriate study section would to the most appropriate study section would create a conflict of interest.create a conflict of interest.

Submit Cover Letter

• Suggest appropriate InstituteMultiple institute assignments

• Suggest appropriate Study SectionGo to web site: www.csr.nih.gov

Description of Study Sections Study Section Rosters

How to choose a study How to choose a study sectionsection

www.csr.nih.govwww.csr.nih.gov

Assignment Notification LetterAssignment Notification Letter Assignment NumberAssignment Number:: 2 R01 HL12345 - 12A1 2 R01 HL12345 - 12A1 Dual AssignmentDual Assignment:: NS NS Scientific Review GroupScientific Review Group:: Virology B (VirB)Virology B (VirB) Information about SRGs may be found on the CSR Home Information about SRGs may be found on the CSR Home

page (http://www.csr.nih.gov)page (http://www.csr.nih.gov) Scientific Review AdministratorScientific Review Administrator:: DR. ROBERT FREUND , SRADR. ROBERT FREUND , SRA CTR FOR SCIENTIFIC REVCTR FOR SCIENTIFIC REV 6701 ROCKLEDGE DR RM 3202 MSC78086701 ROCKLEDGE DR RM 3202 MSC7808 BETHESDA MD 20892BETHESDA MD 20892 (301) 435 - 1050(301) 435 - 1050

Institute/Center:Institute/Center:NATL HEART, LUNG, & NATL HEART, LUNG, & BLOOD INSTBLOOD INSTDIV/EXTRAMURAL AFFAIRS DIV/EXTRAMURAL AFFAIRS RK2 7100RK2 7100NATIONAL INSTITUTES OF NATIONAL INSTITUTES OF HEALTHHEALTHBETHESDA, MD 20892BETHESDA, MD 20892(301) 480-5295(301) 480-5295

CSR Study SectionsCSR Study Sections

•Administrative Review

•RecruitmentStanding MembersTemporary Members

•AssignmentsMatch Expertise/Interests with ApplicationsConflict of Interest IssuesWorkload of Reviewers

Study Section ActionsStudy Section Actions

Unscored (lower half)Unscored (lower half)

Scored, Scientific Merit Scored, Scientific Merit Rating (Rating (priority scores and priority scores and percentilespercentiles))

Deferral (this cycle, next Deferral (this cycle, next cycle)cycle)

Mock Study Section Mock Study Section VideoVideo

StreamliningStreamlining

Reviewers categorize applications in Reviewers categorize applications in “lower half” in scientific merit using “lower half” in scientific merit using preliminary scores.preliminary scores.

Lower half applications:Lower half applications: Not discussed or scoredNot discussed or scored Written critiques are provided to Written critiques are provided to

the applicantthe applicant Not taken to Advisory CouncilNot taken to Advisory Council

In most cases, unscored applications In most cases, unscored applications have potential and are worth revisinghave potential and are worth revising

Scored Applications

•Reviewers (usually 3) present opinions

•Discussion (approx. 15 min. per application)

•Discuss other considerations (vertebrate animals, human subjects, bioharzards)

•Score

•Discuss Budget

Review CriteriaReview Criteria Significance: Significance: Does the study address an important Does the study address an important

problem? How will scientific knowledge be problem? How will scientific knowledge be advanced?advanced?

Approach: Approach: Are design and methods well-developed Are design and methods well-developed and appropriate? Are problem areas addressed?and appropriate? Are problem areas addressed?

Innovation: Innovation: Are there novel concepts or Are there novel concepts or approaches? Are the aims original and innovative?approaches? Are the aims original and innovative?

Investigator: Investigator: Is the investigator appropriately Is the investigator appropriately trained?trained?

Environment: Environment: Does the scientific environment Does the scientific environment contribute to the probability of success? Are there contribute to the probability of success? Are there unique features of the scientific environment?unique features of the scientific environment?

Overall Evaluation & Score Reflects Impact on FieldOverall Evaluation & Score Reflects Impact on Field

Scores & PercentilesScores & Percentiles

Reviewers’ scores: 1.0 (best) to 5.0 Reviewers’ scores: 1.0 (best) to 5.0 (worst)(worst)

Priority Score:Priority Score: Average of all reviewers’ scores x 100Average of all reviewers’ scores x 100 Range from 100 to 500Range from 100 to 500

Percentiles (Percentiles (R01s onlyR01s only):): Normalizes scores between different Study Normalizes scores between different Study

SectionsSections Each application is ranked against all Each application is ranked against all

applications reviewed in the last year (3 applications reviewed in the last year (3 review rounds)review rounds)

Summary Summary StatementStatement Once applications are reviewed, the Once applications are reviewed, the

results are documented by the SRA in a results are documented by the SRA in a summary statement and forwarded to the summary statement and forwarded to the Institute (and the PI) where a funding Institute (and the PI) where a funding decision is made: decision is made:

The summary statement contains:The summary statement contains:

Overall Resume and Summary of Review Overall Resume and Summary of Review DiscussionDiscussion

Essentially Unedited CritiquesEssentially Unedited Critiques Priority Score and Percentile RankingPriority Score and Percentile Ranking Budget RecommendationsBudget Recommendations Administrative NotesAdministrative Notes

Getting the ResultsGetting the Results

Mailer: score & percentileMailer: score & percentile

Program staff:Program staff:Score & percentileScore & percentile

Payline informationPayline information

Advice on revisionAdvice on revision

The NIH CommonsThe NIH Commons

Summary StatementSummary Statement

After Review?

• Contact Program OfficerFunding Decisions, advise and interpretation

• Revise ApplicationAddress everything in IntroductionDon’t follow comments blindlyResubmit

NIH Grant Receipt, NIH Grant Receipt, Review, and Award Review, and Award ScheduleScheduleFeb-MarchFeb-MarchJune-JulyJune-July Receipt DatesReceipt DatesOct-NovOct-Nov

June-JulyJune-JulyOct-NovOct-Nov Review DatesReview DatesFeb-MarFeb-Mar

SeptSeptFebFeb National Advisory Council Board National Advisory Council Board

DatesDatesJuneJune

Dec 1Dec 1Apr 1Apr 1 Earliest Possible Beginning DateEarliest Possible Beginning DateJuly 1July 1