Archive for the ‘Peer Review’ Category


Advisory Council Meeting

The next meeting of our Advisory Council is later this week. For more information on Council activities, see these previous Feedback Loop posts: The Advisory Council’s Critical Roles, an overview of the types of input Council members provide to NIGMS “Did Council Fund My Grant?”, a discussion of the Advisory Council’s role in making funding [...]

Filed under: Meetings/Events, Peer Review
Permalink: https://loop.nigms.nih.gov/index.php/2013/01/23/advisory-council-meeting/

Discussing Your Application’s Review with Your Program Director

Study sections review applications three times a year, about halfway between the submission date and the second level of review by an advisory council. We are currently in the midst of the review cycle for the January 2013 Council meeting, which means that applicants will be getting their summary statements soon. A recent post described [...]

Filed under: Peer Review, Resources
Permalink: https://loop.nigms.nih.gov/index.php/2012/10/23/discussing-your-applications-review-with-your-program-director/

FAQs on Application Review, Next Steps

To address questions that investigators frequently ask about the review of their applications and the next steps after review, NIH recently created an online resource, titled Next Steps. It has also added a link to this new Web site on summary statements, just below the impact score and percentile. Questions include: What does the score [...]

Filed under: Peer Review, Resources
Permalink: https://loop.nigms.nih.gov/index.php/2012/09/27/faqs-on-application-review-next-steps/

“Did Council Fund My Grant?”

This is a question we’re often asked shortly after the NIGMS Advisory Council meets in January, May and September. The short answer is: No. Here’s why. As described in a previous post, our Council provides a second level of peer review of applications assigned to NIGMS. It is not a second study section. Instead, the [...]

Filed under: Meetings/Events, Peer Review
Permalink: https://loop.nigms.nih.gov/index.php/2012/06/25/did-council-fund-my-grant/

Why Overall Impact Scores Are Not the Average of Criterion Scores

One of the most common questions that applicants ask after a review is why the overall impact score is not the average of the individual review criterion scores. I’ll try to explain the reasons in this post. What is the purpose of criterion scores? Criterion scores assess the relative strengths and weaknesses of an application [...]

Filed under: Peer Review
Permalink: https://loop.nigms.nih.gov/index.php/2012/02/07/why-overall-impact-scores-are-not-the-average-of-criterion-scores/

Addressing Additional Review Criteria Questions for AREA Applications

Of all the institutes and centers at NIH, NIGMS receives the most Academic Research Enhancement Award (AREA, R15) applications and funds the most AREA grants. This is probably because the faculty and students at eligible institutions, which have not been major recipients of NIH research grant funds, typically focus on basic research using model organisms [...]

Filed under: Funding Opportunities, Peer Review, Research Administration
Permalink: https://loop.nigms.nih.gov/index.php/2012/02/02/addressing-additional-review-criteria-questions-for-area-applications/

Productivity Metrics and Peer Review Scores, Continued

In a previous post, I described some initial results from an analysis of the relationships between a range of productivity metrics and peer review scores. The analysis revealed that these productivity metrics do correlate to some extent with peer review scores but that substantial variation occurs across the population of grants. Here, I explore these [...]

Filed under: Director’s Messages, Peer Review
Permalink: https://loop.nigms.nih.gov/index.php/2011/06/10/productivity-metrics-and-peer-review-scores-continued/

Productivity Metrics and Peer Review Scores

A key question regarding the NIH peer review system relates to how well peer review scores predict subsequent scientific output. Answering this question is a challenge, of course, since meaningful scientific output is difficult to measure and evolves over time–in some cases, a long time. However, by linking application peer review scores to publications citing [...]

Filed under: Director’s Messages, Peer Review
Permalink: https://loop.nigms.nih.gov/index.php/2011/06/02/productivity-metrics-and-peer-review-scores/

Enhancing Peer Review Survey Results

One of the key principles of the NIH Enhancing Peer Review efforts was a commitment to a continuous review of peer review. In that spirit, NIH conducted a broad survey of grant applicants, reviewers, advisory council members and NIH program and review officers to examine the perceived value of many of the changes that were [...]

Filed under: Director’s Messages, Peer Review
Permalink: https://loop.nigms.nih.gov/index.php/2011/03/01/enhancing-peer-review-survey-results/

NIH-Wide Correlations Between Overall Impact Scores and Criterion Scores

In a recent post, I presented correlations between the overall impact scores and the five individual criterion scores for sample sets of NIGMS applications. I also noted that the NIH Office of Extramural Research (OER) was performing similar analyses for applications across NIH. OER’s Division of Information Services has now analyzed 32,608 applications (including research [...]

Filed under: Director’s Messages, Peer Review
Permalink: https://loop.nigms.nih.gov/index.php/2010/09/30/nih-wide-correlations-between-overall-impact-scores-and-criterion-scores/