Establishing a Threshold for Application Inclusion in Peer Review Committee (PRC) Discussions

Research Question:

What threshold would capture the largest percentage of applications that were ultimately approved following discussion at peer review committee (PRC) meeting, while minimizing the percentage of applications that would not be funded without PRC discussion?

Dataset:

Method:

Applications initial ranking percentiles within PRCs prior to face-to-face meetings was compared to success of the application following the discussions.

For all applications above a given ranking percentile, the percentage of ultimately approved applications found within the group was calculated.

Results:

Ninety-eight percent of all applications that were ultimately approved following PRC discussion had an initial ranking of 60 or above, while two percent of applications that would have received funding if included in PRC discussion are lost.

Figure 1. Application Rankings before Peer Review Committee Meetings and Application Success in Ten OOGP Competitions (2010-2015)

Conclusion:

The analysis demonstrates that using a threshold for inclusion on pre-meeting ranking percentiles would have better focused PRC application discussion meetings on those applications with a higher likelihood of receiving funding.

For a breakdown by OOGP competition of the above analysis see the Competition Breakdowns page.

Note: A similar analysis was conducted to determine if there was a threshold above which applications always get funded and do not need to be discussed by PRCs; however, there was no ranking percentile above which 100% of the applications were consistently funded. For analysis please see below.

Research Question:

Is there a threshold on pre-meeting rankings above which applications always get funded and do not need to be discussed by PRCs?

Date modified:

2018-04-10