In a Nov. 4, 2021, memo sent to state broadband offices that are participating in The Pew Charitable Trusts’ technical assistance program, the “Broadband Education and Training Initiative,” Pew experts explored how states use scoring metrics to evaluate broadband grant applications. The choice and weight of metrics should reflect each state’s priorities in order to ensure funded projects will advance state goals and deliver meaningful benefits to residents.
Read the full memo below.
To: State broadband offices
From: Jake Varn, The Pew Charitable Trusts
Date: November 4, 2021
Subject: Broadband Grant Program – Scoring Metrics
The following memo includes information on broadband grant scoring metrics, with side-by-side comparisons of the metrics used by Indiana, Minnesota, and Virginia. These three states represent both relatively well-established state broadband grant programs (Minnesota, in particular) as well as programs that updated their scoring systems in 2020 and 2021.
- The scoring metrics for evaluating grant applications can be a tool to promote and enforce state priorities.
- State grant programs use different point scales for scoring grant applications. For example, Minnesota uses a 120-point scale, Indiana uses a 250-point scale, and Virginia uses a 300-point scale. For comparative purposes, the below examples include the equivalent percentage of points awarded per category.
- Each program emphasizes different components in its scoring of applications, based on state priorities:
- Virginia awards up to 135 points (45%) for the applicant’s project budget and cost appropriateness. This includes up to 125 points for a cost-benefit index calculated by using the total amount of Virginia Telecommunication Initiative (VATI) funding requested and the total number of serviceable units.
- Minnesota places a greater emphasis on speed and the overall change in level of service available. See below for a table on Minnesota’s scoring rubric with a sliding scale of points available depending on current speeds, speeds after the build, and the total number of passings (up to 20 points or 17%).
- Indiana places a greater emphasis on the match contributed by applicants and utilizes a sliding scale of up to 65 points (26%) for projects with a higher cost match, with applicants offering to cover more than 75% of the cost receiving the maximum points.
- States may also incorporate other priorities into grant scoring. For example, several states award points for digital equity, affordability, adoption efforts, or for specific priority populations (e.g., Indiana awards up to 15 points [6%] for the inclusion of “Economically Disadvantaged Student Household Service Packages”). Virginia’s “Commonwealth Priorities” category allows for a flexible awarding for projects that align particularly well with the agency’s goals and directives.
- States can prioritize policy goals either by including them in the scoring rubric or by addressing them through screening eligibility requirements or a subsequent review phase following the application scoring process (i.e., if the final grant selection process is conducted by a board or commission, as in Colorado and Wisconsin). States can also reference these priorities as a component of a category on their scoring rubric.
- Notably, the potential impact of a state grant program’s scoring process may be limited by a need to classify areas that have received past federal or state funding as ineligible for grant funds. While this can serve as a protection against “overbuilding” or for complying with federal requirements, projects funded through these previous programs may offer service at inadequate speeds and census block-level analysis may overrepresent the actual level of coverage.
Example Scoring Rubrics
States frequently use scoring rubrics to screen grant applicants and award projects that align with the state’s policy priorities. The Minnesota Border to Border Broadband Development Grant Program utilizes a 120-point scale to rank applicants. The VATI program in Virginia follows a 300-point evaluation criteria formula. In Indiana, the Next Level Connections Broadband grant program uses a 250-point scale. The precise weights of the scored categories are often adjusted between rounds to better reflect the state’s priorities and applicant pool.
Common scoring categories include:
- Project description.
- Level of service (or total number of households/businesses/anchor institutions to be served by the proposed project).
- Project readiness.
- Community engagement.
- Affordability and/or adoption assistance.
- Matching cost-share.
Select Scoring Categories Comparison
This category can be used to evaluate a variety of application components, including the overall scope of the project, the technologies used, and the parties involved. States may also include features such as project readiness, speeds and pricing tiers, and budgetary components in this general category, if those aspects are not separately scored.
|Share of points: 26%||Share of points: 42%||Share of points: 28%|
|[Indiana scores the project description and project readiness in a single category]
||[Minnesota’s Project Readiness (21%) and Project Sustainability (21%) are the most applicable comparative categories]
Applicant has concretely demonstrated a comprehensive knowledge of—and detailed preparation for—the proposed project. Applicant has provided evidence of being fully prepared to build, implement, and operate the project:
Applicant has demonstrated strong internal capacity to effectively support and sustain its broadband infrastructure proposal:
|Category: Project Description and Need
Describe the fundamentals of the project, including:
Note: Applicants will achieve maximum scoring in this section only if the application reaches universal coverage in the county or counties included in the application.
This category is used to evaluate the level of support or engagement from the community that will be served by the funded project. States evaluate this through letters or other demonstrations of support from community members, alignment with local or regional plans, and formal commitments, including financial commitments from local governments or community partners.
|Share of points: 6%||Share of points: 12.5%||Share of points: 0%|
||Additional scoring points will be awarded for the following:
||Virginia does not award points for community engagement. However, the program requires applicants be public-private partnerships between a unit of government and a private sector internet service provider.|
This category is used to award points to projects that will achieve certain speeds or go beyond the minimum speed requirement of the grant program. Projects that can be scaled to higher speeds in the future, particularly fiber, can be rewarded with additional points in this category as “future-proof” investments that will meet expected future demands. Projects without scalable speeds may require additional state funds to upgrade and remain sufficient. This category may also include pricing requirements, and augment or serve as substitute for an affordability category.
|Share of points: 24%||Share of points: 17%||Share of points: 3%|
|See table below.||See table below.||[Virginia includes speed as a subcategory of the “Project Description” category.]
Describe the internet service offerings, including download and upload speeds, to be provided after completion of the proposed project. Detail whether that speed is based on dedicated or shared bandwidth, and detail the technology that will be used. This description can be illustrated by a map or schematic diagram, as appropriate. List the private co-applicant’s tiered price structure for all speed offerings in the proposed project area, including the lowest tiered speed offering at or above 25/3 Mbps (up to 10 points).
Indiana speed points for households, businesses, and anchor institutions passed
|Download speed after build|
|# of passings||10 Mbps||50 Mbps||100 Mbps||500 Mbps||1 Gbps|
|1 - 50||0||3||6||17||30|
|51 - 250||1||4||10||20||34|
|251 - 500||2||5||14||24||37|
|Upload speed after build|
|# of passings||5 Mbps||20 Mbps||100 Mbps||500 Mbps||1 Gbps|
|1 - 50||0||1||4||8||15|
|51 - 250||0||2||5||10||16|
|251 - 500||1||3||6||11||18|
Minnesota’s Anticipated Broadband Improvements Scoring Table
|# of passings||Speed now:||0/0 Mbps||≤10/1 Mbps||0/0 Mbps||≤10/1 Mbps||25/3 Mbps||0/0 Mbps||≤25/3 Mbps||<100/20 Mbps|
|Speed after build:||25/3 Mbps||25/3 Mbps||100/20 Mbps||100/20 Mbps||100/20 Mbps||1Gbps/1Gbps||1Gbps/1G||1G/1Gbps|
This category is often used to reward applicants that can cover a higher percentage of the project’s total costs, and therefore require less in state funding. However, an overreliance on this category may disadvantage economically distressed communities and smaller providers that lack the financial resources of wealthier communities and larger providers.
|Share of points: 26%||Share of points: 12%||Share of points: 45%|
|Percent of state grant request compared to total eligible project costs:
Grant Funding Request Amount Scoring Table
|Category: Project Budget and Cost-Appropriateness
Describe the project budget, including:
America’s Overdose Crisis
Sign up for our five-email course explaining the overdose crisis in America, the state of treatment access, and ways to improve care