Santa Clara County Builds Foundation of Evidence to Monitor Delivery of Mental Health Services

Inventory of programs provides a tool to map their implementation across continuum of care

Navigate to:

Santa Clara County Builds Foundation of Evidence to Monitor Delivery of Mental Health Services
Santa Clara
Getty Images

A comprehensive review of county-funded mental health programs helped Santa Clara County, California, better understand the services offered across its continuum of care. Building a foundation of evidence helps the county monitor program fidelity—that is, the degree to which a program adheres to its research-based design.

In 2019, Santa Clara County’s Behavioral Health Services Department (BHSD) partnered with The Pew Charitable Trusts’ Results First initiative to assess the evidence base of interventions offered in outpatient settings for adults with mental health issues. Although BHSD was already making data-driven decisions, it hoped to take this work a step further to ensure that the right services were being delivered in the right amount to the right population.

So the department compiled a program inventory, a catalog of programs it funds in county clinics and through contracted community providers. From the start, BHSD intentionally made this process collaborative.

“Relationships with providers [in] Santa Clara County are … critical, [given that] many of our programs and services are contracted out. … As such, buy-in and full engagement with all stakeholders around the potential value of this project … was important to achieve the desired outcome,” said Todd Landreneau, director of adult and older adult services at BHSD.

One of the first steps was to map the programs being offered across the department’s continuum of care, which contains several levels of services ranging from less intensive (such as case management for adults with mental health barriers to employment) to most intensive (inpatient treatment for psychiatric disorders). BHSD asked community providers to identify discrete interventions they offered their clients.

Department staff then convened a small external work group made up of a subset of these providers to validate the list for accuracy. Once this was completed, BHSD and the work group compared the programs in the list to the evidence about what works to reduce mental health symptoms using the Results First Clearinghouse Database. Then they created profiles for the most commonly offered programs, which included fidelity markers such as number and frequency of treatment sessions and target population to be able to compare implementation across providers. For example, according to research, adults with a clinical diagnosis of depression who are receiving cognitive behavioral therapy should meet with their clinician one to two times a week for 12-20 weeks.

Through this process, BHSD identified several opportunities to improve program fidelity and standardize implementation.

  • For the first time, BHSD could visualize the concentration of services across the levels of its continuum of care. This helped the department identify gaps in “step-down” treatment options to move lower-risk clients from a more intensive level of care to a less intensive one—a revelation that BHSD is considering in its future procurement plans.
  • Through the inventory process, BHSD noticed mismatches between a program’s intended treatment population and the clients receiving the services in Santa Clara. To ensure that programs are being delivered to the clients they were designed to treat, BHSD decided that it wants to find or develop a clinical assessment tool that could be used across providers to better place clients in appropriate services.
  • In identifying which programs were offered by multiple providers, BHSD realized that implementation of certain programs was not standardized. For example, the number of sessions offered in a treatment protocol differed from provider to provider. This has led BHSD to consider developing a common terminology for programs, selecting specific program models, revising contracts to encourage use of those models, and offering training to providers to streamline implementation.
  • BHSD plans to continually monitor the alignment of currently funded programs with their evidence-based designs—establishing a fidelity monitoring system tied to the department’s inventory to ensure that clients are getting treatment that meets their needs. BHSD intends to start building this system around two programs—motivational interviewing and solution-focused brief therapy—reconsidering the data collected through regular reports, training providers at county clinics on their core components, and applying lessons learned to roll out the same process for other programs and community providers.

“The biggest change to this work is understanding what the concept of ‘evidence-based practice’ means, using data to plan the implementation or termination of a program, and aligning … services [for] effectiveness to both the client and the department,” said Margaret Obilor, division director of adult and older adult services at BHSD.

As Santa Clara’s example shows, program inventories offer jurisdictions a way to map services across their continuum of care, compare implementation across providers, and build a foundation for monitoring fidelity. Santa Clara also demonstrates that involving providers in the process can help jurisdictions collect more accurate information, spread knowledge about program assessment, and ensure buy-in when making decisions based on inventory findings.

Sara Dube is a director and Abby Hannifan is a principal associate with the Results First Initiative.

Spotlight on Mental Health

Composite image of modern city network communication concept

Learn the Basics of Broadband from Our Limited Series

Sign up for our four-week email course on Broadband Basics

Quick View

How does broadband internet reach our homes, phones, and tablets? What kind of infrastructure connects us all together? What are the major barriers to broadband access for American communities?

What Is Antibiotic Resistance—and How Can We Fight It?

Sign up for our four-week email series The Race Against Resistance.

Quick View

Antibiotic-resistant bacteria, also known as “superbugs,” are a major threat to modern medicine. But how does resistance work, and what can we do to slow the spread? Read personal stories, expert accounts, and more for the answers to those questions in our four-week email series: Slowing Superbugs.

Explore Pew’s new and improved
Fiscal 50 interactive

Your state's stats are more accessible than ever with our new and improved Fiscal 50 interactive:

  • Maps, trends, and customizable charts
  • 50-state rankings
  • Analysis of what it all means
  • Shareable graphics and downloadable data
  • Proven fiscal policy strategies


Welcome to the new Fiscal 50

Key changes include:

  • State pages that help you keep track of trends in your home state and provide national and regional context.
  • Interactive indicator pages with highly customizable and shareable data visualizations.
  • A Budget Threads feature that offers Pew’s read on the latest state fiscal news.

Learn more about the new and improved Fiscal 50.