SCRS Talks
SCRS Talks, hosted by the Society for Clinical Research Sites (SCRS), is a platform for clinical research industry professionals to hear about valuable information shaping the research industry today. These short interviews will provide new perspectives and insights on pressing topics, current events, and the research community.
SCRS Talks
Turning Site Data Into Sponsor Trust: A Conversation with CRIO
Use Left/Right to seek, Home/End to jump to start or end. Hold shift to jump forward or backward.
Jimmy Bechtel sits down with Megan Richards, Director of Sponsor Operations at CRIO, to talk about how research sites can get more strategic with their data. Megan walks through where to start when identifying the right KPIs, how to build dashboards that actually get used (and the four common pitfalls to avoid), and how benchmarking against industry standards helps sites spot both wins and opportunities for improvement. The conversation wraps with practical advice on turning operational data into a compelling story for sponsors and CROs, strengthening relationships, and winning future study awards.
Hello and welcome to SCRS Talks provided by the Society for Clinical Research Sites. I'm Jimmy Bechtel, the chief site success officer with the Society, and today I'm joined by Megan Richards, who's the director of sponsor operations with a long-standing partner with SCRS, Creo. megan is here to talk with us today a little bit about data and how sites might think of data differently. CRIO is in the business of information and data and has served as a, cruxical organization in the exchange of information between the sites and the sponsors and CROs, et cetera. So really excited, Megan, to have you here with us today. Before we get into the questions and start having our conversation, I'd love to learn maybe a little bit more about you or CRIO.
Megan RichardsGreat. Thanks, Jimmy. So yes, my name is Megan Richards. I'm currently the director of sponsor operations here at CRIO. I've been here almost seven years now, and in my current role, I coordinate the rollout of central eSource to help sites increase data accuracy at the point of entry into the eSource tool itself through the use of real-time flags and alerts, and also to support sponsors in getting more real-time visibility into the data that's being captured in a standardized template. Prior to that, I worked on the site side, onboarding research sites to CRIO's eSource, CTMS, and eReg software, and I've also been heavily involved throughout my entire time at CRIO in rolling out our Looker reporting tool, and later, the BigQuery data warehouse, which we use to help support clients in identifying their key performance metrics and also in creating dashboards and visualizations to help track those metrics. So very excited to be here today.
Jimmy BechtelI am excited to talk with you about this as well, so really exciting. I love data. Anyone who's been around SCRS long enough knows that I'm definitely one of the data guys. And any time we can enhance the data that we get or drive us forward even faster with data, then I'm all for it. Megan, for sites that are just starting maybe on the opposite spectrum of you and I, to think about data more seriously, where do you even begin when it comes to thinking about or identifying KPIs that actually matter for their operations?
Megan RichardsYeah, this is a great question. I think there are a lot of sites that are tracking things already, but there are plenty that just need to figure out where to start or perhaps some that might even be tracking too many things and just need to reset so that they can get things started in a more practical manner for their sites. So I think we can recognize that it can feel a bit overwhelming at first, perhaps. But definitely start small and slowly build things up. Add more metrics over time. As you and your team get more into the habit of it, it really becomes part of your company culture, and then it's going to be something that is just natural to be doing. Think about identifying areas where your team spends the most of their time or experiences the most friction in the day-to-day. Think of areas where you might be tracking things manually, or if there's anything that's being pulled from multiple places or multiple sources that needs to get joined together into spreadsheets or elsewhere. These can all be good areas to pinpoint to track for your KPIs. I think the most valuable ones will certainly be the ones that are going to help you solve certain problems. So it could be problems that the sponsor and CRO are going to be interested in, like enrollment rates or query resolution turnaround times, study startup turnaround times, protocol deviations. But don't forget about the internal metrics that help you keep track of your overall site health as well. So something as simple as tracking the number of studies by coordinator and coupling that with forecasting of future study awards so that you can better predict future staffing needs that your site might have And then ultimately, stay consistent, establish the standardized benchmarks or deviations and processes for capturing that data. And that way you know that you're making decisions based on reliable information and you're able to track the direction that your team might be going positively or negatively because you've got those benchmarks that are created as well
Jimmy BechtelThanks, Megan. A lot of really great examples there for sites to think about. And I do, I agree with you. I think that's a really great way. It's, identify areas of friction or tension or unknown, and that's really where you start. And I think it's also really important, as you mentioned, you don't have to take on the world. Start slow, start small, integrate a couple of KPIs. And one of the other things I think that's really important is getting everyone aligned, right? And getting The buy-in with some of that. What kind of leads me to my next question around this, so which is once a site knows they've gone through what you just described, which metrics to track, what does building a dashboard or a database or a home for that information look like in practice? And what are some of the common pitfalls, sites fall into when they do this?
Megan RichardsSure. So I would definitely say Utilize the tools that you have available to you If you're using an eSource or a CTMS system like CRIO or others, there are a lot of reports that might be pre-built, and there is scheduling functionality that's built into some of those reporting tools that allows you to send data to central dashboards. So start there. Usually that's a, a nice starting point for sites to then build from. But as you're thinking about what to put on these dashboards and how to build them, just remember that a, a successful and an effective dashboard is going to give you that real-time view into your site's operational health. It will help you highlight trends and flag issues that might require action before they become larger problems. And then for some pitfalls to avoid, I will try to summarize this into four key areas that I think are particularly important. One of those is to tailor your dashboards to the audience that is going to be using them. If you have data that's going to the site coordinators, they may need more of that day-to-day information that's going to help support their scheduling needs and room assignments and anything else that's gonna help in that... in the day-to-day. Whereas your site managers or executives at those sites are going to need high-level information about overall site health. And then again, even the sponsors and CROs that might be receiving some of this data are going to need something different. So that kind of one-size-fits-all concept of a dashboard is probably going to have too much information on it. And think about, again, who is the user really of this dashboard, and make sure to tailor different versions to those different groups of people. The second one I would say is define what you're tracking. If you don't know what it is exactly that you're tracking, or you don't really know if that metric is good or bad and what direction it's trending, you're not going to be able to tell other people at your site. And then if they're looking at the dashboard, it's going to be even more confusing to them. So add those definitions wherever is going to be needed on these visualized dashboards. Include ranges that can help to identify trends and outliers, and can actually allow you to then act upon those if you start to see patterns over time The third item I'd certainly recommend considering so that you can avoid is make sure you allocate enough time for this. It's an important part of the job, but it can take some time to start building out these dashboards and then maintain them. So again, remember that it's possible to be tracking too many things. Start small, add things as you go, but also ensure that time is allocated in whomever's role it's going to be. Add it to the job descriptions, make p- make people aware of this so that they know that it's part of what they will be doing in their day-to-day. And then finally, I would recommend automating what you can. So again, take advantage of those reports that might be built into systems that your site is already using that scheduling functionality, any additional support that they can provide. But if you can avoid having to track things manually, that can cause errors and take additional time certainly think about the automations and how that can help save your time overall
Jimmy BechtelExcellent, Megan. I couldn't agree more with really all those points, and I love how they were progressive too, right? It's almost like not only are these things you need to do, but they're also stepwise. There, there's an order in which you need to do this. And again, I think the really important part of the success here, as you allude to and mention, is really about involving multiple individuals, right? Getting the team on board with this and aligned around what needs to be done and how this is going to work so that it's useful. Because if you create this beautiful, complex, data abundant dashboard, but no one knows how to use it and no one knows what it means, and it doesn't make sense to the rest of the team it's worthless at that point. So getting Everyone aligned on that, is an excellent point, and you do that through exactly what you described in your process there. I think that's great So Megan then, as we can kinda continue to move through the the steps here and the, the timeline for successful data and implementation and usage, how can sites then, once they have this dashboard, use that data to benchmark their performance against maybe industry standards? And why does that comparison really matter?
Megan RichardsThat's a great question, and I think the first point I would make there is figure out what those industry standards are. Ask your sponsors, ask the CROs if they can provide any metrics so that you actually have some, some metrics to benchmark against. If you don't have that information, I know SCRS puts a lot out there and I'm sure there's a lot more online that can help to identify some of the standards. But think about some of the external metrics that will help to showcase your site's success to sponsors. So again, things like your study startup turnaround times, query resolution rates, EDC data entry turnaround times, or participant retention, like really metrics that will help your site stand out. And then from there, in terms of the benchmarking piece of this, con- remember that benchmarking is really what is going to provide the context to your team and to anyone externally who's going to be receiving this data. So this is what allows you to compare your data against the industry averages and to show how successful your site is compared to other teams out there by, understanding how quick, again, those enrollment rates are, that query resolution time is compared to the averages to really showcase your successes. Compare the data to, again, just determine where you might be outperforming, and also to identify areas of improvement. That'll be helpful so that you can also monitor your progress over time, showcase the successes that you've made, and then highlight those to sponsors too, so that they can see how you are, putting effort as a team into improving upon some of your internal processes and helping to, ultimately turn everything over more quickly and efficiently and accurately. And then I would just say track your trends across studies as well, so that you can highlight areas of improvement over time, but also so that you can celebrate them internally. And as you have these successes, don't just forget to share them with the sponsor, but celebrate them with your site and with your team so that as you have these improvements, you're continuing to create this culture of Tracking metrics and making that really part of, an important day-to-day point on your team. But celebrating it so that people really want to continue to do this as a team to really create that team mentality that's going to set your site apart from others in terms of what the sponsor is seeing too
Jimmy BechtelMegan, another great set of sort of tips, right? Information, best practices really around how we do this. And you're exactly right. There's so many resources out there. It's just taking the time to distill and find the ones that work for you. And yeah, thanks for the the plug on SCRS, right? The landscape data really does help a lot of sites with their benchmarking. And I would also shamelessly plug SCRS, KPI resource as well. We have a really robust resource and document that helps sites maybe do some of the steps and think about some of the things that you mentioned previously in identifying which KPI they might need to track, what they mean, and then how to track them effectively. So if Anyone out there is looking to take some of the great information that Megan's sharing here and bring it into reality that might be a good resource to help supplement that. So Megan, As we begin to close the conversation here it's been great. The number of things for sites to think about that you've mentioned i- is really numerous. But as Sponsors are increasingly looking for proof of site performance before and during that trial, right? It's this constant interview that we're really going through as a site across a spectrum of any given study. So how can sites then use that data that we've, built here, and we're tracking, and it's working well for us? How can they use that operational data to then tell the compelling story and strengthen those relationships? Really because that's what we're, partially doing this for. As you've mentioned, it's not only internal and internal management here as a business, but it's also then putting their best foot forward with their sponsors and CROs they work with.
Megan RichardsYeah. So- Definitely make sure you understand the data first, and then that goes back to the point I was making earlier with having those definitions and having the benchmarks available so that you can understand which direction you're trending and which items to highlight to the sponsor at any given time. So understand that data and then tell the story. Talk to the sponsors around where those successes are in participant enrollment and your, data quality and number of queries and query turnarounds, how you're meeting timelines and executing the protocol, consistently across all of your studies with minimal deviations. All of the data that's being shared, you wanna understand, and then you want to share those numbers so that you can provide that evidence that really helps to prove and showcase your site's success. And when thinking about telling the story with the numbers, don't just share the numbers, but talk about how some improvements that you've made to process at your site and staffing and investing in technology ultimately has led to better overall site performance, and most importantly, why we're all here, better participant outcomes. And that really helps to bring meaning to the numbers that you're sharing. And additionally, if you can tell a story on the tech side of how tech is saving your site's time and creating more quality data, that can also strengthen the case for your site to perhaps get that tech paid for by the sponsor Then think about, the big picture here, which is that partnership component, and that we want to develop that relationship with the sponsor, with the CRO so that we can continue to work with them on additional trials in the future. So if you are being very proactive about sharing these metrics and highlighting your successes, and you're seen as being a transparent site amongst the sponsor, landscape with all of the other sites out there, it helps to ultimately strengthen that partnership with the sponsor, help to win additional study awards, ideally really just opening the door for you for those future opportunities. And again, when you're considering all of this and which of these metrics is going to be most useful when you're talking to the sponsor, think about those external ones, those study turnaround times, time to visit, enroll, query resolution. Consider those, those metrics that the sponsors are going to want to see to say, "Yes, this is definitely a highly productive site that we wanna keep working with in the future." And really, Again, ultimately allows you to strengthen that relationship, keep winning study awards, and then keep improving your processes so that additional sponsors will want to work with your site as well.
Jimmy BechtelWinning all around is exactly what I received from that, Megan, and that's the goal here. We want the site to win, of course, but as long as we can demonstrate that the sponsors or CROs and sponsors through them are going to win as a result of, as well using data, then we're doing our jobs. And we're going to, as you state so eloquently really develop stronger relationships with those organizations. An excellent place, I think, for us to conclude our conversation here. And thank you so much for being with us today, for talking about this, sharing some insights again from a, an organization that really has always put data at the core of everything that they do a- and drive... help the industry drive decisions forward using that data. Again, thank you
Megan RichardsThank you, Jimmy, and I'll definitely recommend for folks that may have heard about CRIO but are not current CRIO clients check out CRIO's website. It's clinicalresearch.io. Encourage you to learn more about how CRIO can set up your study operations for success.
Jimmy BechtelExcellent. And Thanks again, Megan. And for those listening, I'd like to also make sure that you check out other SCRS resources on our website, myscrs.org, like that KPI resource that I mentioned, other podcasts, webinars and a lot of other great content. But for now, thanks for tuning in, listening, and until next time.