Loading summary
Transcript38 lines
- [00:00]
A
Foreign.
- [00:06]
B
Welcome to ACE Podcasts.
- [00:08]
C
Thanks for tuning in as we elevate clinical endocrinology by taking deep dives into trends and topics that can help us.
- [00:14]
B
Improve our patient care and global health.
- [00:17]
C
Find the Latest episodes on aace.com podcasts.
- [00:22]
B
And now let's meet the endocrine experts who will be talking with us today.
- [00:29]
C
Hello and welcome to our ACE podcast. I am Dr. David Lieb, professor of Medicine in the Division of Endocrinology at Eastern Virginia Medical School at Old Dominion University in Norfolk, Virginia. I also serve as our Endocrinology Fellowship Program Director. I was an Author of the 2023 Protocol for the Development of ACE Clinical Practice Guidelines and Consensus Statements and have been involved in work involving enhancing the trustworthiness of clinical practice guidelines. Joining me today is Dr. Carol Pang, Dr. Shenaz Sultan, and Dr. Melanie Bird. We'll be taking a peek behind the scenes and discuss the methodology used to develop the 2025 ACE clinical practice Guideline on the Pharmacologic management of adults with dyslipidemia. Thank you all for joining us today. Dr. Pang, could you introduce yourself and tell us a little bit about your area of expertise and your role on the guideline?
- [01:23]
B
Yeah.
- [01:23]
D
Hi everyone. I'm actually finally a board certified Endocrinologist because I just completed my fellowship at Boston University last year 2023 and I'm now practicing in Taiwan, but I'm still able to collaborate with everyone to perform this Kindline development. I was very honored to be selected as the first ever Methodology Fellow for the ACE Practice Guideline Task Force during my second year of fellowship. I actually applied with very minimal expectations because the position was open to both early career attendings and fellows. When I received the invitation for a ZOOM interview on a Friday afternoon kind of like 5pm, I actually thought it might be a scam, but ultimately I think my focus systematic reviews and Metaanalysis made me a strong candidate because my third original article published in 2018 was a meta analysis and since then I have been leading or co authored in six meta analysis and one coping sorry, one scoping review project.
- [02:36]
C
Awesome. Very cool. And congratulations Dr. Sultan.
- [02:40]
A
Yes, thank you. It's a pleasure to be here. So I am a Professor of Medicine in the Division of Gastroenterology, Hepatology and Nutrition. I'm also the Vice Chair for DEI in the Department of Medicine and in a former life I used to be a Program Director of our GI Fellowship program and I started out my career as a health services researcher and focused on Colorectal cancer. But I spend Most of my time currently very much in the guideline world. I was the former chair of the American Gastro Association Clinical Guidelines Committee and a long standing member of the GRADE Working Group and the US GRADE Network. And I focus a lot on trying to teach folks about how to use GRADE as well as advance some of the methodology behind the GRADE framework.
- [03:25]
C
Awesome. It's great to be surrounded by so many medical educators here, especially with regards to guideline development.
- [03:31]
B
And Dr. Bird, thank you Dr. Lieb. I'm so excited to be part of this. So I am the methodologist here on staff for the ACEs Clinical Practice Guideline Program. I have over 10 years experience in developing clinical guidelines, consensus statements, health policies, et cetera. Prior to that, I was a biomedical researcher in immunology as well. But basically research, data analysis, evidence assessment is my passion. So I was really excited to be part of ACEs first guideline using GRADE and helping implement that program here and also very excited to talk about it today.
- [04:14]
C
Thank you. This is a super powerful team and I'm excited to hear everybody's thoughts about this guideline in particular. So, Dr. Sultan, this is the first guideline from ACE that's used the GRADE framework. Can you give us a short background on GRADE and why we use it?
- [04:30]
A
Yeah. So GRADE is actually an acronym. It is short for Grading of Recommendations, Assessment Development and Evaluation. And GRADE really began as a collaboration of experts dating back to about the year 2000, where many researchers, methodologists, statisticians, public health specialists, clinicians got together from a number of different specialty areas as well as from international organizations to come together to really develop a transparent approach to grading, the quality or certainty of evidence and and the strength of recommendations primarily focused on healthcare. The framework now is actually considered the standard for guideline development and it's been adopted by over 200 plus organizations. The larger grade working group still remains as a very informal group of individuals. They now have about over a thousand members worldwide and there are currently about 25 to 30 grade centers or grade networks internationally. And there's always ongoing work to continue to advance the methods behind guideline development.
- [05:35]
C
And Dr. Bird, can you tell us why ACE decided to adopt GRADE and what that means for our guideline program?
- [05:43]
B
Absolutely. So back in 2022, ACE adopted a new strategic plan with goals to increase awareness and use of their guidelines, publications and other educational resources by the endocrine community worldwide. As part of that, ACE adopted new policies and processes to enhance the guideline development program. So including adoption of GRADE, which helps us standardize across different organizations as Dr. Sultan mentioned, since it's been adopted so widely, this sort of helps us align better with other guideline development groups, other organizations globally. ACE also added updates to their COI policy and the process for forming task forces. And this was with a goal to enhance diversity, equity, equity and inclusion as part of that process. And so really we're looking at basically raising the game, right? Like we want to enhance the guideline program. We want to adopt best practices for guideline development so that we can be a major player in that field and in that area. And to that end, we also joined the GRADE Working Group as well as the Guidelines International Network. And this is really to provide opportunities for ACE members to participate in guideline development for all of us to learn those best practices and for, you know, understanding how to best implement and strategize on really increasing and enhancing our guideline development program. And this is really just about providing trustworthy guidance that is patient centered and facilitate shared decision making, which is foundational to ACE's main mission of improving global health.
- [07:35]
C
I think the trustworthiness piece is very important and talking about changes with respect to the conflict of interest policies is key. And of course, making something very patient centered is important too. Dr. Peng, you are our first Methodology Fellow, which is very exciting for the organization and for our guidelines moving forward. Can you tell us about your experience in helping to develop the guideline and what were some of the key steps for you in the process?
- [08:05]
D
Sure. I actually feel very privileged to be part of this project because this is the first ever and I'm so lucky to be one of the team because at my level, just a fellow, I couldn't have the chance to participate guidelines. I'm the one reading the guideline and trying to memorize all the details of the guideline. I have to say, my experience as a Methodology Fellow has been all overwhelmingly positive. The team has been incredibly supportive. Even I had to relocate to Taiwan and Prepare for my U.S. endocrinology board during the critical stage of the guideline project. I was able to make time for it and still stay on top of my task despite a demanding schedule. And that is from the teamwork, especially Dr. Bird, her effort in planning ahead and setting clear goals and project stages. Initially I was kind of intimidated because I have never used GRADE before. What I had in the past is my research experience in systematic reviews and meta analysis. And I didn't know how I can contribute. But Dr. Bird and Dr. Salton and everyone kind of guide me through every step of the way so that I can know how great work. And then contribute my expertise in systematic review and meta analysis. I have to say the key step I contribute was the systematic review process which I help fine tuning the PICO questions. PICO actually stands for patient population and I stands for intervention and C stands for comparison. O stand for outcomes. So Dr. Bird mentioned about the patient centered outcomes. We actually formulated the questions so that we can develop a patient centered outcomes questions to help develop this guideline. And because of my background in endocrinology and also a little bit background in methodology, I was able to bridge the gap between the task force and the methodology team. And also I had experience in setting up the search strategy with Librarian with my previous project. So I was able to work together with a librarian kind of craft the most appropriate doable search strategy because we don't want too many or too few search results. We eventually had 4,000 abstract to go through, which is a tremendous task for everyone. And we need two independent reviewers to go through the process. And I'm, I'm one of them. And so I think working with the librarian and the whole team, using the confidence platform simultaneously, we can work together and go through the screening process is the very critical stage of the whole guideline development.
- [11:17]
C
Dr. Sultan, what's unique to GRADE compared to the other frameworks that are out there that organizations might use?
- [11:24]
A
That's a good question. So before grade, there were so many different varying systems or frameworks out there for guideline development. And often every organization or society would develop their own framework. And what it led to was a lot of confusion among end users, the clinicians, the patients who are trying to understand how to utilize these recommendations to improve or provide the best care. And so one of the main, main goals of the GRADE working group was to really have one unifying kind of framework that could be used across societies, across organizations, across other guideline producing countries. So that there was at least some uniformity in how to apply and understand recommendations. So the basic foundation to the GRADE framework is that there's transparency and there's explicit criteria used to really understand the evidence. And so there's an emphasis on this methodologic rigor. I would say the biggest difference in GRADE is that it's not necessarily study centric or study design centric, but rather it's outcome centric. And GRADE places a high value on really understanding what are the patient important outcomes for decision making. And there's a lot of time spent on trying to understand those outcomes and identifying those outcomes, understanding what are important thresholds for each of those Outcomes to help with decision making. There's a big emphasis on the totality of evidence. So as Dr. Peng alluded to, at the basis of every FICO question is a systematic review of the evidence. And so looking at that totality of evidence is really, really important. And finally, making judgments about how confident you are of the effects that are coming from that body of evidence with explicit criteria for making judgments around criteria that might help you reduce your confidence or actually increase your confidence. And finally, taking all of that work around the evidence review and coming up with a recommendation, there's a again, very systematic approach to looking at the trade offs, the benefits and the downsides, the desirable effects and the undesirable effects, as well as patient values and preferences and other criteria that we call part of the evidence to decision framework around feasibility, acceptability, cost and resource use, as well as equity implications.
- [13:53]
C
One of the things that I think is also important with respect to guidelines is timeliness. You know, how quickly can they come out as the evidence is changing over time. And sometimes guidelines come out after a long period of time and they're kind of bloated. There's guideline bloat with just way too much, much information. Does the GRADE methodology and the format and structure and framework allow for more rapid guideline development and for more focused guideline development?
- [14:25]
A
I think you're highlighting an important limitation that often comes up with guidelines that in especially rapidly advancing fields, sometimes by the time the guideline comes out, it's already perhaps outdated. I think within grade, if you have a really well done systematic review that you can appraise the quality of and utilize or update, that actually significantly decreases the amount of time and effort that it might take to actually develop a recommendation for that specific question. But I think there's a lot more work being done around kind of these newer techniques for developing living systematic reviews or living guidelines, also incorporating AI artificial intelligence in terms of helping to decrease the steps it takes for the systematic review or the evidence synthesis. So I think these are all challenges that we're recognizing and trying to address.
- [15:16]
C
I was definitely going to ask about artificial intelligence and its use in developing guidelines. So that might be a topic for another podcast, hopefully in the future. Dr. Bird, how is evidence assessed using grade?
- [15:28]
B
So, as Dr. Sultan sort of outlined initially, so there's definite domains and these frameworks that we walk through that help us really determine our confidence in the estimate of effect. So for example, how well does an intervention work? How much does it decrease undesirable effects, mortality, the risk of stroke, the Risk of heart attack, those sorts of things and how confident are we in that difference? So for parts of that there's multiple domains. So following the systematic review that we do, and for this guideline in particular, we were very fortunate and found some published systematic reviews that were of, of high enough quality that we could basically use those directly or just update with some newer studies that had come out. So that actually did save us quite a bit of time and headache so that we didn't have to do all of them from scratch. Because for this guideline we did around seven systematic reviews. So either finding the published reviews and updating them or thoroughly going through them or, or actually doing our own and then creating our own meta analyses as well to find those, you know, point estimates for the different outcomes. So for Gray, that uses multiple domains and each time it is outcome specific. So for each outcome that was prioritized by the task force, we then looked at the evidence and if we were able to, we did a pooled estimate of effect. So again, how much it increased or decreased that outcome based on the trials and just want to highlight that they really are in patient important outcomes. So for this guideline we really prioritize things that would be important to patients. So those would be things like mortality, heart attack, risk of stroke, surgical procedures, amputation, things like that. For other guidelines, it may be quality of life, it could be lots of things. But we're really trying to avoid reliance on what we call disease oriented or intermediate outcomes. So lab values. Right. Because for most patients, they're more concerned about whether or not they'll have a heart attack over maybe what their LDL cholesterol level is like. That isn't necessarily while they correlate a lot of times that isn't something that patients are overly concerned with. They really want to know what are those downstream effects that are important to me and my quality of life. So that's what we're looking at is those individual outcomes. So we also try to avoid composite outcomes. So we're not necessarily looking at MACE or major adverse cardiovascular events. We're going to separate those out. And I think that is going to be one of the things that is going to be newer for a lot of ACE members reading these guidelines is that they're going to say the task force weighed these outcomes individually and they didn't, you know, rely on this bigger outcome that rolled up all those individual outcomes together. So we're really taking a lot of care to break that down and to really weigh the different benefits and harms for Each step. So what we're looking at is whether or not when we have those results, how confident are we that that point estimate is true? So does it actually lie? Is a true effect actually what we're seeing is it benefit, is it harm, is there no effect? And is that estimate of effect adequate to support clinical decision making? So we really want to think about things that are clinically important, not statistically important. So even though it's really difficult for all of us that, you know, relied so heavily on P values, we throw all of those out the window, right? And we're really looking at what is that clinically important threshold and did the intervention cross that? Did the effect reach that intervention or did it not? So with that, we're looking at a bunch of different domains and this is where it gets a little bit, you know, very complicated. So I'll try to keep it high level. But really we're working on two different. While we're not study design centric, we sort of do start out based on study design so that randomized controlled trials start out at high certainty and then non randomized or observational studies start out at low. So for this guideline we, we kind of prioritized RCTs because we were talking about a lot of different medications. So we sort of, you know, prioritize looking at RCTs first. And when we see those RCTs we're going to look to see do we have concerns about risk of bias? Were the studies done in a way that controlled for bias? So were they blinded appropriately? Was allocation done effectively? Blinding? Did they report all the outcomes, all those sorts of things? Was the trial stopped early? Do we feel like we have and the studies was, was done well enough to control that we didn't have bias introduced. We then are going to look at consistency across studies. So for many of the medications we had several trials, 10, 11, 12. So was there consistency across that or were the results from each all the studies, you know, really variable and all over the place? We look at directness. How close to the pico question were the elements of those trials? So did it have this population of interest? Did it have the intervention that we were interested in, the comparison and did it report the outcomes that we are interested in? And then we looked at precision. So we want to know how precise is it. And in this case we're looking at when we see those estimates of effect. Okay, so when we see those study results again, are they consistently, are they kind of all aligned? What about our confidence intervals? Are there Huge wide confidence intervals that span sort of that threshold for decision making. Do they include both benefit and harm? And if they do, then that's going to lower our confidence in the estimate effect. So, quick example, for some of the interventions we are looking at, we had a threshold of, say we want to see a decrease of five strokes per 1,000 individuals, because that's, we're concerned to serve those absolute risks. And some of the results, when we looked at it, while the summary estimate may have been 4 or 5 decrease, you know, number of strokes decrease, the confidence interval went from 10 fewer strokes up to two more strokes. So that's a lot of uncertainty there. That's not very precise. And so we want to be really careful if we're going to potentially make a recommendation for an intervention, are we actually decreasing so the desirable effect related to stroke, or would we maybe cause harm? And if we don't know or we're uncertain about that, we're going to rate down. So things that may have started out as high certainty may end up at moderate or low certainty of evidence or even very low, depending on how much information we have. So this one we're saying, you know, this is again for each outcome. So we would say, okay, here's the outcome for stroke, here's the outcome for mentality, you know, what is our certainty evidence? And we're going to look at all of those and make a decision. The final thing for RCTs is publication bias. And this is one where we're really thinking about, are we missing studies? So for those people who have been publishing for a long time, we know that studies with positive results get published faster more often than studies with negative results. It's just the way it is. So we want to know like, are we seeing skewed results? Because we're only seeing the like, small positive trials that may be industry funded and the bigger trials or the trials where there were negative results didn't get published and we're missing those. So we want to just be careful about that and think through, you know, do we feel like we have that totality of evidence or are we really missing key information? So flipping over to non randomized studies, and these are observational studies, they're going to start out at low, but that certainty can be raised if we see a few things. If we see a really large effect, we may feel more confident, okay, this intervention does something. If we see a dose response occurring, then we're like, okay, there again, maybe we have more confidence in the effects because we are actually seeing an increase with the increased dose or vice versa. And then there's the favorite domain for a lot of us because it's such one that you really have to think through and it can be a bit of a sticky wicket is what we call residual confounders. So if we're having observational studies and when we we think about observational studies or non randomized, we worry about the introduction of confounding variables. Right. Something that's going to change things or mask the true effect. And for this domain, if we still see an effect despite the presence of the potential presence of confounders making it lower or maybe masking that effect, then we're going to feel a little bit more comfortable. You know, in, in that it's true that, you know what, even with all of these confounders lowering, maybe what with the true effect is we still see an effect. So it is probably okay. And our confidence might be a little higher for this guideline. We didn't have as much in the way of looking at non ransomized studies just by the nature of the questions. So we didn't cover this domain a lot. But in the public health literature in particular, these domains are things that they spend a lot of time thinking about. And there's great guidance on it from the grade working and others on sort of how to think through all of that in a very systematic way. So to say all of this we come through, we've done all of this work, we then look across our outcomes that have been rated either critical important or not important for clinical decision making. And within those critical outcomes we say what is the lowest certainty of evidence? And that's what we take as our overall certainty for that question. And then that's what gets fed into the evidence decision framework. That then helps us start thinking about the recommendation and the direction and the strength of that recommendation.
- [25:53]
C
And that is a beautiful segue into my next question. Dr. Peng, tell us about the evidence to decision framework that's part of grade. I think that's something that's novel about the grade methodology.
- [26:07]
D
Yeah. After Dr. Bird giving the very brief overview of the very comprehensive evidence generation process, we have to discuss within the task force why we made this decision, like why we rate down or rate up. And we have a lot of discussion within our members and we kind of need to that our readers or you kind of users know why we made this decision. Right. We need to give them the rationale. In the past we don't really give much of rational why guideline gave us this recommendation and this evidence to decision framework cannot tell us based on the evidence we generated, we think we need to take something else into consideration because we should not just based on clinical data or numbers. We want to be patient focused. Right. So as Dr. Sultan already mentioned that we need to take visibility, accessibility or equity or patient preference into consideration. Like in the medication we kind of delved into is very novel and very expensive medication. But are they cost effective? Right. They may be generating very trivial small benefits, but they are super expensive. Would they be suitable for every patient? So we need to kind of give the rationale, how we gonna apply the recommendations? Because clinicians practice in different areas with different resources and not everyone can access the medication or the test. We need to send out the labs and that may not be feasible for someone in a rural area. And so the evidence to decision framework, it kind of goes through many domains. If I have to go through the domains, it may be too many, but I would just take one. For example, I said about the cost effectiveness and also I mentioned about the equity, because this is something that we always need to know. Is there any disparity that equity could be possibly be reduced?
- [28:24]
A
I'm happy to add to Dr. Peng's explanation so far. So, Dr. Peng, you did a good job in kind of summarizing the fact that it's not just the overall certainty of the evidence, or not just the evidence review that then we can directly use to make the recommendation, but that we really have to think about the overall totality of the evidence and the trade offs. So when you're talking to a patient and you're telling them to start a new medication, you really want to inform them, inform them about the potential benefits they could get, but also the potential downsides related to harms. And so having that trade off in mind is really, really important to think about when you're developing the recommendation. So there's a lot of emphasis on thinking about what are the overall benefits or desirable effects, what are the overall undesirable effects or downsides or harms. And then, and really thinking about what that trade off really is. And then you alluded very nicely to some of the other really, really important domains that we need to think about, which are around patient values and preferences. And different patients may value different outcomes variably and that might inform their decision to follow or not follow through a recommendation. So for patients that maybe place a high value on reducing strokes, they might make a different choice than those individuals that place a higher value on reducing the burden of taking a medication and the potential downsides or harms that might occur from that medication. So it's really important to think about patient values and preferences. And then lastly, you talked about feasibility. Is this intervention feasible to implement? What are the cost implications or resource implications? How acceptable is the intervention? And really importantly, you highlighted equity. I think for a long time, we've perhaps not explicitly thought about equity implications. And within the framework, it really kind of forces the panel to think about, are we going to further inequities or are we going to actually acknowledge in the context of what this recommendation is doing, how will we make sure that every, every patient has the opportunity to actually benefit in terms of the potential benefits of our recommendation? So that's an important, explicit consideration.
- [30:29]
C
I think, Dr. Sultan, you've kind of gotten it. One of my final questions was what clinicians need to know about grade when implementing guideline recommendations into their clinical practice? Which is what this is all about. And I actually am interested with your experiences, how has being involved in clinical practice guideline development changed you in your practice as a practicing physician?
- [30:56]
A
Ooh, another good question. I think at the end of the day, when we as clinicians are caring for our patients, what we really need to know is, do I recommend something to a patient? Do I not recommend something to a patient? So this is getting at kind of the direction of a recommendation statement. So are you going to make a recommendation for something or recommendation against something for a patient, then getting at the strength of that recommendation? So within gray, there's explicit language that's used to articulate the strength of the recommendation and the direction of the recommendation. So strong recommendations versus conditional or weak recommendations. And the reason that's important is because at the end of the day, when you're seeing a patient, you really have to give them some opportunity to come to a conclusion one way or the other. And for strong recommendations, perhaps there's less discussion with the patient, because what it implies is that there's clearly a trade off of really big, big benefits and maybe small downsides. And for the majority of patients, this is what you should be doing. This is really the right thing to do. So, for example, to borrow from Nike, and we use this example all the time when we're teaching is just do it. You're not going to have a long conversation with a patient about, well, these are the pros, these are the cons. What do you think should be the best way forward? I want to understand what your values and preferences are. So strong recommendations often just do it. But conditional recommendations, which is really the majority of decisions that we have to make and really how we often practice with our patients, where we're really trying to share with the patients, these are the potential benefits, these are the potential downsides. What do you think would be the best way forward? What do you think about doing this or not doing this? And that is what a conditional recommendation really encourages, that shared decision making approach, highlighting what we know are the potential benefits, what we know are the potential downsides, and then coming to kind of a decision that aligns with what the patient really wishes to do. How has that changed what I do? I think I spend a lot more time actually having a more informed, shared decision making conversation. So one of the nice things about these evidence profiles that we call them, which are like the summary of the treatment effects, let's say, across all these different outcomes at the end, using this framework, you can actually tell a patient, if you take a medication for at least five to ten years, your potential risk of having a stroke is five fewer per thousand. And the likelihood of you having a potential side effect is, you know, this many more adverse effects per thousand. So it really allows you to have a more explicit conversation with the patient to understand what are those benefits and downsides. I think in the past I used to speak more vaguely. I think if you take this medication, data suggests that perhaps you'll have less cardiovascular events and perhaps you'll have this many fewer chance of you dying over the next few years is lower. But now I actually utilize a lot of that evidence that we have to develop the recommendation directly with my encounters with my patients.
- [34:00]
C
I love that you brought up sort of shared decision making. I think that's sort of a hot word or hot phrase in medicine right now, but it's incredibly important because it's what we do every day in clinic and in the hospital. And I think you explained very nicely how your experience as part of being involved in guideline development has shaped how you approach shared decision making. And I, you know, I had a very similar experience when I was involved in a clinical practice guideline in the past. And I wanted to ask, Dr. Bird, you mentioned, you know, that there's a team that gets together and ranks outcomes and makes a lot of these decisions, determines what the pico questions are going to be that Dr. Peng mentioned, how can ACE members get involved in the clinical practice guideline process? And I should say that I was the co chair for the Impanelement Task Force for this guideline, specifically with my co chair, Dr. Shailendra Patel. So I know A little bit about what that process is like. But I wanted to make sure that you had an opportunity, opportunity to talk about that too.
- [35:04]
B
Yeah, absolutely. And this is something, you know, first and foremost read the guideline, sort of look through it, get a feel, a sense of what it looks like. I will say one of the best things as a researcher and someone who basically's job is to apprise and assess other organizations guidelines, the way the ACE is doing it now is extremely transparent, which increases the trustworthiness. You can actually look at all the judgments the task force made, that discussion and you can really understand why the recommendation is the way it is, why the, you know, it's conditional or strong. And the task force is really great in really spending a lot of time and being very thoughtful in that process. So obviously, you know, read the guideline, sort of understand the process and then when ACE is ready to do the next one or any really guidance document, the new process is we do an open call for authors. So this means anyone who is an ACE member can submit an application, fill out a conflict of interest disclosure form and apply to be on the task force. We then have an empanelement work group that reviews those applications. They're really looking for that balance of expertise, years in practice and then DE and I. So where are they practicing? What is their patient population? All those sorts of things, you know, what is their passion towards, you know, patients, preferences, values, dei, all those sorts of things. And then that work group makes some, you know, kind of forms a slate that then goes through, you know, several levels of approval before the task force is finalized. But it will, it, you know, it's. We had such success and has such a wonderful task force with just really great opinions. It was multidisciplinary. That's what we're really striving. So we had obviously our endocrinologists, but we also included a clinical pharmacist, we also included a family physician to get that primary care perspective as part of the task force, which I think is really, really important. When organizations make guidelines, they want them adopted widely. But to do that you have to have people at the table, right? You have to include them in the conversation if you want them to sort of understand and adopt the guidance. The final thing that ACE is doing as part of that, getting everyone at the table. For this guideline, we actually incorporated patient review of the recommendations. We checked with them and said, did we get the right outcomes? Are these outcomes important to you? Did we do that correctly? Do the recommendations make sense? Looking at some shared decision making tools that we sort of incorporated. Does that help you understand what these different medications do and what the potential harms are? And that was really, really exciting. And we had wonderful patient representatives from Women Heart that looked over everything very thoroughly and gave wonderful feedback on it. So that's also important too is making sure that all stakeholders, all people that might be impacted by these recommendations are really included in that process because there again, we're, it's, that's going to enhance the trustworthiness of these guidelines. So I think that's just really, really exciting. You know, from start to finish, I think ACE has been so invested, obviously by bringing in amazing experts like Dr. Sultan, bringing in medical librarian, prioritizing methodology fellows like Dr. Pang who practice in completely different settings to bring that that experience. And so I think overall it's just been a pleasure to work on this.
- [38:51]
C
Guideline and Dr. Peng has laid the foundation, I think, for the role of the Methodology Fellow. I know that there are people listening to this podcast who are fellows or junior faculty that are going to be interested in that position for, for future guidelines. Dr. Bird, what's that process look like?
- [39:16]
B
So it's the same open call and you know, individuals apply and while we love to have the younger generation, our fellows or whatever, we understand that they can be extremely busy as well. So this is actually open to any career stage. Anyone who wants to learn more about guideline development can apply to be a Methodology Fellow. And what the benefits are for that, whether it's a guideline or a consensus statement is that. And obviously I'm going to hand it to Dr. Peng in just a second to like give her viewpoint. But there's extra benefit. Like you get to have more training, more understanding, ask those questions. You get to interact with experts in the field and just gain a broader understanding of whether it's systematic reviews or narrative reviews, literature searches, all those sorts of things. That's the real benefit for participating as a methodology fellow. And Dr. Peng, please, I would love to hear your thoughts about the whole program.
- [40:13]
D
I have been highly recommending this Methodology Fellow position if there any opening to anyone that is a team, you know, ACE member, because I tell them you just become a member and then you will receive the emails, I don't know how often, like once a week. And then they will kind of call out the process for getting the Methodology fellow or like authors that Dr. Bert mentioned. So I always pay attention to those information in the email. They always in the bottom the email. I'm not sure why, but I always scroll through, scroll down to the bottom and then look at the deadline for anything and I apply to the position I'm interested in and that's how I get selected. I didn't it doesn't take too much time to prepare for the application document. You basically just need to you submit your cv, which you have a handy in your hands most of the time and then I forgot what I need to submit it to. But it probably didn't take me more than 30 minutes to do the submission process. So it's like a low hanging fruit for the fellow to get more experience if they are interested in becoming the Methodology Fellow. Excellent.
- [41:27]
C
Thank you. And I want to thank all of you. Thank you Dr. Pang, Dr. Sultan and Dr. Bird for joining me for this podcast and thank you to everybody who's listening. The work we've discussed today I think underscores the rigor and the transparency and the patient centered focus that ACE strives to bring to its guidelines. And by adopting the grade methodology, ACE is enhancing the trustworthiness of its guideline process, helping clinical endocrinologists to make informed decisions that ultimately lead to better patient care. To read the full guideline and to view our other podcast on the guideline recommendations and key updates, visit pro.ace.com ClinicalGuidance thank you. Thanks for listening to another great ACE podcast.
- [42:15]
B
Join us for another episode@aace.com podcasts and help us in our mission to elevate clinical endocrinology.
- [42:23]
C
Together we are ACE.