drerikbrady       Erik here, Raleigh, NC, outcomes measurement, data and analytics are my focus, always here to learn, #CMEchat

BrianSMcGowan            Hope all is well...hopefully I can throttle my tweetstream for the next 45 minutes #CMEchat!

BrianSMcGowan            @drerikbrady - great to see you...virtually #CMEchat

greyelmy           Heather Guerrero, Foster City, CA. #CMEchat

MedPedsDoctor            Alex Djuricich, from Indianapolis, where the football enthusiasts go and unfortunately measles follows, excited about this  #CMEchat

BrianSMcGowan            @greyelmy - snazzy new avatar. good morning heather! #CMEchat

rmtyner Michelle from Indiana - in the midst of finals week and so close to 200 followers -> looking forward to discussing assessment #CMEchat

BrianSMcGowan            @MedPedsDoctor - how long before you leave us this week? ;-) @meducate part II  #CMEchat

dpguinee          Daniel here, Freehold NJ, on the iPad, with keyboard #cmechat

drerikbrady       @BrianSMcGowan - missed you last week, good discussion on mentoring as i'm sure you saw #CMEchat

BrianSMcGowan            we need Wo-mentors! RT @drerikbrady: @BrianSMcGowan - missed you last week, good discussion on mentoring as i'm sure you saw #CMEchat

MedPedsDoctor            I will try to stay the entire time today.  Excited to hear CME thoughts on assessment. #CMEchat

laurenero           Lauren here from Maryland #CMEchat

dpguinee          @BrianSMcGowan not monitoring #HIMSS12 as well? #cmechat

CMEChat          T1 – what are you most important steps in your needs assessment (NA) and content planning process? #CMEchat

improvecme      Derek Dietze here, Arizona. Always looking to optimize the value of outcomes measurement in CME #CMEchat

BrianSMcGowan            you betcha...they are breaking twitter! RT @dpguinee: @BrianSMcGowan not monitoring #HIMSS12 as well? #cmechat

jjuch     "John from NJ here. Will be in and out today

 #cmechat"

BrianSMcGowan            t1 - tough to express in 140 characters, perhaps...but please take a shot at sharing your biggees with needs assessments #CMEchat

drerikbrady       @improveCME - Cool, Derek's here too!  I owe you a phone call. #CMEchat

reginamotarjeme            Regina from Denver, will try to stay the entire hour #cmechat

BrianSMcGowan            t1 - as you may know...i am obsessed with data...so i want to aggregate the data i have to support educational needs. #CMEchat 1st thing 1st

drerikbrady       T1 - we've become particularly solid at pulling on our outcomes data from subsequent programs as a first step in needs assessment #CMEchat

laurenero           biggest in needs assessment is getting physician planners to start with the practice gaps. #CMEchat

jjuch     T1: make lit review the first step of the process to get lay of land. step 2: look to other sources for establishing gaps and needs #cmechat

greyelmy           "T1 diversity of sources for assessing needs

 #CMEchat"

BrianSMcGowan            @jjuch - but whose land are your surveying with lit review...i struggle with this concept alot...seems the wrong place to start IMO #cmechat

MedPedsDoctor            Agree with @laurenero but some docs have a hard time understanding what a "practice gap" is.  Teach 'em! #CMEchat

rmtyner t1 knowing what best practices and guidelines are is a good step and what are the barriers to implementing #CMEchat

drerikbrady       T1 - a needs assessment that ignores prior outcomes is missing the boat #CMEchat #datageeksunite

theCMEguy       Derek from Philly here. Finally off the phone. #cmechat

MedPedsDoctor            .@jjuch Agree with literature review as important, but sometimes local needs are different from national needs noted in literature #CMEchat

BrianSMcGowan            t1 - 'gaps' are the best place to begin...but then what? how do we get to the gaps that education can solve = educational needs? #CMEchat

theCMEguy       @MedPedsDoctor @laurenero Agree! This was a huge part of my job, explaining what is a gap and what is an ed gap #cmechat

drerikbrady       T1 - i love a needs assessment survey of the learners, crafted in collaboration with a topical expert #CMEchat

PSB_CME        T1: Getting planners away from the "but we wanna" mechanism of thinking #CMEChat

rmtyner @MedPedsDoctor i have heard that somewhere else too... @BrianSMcGowan #CMEchat

dpguinee          T1 We like to identify from HCPs what they feel they need education on then go 'bigger picture' with lit rev, gov't sources, etc #CMEchat

jjuch     "@MedPedsDoctor  ""sometimes local needs are different from national needs noted in literature"" That's why I see lit as only begin

 #cmechat"

reginamotarjeme            outcomes from prior programs is a great starting point, plus faculty input #cmechat

BrianSMcGowan            T1 - My Gaps Mantra: "Show me the difference b/w what is and what should be" #CMEchat

BrianSMcGowan            #CMEpouting RT @PSB_CME: T1: Getting planners away from the "but we wanna" mechanism of thinking #CMEChat

MedPedsDoctor            Sometimes the gaps are not in educating about the newest "thing" out there, but in implementation of standard of care/guidlelines #CMEchat

rmtyner t1 i like topical experts but i think when look at practice and practice change you need to talk to physicians seeing the patients #CMEchat

theCMEguy       T1: I remember the days when we would throw out a list of 5 references and call it a needs assessment. Change is good. #olddays #cmechat

PSB_CME        T1: Realistically- I like to dig deeper on past evaluations through the comments about what is really "needed" #CMEchat

BrianSMcGowan            t1: to write a needs assessment you must take on the role of an investigative journalist...#CMEchat...and ask the tough question!

drerikbrady       @reginamotarjeme Agree, start with what you know and share it with your planned faculty T1 #CMEchat

MedPedsDoctor            OK, maybe A-HA moment is being able to explain a GAP in a few sentences.  FYI: docs don't like the phrase "gap analysis", IMHO #CMEchat

CMEChat          T2 – when working with faculty, how do you get buy-in that their opinion is not enough to drive educational planning? #CMEchat

rmtyner t1 just wrote a paper on Criterion 19 and understanding the theories behind behavior change - not always about the science #CMEchat

dpguinee          T1 - Also, work w hosps/hlth system to ID needs, eg: impr numbers connected w QI initiative - local gap in need of local sol'n #CMEchat

improvecme      T1 Constantly monitoring needs through review of online newsbriefs in particular disease can spark areas for further investigation #CMEchat

theCMEguy       T1: Can you use "expert opinion" as your sole source for a gap? IMO, no. #cmechat

BrianSMcGowan            T2? RT @theCMEguy: T1: Can you use "expert opinion" as your sole source for a gap? IMO, no. #cmechat

jjuch     "T2: a real challenge

 #cmechat"

PSB_CME        T1: I also refrain from asking the learners what they think their gap is.. because they don't really know.#CMEchat

PSB_CME        @theCMEguy I abhor "expert opinions."  Even my own #CMEchat

greyelmy           T2 gently #CMEchat

MedPedsDoctor            T1: @theCMEguy If "expert opinion" also understands what the implementation data are, might work better. #itsnotjustthecontent #CMEchat

PSB_CME        T2: With a stick #justkidding #CMEchat

BrianSMcGowan            T1 - @pSb_CME touches on the difference b/w actual needs and perceived needs...this may be the cure for most needs assessments! #CMEchat

theCMEguy       @PSB_CME Interesting...so you see no role of the opinions of your target audience in the NA process? #cmechat

dpguinee          Not always true RT @PSB_CME: T1: I also refrain from asking the learners.. because they don't really know.#CMEchat

jjuch     @PSB_CME T1: "learners don't really know" challenge is that if they don't know it's a gap, then why participate in edu on it? #cmechat

PSB_CME        T2: Usually through education- the experts often don't remember what it's like to be new- also that CME is circular #CMEchat

BrianSMcGowan            T2 - at the end of the planning process, absent of further data, 'experts' may discuss whether they agree...if not, find others? #CMEchat

MedPedsDoctor            Man, you all have really thought a lot about actual vs perceived needs.  This is a good thing! #CMEchat

drerikbrady       T2 - point to areas where education is needed and ask for their validation, get them to help refine the needs assessment = buy in #CMEchat

PSB_CME        @theCMEguy I think that the "experts" can't get to the root of what the learners need...just what they THINK the learners need.  #CMEchat

BrianSMcGowan            T2 - i treat faculty like grown-ups. they provide opinion i provide data. they like data. their opinions change...sometimes ;-) #CMEchat

MedPedsDoctor            @PSB_CME Not understanding your points.  Neither the "experts" nor the "learners"  know what they need.  Does anyone? #CMEchat

drerikbrady       T2 - i've had no trouble with faculty when i have a survey of learners to lean on #CMEchat #docsaredatageekstoo

reginamotarjeme            you lost me...T2? #cmechat

CMEChat          T3 – what techniques do you use to validate your NA prior to launching your plans or programs? #CMEchat #pre-formative?

theCMEguy       @BrianSMcGowan Yeah, I think this is the right approach. Opinions have value, but you need to go beyond it #cmechat

PSB_CME        @dpguinee @jjuch In terms of asking about their "gaps"- I think there is better phrasing than "what's your gap"? #CMEchat

rmtyner t2 i think with topical experts we have to realize that they are experts in their area and we are the experts in CME need to meld #CMEchat

BrianSMcGowan            i found you! but what is the question! RT @reginamotarjeme: you lost me...T2? #cmechat

drerikbrady       @BrianSMcGowan Bingo. Bring your data to the table with you. T2 #CMEchat

BrianSMcGowan            #notPG MT @PSB_CME: @dpguinee @jjuch In terms of asking about their "gaps"- there is better phrasing than "what's your gap"? #CMEchat

laurenero           What is the problem we want to fix?  What are the practice-based issues that you want to address?   #CMEchat

BrianSMcGowan            @rmtyner - but i abhor the term expert...suggests we have nothing left to learn... #CMEchat

theCMEguy       “@drerikbrady: @BrianSMcGowan Bingo. Bring your data to the table with you. T2 #CMEchat” >> BYOD

MedPedsDoctor            #TOTD, from @drerikbrady "Bring your data to the table with you"  Love it! #CMEchat

dpguinee          @reginamotarjeme Time zone difference?  No, i missed T2 also.  #CMEchat

MedPedsDoctor            @PSB_CME I totally agree.  The word "gap" has an "icky" feel to docs.  Put it in different language! #CMEchat

BrianSMcGowan            t3 - the validation to be is to reach out to audience members...assuming that they are predefined. #CMEchat

drerikbrady       T3 - formative surveys can be very powerful, after a program is sold, work with faculty to survey about specifics issues #CMEchat

theCMEguy       @PSB_CME @MedPedsDoctor Use data/lit review for gaps; opinions are better used for determining ed need. Is that fair? #cmechat

rmtyner @BrianSMcGowan i know that I am "supposed" to be an expert in my field - doesn't mean i don't have anything left to learn...  #CMEchat

MedPedsDoctor            Interesting.  When someone speaks at own institution, they are "too narrowly focused".  When speak elsewhere, "expert".  Why? #CMEchat

BrianSMcGowan            T3 - why do we put so much time and energy and $$ into programs and so little effort into truly validating needs - #insane #CMEchat

PSB_CME        T3: Prefer to refrain from a "traditional" NA- I like to clearly identify the gap, clearly identify the needs underlying the gap #CMEchat

drerikbrady       @BrianSMcGowan T3-this is where cultivating and maintaining a learner group is so valuable #CMEchat

BrianSMcGowan            t3 - so when you have totally wrapped up the needs assessment & you're about to launch content development, is there one last step? #CMEchat

PSB_CME        @theCMEguy @MedPedsDoctor Not necessarily.  Data/lit review might not be gaps of own learners.  Whose opinion for ed need? #CMEchat

MedPedsDoctor            How about an example to drive home the points being made about gaps, needs, etc.?  #docswouldunderstandbetter #CMEchat

BrianSMcGowan            #TOTD RT @drerikbrady: @BrianSMcGowan T3-this is where cultivating and maintaining a learner group is so valuable #CMEchat

improvecme      T3: Validate gaps through surveys of target audience. #CMEchat

theCMEguy       T3: A quick 1-2 question survey attached to registration is one way to validate (for live programs anyway..) #cmechat

dpguinee          Sold?  Perhaps, initiated? RT @drerikbrady: T3 - formative surveys can be very powerful, after a program is sold, work w faculty... #CMEchat

reginamotarjeme            Identify gaps, create survey to fine tune further content #cmechat

BrianSMcGowan            @MedPedsDoctor - perhaps an interpretive dance or po-up book? #docswouldunderstandbetter #CMEchat

PSB_CME        @MedPedsDoctor I can give you an example using firefighters.  Or baseball. #CMEchat

improvecme      T3: Try to identify & validate gaps by Moore levels—knowledge, competence, performance, pt outcomes. #CMEchat

drerikbrady       @BrianSMcGowan Yep, make sure that outcomes ?'s are aligned with the learning objectives, IMO, that's done before content is built #CMEchat

BrianSMcGowan            @MedPedsDoctor #docslikegolf, right? #docswouldunderstandbetter #CMEchat

MedPedsDoctor            As someone who crosses both CME world & "doc-in-trench" world, my doc colleagues will give up if talk about "gaps" more than 1 min #CMEchat

CMEChat          T4 – formative assessment (FA) is invaluable to the learner AND the educational planner. How does FA effect your programs? #CMEchat

MedPedsDoctor            #hastygeneralizationthere #notalldocsgolfonWednesdays #CMEchat

PSB_CME        T3: Big fan of pre-evals of the learners signed up (live progs)- to move faculty towards true gaps/needs and away from canned talks #CMEchat

BrianSMcGowan            or Bloom's? RT @improvecme: T3: Try to identify & validate gaps by Moore levels—knowledge, competence, performance, pt outcomes. #CMEchat

drerikbrady       T4 - i see formative as 'fine-tuning', really drilling down to the specifics needs of the specific target learner group #CMEchat

jjuch     @PSB_CME Me2" T3: Big fan of pre-evals of the learners - to move faculty towards true gaps/needs and away from canned talks"  #cmechat

BrianSMcGowan            @MedPedsDoctor #they.DO.CMEchat.instead? #hastygeneralizationthere #notalldocsgolfonWednesdays #CMEchat

theCMEguy       @MedPedsDoctor CME terminology wld be a great future #CMEchat topic. Got ripped earlier this week for using "competence" in ref to MD's

PSB_CME        T4: Guess I jumped the gun a little bit.  See pre-evaluation tweet #CMEchat

drerikbrady       @BrianSMcGowan @improvecme Or Prochaska's. #CMEchat

reginamotarjeme            Online assessment surveys of participants, utilize results to develop subsequent activities #cmechat

dpguinee          Learning from you today! Lot of "CME speak" RT @MedPedsDoctor my doc colleagues will give up if talk about "gaps" more than 1 min #CMEchat

BrianSMcGowan            T4 - the beauty of one-off education is that you don't have to worry about formative assessment #CMEchat #SetItAndForgetIt ;-)

MedPedsDoctor            LOL, Brian!  Wednesday is my "education" day. #CMEchat

BrianSMcGowan            @theCMEguy - but you were right and she was wrong...dont sweat it... #CMEchat

reginamotarjeme            yup - RT @drerikbrady: T4 - i see formative as 'fine-tuning',drilling down to the specifics needs of the target learner group #CMEchat

MedPedsDoctor            Is this "name the writer of said model"-chat?  You all starting to sound like physicians!!  LOL #CMEchat

drerikbrady       @MedPedsDoctor An entire day devoted to education?? Color me jealous #CMEchat

PSB_CME        @theCMEguy @MedPedsDoctor YES!  Drives me nuts when evals ask "did this activity improve your competence in X" #CMEchat

BrianSMcGowan            @MedPedsDoctor - that is so Maslow's basement of you... #CMEchat

BrianSMcGowan            T4 - if programs are engaging than formative assessment is easier, but how do WE use it in real-time to course correct? #CMEchat

improvecme      T4: Formative assessment is often defined differently by different people. What's your definition? #CMEchat

drerikbrady       @PSB_CME @theCMEguy @MedPedsDoctor That's the worst. Use your outcomes questions to determine this #CMEchat #comeonpeople

MedPedsDoctor            Keep it simple point of the day: "formative assessment = feedback" #CMEchat

drerikbrady       @MedPedsDoctor I'll drop names with the best of them.  #CMEchat #PhDstookthatclasstoo

BrianSMcGowan            @improvecme - assessment done throughout the course of learning. for learners = feedback. for educators = course correct #CMEchat Agree?

theCMEguy       RT @drerikbrady: @MedPedsDoctor I'll drop names with the best of them.  #CMEchat #PhDstookthatclasstoo

BrianSMcGowan            but what do WE do w/ the feedback? RT @MedPedsDoctor: Keep it simple point of the day: "formative assessment = feedback" #CMEchat

CMEChat          T5 – the summative assessment of one prgm may serve as the NA for the next program, how do you ensure this linkage? #CMEchat

improvecme      T4:With several live mtg w/same content, formative assessment can include using outcomes results from 1st few to improve remaining #CMEchat

MedPedsDoctor            Feedback is iterative.  Use it to improve.  Just like a curriculum, which is not static, but active. CME folks do it too. #CMEchat

drerikbrady       T5 - Data mining.  You cannot afford to just "file" your data.  #CMEchat

MedPedsDoctor            I don't judge anyone by letters after their name.  Just like interactions w patients.  We are all human beings 1st #CMEchat

BrianSMcGowan            t5 - the challenge with the CME circle and summataive assessment is that so much of CME has non-defined learners. #NotQuiteRandom #CMEchat

BrianSMcGowan            @MedPedsDoctor - i would not go that far... #CMEchat

BrianSMcGowan            RT @dpguinee: Off to the dentist - hope he's kept up with formative assmnts & doesn't have any practice gaps #CMEchat #strahan #madonna

improvecme      @BrianSMcGowan Agree. Often learners left out of getting feedback. #CMEchat

PSB_CME        T5: Make sure what you're asking is relevant, try and get your planners to use that data.  CME is dynamic, not static #CMEchat

improvecme      T5: Put in place a formal process for summative results review and identification of unmet/ongoing needs. #CMEchat

drerikbrady       @BrianSMcGowan T5 - but that's a mistake really, even MECCs have the ability to create a membership of their learners #CMEchat

PSB_CME        T5: Circle of CME Life #CMEchat

BrianSMcGowan            T5 - bigger challenge is w/ qualitative feedback...seems to simple to pick and choose the stuff that is sexiest or most vocal...#CMEchat

improvecme      T5: As a policy insist that whenever possible, NA sections of grant requests include summative results from previous activities. #CMEchat

MedPedsDoctor            @PSB_CME Circle of CME Life.  Problem is: who is Mufasa today? #CMEchat

theCMEguy       @drerikbrady @BrianSMcGowan But much more difficult if your strategy is a series of 1 off programs. #cmechat

BrianSMcGowan            @CMEMufasa ?? RT @MedPedsDoctor: @PSB_CME Circle of CME Life.  Problem is: who is Mufasa today? #CMEchat

BrianSMcGowan            T5 - seems like difference answers for closed networks of learners vs the general build it and they will come CME & Satellites #CMEchat

drerikbrady       T5 - set up an excel with top level data from individual programs to point you back to more specific ongoing needs data #CMEchat

MedPedsDoctor            Brian: the Lion King.  Mufasa was the king lion ... who died. #canyoutellIhavea4yearold #CMEchat

BrianSMcGowan            T5 - pls do not include 4 cherry picked quotes from past evals as evidence of validation. #insulting to grant reviewers #CMEchat #context

improvecme      T5: Centralize your NA and outcomes measurement results by disease so they can easily be reviewed/searched. #CMEchat

BrianSMcGowan            @MedPedsDoctor - you overlook my musical theatre training... #canyoutellIhavea4yearold #CMEchat

BrianSMcGowan            #bigdata RT @improvecme: T5: Centralize your NA & outcomes measurement results by disease so they can easily be reviewed/searched. #CMEchat

CMEChat          Thx for participating in #CMEchat. Discussions herein are assumed 2 b personal opinion & not that of current, past, or future employers.

MedPedsDoctor            T5. But if quote captures essence of what is valid, why not include quotes? #CMEchat

CMEChat          As we get wrap up, please vote for the tweet of the day (#TOTD) seen during this week's #CMEchat.

CMEChat          The real impact of the #CMEchat lies in your action - please engage others to participate & take action on things your have learned! G’day!

ShawnaTiffney1 Brian: the Lion King.  Mufasa was the king lion ... who died. #canyoutellIhavea4yearold #CMEchat