Researchers' experiences of patient & public involvement
Learning from experience of involving patients and the public
In ‘training for involvement’ researchers discussed their training needs and preferences. Alongside formal training, researchers discussed the importance of informal learning by experience. This included both their own learning by doing involvement (including learning from mistakes) but also what they could learn from observing or talking to their peers who had more experience. Several people described how their understanding and attitude had evolved over the years. Valerie said, ‘I feel like I’ve grown from someone who wouldn’t even know what PPI was’, to someone who now makes it ‘pretty much the first step of everything you do’. Vanessa noted that this was a continuous process: ‘we don’t have all the answers and we’re learning as we go.’ Suzanne said, ‘It just doesn’t feel real until you’ve done it.’
David describes how experience of involvement has changed his thinking from scepticism to seeing real value in it.
David describes how experience of involvement has changed his thinking from scepticism to seeing real value in it.
I'd run a trial in the past where we operated under that sort of sentiment. It got funded and it just shows you how things have changed, but we've moved a long way from that. More recently we've just put in for a new trial on anterior cruciate ligament deficiency, and the process has been considerably different. We started off by, before going anywhere near any of the clinicians, which we did do subsequently, going to patients and asking whether they thought the question that we felt was important, was important and they would share it. And right from the start it's been a sharing of whether this is correct or not. Once that’s been done then we of course to further clinicians and went to a wider field which is still part of the PPI process. But it was soliciting opinion at a much deeper level than we've ever done before. And the people who were involved in that were not there as to having – so it wasn’t lip service, it wasn’t somebody just sitting on a committee, but we really did need to mine their knowledge and their information right from the question phase, how the trial might be run and to the point of setting out the measures. And outcome measures being what we should measure which would dictate whether the treatment had been successful or not, and that’s really important. As academics and clinicians we tend to think we know what is important to patients, and that’s often not the case, so we put forward a form or an assessment or some sort of questionnaire, or even an objective clinical assessment, and they’ll probably balk at it and say, "I'm not sure what you're asking; why's that important?" So, we have to change our mind and maybe think about something different. For me, it's been helpful because I've been involved in developing some of those questionnaires, and it makes me realise that what we think we know we don’t, and the patients often tell us something entirely different.
Felix has been on a learning curve with involvement. He worries about it being done badly but recognises people learn by doing it. It has to be hard to be a true learning process.
Felix has been on a learning curve with involvement. He worries about it being done badly but recognises people learn by doing it. It has to be hard to be a true learning process.
Yeah, yeah. I mean, yeah and I think it sounds a bit smart because here I am, you know, I didn’t know anything about it three years ago and then, you know, clearly it's a result of a learning curve this where I am today. And it's probably, you know, I want to allow other people to make those. You know, when I'm being so harsh about the unethical stuff, you know, I think I'm talking about the gatekeepers that could potentially have an impact on good PPI and could steer those things in a helpful way. Yeah because you want people to make those, and almost you know, you know I've got, I had quotes from people that say, you know, “good PPI is the PPI that hurts” you know. It has to and I would probably agree to that you know. It has to be a little bit hard sometimes you know, for it to a learning process. So, you know, maybe there is something to be said for people to just go and do it and burn their fingers. But I think it has the risks that they then walk away from it and kind of come up with a compromised version which says I prefer to keep them at a distance so I'm going to delegate it into a PPI group that I can consult at my convenience or not. And then follow on their advice or not and I'll make that decision and all the power's in my hand.
Yeah so it's, you know, it's clearly a learning curve and hopefully to the, you know, to the better but, but that’s as diverse and as complex as people are diverse and complex and how they approach their lives and lifelong learning really and how much. Probably the more senior you get the less, you know, the more you have an established system and the less or the, or the easier, you know, to reduce complexity, the easier it is to stick to a routine and how you deliver. But like, you know, like I say I think it's a source of continuous freshness and validation, you know. Hopefully people would see it like that, you know, to say, "Well does that make sense, you know, what I'm doing?" and you know to, you know, their understanding that it enhances and it adds value to anything you do if you allow that to happen and that’s mm yeah. So yeah, and maybe I should you know; maybe people must do that and hopefully it'll change them for the better.
Stuart has learned you have to be prepared to manage difficult conversations when you don’t agree with people, and to accept compromise.
Stuart has learned you have to be prepared to manage difficult conversations when you don’t agree with people, and to accept compromise.
Gail learnt from some early guidance about providing glossaries and giving people a job description, but it has been a steep learning curve and there is still more to learn.
Gail learnt from some early guidance about providing glossaries and giving people a job description, but it has been a steep learning curve and there is still more to learn.
But again equally it was a very useful document for the professionals to then understand what the young person’s role was, made the professionals have to think more carefully what their role on the steering group was to be able to explain it to young people. So it was, it was a steep learning curve and I'm sure we didn’t do it all right first time round, but that’s where, where I first started thinking about this and then I hope that my practices developed from there. So now in the research project that I’m working in now we have a group of, it’s about 20 young people signed up to the group about eight to ten attend regularly our monthly meetings and they’ve been involved in the planning defining the research questions, designing the research tools. They’re in the warp and weave of the management and governance of the research project. Again I'm sure we’re, you know, not getting it all right, it’s still a very, you know, there’s a lot, a lot to think about and as researchers we’ve still got to get some stuff ironed out and get it right. But I hope my, my vision and the scope of what I'm doing in terms of involving young people has grown over the years, so that’s where I'm at now.
There was little formal training available when Chris started. He has learnt by trialling things and working out what worked well and what worked less well.
There was little formal training available when Chris started. He has learnt by trialling things and working out what worked well and what worked less well.
Which are, are just different challenges, you know, whether that be working with people with mental health issues or elderly. Each area of health services research will have its unique challenges. So ours has been really sort of learning through trialling things and things that have gone well and the things we've learnt not to do.
It’s important to be open about times when involvement does not go well and to learn from mistakes. Just doing it is the best way to learn.
It’s important to be open about times when involvement does not go well and to learn from mistakes. Just doing it is the best way to learn.
I do kind of think it’s really important to people start, when they start off with Patient Public Involvement to actually start getting and doing some Patient and Public Involvement quickly because that’s how, in a way that’s how you learn. And if I go back to giving an example of the prioritisation process so it wasn’t trial and error in the sense that we were very keen that, we were very sure that we have commitments and making sure that they would be at least some research projects that came from patients and members of the public and we were also very keen that they should have an input into judging not just the patient initiated projects, but all the research projects whether it be from academics or whatever. The first time we did it, it was all done to a very short deadline, so the papers only came out like the day before the meeting and some people didn’t pick up the e-mail or whatever so they got, they got them on the day the papers that went with the questions so there’s a team heading did some background research on the questions to, to help them make decisions but it was written in not the most user friendly language had a lot of jargon and stuff in it. never the less, I mean people did come back and I think that’s because they could see, I mean we were very open and saying we are doing this for the first time and so we said, you know, we are making mistakes and we know we are making mistakes, but you could go on forever postponing doing it and in a way we thought this is where we are and we can get on with it. And I think what was really valuable was that we were very open about that so we weren’t trying to pretend anything other than that we were trying something out and there were mistakes. but I think people felt very, why people came back was two, people felt they’d been involved right from the very beginning so it wasn’t that something had been set up and run for years and then they were brought in, they were in there from the beginning and because they were making decisions about which research projects we would take forward I think there was a real sense that people very genuinely being involved in the decision making process that mattered. And then when we came to do it a year later when everyone, well six months later you know documents came sort of at least a week in advance and I think we originally had a glossary of jargon to go with it and then we actually had a subsequent version decider, actually don’t have glossary just don’t use jargon in the first place so we did that. then there was the innovation of, of saying not everybody has to read everything why don’t people volunteer to lead on a couple a of, of each one so everybody shared the burden around in that kind of voluntary basis and maybe helped to give people the confidence to do that. Another interesting thing was that the whole of the Patient Public Involvement group would look at the, what was the shortlist of questions, they get more detailed look at and would make decisions about which ones to vote for and then they sent a couple of delegates to the group that makes that decision and they were sent originally with quite a strict mandate, these are the things we want you to vote for.
It’s important to be clear about the limits to involvement and to be realistic about what people can expect, so neither they nor researchers waste their time.
It’s important to be clear about the limits to involvement and to be realistic about what people can expect, so neither they nor researchers waste their time.
It isn’t always easy involving people in writing lay summaries; Valerie has learnt that it’s OK for the researcher to do the first draft. It helps to learn from other researchers.
It isn’t always easy involving people in writing lay summaries; Valerie has learnt that it’s OK for the researcher to do the first draft. It helps to learn from other researchers.
For me it has been, yeah. I think for an example, like a, an example would be when we've experimented with doing, with writing plain language summaries which we produce for our research projects and our papers. And we went through several iterations of trying to have meetings around that and working with different groups of parents to figure out what is the best, what is actually working, you know, and we'd be, the first meeting that we had we kind of. I think everyone was a bit shell-shocked at the end of it because unfortunately we started with quite a tricky one; we started with a systematic review [laughs] that we'd produced and it's again it goes back to your earlier question about what is PPI? And we had gone in with let's try and write this from scratch as a collaborative; have a meeting, we'll talk about it and of course you get into a room and you’ve got a systematic review in front of you and you’ve got a group of people around the table and everybody goes, "Well it's probably all important really isn’t it?" So yeah, and through, I think, a couple of other project meetings after, so from that what we did achieve was just sort of have a template about.
So we wanted a little box with key messages and people may not read any more than that, you know, we wanted to just have big bold questions – what do we do? Who did it? Who said it was OK? You know, like a very much, similar to an information sheet for a study in a way, you know. And then we took that forward to the next time we needed to do a systematic review and realised that actually sometimes it's OK for the researcher to write a first draft. Somebody's got to write the first draft and if one of the parents in that room said, "I'll write the first draft," then that would be great. And if they don’t that’s OK [laughs], it's kind of about opportunity to do it than forcing the issue really. Yeah so I think that was one where we, yeah it has been trial and error and particularly involving the systematic reviews I think are quite, and not just in the plain language aspect of it because we've... I had a group of parents who were involved in producing that in the whole kind of conduct of that systematic review and that’s not something that’s always done. And again that’s lessons learned from that one we've used again in another, another systematic review that has been done on a slightly more, possibly slightly easier topic to do about here. So yeah, I think it is and I think some topics are again more accessible than others for that as well. So it is a learning curve for us isn’t it and I think what's great about the PPI conference and INVOLVE and everything like that, is that you can all learn from everybody else's ‘learnings on the job’ so yeah.
Researchers will learn best about involvement if it’s taught early in their career, and they can observe others with more experience first before they are expected to do it.
Researchers will learn best about involvement if it’s taught early in their career, and they can observe others with more experience first before they are expected to do it.
You know so, if you have a researcher however senior, who's never involved anybody before get them to be an observer on a patient group or to just, you know be a buddy or an observer on a research project where patients are being involved and see it happening. Just simply observe and see what they think and that’s the best way; it's probably the best way for anything really is, you know you need to observe and experience something before you do it yourself. I think it's an awful lot of, it's an awfully big ask for anybody to say, "Right you've never involved a member of the public, go away and do it on your own piece of research." Better to do it in a safe environment with somebody else's research first. So I think all people who are training to do research in health, in health and social care, should be taught about public involvement and should have an opportunity to experience it…
It can only be normal practice because people want to do it and it can only become something people want to do because they see it adds value. People do things because they see it works and that’s the ultimate goal. I think you can't force it to happen, but I think if you can introduce as many people to the concept and bring them along. So everybody's got to go on that journey ultimately and I think it's about the best ways of doing that are teaching it early. So, if you want something new, something different to happen then teach it from the earliest possible time. So it goes back to, you know things we want in our population are taught in primary schools. So I'm not saying we should be teaching public involvement in primary schools but, it's about, you know and anybody who wants a career in health, health and social care, that involving the users of health and social care, whether that’s in service development or research, is just the fundamental part of their basic and post-basic training. You know we teach medical students and non-medical students about lots of things and it should include involving the people they're, you know they're treating and researching.
So that’s ultimately the way to do it is to make it part, just you normalise it you know so it's part of teaching; it's part of service delivery and it's part of research and linking together. So, there's a lot, there's probably more people involved in service, improving the service delivery, than there is in research but actually the two don’t link together very well. So, part of what is, you know part of what would make public involvement normal in health research, would be by linking it to health care so that you can see the place – both the research place has in healthcare – and also the place that service involvement, so user involvement has in healthcare and research. So it's linking those things together.
Hayley’s advice is to realise you’re not alone and to learn from colleagues about their experiences of involvement. Good case studies might help convince sceptics.
Hayley’s advice is to realise you’re not alone and to learn from colleagues about their experiences of involvement. Good case studies might help convince sceptics.
That’s great. One thing that’s just popped into my head there was, how would you convince people who are sceptical about involvement – what would you say to them?
I would give them an example. I would try and maybe talk to them about the example I talked to you about today about how our researcher developed it up and how he's changed his project. And there's other examples like I suppose I would talk about the year six pupils we work with who didn’t understand ‘peer pressure’ in the question. And I would give them examples where I would try and let them know that this has made a difference for the better and yes, these are just one or two anecdotal things from me. But these are real examples of how it has helped people yeah I think. It's always difficult I think though because if you are sceptical and you don’t have any reason to do it, if nobody within your line management is pushing you to do it and you could quite easily do the research quicker by just doing it yourself yeah – it's a difficult one.
Sabi worries that training in involvement risks being a ‘reductionist, cookbook’ approach. It’s better to create a community of practice where PPI is ‘the natural way of operating’.
Sabi worries that training in involvement risks being a ‘reductionist, cookbook’ approach. It’s better to create a community of practice where PPI is ‘the natural way of operating’.
So again digital technologies have made it possible for people not to be observed and to independently access and use resources to expand their understanding and their awareness. And as I said to you I think right at the beginning, I don’t think involvement practises rely on formalised knowledge – that is important but it's necessary but not sufficient – and that some of the awareness and the informal knowledge needs to be harnessed as well, and how you do that is really difficult. But I think, you know, I come back to my point about developing a supportive infrastructure for PPI which involves establishing ongoing continuous collaboration and partnership where, you know, you might have internships; so you might have PhD students or junior researchers work with groups that have been involved in research or are involved in research, so you're developing capacity. So training becomes less about developing particular skills and expertise – it's more becoming immersed in a community of practice which is centred around patient focused research or, you know, lay person focused research, in which case training is less about intellectual development or skills development.
It's more becoming immersed in the culture in which this is what you do and this is in the way that research is done, implementation is done. Do you see what I'm saying – it's much more, it's much more holistic than just looking at people's training needs. People need to become part of a culture, part of a community where that’s the natural way of operating, there is no other way but involve people and these are the people. And so people will have met people who they can involve so that it doesn’t become a thing, "Oh, you know, who do I contact?" – it's, you already know because you’ve already worked with them and it's natural to go back because they’ve become your friends or, you know, you’ve done some, you’ve done some activities with them previously. And I suppose that’s where you want to get to in order to develop true partnerships with local communities and patients.
There is little consensus over what good involvement looks like and a lot of reinvention going on. Suzanne would like to see more opportunities to learn from others’ experiences.
There is little consensus over what good involvement looks like and a lot of reinvention going on. Suzanne would like to see more opportunities to learn from others’ experiences.
And I think it's, so it's quite hard to get kind of consensus over things you know and whether you should be getting it or not I don’t know actually but, you know, but there's sort of, there's lots of kind of, I, it's a bit like a cottage industry type work going on so it's sort of people are, you know, kind of reinventing wheels in little silos when not actually talking with one another enough I think because you're sort of - And actually there's probably a lot of knowledge out there but it actually needs to be shared, or there needs to be forums or mechanisms by which they can share the main - I think a lot of the kind of involvement networks like, obviously like INVOLVE, and then there's the one in Wales as well, they, you know they used to do, have training, but it's something that there's not been a lot of money for, I think that’s been an issue as well. You know so it's sort of, you know and some of the work that other colleagues do here is giving advice on that to, you know, to researchers within the university who are, have got that bit in their application and they think, 'How do I do this?' So I think it's something that’s going to be quite hard to implement without funding, but also actually researcher's awareness that it’s something they want to invest their time in as well.
As well as learning from their colleagues, Vanessa and Rebecca were among those who talked about how much they had also learnt from the people they were involving.
It’s important to give user researchers careful supervision and support, but Vanessa feels she has learnt a lot about research from working with them.
It’s important to give user researchers careful supervision and support, but Vanessa feels she has learnt a lot about research from working with them.
And, you know we had, we have what we called a lived experience advisory panel and we had eighteen people in a group the other week and I just sat in this group and thought, 'These people are so talented and I learn so much from them. They are, they know, not just about lived experience but about research as well; these are really, they, it's just fantastic to have the opportunity to sit and spend two hours speaking to this group and they're helping to try and shape this project.' And it, you know I just feel a great privilege that we are, we can do this.
Copyright © 2024 University of Oxford. All rights reserved.