Researchers' experiences of patient & public involvement
Practical advice for involvement
NIHR INVOLVE provides a series of briefings for researchers with practical advice and help, as do many local Research Design Services. INVOLVE has distilled the following key practical messages:
- involve people as early as possible
- be clear with the people you want to involve
- be accessible
- resource public involvement in research
- offer training and support
- clarify organisational responsibilities
- document and record public involvement in your research
Researchers we talked to offered a wealth of practical advice from their experience, which features in many of the topics on this site (for example ‘Finding people to involve in research’; ‘Payment, expenses and funding issues in patient and public involvement’; ‘Training needs for involvement’; ‘Learning from experience of involving patients and public’; ‘Organisational support and leadership for patient and public involvement’; ‘Measuring the impact of involvement’; and ‘Messages to researchers/colleagues about patient and public involvement’). Below we draw together a few overarching comments.
One area that researchers felt was important was being flexible about where and how to involve people, and not being bound by traditional committee structures. People who would like to get involved may not find it easy to travel or to access university buildings, perhaps because of their own health issues, or caring responsibilities, or financial difficulties. They may also find the university environment an intimidating space. Although face to face meetings might be preferable in many ways, Suzanne pointed out that some people may prefer to contribute by Skype or Facebook (for example people with cystic fibrosis, worried about exposure to infection). Alternatively meeting people at home or in existing community settings might be an option. Where possible, some researchers recommended booking and paying for travel tickets and accommodation for people in advance, or reimbursing people in cash.
Pam says it’s the researchers and institutions who are hard to reach, not the people. Practical things such as a crèche and a flexible approach to paying expenses can help.
Pam says it’s the researchers and institutions who are hard to reach, not the people. Practical things such as a crèche and a flexible approach to paying expenses can help.
We need to think of alternatives to traditional committee structures to enable more people to get involved. Suzanne suggests social media can help.
We need to think of alternatives to traditional committee structures to enable more people to get involved. Suzanne suggests social media can help.
They're just saying, "Oh God I'm going to have to sit in a room and be there for however many hours and they're going to be talking about I don’t know what," and I just think that’s hugely off-putting for some people. But I guess the point really is that you're looking at other ways of involving that don’t involve going into committees or that sort of thing so you're trying to get into a, you know, tap into, you know, harder to reach groups you know. Because, you know I would say that like men are a hard to reach group in this respect you know and it's sort of. And is that kind of, you know, taking the mountain to Mohammed a bit and actually bringing the team to them or what really; or actually getting people to contribute you know in virtual ways as well. I know there's an issue, it's like… I was just talking to someone with cystic fibrosis and they were talking about that, you know, infection's an issue. "I want to get involved but actually I don’t want to go to this, you know, meetings through, you know, two sweaty trains and goodness knows what else if I'm, you know, if I'm, if I have got a compromised immune system I'm not going to do it." But actually there's other ways they can do it, is that you know, is that Skyping or is it; you know Facebook groups or whatever. You know there's probably a thousand and one other ways of doing it.
If possible, Andy prefers to reimburse expenses in cash on the day, but it took some negotiation with the university’s finance team. ‘Thank you’ payments are a different system.
If possible, Andy prefers to reimburse expenses in cash on the day, but it took some negotiation with the university’s finance team. ‘Thank you’ payments are a different system.
Hayley’s work as a PPI coordinator includes both expert facilitation and practical issues such as health and safety and dietary requirements. Her background as a youth workers helps.
Hayley’s work as a PPI coordinator includes both expert facilitation and practical issues such as health and safety and dietary requirements. Her background as a youth workers helps.
So I think some of the skills I've kind of developed up as well as being kind of, trying to work within the parameters of those two different stakeholders because sometimes what the young people want and what the researchers want are very different. And to also understand that, with the researchers sometimes they are not in a decision making place. So some of my other work in local authorities we would work with the decision makers directly, whereas with researchers, when they're going for research funding, they're not actually making a decision on whether that research is going to be funded and whether it's a good idea and so, they're kind of also taking on the young people's views and it took me a while to kind of build-up that knowledge of research, the real world, the reality of research I think.
…Some of the other things I suppose behind the scenes is working with the young people – things such as dietary requirements and things which I think people kind of overlook. We do a lot with the young people with kind of ; we make sure we know all their dietary requirements and allergies. Any things in regards to if they're on any medications and just things. So we have someone whose first aid trained but if we have somebody – one of my young people has asthma – if they have an asthma attack we're prepared and we know about it. And also – I've just thought of something else anyway – also we, as part of the risk assessment as well we've obviously thought about child protection because we're working with fourteen to twenty one year olds.
There may be issues with child protection and because we have young people who actually come from different local authorities within Wales, each local authority has a different system. So we've got a file which in there has all of the different local authorities our young people come from. So if we have a child protection issue we've kind of printed off their web page to find the number we contact that local authority. So there's a lot of things which I suppose some people wouldn’t really think about which we’ve just have to prepare and make sure we're prepared for. We also have somebody who is a manager, who is an emergency contact. So off site all the young people fill in a consent form. They can fill it in themselves if they're over sixteen. If they're under sixteen we have to get it filled in by a parent or guardian. And we ask everybody, even if you are over sixteen, to put an emergency contact on there so if something happened here we would be able to – the process is I would phone our off-site emergency contact which would be one of the managers who then has all those details to phone families to say if there's a been a fire in the building or.
…Well because I come from youth work we do sort of introduction to youth work training and a lot of these kinds of aspects are covered in that. So I came here with the knowledge of that. I do think to myself if I'd come from maybe just a research background there's some of these things I wouldn’t have instantly thought about. And this is where I think that it's important when we're doing research, but also public involvement from sort of academia from research institution, centres, universities, it's always important to have on-board somebody who is familiar with the public or has worked with our public before. So in our case it is young people and we have myself and the youth worker – we've done that before. There may be a whole other level of guidance and there may be other issues to think about if you're working with adults who are under a protection of vulnerable adult's action and I wouldn’t know anything about that but, it's important to understand the issues for that public. And I think you can only really do in that either having worked with that public before or asking them.
Informal, face to face relationships are important, and Felix always brings cake to meetings. It is vital to build in enough time, both for researchers and the people involved.
Informal, face to face relationships are important, and Felix always brings cake to meetings. It is vital to build in enough time, both for researchers and the people involved.
Chris never had any training in involvement but his advice is to treat people as you would like to be treated - with courtesy, hospitality and a friendly welcome.
Chris never had any training in involvement but his advice is to treat people as you would like to be treated - with courtesy, hospitality and a friendly welcome.
Well there might have been, I just didn’t know about it.
Right
Or I didn’t look for it [laughs].
Right OK. And I mean thinking about, thinking back on that do you think that training would have helped you in any way?
I think if there'd have been the knowledge out there about how to do it but I'm not so sure there was to be honest. I think the best advice you can give anyone is treat people as you would like to be treated yourself – courtesy, look after them; if someone came to your house you'd offer them a cup of tea, so offer them a cup of tea and if you’ve got some funding or, you know, a bit of bread at home, make some sandwiches, you know. Our feedback forms in our first couple of years, you know, everyone mentioned the lunch. You know, that didn’t occur to us not to provide some sandwiches at midday, you know. Most of our meetings are between ten and one so we, the meeting runs from ten till twelve and then we have lunch afterwards and, you know, a lot of families really, and parents really enjoy the peer support, so it's chatting to each other.
So lunch is a key part of it for us and we provided it. But what we didn’t understand is parents go, get invited to a lot of forums particularly, you know, about how services are organised and how few people actually provide lunch. Or even, you know, anything at all. You know, so that, that’s just so important you know. Look after people and make them feel welcome, part of something and, you know, cup of tea and a sandwich and a biscuit and bit of a laugh [laughs]. It's not a complex intervention is it?
No?
Well no it probably is in some settings.
Chairing and facilitation are key to good involvement. Pam recommends a training course in chairing, and bringing in others with good facilitation skills.
Chairing and facilitation are key to good involvement. Pam recommends a training course in chairing, and bringing in others with good facilitation skills.
What I really liked there is a guide by Toucan Associates about how to Chair a PPI meeting and, and that’s quite, I mean it’s quite a bold statement I think about how to deal with that situation. So yes it can take some, some skill. And I think that’s where sometimes it can be useful to have, to not expect a biomedical researcher to have all that as part of their, their skill set and then in that case to maybe bring in a nurse or somebody with PPI responsibilities to do some of that facilitation work as well.
Practical things to consider include being clear what is expected of people, making sure they get feedback on their role, and encouraging a wider group of people to get involved.
Practical things to consider include being clear what is expected of people, making sure they get feedback on their role, and encouraging a wider group of people to get involved.
Yeah what the role is for people sometimes. I think it's been interesting kind of talking to people who have been involved in and again you may well have and you can tell me later. You may well have found this yourself but it is people don’t sometimes know what is wanted of them. So they’ve been asked to be involved and they're like, "OK that’s great," but actually, you know, do you know what you want me to contribute here, what are the boundaries of it? Is it very free, is it, you know; do you want me to, you know?" There seemed to be a dichotomy between the sort of, you know, very limited specific involvement to, "Yeah we've got you here and we're not quite sure what to do with you," type thing you know, so it's sort of.
That’s definitely a fuzzy area and that’s been mirrored with the work we've done with the pharmaceutical industry as well, it's like the role and the purpose and the aims of involvement are not entirely clear and kind of agreed and understood I think as well. There's the payment stuff obviously. And then the feedback I think is another one, you know, what do you do about feedback? Do you, you know, are, do people know what happened. Some people don’t even get a copy of the paper or, you know, I've heard so many tales about, you know, "I'd love to have got a report," or, "Loved to have seen this," and you know, I think it's, again it's sort of knowing what you’ve contributed to because, you know, it's like anything you know, anything you do in life you want to see what the consequence of it is and will you bother do it again.
And then the kind of, the difficulties of kind of ; I think a lot of the time – this might not be a fuzzy area, but it's – you know it can, there's a little. Some people would say there's a usual suspect's problem as well. So you, and actually how do you open things up a bit more to encourage and engage more people with – I think that’s a real, a real challenge, a real issue for people to kind of tackle really because it's sort of, you know, it's not really about representativeness, it's just more that actually you know, people can only, might get tired of being involved after a while and actually you need to, you know, keep the pool fresh really for that reason.
Giving positive and constructive feedback is important. Sometimes parents on the panel will moderate each other if the discussion is drifting off topic.
Giving positive and constructive feedback is important. Sometimes parents on the panel will moderate each other if the discussion is drifting off topic.
Yeah, yeah, no I think, you know, giving people constructive, you know, acknowledging when people are doing things well. And, you know, gently trying to pick out, you know, where things could be done differently and I think that’s an important part of it and equally it should be reciprocated and parents – I give them free rein to tell us when we're doing things wrong and what we could do differently, you know. One of our parents suggested, you know, “you should give out, well you should give out certificates where people have been involved in projects” because, you know, some of these parents have been out of work for periods of time and if they want to go back they want some documented evidence of what they’ve been doing. So yeah, I think, I think, I try to create a culture within our research group with the parents where it's very two-way.
And, and they seem quite willing to tell me where we could do things differently and I think that’s great.
That’s good. And if you do have to give any sort of constructive feedback, you know, maybe something that’s a wee bit tricky – how do you find doing that?
Oh it's always a very challenging thing in any sort of circumstances – you know, as a line manager or a friend – in any circumstance, I think it just needs to be done sensitively, if at all. I think there's an element of choosing when it's appropriate or not. I think in some senses our parents provide it with each other. I think, you know, occasionally someone will have an issue that they really want to sound off about and that’s OK and then the group will round them off and sort of come back on topic again. You know, occasionally I might have to sort of moderate a discussion to get it back on topic from my point of view and, but try and do it in an easy way, you know.
Rather than an overly officious way.
So yeah, I think it's just moderating those sort of occasions, are a common example of needing to just sort of steer the activity or steer the discussion to keep it on course for what we, as a group, are trying to achieve.
Gail learnt from some early guidance about providing glossaries and giving people a job description, but it has been a steep learning curve and there is still more to learn.
Gail learnt from some early guidance about providing glossaries and giving people a job description, but it has been a steep learning curve and there is still more to learn.
But again equally it was a very useful document for the professionals to then understand what the young person’s role was, made the professionals have to think more carefully what their role on the steering group was to be able to explain it to young people. So it was, it was a steep learning curve and I'm sure we didn’t do it all right first time round, but that’s where, where I first started thinking about this and then I hope that my practices developed from there. So now in the research project that I’m working in now we have a group of, it’s about 20 young people signed up to the group about eight to ten attend regularly our monthly meetings and they’ve been involved in the planning defining the research questions, designing the research tools. They’re in the warp and weave of the management and governance of the research project. Again I'm sure we’re, you know, not getting it all right, it’s still a very, you know, there’s a lot, a lot to think about and as researchers we’ve still got to get some stuff ironed out and get it right. But I hope my, my vision and the scope of what I'm doing in terms of involving young people has grown over the years, so that’s where I'm at now.
It’s important to be clear about the limits to involvement and to be realistic about what people can expect, so neither they nor researchers waste their time.
It’s important to be clear about the limits to involvement and to be realistic about what people can expect, so neither they nor researchers waste their time.
Alison wonders if a more contractual arrangement would be fairer and help ensure value for money but it could also exclude people.
Alison wonders if a more contractual arrangement would be fairer and help ensure value for money but it could also exclude people.
Yeah the other side I guess of the whole paying people for being there, you know what's, there's a question about what you expect of them. So if someone is paid to come to a meeting and sits there and doesn’t say anything, is that OK or is it not OK? Maybe they were taking it all in and they’ll talk to afterwards; maybe they didn’t find there's anything relevant to them or maybe they were just, you know, tuned out [laughs] in which case should they really get the money? I think we rarely get people sitting there and saying nothing but…
…I'm wondering if we should have more of a kind of contractual relationship with them but then you can't, you can't sort of say, "Sign this piece of paper to promise to say three useful things per meeting," I mean it doesn’t work like that does it? So I guess we just have to accept it.
Pam describes how the Research Design Service has developed pre-grant funding support, helped reduce bureaucracy in payment systems and provided advice on benefits.
Pam describes how the Research Design Service has developed pre-grant funding support, helped reduce bureaucracy in payment systems and provided advice on benefits.
And what sort of obstacles did you face with trying to implement that plan?
Well not, not many because I haven’t necessarily had direct personal responsibility for, for implementing these plans. But we’ve had a lot of support to overcome obstacles from people like administrative staff. Their roles can be quite vital. They’re behind the scenes, but if they’re the people that ensure that people get their payments on time, then they’re actually vital to demonstrating respect really. And then there have been, yeah there are some obstacles about the way in which universities might expect to set people up on a, an employment contract in order to process the money through the payroll systems so that, that can feel like an obstacle and it can be an obstacle for members of the public that don't understand or might even be frightened by some of those very bureaucratic formal procedures.
I suppose especially if there’s implications for benefits or issues around benefits too.
Yes.
Have you encountered that?
Yes, yeah. In fact because I’m a member of INVOLVE I’m actually working with them at the moment on that topic so I was on a telephone conference yesterday and revising the payments. And there again, as I say, some people have got specialist knowledge and so there are people that are updating the advice on welfare benefits and so it, it can be complex and challenging. And I think yeah that, that there are obstacles. But I think from my experience working at a sort of organisation on an institutional level means that you can put some systems in place and I suppose that’s where if you are encountering perhaps novice researchers or people that have not done it before you’ve got to do a certain amount of hand-holding to explain how, how these mechanisms work really.
People can get involved in all sorts of ways. Chris advocates a ‘light dip in and out approach’ so people can choose flexibly what to do, rather than giving them a contract.
People can get involved in all sorts of ways. Chris advocates a ‘light dip in and out approach’ so people can choose flexibly what to do, rather than giving them a contract.
And, you know, in generating research questions in co-applicants and funding and doing just systematic reviews, qualitative research, surveys. And not so much myself but other people in – well actually yeah – no in designing a clinical trial that wasn’t subsequently funded but there was a father who was, was very keen, and again travelled quite a distance to come and have a couple of meetings with us. And people have reviewed documents by email so, so I think yeah, no I think people could be involved in every part of the process if the opportunity is presented in the right way. For us, the awareness is around how much individual people might want to be involved so not everybody has the time or the inclination to want to be involved in every aspect. Some people, you know, and that might change over time so I think that flexibility is really important as well and not having a contract where if you said you were going to be involved then you have to do this, that and the other, you know, as I say, working with families with disabled children you do need that flexibility and that light dip in and out approach. But then to be ready when somebody really wants to invest more time in it and then work harder ourselves to enable that opportunity.
It’s important to keep a record at the time of what involvement activities have taken place and what happened afterwards.
It’s important to keep a record at the time of what involvement activities have taken place and what happened afterwards.
Yeah
But in terms of recording it.
Recording it yeah
Recording impact, I mean it. I suppose an awful lot of people are not very good at tracking or recording what happens when they do something. So I've been, this morning, at a meeting for a patient and public involvement advisory group for one of the NIHR biomedical research centres and they're trying to identify and understand whether they're making a difference. And the NIHR programme reference group I'm part of and now co-Chair, we've also been doing the same thing and you just simply need to record it because unless you say, "Well what did I do; what happened afterwards?" you’ve got no chance of knowing whether what you're doing is actually making any difference or not, or whether actually it's just good therapy and you're all talking together and that’s great, but actually it doesn’t do anything. And because public involvement is what's called a complex intervention, because we're all different and we all interact with people differently and we all have different perspectives and views and there's that other complication of representativeness – are you there for you or, are you there representing other people? Sometimes it's one; sometimes it's the other, sometimes it's a mixture of all of them. But, ultimately we need to try to, we need to try to measure things, you know measuring's important. It might be seen to be dull and anally retentive but, actually it's, you know if we don’t measure what we do in the same way as, you know that’s why you do research to measure things. You know, you measure outcomes in research studies, it's what you do; it's the only way you can make, you can measure if you’ve made a difference. And we have to find ways of recording what we do and seeing whether it makes a difference or not and then changing behaviours accordingly.
Hayley describes how young people and researchers assess the impact of involvement. Young people understand not every idea can be used but appreciate it if researchers are honest about this.
Hayley describes how young people and researchers assess the impact of involvement. Young people understand not every idea can be used but appreciate it if researchers are honest about this.
And then it's easier for us to track what the young people have said and what the researchers have responded to it. So we've had some instances where it's not been possible for the researchers to take on what the young people say. But I feel like the young people are happy as long as we go back and we say, "This is the feedback and these are the reasons why we can't take up this idea of yours." And I think it's kind of sometimes researchers feel, "Oh I can't do it so I should just like not tell them that I can't do it." But actually I think the young people respect the researchers more when they do come back and say, "We can't do it and these are the reasons."
Patient and public involvement – Factors which make it easier to get involved
Patient and public involvement – Difficulties and barriers to involvement.
Copyright © 2024 University of Oxford. All rights reserved.