Systematic reviews programme advisory group meeting
Date
Wednesday 26th June 2019
Attendees
Professor Ken Stein, (Chair), Programme Director
Dr Phil Alderson, NICE representative
Professor Andrew Booth, Academic Advisor
Professor Martin Burton, Cochrane UK
Professor Rachel Churchill, CRG Representative
Dr Tara Lamont, NIHR Dissemination Centre Representative
Professor Jo Lord, Academic Advisor
Dr Karla Soares-Weiser, Cochrane Editor in Chief
Professor Olivia Wu, Complex Reviews Support Unit
Observers
Dr Gail Johnston, Health & Social Care R&D Division Northern Ireland
Dr Kay Pattison, Department of Health and Social Care
Ms Christine Holmes, Department of Health and Social Care
Secretariat
Ms Sally Bailey, NETSCC & TARs representative
Dr Sofia Araujo-Betancor, NETSCC
Mrs Sarah Harwin, NETSCC
Apologies
Mr Michael Bowdery, Welsh Assembly Government
Dr Julie Simpson, Scottish Government Health Directorates
Dr Helen Bulbeck, PPI Representative
Dr Neil Hawkins, Complex Reviews Support Unit
Welcome and introductions
KS welcomed everyone to the meeting, and all individuals introduced themselves.
1b) Minutes of 12th December 2018 meeting
The minutes of the previous meeting were agreed and accepted as an accurate record.
2a) Cochrane Review Group annual reporting summary 2018
SB presented this item. Key points highlighted and discussed by the Group include:
- Consumer engagement - One group reported difficulties in this area, due to the nature of the condition they focus on. However, other CRGs working with challenging conditions do engage with consumers. NETSCC to ask Helen Bulbeck for advice as to how the group may better engage. The Group stressed the importance of consumer involvement all throughout the process,
- Prioritisation - Cochrane Updated Classification System. This is a new platform to aid CRGs with prioritisation. Four CRGs were lined up to test the system, however due to technical issues with the platform this has been postponed until later this year, with roll out due early 2020.
- Impact and impact factor - The Group agreed there is a difference between an impact factor number and actual impact. RC noted the need for more emphasis on Knowledge Translation activities, with CRGs demonstrating how they are trying to reach all sorts of audiences, other than academics. Dissemination needs to draw attention to the reviews that have influenced practice.
- Financial reporting - Has improved since better monitoring put in place, with the overall low underspend similar to the previous year.
The Group agreed the summary of annual reports is a useful document and important for CRGs to complete. The following improvements were suggested:
- Request information from CRGs about knowledge translation
- More focus on individual CRG progress rather than in comparing Groups among themselves using the new formula only
- Need to reflect the amount of work that goes into considering rejected reviews - to avoid empty reviews, concerns about ability of author, or non-priority etc.
Following on from a discussion about the CRG business Plans, it was agreed to share the redacted version of these (i.e. no salaries) with the wider Cochrane community, like the Networks and international Cochrane centres.
3a) Quinquennial Review update
SB introduced the item and confirmed that all CRGs previously funded by NIHR were again successful in receiving funding. The CRG business plans cover the first 3 years of the 5-year contract (i.e. 2020-2025). This allows for a formal review in 2023 to consider progress and make changes to contracts if needed.
3b) Three-year review of provisional plans
- CRGs progress should be measured against their own business plan. It was also suggested to include this analysis/measure in the Annual Report
- The review will be an opportunity to consider wider government priorities. For example, a Group may have done well but resources might have to be reallocated elsewhere based on current NHS and Social Care priorities.Annual reports to be updated to request information on Social Care review activity and qualitative reporting of changes in external issues
- Relevant and sensitive to the wider context
4a) Incentive Awards 2019 call paper
4b) Cochrane Incentive Awards 2019 Terms of Reference
5a) Cochrane Reviews of NICE Priority Report on first year scheme
PA introduced the item and set out the current process. There have been three rounds with 10 reviews identified. Three have delivered, six are ongoing and one due to start in August. It was highlighted that it took a bit of time to get started but confidence is growing in the system. Timely delivery of reviews continues to be a challenge and is being closely monitored. KS reiterated that the review has to be delivered by the agreed deadline.
5b) Cochrane Reviews of NICE Priority Financial Summary of first year of scheme
It was agreed that these reviews are good value for money, however it should also be noted the financial summary does not reflect the true cost of undertaking these pieces of work and CRGs should be encouraged to quote realistic amounts. Thought needs to be given about how the mechanism is working and the real cost. NETSCC to organize a separate meeting with KSW to discuss this in more detail.
6a) Network Support Fellow (NSF) update on year 1
KSW introduced the item; all eight posts have been filled with two of the eight yet to start. Different skill specialisms have been appointed across the networks.
Key role of NSFs is UK based priority setting, filling the gap between the associate editor and review teams. Engagement is also key, not only with the CRGs within the network, but between other networks to avoid silo working.
Networks do meet together once a month with Cochrane Central. The aim is to have the same strategy even if the way the different networks deliver it is different.
6b) Network Support Fellow Finance summary update
- Networks have the same level of provision independent of coverage level, e.g. Mental Health is currently at a disadvantage due to the high number of CRGs within it
- Fellows started at different times and therefore progress should be measured relative to the start dates of each NSF
- The review should focus on networks as a group, not individuals and provide a formative review of what has been learned to inform whether to continue funding or not
7a) Update from Cochrane UK
- Cochrane courses are not only attended by prospective authors. There has been an increase in people who want to learn about Cochrane reviews without the intention of authoring one
- The joint Cochrane UK and Ireland Symposium was a success. Workshops were organised against what the audience wanted, and bringing in relevant trainers, rather than asking experts to arrange workshop subjects. The 2020 Symposium will be in Dublin. Students for Best Evidence is going to be rolled out globally via Cochrane Central
- Cochrane UK has a good relationship with the UK press and has been mentioned 7,000 times in the last year. Cochrane is represented as a highly trusted brand of reliable evidence. Funding has been secured for the next five years to support the Cochrane UK Fellow Programme from the regional Health Education England Programme
8a) NIHR Dissemination Centre (NDC) update
A number of relationships have been made with a series of organisations such as Royal College of Occupational Therapists. Regular news items in their magazine and website will be featured.
The next Themed Review, promoting physical activity, launches on 4th July.
9a) NIHR Complex Reviews Support Unit (NCRSU) update
- The NCRSU is coming to the end of the fourth year and the focus this past year has been on 10 Cochrane Programme Grants, with support and training on methodological issues
- Continuing the development of the Apps for network meta-analysis, and meta-analysis of diagnostic test accuracy, which may be included in the update of The Cochrane Handbook
- The workshops at the Cochrane Colloquium in Edinburgh and the Cochrane Symposium in Oxford were well attended. The Apps workshop has been very successful. Currently investigating webinars in late summer/early autumn
- Applied for workshop presentations at the 2019 Colloquium, but these were rejected
- 12 months left on the current contract, the NCRSU are working on ways to engage people as may not be able to support reviews for the whole timeline of the review
10a) Update on Cochrane news and initiatives
- Cochrane Library Impact Factor has again increased, 7.755
- Supporting editorial to decrease time to publication is their top priority project, aiming for a 30% reduction by 2 years
- Launching process for high profile (controversial) reviews shortly
- Editorial board to discuss content and publishing strategies beyond 2020 and support prioritisation
- Better use of empty reviews to assist funders
- Establish ‘Network Clinics’ to support Associate Editors and share resources
- Introduction of Cochrane’s own Programme Grant scheme, which will have no flexibility in delivery times
- Core competencies training for Managing Editors around complex reviews to be introduce
- Innovations funding given to networks to cover: Obesity gap analysis; public health relevance; economic evaluations; time to event outcomes; and optimal methods for measuring pain as an outcome
11) AOB and Close
Date of next meeting is Thursday 5th December 2019 10:30 – 15:00, Minerva House, 5 Montague Close, London, SE1 9BB.