Article Text

Download PDFPDF

An evaluation of research capacity building from the Cancer Experiences Collaborative
  1. Sheila Payne1,
  2. Jane Seymour2,
  3. Gunn Grande3,
  4. Katherine Froggatt1,
  5. Alex Molassiotis3,
  6. Mari Lloyd-Williams4,
  7. Claire Foster5,
  8. Julia Addington-Hall6,
  9. Elizabeth Rolls1 and
  10. Chris Todd3
  1. 1Faculty of Health and Medicine, Lancaster University, Lancaster, Lancashire, UK
  2. 2School of Nursing, Sue Ryder Care, University of Nottingham, Nottingham, UK
  3. 3School of Nursing, Midwifery and Social Work, University of Manchester, Manchester, UK
  4. 4Division of Primary Care, University of Liverpool, Liverpool, Merseyside, UK
  5. 5Faculty of Health Sciences, University of Southampton, Southampton, UK
  6. 6School of Nursing and Midwifery, University of Southampton, Southampton, UK
  1. Correspondence to Sheila Payne, Faculty of Health and Medicine, Lancaster University, Lancaster, Lancashire, UK; s.a.payne{at}lancaster.ac.uk

Statistics from Altmetric.com

Introduction

The National Cancer Research Institute's (NCRI) strategic review identified the need to build research capacity in UK supportive and palliative care research.1 Only 4.3% of direct spending on cancer research by NCRI partners (about £11 million per year) was being directed at supportive and palliative care, and weaknesses in the field included:

  • The predominance of small-scale and often poor quality studies with less attention to research into meeting patient's needs

  • Lack of a critical mass of experienced research groups and researchers, with international-level performance and little integration with the wider research community and other disciplines

  • Lack of user involvement

  • Lack of strong leadership, and

  • Competition for limited resources.1

To redress these, NCRI recommended the establishment of interdisciplinary, supportive and palliative care, research collaboratives which were to include academic organisations, researchers and individuals, and groups from different research disciplines and clinical professions, whose purpose would be to enhance the value, quality and productivity of UK cancer-related supportive and palliative care research.2

We have described the financial and personal challenges of building collaborative research more fully elsewhere.3 This paper uses an evaluative framework4 to describe Cancer Experiences Collaborative's (CECo) activities, and assess the extent to which CECo has built research capacity in supportive and palliative care. It considers the legacy of CECo in the context of the wider discussions about value of collaborative research, and offers a critical appraisal of this type of funding model.

The Cancer Experiences Collaborative

CECo was one of two UK interdisciplinary research groups that was awarded NCRI collaborative funding (2006–2011) of £1.9 million. It comprised a partnership between researchers at five UK universities (Lancaster, Liverpool, Manchester, Nottingham and Southampton), clinical organisations (including the four largest hospices in England, and cancer centres); Help the Hospices (a leading charity supporting UK hospice care), and user representatives, with a total of 26 organisations represented among grant-holders and named collaborators.

While funding is normally provided for scientific research programmes, the aim of NCRI's investment in CECo was to develop a collaborative infrastructure that supported research capacity building through which individuals and teams could gain additional project-specific funding to take forward supportive and palliative care research. CECo identified four areas for development:

  • Increase research grant income

  • Increase the quality and quantity of publications

  • Build research skills and grantsmanship in individuals and teams, and

  • Improve user involvement.

Three research themes were identified through which to focus activity: ‘Innovative approaches to complex symptoms’; ‘Older People towards the end of life: priorities, processes and places’ and ‘Innovations in Methodology’. Details of these can be found on the CECo website (http://www.ceco.org.uk). Between May 2006 and September 2011, CECo members generated £18 762 705 in new research income. Of this total, £4 378 951 arose directly from CECo activities and involved cross-institutional work, and was related to one of CECo's priority areas, while a further £14 383 754 benefitted indirectly from links to CECo, by being outwith CECo's main areas of work or involved only one organisation. The latter category ‘benefitting from CECo activities’ accounted for the majority of research income generated and demonstrates the added value of the intrastructure support, networking, methodological expertise and senior research mentorship that accrued from this collaborative. The distribution of this additional external income over 5 years is shown in figure 1.

Figure 1

CECo's additional external income by year (May 2006–September 2011).

The Evaluative Framework

The definition of research capacity building (RCB), adopted by the UK Department of Health is ‘a process of individual and institutional development which leads to higher levels of skills and greater ability to perform useful research’ (p. 1321).5 In attempting to describe the outcomes and benefits of RCB, Cooke argues that it is both a means to an end (useful research that informs practice and informs health gain), and an end in itself (by developing structures and skills enabling research to take place).4 As a result, any framework for measuring RCB should be inclusive of process (the steps and mechanisms) and outcome measures (the goals). To meet the challenges of measuring progress and identifying appropriate outcomes, Cooke has provided a framework that identifies four structural levels at which RCB initiatives provide support and can therefore be assessed: individual, team, organisation and supra-organisational/network.4 Across these, there are six principles of RCB, and we will draw on these to consider the efforts of the CECo Collaborative. These principles are:

  • Building skills and confidence through training, and creating opportunities to apply skills

  • Supporting research ‘close to practice’ in order for it to be useful

  • Establishing linkages, partnerships and collaborations to enhance RCB

  • Ensuring appropriate dissemination to maximise impact

  • Building elements of sustainability and continuity, and

  • Investing in appropriate infrastructure to enhance RCB.4

Within each principle, Cooke's framework provides examples of activities and suggestions for measurement criteria that could be included.4 These principles and examples of measurement criteria are outlined in table 1.

Table 1

Principles of research capacity building and examples of measurement criteria

CECo's activities, outlined in the Annual and Final Reports and other CECo records, will be assessed using these suggested criteria.

CECo's Building Research Capacity Activities

Developing appropriate skills and confidence through training, and creating opportunities to apply skills

One of the central aims of Cancer Experiences Collaborative (CECo) was to build research capacity in supportive and palliative care research in a new generation of researchers, by providing opportunities for them to develop their expertise and skills and deeper understanding of applied research under the leadership of experienced researchers. CECo made a decision to focus on developing clinicians and researchers at the early stages of their career, and within each of CECo's Research Themes, researchers and partners, drawn from more than 20 different academic and clinical backgrounds as well as service users, have been actively engaged in research.

CECo activities also involved specific research training at introductory, doctoral and postdoctoral levels, through master classes, Economic and Social Research Council (ESRC)seminar series, PhD and postdoctoral methodology workshops, the mentorship of novice researchers (particularly in hospices) through doctoral studies, postdoctoral fellowships, and the identification of ‘rising stars’ among senior lecturers and readers. The suitability of research methods used in supportive and palliative care research, and evidence that contributed to improving the research process and outcome were also explored, including issues relating to quantitative or qualitative research methodologies,6 ,7 participant understanding of research design or terminology; the involvement of service users in research; and the use of innovative research methods or approaches.

Fifteen clinicians were awarded time-limited scholarships; this bought out their time from clinical work to enable them to undertake a small project under the mentorship of CECo senior researchers. An investment of £150 000 has resulted, to date, in 16 peer-reviewed publications and five further grants awarded to the scholars to the value of £50 000. These scholars have also made presentations at major conferences, including those organised by National Cancer Research Institute, European Association of Palliative Care, Multinational Association of Supportive Care in Cancer, European Cancer Organisation, Palliative Care Research Society, British Psychosocial Oncology Society, Help the Hospices and the International Advance Care Planning Association.

I was lucky to have been awarded the CECo scholarship, which enabled me to work on a research project that I initially developed during my academic foundation doctor training. The CECo scholarship has also helped me to gain generic skills in undertaking research work, and I hope that I can continue to build on them through submitting a PhD proposal in the near future. I believe scholarships, such as CECo's are invaluable in developing research capacity and encouraging junior researchers to progress in academia. CECo Scholar.

The development of expertise and confidence has had a major impact on the research careers of CECo's scientific staff, with at least five new Chairs, and career progression to lecturer and senior lecturer roles for more than 10 people. In addition, it has influenced practice by engaging clinicians in research and, conversely, embedding researchers more within clinical practice.

Supporting research ‘close to practice’ in order for it to be useful

CECo was concerned to generate research that moved beyond describing patient need towards developing and testing effective solutions using appropriate study designs. The Innovative Approaches to Complex Symptoms Research Theme secured funds to undertake research with a strong policy and theoretical emphasis in the areas of: non-pharmacological interventions; assessment methods for complex symptoms; self-management of cancer-related problems; and research into non-cancer symptom management.8,,10 The Older People towards the end of life: priorities, processes and places research theme developed a programme of work relating to the improved care and support, towards the end of life, of older people and their informal family carers, taking into account socio-demographic and ethnic diversity, and introducing methodological innovation, especially in user involvement. It sought to provide new evidence to address issues and, working with policy makers and practitioners, to disseminate findings and their implications for best practice and policy.11,,13 The Methodology Research Theme investigated methodological and practical challenges in conducting research in supportive and palliative care, including recruitment, outcome assessment and study adherence. It initially focused on improving understandings about narrative methodology, and investigating the application of narrative methods in supportive and palliative care.14,,16 More recently, the focus expanded to study the suitability of a variety of methods used in supportive, palliative and end-of-life care research, and to provide evidence that contributes to improving the research process and outcome.

CECo has also had an impact on the wider scientific community through its development of end-of-life care research methodologies, links to wider methodological debates and innovations and facilitation of a considerable volume of research of international significance. At present, however, it is too early to assess the extent to which CECo has contributed to improving the illness experience for patients and their families. This is partly because there is a time lag between research and its integration into practice, but also because it is more difficult to demonstrate changes to clinical practice as a result of research. Nevertheless, some influences are being detected, for example, on policy17 and in clinical guidelines for supportive care in multiple myeloma,18 and National Cancer Survivorship Initiative participating in the NCRI rapid review to determine research priorities for cancer survivorship.19 ,20

Despite the challenges it entailed,3 service users—including patients, carers, health and social care professionals, support workers, voluntary organisations and advocacy groups—were integral to the research process through their involvement in all stages. This included participating in CECo management, advising on CECo scholarship awards, and reviewing and advising on all aspects of CECo research by: ensuring that research proposals addressed questions of importance to those most affected by cancer; helping to refine research questions; developing new measures grounded in firsthand experience; and improving the quality of information for research participants. Their contribution was enhanced through a series of supportive activities that enabled them to learn about research, committee and academic procedures. Training to support user contributions included preparing user-led research proposals, and a number of users have had abstracts accepted at NCRI and other conferences, and submitted research proposals in their own right.

Developing linkages, partnerships and collaborations to enhance RCB

Collaboration in research is not a new phenomenon, and there are many national and international examples of large programme grants and international studies, including those funded by the European Commission.21 However, the distinctive feature of CECo—placing RCB not only as a means to an end, but as an end in itself4—has meant that developing linkages, partnerships and collaborations, within and outwith the CECo collaborative had a developmental as well as a functional status. With the focus upon building internal linkages, there was the real danger that exclusion of individual researchers outwith CECo could happen, and this may have been an unfortunate and unintended consequence of such collaboration.

Within CECo, the development of the research community was facilitated through the provision of a website that provided increasingly sophisticated facilities for joint working. An on-line forum enabled researchers, service users and clinicians to contribute to collaborative projects, engage in discussion and facilitated information transfer. As a direct result of CECo, extensive collaborative links have been developed and maintained across the UK. International-level research experience has also been gained through increasing links with international scholars and the development of collaborative initiatives. Examples of these include: a joint workshop with researchers from The Netherlands/Belgium which led to the development of a number of grant proposals, and strengthened epidemiological/public health expertise leading to an international study on the perspectives of older people on end-of-life care,22 and an ongoing international study which examines the contentious issue of palliative sedation in end-of-life decision making.23

Ensuring appropriate dissemination to maximise impact

A key stage in research is its dissemination through strategies that are ‘fit for purpose’4 and, to date, 547 papers have been published in academic and professional journals, of which 80 (15%) are a direct result of CECo activity and 467 (85%) have benefitted from CECo activities. Furthermore, as figure 2 identifies, the number of papers resulting directly from the work of CECo has risen steadily during this period. Similar growth in conference presentations and membership of prestigious committees was evident but not illustrated here.

Figure 2

CECo academic publications by year (May 2006–September 2011).

Building elements of sustainability and continuity

While the impact of research on policy and practice is difficult to assess, particularly in the early stages, CECo has made a significant contribution to policy, guidelines, practice development and educational and information materials for professionals, patients and the general public.24 ,25 This has been achieved through the promotion of evidence-based practice to benefit patient care that has also been relevant to the decision making of practitioners and policy makers. For example, research on Cancer Survivorship has informed the emerging strategic direction taken by Macmillan Cancer Support and the National Cancer Survivorship Initiative.19 ,26 Research and scholarship on decision making for frail older people who lack capacity has informed a Council of Europe Symposium on medical decision making at the end of life,27 and the development of guidance for health and social care staff about decision making and advance care planning in life-limiting illness.28 This links to an extensive consultation process and wide involvement in national and international research and education activities to promote and develop advance care planning.29 Related public information has also been developed and distributed nationally,30 and this has been subject to an independent evaluation.31

Investing in appropriate infrastructures to enhance RCB

Each of the CECo Research Themes was led by senior people with designated responsibility for providing academic leadership, together with a small team of researchers who were responsible for taking forward the programme of collaborative research development, research capacity building activities, and other events consistent with each group's special remit.32 Alongside research and collaborative skills, CECo has built leadership capacity in many ways, including through investment in leadership training with expert facilitators, and devolving budgets to theme leaders who have learnt to inspire and motivate their teams, manage people from different backgrounds, motivations and skills, and resolve conflicts as they arise.

Discussion

Within our original aim of making significant and substantial progress in the quality of research in supportive and palliative care,3 a central focus has been on RCB. CECo has been an unprecedented model for collaborative research engagement between universities and local research users in different supportive and palliative care settings for which, it could be argued, the extensive research activity has been a means to an end—the development, not only of a critical mass of research, but of a critical mass of researchers who have developed their skills, understanding and confidence in research. As a direct result of CECo, research capacity has been increased, and the quality and volume of UK collaborative supportive and palliative care research has been enhanced.

Within programmes of research, there are many reasons for collaboration, including: enabling large-scale, multicentre studies to bring together a team of experts and access large samples; attracting funding;33 ,34 and enabling the development of cyberinfrastructure in order to adopt standard measures, vocabularies and systems.35 Despite a general reduction in the availability of research money and more intense competition for limited resources, working collaboratively has enabled CECo researchers to secure more substantial grants to undertake research that is having an impact on policies and practice. Arguably, these successes might have occurred anyway for senior investigators, but it is unlikely that research capacity will have been promoted in such an equitable way.

Cooke's framework4 has been useful in assessing the process as well as the outcomes of CECo's RCB activities. Although it has been patchy, with some principles being less well developed, and with less engagement from medical professionals than anticipated, but where they have engaged, CECo can demonstrate the consistent development of the span and skills of individual (academic, clinician and user) researcher expertise in supportive and palliative care, increased leadership capacity in senior researchers, and stronger links with international scholars and research initiatives. However, it takes longer to demonstrate the impact of the investment in young researchers and, perhaps most disappointingly, there has been an uncertain ‘translation’ of effort with non-active researchers into active researchers. More targeted support is needed to encourage practitioners to engage with research, while maintaining clinical roles. While a CECo-funded comparison of publicly available data on palliative care publications submitted by universities for the 2001 and 2008 Research Assessment Exercises showed little growth in research capacity,36 analysis of Research Excellence Framework (REF) 2014 data will be informative as a concrete measure of the outcome of CECo on the vibrancy of UK research and UK researchers. It is acknowledged that different organisations will judge the success of CECo outputs by different criteria dependent upon the ‘unit of assessment’ (the comparator group) to which individuals and research groups will be returned in the forthcoming REF.

Discussions about collaborative research usually begin at the point of how, with whom and on what to collaborate, and rarely, if ever, do they consider equally important questions of where the impetus and emphasis for collaboration is coming from, and how it is connected to the political research context.37 Recently, questions have begun to be asked about the value of collaboration in research. On the one hand, there is a view that concentration of research funding in a few elite universities fuels an obsession with institutional competition, rather than with the real world of partnerships,38 while on the other hand, there is a need to reform the ‘exhausted’ top-down funding mechanisms that force researchers into collaborations.39 Building a collaborative for RCB is time consuming, and presents many challenges3 through the outworking of the politics of collaboration.40 During CECo's first and second years, there were few research outputs—the focus of effort was on organising and hosting meetings, building trust, negotiating tensions and identifying common interests. Many lessons were learnt, including how to focus effort most fruitfully. One of the tensions in RCB is whether to concentrate effort on the ‘brightest and best’, or to enable people at all stages of their careers to broaden their research knowledge. CECo chose to focus on the development of research knowledge at all levels, including within hospice settings—an area underserviced by NHS support. RCB also entails certain costs: it takes people out of their comfort zone; distracts them from their own interests; and, for senior researchers, ‘valuable’ time is taken up with developing governance arrangements, managing people and projects effectively across institutions in the absence of line-management responsibility, and mentoring and helping to improve the grants of others, often at the expense of their own research and grant applications.

There are different models for collaborative research, for example, the three-dimensional framework of O’Sullivan et al41 which is based on: the number of different administrative units represented in the research team (institutional context); the number of academic fields present on the research team (homogeneous or heterogeneous), and the manner in which the work is performed and knowledge is created (disciplinarity). However, the question of appropriate models of collaboration for research capacity building remains unanswered and needs to be addressed. The CECo model, which privileges the processes of research collaboration as central to RCB, has attracted increasing international interest, and the models of governance, leadership and user involvement developed within CECo is beginning to be applied beyond the UK, including the newly formed All-Ireland Institute of Hospice and Palliative Care (see http://www.aiihpc.org) and in Australia.

Conclusion

As a direct result of CECo, the capacity of UK researchers has been increased, and the quality and volume of collaborative supportive and palliative care research has been enhanced. CECo has also had wider influence on research, policy and practice within and beyond the UK. Time will tell what the extent of the impact of CECo has been, but it is unlikely that the benefits that are already evident would have occurred without the NCRI investment in the infrastructures of CECo. As we enter a period of increasing austerity, the challenge is to retain collaboration to support RCB rather than revert to small-scale single-researcher studies with potentially less impact.

Acknowledgments

The authors thank all members of the Cancer Experiences Collaborative. Special thanks go to Anthony Greenwood, Anne-Marie McDonnell and Jan Lyons for their help in the preparation of this paper.

References

Footnotes

  • Funding National Cancer Research Institute.

  • Competing interests The author has served on the NCRI Palliative Care Clinical Studies Group from 2008 to 2012 and the Association for Palliative Medicine Science Committee from 2005 to 2012. He is a grant holder from the following awarding bodies: Cancer Research UK, Marie Curie Cancer Care and HTA.

  • Provenance and peer review Not commissioned; externally peer reviewed.

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.