Using open research practices to conduct a systematic review and meta-analysis of health care data in pancreatic cancer
Claire Price, a PhD student in health sciences, has been focusing on quantifying weight loss prior to pancreatic cancer diagnosis, to help improve early detection while embracing the principles of open research, particularly for transparency and reproducibility.
Pancreatic cancer is rare but has dismal survival rates; it's the sixth cause of U.K. cancer mortality. It often presents with non-specific symptoms. This makes early diagnosis challenging. However, because weight loss occurs in most patients with pancreatic cancer, it could be a useful diagnostic marker.
Our aim was to improve its utility as a marker for pancreatic cancer by quantifying pre-diagnosis weight loss. We undertook a systematic review with meta-analysis.
However, health care data must remain private and confidential. Health care datasets cannot be shared in their original form. Only non-identifiable data can be shared and only in a safe environment. This means it is challenging to ensure transparency in research using health care data.
Before conducting this review, Price attended an open research course at the University of Surrey to improve her knowledge of open research and best practices. We registered the study protocol on PROSPERO, which is an international database where researchers can submit their proposals for literature reviews.
This helps the research to be transparent and reproducible as well as avoiding duplication of work. It also allows a comparison of what was planned and what was completed for the research. We followed PRISMA guidelines which provide a framework for what information must be included when writing up the research, such as a well-defined research question together with reasons studies can be excluded from the research.
We conducted a systematic review and meta-analysis of studies which included quantifiable information about weight loss prior to pancreatic cancer diagnosis. The search for studies to include was conducted using five different databases in November 2023. We used a tool called ROBINS-I to assess possible bias in how the studies we found were conducted.
Examining possible bias is important as this may influence the results when synthesizing the data from many studies and using a tool for this assessment is important so that bias is appraised in a standard and reproducible manner.
Extracted data has been deposited in a database for openly sharing datasets and will be submitted as a Research Elements article which focuses on how the data was extracted from the studies.
The review will be shared as a preprint to improve the speed of dissemination. It will also be submitted for publication in a peer-reviewed open access journal, increasing communication and knowledge in the area of improving the early detection of pancreatic cancer.
Transparency of methodology enables reproducibility as well as preventing duplication of effort and cost. Depositing extracted data maximizes the findability and accessibility of the data. This encourages data reuse practices which supports data minimization. This means that only as little data as is required is collected and that the same data is not collected several times, which is especially important for potentially invasive research, such as that involving health care data,
We also encountered challenges when conducting this review which were related to limited open research practices in the original studies. Extracting data for meta-analysis was difficult due to heterogenous study types and a lack of transparency.
Many original studies lacked meta-data, only presented data graphically or only reported summary statistics (e.g., as the result of a regression model) so the raw data is not provided. Authors of the original studies often could not clarify results. Without meta-data to enable data reuse this meant some studies had to be excluded from meta-analysis.
Out of 6,664 original hits 30 studies were included in the review and meta-analysis. Random effects meta-analysis was conducted across three different ways of reporting weight loss (the amount of weight lost (kg), BMI change and proportion of people losing weight).
We found 57.4% of people lose an average of 5.89 kg or have a BMI change of -2.54 kg/m2 prior to pancreatic cancer diagnosis. However, there was a great deal of heterogeneity between the studies so there is limited confidence in the results and their wider applicability.
Research using health care records needs to be approached carefully, due to privacy and other ethical considerations. However, maximizing open research practices enables data to be shared to maximize patient benefit. This avoids repetition of work and increases reproducibility.
Original datasets that consist of health care records cannot be made open access. However, open research practices can still be adopted by sharing data that has been aggregated or deidentified. It is important to present meta-data to provide context for the research. This improves standardization across study types and facilitates study combinability.
More information:
Weight Loss Prior to Pancreatic Cancer Diagnosis: A systematic review and meta-analysis. PROSPERO 2022 CRD42022302985 Available from: www.crd.york.ac.uk/prospero/di … hp?ID=CRD42022302985
PaCaClaire/Systematic-Review-Weight-Loss-Extracted-Data: Weight Loss Prior to Pancreatic Cancer Diagnosis—Systematic Review Extracted Data: zenodo.org/records/10118729
Provided by University of Surrey