It is argued that effective prompt design is itself a primary risk management strategy, reducing the probability and severity of characteristic failures before verification is required, and introduced a structured framework for matching downstream verification effort to risk across dimensions of output verifiability, researcher expertise, and consequence of error.
Abstract
Responsible use of large language models (LLMs) in life science research demands a unified approach to risk, yet existing guidance treats prompting and verification as separate topics rather than as integrated components of a single risk management framework. This paper addresses that gap for life science researchers. We explain how LLM architecture produces both remarkable capabilities and characteristic failures including hallucination and sycophancy, with particular attention to vulnerabilities most relevant to life science workflows. We argue that effective prompt design is itself a primary risk management strategy, reducing the probability and severity of characteristic failures before verification is required, and introduce a structured framework for matching downstream verification effort to risk across dimensions of output verifiability, researcher expertise, and consequence of error. We apply both layers to common research tasks, including literature synthesis, code generation, writing assistance, statistical reasoning, and administrative work, with documentation practices and ethical obligations addressed throughout. Six supplementary guides extend each component into detailed workflows, worked examples, and reference checklists, and a companion open-source repository (https://github.com/SharptonLab/PromptLab) provides tested prompts and verification tools for immediate use. Together, these resources are designed to help researchers use these tools carefully and document how they did so.
A structured review of research on responsible LLMs in finance using a broad-to-narrow screening process across Web of Science and Scopus, reported with reference to the applicable PRISMA 2020 items is provided.
While vibe coding has the potential to reduce barriers to data analysis for researchers, this case study demonstrated that it can produce both valid and invalid outputs and that foundational statistical training, knowledge, understanding, and methodological expertise remain paramount when using it.
D. Tolentino, E. Kohout, Paul Boy et al.· Nursing Research· 0 citations
This paper presents a methodology for building safety evaluation datasets that comprehensively cover the full spectrum of sensitive topics relevant to LLM safety, and releases a public repository containing the list of categorized Italian Wikipedia pages, the automatically generated prompts, and the standard prompt tem...
Elena Marafatto, R. Navigli· International Conference on...· 0 citations
In this single-centre proof-of-concept, aggregate accuracy was insufficient for safety characterisation: models with indistinguishable mean accuracy carried different catastrophic-failure tiers and reproducibility profiles.
Fang-Yan Liu, Zhi Liu, Xiaolu Fei et al.· Journal of medical systems· 0 citations
Large language models (LLMs) are increasingly relied upon to support ambient documentation and clinical reasoning. Here we examine the impact of a failure mode shared between these two applications by assessing their sensitivity to information incidental to the patient encounter. In 576 patient-clinician dialogues, we...
K. Vishwanath, Brandon Ye, A. Alyakin et al.· 0 citations
By tracing the evolutionary trajectories of these methodologies, this scoping review provides a mechanism-centered framework to inform responsible model development and deployment in medical settings, tailored to task complexity, data characteristics, and resource constraints.
Fang Li, Jian-Fu Li, Weiguo Cao et al.· npj Health Systems· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.