RadTechBERT: a domain-specific language model for radiological technology evaluated using Japanese national examination-derived cloze questions.
RadTechBERT with BPE_32K outperformed baselines in many subjects, with more than a twofold improvement in radiation safety management and radiation measurement relative to the strongest baseline, while gains were smaller in subjects having substantial overlap with general medicine, and Wikipedia mixing did not yield co...