Rethinking input complexity in transformer-based clinical prediction: implications for feature dimensionality and sequence length in longitudinal electronic health record data
Abstract Objectives Transformer-based models for clinical prediction using longitudinal electronic health record (EHR) data are often developed with large feature sets and long patient histories under the assumption that more data improves performance. However, high-dimensional inputs and long sequences increase comput...