FedHSFV: Federated Learning for Finger Vein Recognition via Hierarchical Decoupling and Subspace Metric

Abstract

Finger vein recognition (FVR) has significant potential in biometrics due to its high accuracy and intrinsic liveness detection capabilities. However, the increasingly stringent privacy regulations have presented severe data security challenges for traditional centralized training. While federated learning (FL) mitigates these privacy concerns through a decentralized training paradigm, conventional FL algorithms that seek a single global model experience significant performance degradation on non-independent and identically distributed (Non-IID) data in real-world cross-institutional deployments. This degradation stems primarily from a dual-heterogeneity issue that involves domain shift caused by hardware discrepancies across acquisition devices, and label skew resulting from nonoverlapping user identities. To address this dual-heterogeneity challenge, we propose a personalized federated learning framework driven by hierarchical parameter decoupling and subspace metric. First, we designed a hierarchical parameter decoupling architecture. Macroscopically, the architecture retains the classifier locally to isolate label heterogeneity; microscopically, it introduces an additive parameter decomposition that decouples the feature extractor on a global full-rank basis (to capture domain-invariant semantics, namely, the shared physiological vein topologies) and a local low-rank adapter (that accommodates device-specific characteristics, such as hardware-induced noise and illumination discrepancies). Furthermore, we propose a subspace similarity matching strategy based on principal angles on the Grassmann manifold. By exploiting the geometric properties of low-rank projection matrices, this strategy accurately quantifies the underlying distribution discrepancies among clients to guide personalized weighted aggregation. Extensive experiments on six public finger vein datasets demonstrate that the proposed framework significantly improves the overall recognition performance and mitigates performance degradation caused by data heterogeneity.