Informative Distance-Based Priors for Correlation Matrices Centred on a Target Reference

Abstract

Specifying a prior over the space of correlation matrices is a persistent challenge in Bayesian analysis. The space is a curved manifold whose dimension grows quadratically with the number of variables, making substantive prior beliefs difficult to encode.\\ We propose a distance-based prior that assigns mass decaying exponentially in the Fisher arc-length distance from a user-specified reference correlation matrix, enabling shrinkage toward any target correlation structure rather than being confined to the identity matrix. Formally, this is constructed as a Penalised Complexity prior, but its interpretation shifts accordingly: unless the chosen target represents a structurally simpler state, the shrinkage penalises deviation rather than complexity in the usual sense. To accommodate conditional independence constraints, we introduce a parameterisation that constructs the correlation matrix via the Cholesky factor of the inverse correlation matrix with respect to a user-supplied graph, thereby reducing the number of free parameters from one per variable pair to one per graph edge. The prior is proper for every positive value of its rate parameter, accommodates correlations of either sign under any graph structure, and reduces to a fully unstructured prior when the graph is complete. A direct sampling algorithm is provided, enabling prior predictive checks and sensitivity analysis, implemented within the \texttt{graphpcor} package.