Rank and computation of the pathlifting Jacobian of a DAG ReLU network
This paper provides a self-contained proof of the rank of the pathlifting Jacobian of a DAG ReLU network by performing an induction on the network's number of hidden nodes by considering the skeleton matrix of the network, a sparse matrix encoding the network paths, and transform the representation of one of its hidden...