Principled Statistical Approaches for Sampling and Inference in High Dimensions