Spectral and dynamical signatures of localization in many-body systems