The Hitchin Map and the Spectral Base II