This is normal. If you zoom in to your cities, you can hear the "early" version of your leader theme, but when you zoom out there is no real music to be heard. Sometimes, you hear some primitive drums beating, but basically not much.
Later, music will start as the civilization develops. Nothing to worry about.