Probably the main thing is that they tend to be smaller. Also likely an outdated prejudice developed back in the days when no one neutered male dogs. Intact males tend to fight more and given the opportunity disappear for days at a time following the call of nature. Also intact males ...... are less dainty around the house
Granted most of the issues other than size go away with neutering. But why change a something that works for you?