Gonna throw my two cents in as well...
I'm by no means *popular* but I gotta say that like, though I know I lose fans and then do polarizing stuff like My Little Pony related music w/e my fanbase has kept growing steadily and not too many people have left.
In fact most people tell me they can look past the pony because they enjoy that I'm not afraid to poof around with genres and I just do what I do to make people jam out.
Honestly, keeping a singular identity and just putting as much quality content out there is going to draw even more people, then pretentious people can brag about how diverse you are to others.