Most people are conformist sheep and are so consumerized by the media that its practically a cultural crime to listen to anything other than something that fits a widely known genre or something by widely known artists, though many would have to take a painting class or maybe some crochet to actually be called an artist. Also there is the fact that "normal" people have a tendency to not want to be otakus, even if they dont know the definition of that word.
I realize this and lie whenever asked what music I listen to. "Eh, rock...some techno." "What bands?" they ask. "Erm...her frmer blrmbr." I respond and then change the subject/ make my escape. If only they knew.