First, you need to understand how drums work.
Unfortunately, I'm not going to explain for fear of someone coming in and telling me I have no idea what I am talking about
HOWEVER...
You should stop doing fancy stuff with your drums and understand what each drum sound is supposed to do.
http://www.zirconstudios.com/tutorial1.php
This is for how to make electronic drums, but there info on what a kick/snare/hi hat is supposed to do and also how to write good drumlines.
You shouldn't have all your stuff in high pass filter... that, to me, is just (and I'm sorry for this) BLASPHEMY.
Kick drums should be low
Snares should be mid
Hi Hats should be high
I usually put toms in mid low.