If I was using my computer right now I'd show you pictures, but if you look closely at the individual notes in the midi sequencer, you can click a small white bar that adjusts the velocity of the note/beat. You can use that instead of the thing at the bottom and that should work fine.
Sorry if I explained that horribly. Anyway, I find sequencing in Reaper just fine, but whatever.