I use large rifle primers and only extruded (stick) powders. I stay close enough to the minimum that I don't get big swings in muzzle velocity, I use a Magnetospeed chronograph to measure, if I get high standard deviations, I go back up. The loads I've used don't seem to get the powder charge so low that I'd have the concerns you're talking about, I have them, too. I think if I wanted to go lower/slower I'd look at something like Trailboss powder but I haven't been there, yet. It's amazing how much recoil is reduced by dropping 400fps in muzzle velocity and 40gr in bullet weight.