What you have sounds like "bump steer." This is a condition that occurs when the steering arms do not stay in line as the suspension moves vertically up and down. The usual reason is lowering the nose of the car by chopping springs or using lowering springs. There are two kits designed to correct this problem. Negative camber kit and bump steer kit. See
http://www.drgas.com/promotor