Yes, according to the laws of physics, the shorter the lever the more energy needed to be used to move it the same distance.
But its not noticable at all. I havent increased the size of my forearms from shifting gears any.
Now thats an idea for us car nuts to get some exercise. Body By Jack Short throw shifters with a 300 lb offset spring, Now that would be a good work out for your arms.