I have my calluses pretty well built and can play a pretty good while without pain. However, I also produce "ridges" on my fretting fingers and sometimes it causes the string to be plucked awkwardly when changing strings with that finger. It is primarily with my middle finger.

Any ideas as to what I am doing wrong getting these ridges?