You have it exactly right!
Some takedown levers hang up a bit on the retaining spring or have enough play to not perfectly center as you push them in. Simply wiggle it a bit as you put pressure on it to seat home, it will seat completely eventually. Try to do this while looking at the retaining hole on the opposite side of the frame. If the lever is not perfectly centered, you will be able to adjust by looking at the lever's end through this hole.
|