Take Down Tool Hole

I like John's set screw idea, but I'd never go to that trouble to improve locking fit, when there are easier ways. More likely, on levers that fit too tightly, a tool or pin punch was inserted in the hole to lower and raise lever.