Jim, our resident Luger Repair member is G.T. and recommended by many. If you search this Forum with "toggle retaining pin" you will find some posts relating to your question.
Per a prior G.T. post, "As for the small retaining pin, removal can range from a simple tap out with a ground down 1/16" punch, to removal by Laser!!! It is different every time, and it should be full length. but will most likely do the job even if compromised? If you want to, send me the toggle train and I will remove the old pin and install a new custom fit pin to cure the issue... Contact me at:
gctomeks@msn.com".
G.T. is a great guy and can help you with your project if you need it. Good luck, Mark