Well, there was a reason why DWM designed it's LP08 rear sight to go on the barrel
I don't think it's a good idea to bolt too many things onto the rear toggle. Because of it's rather violent movement it will create stresses and it will be hard to keep rear sight attachments at the position you want them to be.