Navigator Rear Brake Cam Lever

I'm hoping to fit some exhaust kick-ups to my Navigator and as a result the nearside silencer may foul on the rod connection for the rear brake.  I may need to do some creative fettling!

The cam lever on the rear drum currently points 'down' if you get my meaning, and rotates the cam clockwise, but I wonder if it could be flipped to point up and pull anticlockwise? This might give me the clearance I need.  Alternatively has anyone ever ditched the rod altogether and made a cable connection?

Regards,

Nick