You are lifting a lot for what you have, I use two 1 1/2" pipes side by side joined with flat bar. I guy them back to the side anchors at mid length and end. All cables on the lifting side connect to the gin pole end which is then tied to that anchor point, I use a separate hinge point. On your arrangement you place much stress on the tower base.

I fail to understand why your gin pole bent toward the tower unless cable's were badly adjusted. You do understand that you must have a second person holding via a cable, the mid point of the tower in the opposite direction, during raising and lowering. Please refer to Bergy's site.