Ideally you'd have a stick pointing straight out the back of the pivot point with a weight on it. It would look somewhat like the tail on a windmill. When the weight is correct, the whole assembly would be balanced.
Think of the way the hands of a clock are (or used to be) made. In order to compensate for the weight of the long pointy "hand", there is a short wide "stub" directly opposite. By being balanced by the counterweight, there is no force applied to the shaft.
The same thing is done for those single blade windmills. One long blade and a short heavy counterweight.
With the right amount of weight you could position it at any angle and it would stay right where you put it (except for wind effects of course).