The PVC pipe is Ok, as it seams good enough for a 4ft but not a 6-7ft. It bends nicely so there is less stress. After digging hole #3, it is much more solid, roughly 2.5 feet down in wet clay. The pipe does "whistle" in the wind, approximately 15mph and higher. It is really nice since my whole windmill can just be picked right off the top of the tower with the help of a ladder or my 4-wheeler.
I once stacked a 2nd 10ft pipe to the top, with my 30" windmill on it, and with the help of my twin brother, a 10 A-frame ladder, and my 4-wheeler, we got it on top. It held up to 20+mph winds, but it would bend approxiamaely 3 feet in a strong gust. My current setup will bend about 2-3 inches with the 4ft on it in 10 mph. I would let it bend up to about 10inches without any fears.
Here is the 20ft tower.
http://www.youtube.com/watch?v=ZWfvyj8diug
I bet if anyone wanted to use my idea, they should buy some 1/8" or 1/4" walled PVC pipe, as mine is about 1/16" thick. The diameter is what counts, so maybe 8" would work better. Also mine has the holes in it for drainage, so the water doesn't build up on the inside (my area gets 40+ inches of rain and the water table is about -1 inches below the ground for 8 months a year.