Is it usually the case that high quality bearings will solve this sort of rumble?
No clue what would be available to handle this. Since it's low and enormous diameter you'd probably want to support it with a track and wheels, rather than just a rod at the center.
Since you didn't mention other types of noise, is it safe to suppose that it was fairly quiet other than the bearing rumble?
Hard to tell since I couldn't get close enough to it. The bearing rumble was conducted to the building so it was what was heard.
Since it's a savonius variant drag turbine I'd expect some vortex peeling at some point around the rotor.
I'm considering a ground level siting also. In particular, under a deck that will be terraced into the hill.
That sounds like a good approach for this sort of turbine.
If you make the rotor a little smaller than the deck the deck will shield most of the high frequency components of the noise from the people on it. (You can add some guides to the corners of the deck to funnel air to the turbine, giving it a cross section closer to that of the deck than that of the rotor proper.)
If the deck and the rotor have separate foundations and no connection (except maybe through a length of buried conduit with a right-angle joint underground) you should have little conducted bearing noise to the deck.