Yep your right.
OK, how about putting the batteries in a box next to the house. Size it for expansion. Short heavy cable to bring in the 12VDC power. In house add a DC distribution fuse box and inverter to power the 120v things your just dying to run. Utility rooms or garage often have the electrical box so put this stuff there?
The cable from the solar panel can be quite thin, less than 2 amps in it.
Have fun, Scott.