I cannot come up with a downside, as long as, like someone else suggested, you are not sucking any component of any insulation into the living space. And, just pondering here, it might not be good if you were replacing this heated air with air from the living quarters that was really humid, as the moisture could condense up there. You'd have to consider this, might not be a factor in your case.