I assume this is polyester resin? The hardener is a catalyst and if you have too much the thing runs away thermally and that is probably what you have happening. If you halve the normal small quantity catalyst it should be better behaved. The whole thing is temperature dependent and high temperatures make the thing worse. If you reduce the catalyst it may take some time to harden and in some cases you may have to warm it to kick the reaction off. Just use enough heat to get it started, too much heat may again set it exotherming. You will do far better with some filler in the resin such as talc or ATH even if you use glass cloth for strength. The filler moderates the reaction with large quantities of resin.
If you are using epoxy the the resin /hardener ratio is fixed and you must not change it, the only thing you can do to slow the reaction is work at lower temperatures.
Not sure about vinyl ester it is somewhere between the two systems, I am not sure if it is a catlaysed reaction like polyester or whether it is a 2 part system like epoxy.
There may be differences in the resin from different sources and some may need more hardener than others for polyester, it seems likely you are using too much for the volume of resin.
Flux