Use of 32kHz for peripherals

I want to tap the 32kHz from the oscillator directly and thereby changing the load on the XTAL. Do I need to place an equivalent of capacitance on the other leg of the oscillator or can the chip balance this with the build in variable capacitance? The setup is the xtal and use a small load capacitor towards a SOT323 mini gate to tap the 32kHz to drive a charge pump.