Some 32kHz crystals were designed for best stability at 35C, about the temperature of a metal backed watch case on the wrist, while others are designed for room temperature operation, so you pretty much are going to get drift with them anyway.
Good though with trying to get the induced noise down, though for lowest noise you really want to have a ground plane under the actual chip, some guard traces at the crystal pins and with a ground plane around the crystal, along with keeping the traces well away at all layers of the board, and a good number of vias to stitch the layers together, which should make the clock more stable. You probably will want to keep the clock area thermally isolated with something, like a small shielding box around them, like you used to see on older computers, that wanted a more reliable RTC before NTP was common.