If you're trying to keep it "all natural" because of the garden, a good layer of diatomaceous earth across the garden will kill everything that gets it on them. If you can find the colony a heavy dose on top might eventually take it out otherwise you'll need to use one of the commercial ant killers.