I know that cyanide has the same smell as almonds and that no foods in our diet contain leathal amounts of cyanide compounds. But creatures like the pink dragon centipede use HCN as a deterent. So the distaste for almonds must occur elsewhere in the animal kingdom.