Peonies are mildly toxic, at best, and must be kept away from your cats. The entire peony plant contains Paeonol, which is a toxin. In the bark of a peony plant lies the most potent Paeonol.