If in doubt, always call your vet or the Animal Poison Line immediately.
Peach pits contain amygdalin which releases cyanide when broken down. The hard pit is also large enough to cause intestinal blockage. Remove completely before feeding peach flesh.
Seek vet advice if the pit was swallowed : it may need to be removed surgically.