Most of the nuts are this way. Pistachio, Almond, Walnut, etc. Nobody actually eats the fruit - just the seed. Mistletoe and Soapnut are also inedible.
All berries of the Nightshade (potato) family, including common potato fruit (what we eat is the tuber- part of the root storage system) are deadly.
Yew, holly and ivy berries are also...