Harvest have the best flavor when left to ripen on the tree. You can tell when plums are ripe by applying gentle pressure with your fingers. If the skin of the fruit feels soft, then it is ready to be picked. Plums should come off the tree easily when you`re using only a slight twist.