Wait till they are ripe and harvest the clusters.  Use a fork to separate them from the stems.  Ive never heard of them being poisonous.   they make great jelly and also pancake syrup if the jelly doesn't set right.