You will find that a GFI receptacle will trip 99% of the time if you test between the Hot and Ground. If it don't, its more than likely defective.
Always check between the Hot and Neutral.