Let me re-state that if you connect your amp to a GFCI, it will protect you from a ground fault in your amp ONLY, and NOT any other equipment you may come in contact with.
I have found quite a few old GFCI units that have been in service for a while to be defective, and recommend that you press the test, and reset button on any GFCI before you trust it. The safest practice is to do this each, and every time you are about to connect to the device.
For circuits where no grounding electrode conductor is provided, (meaning no ground wire), the test button on the GFCI, or any portable GFCI tester will not trip the unit. This is because the test button shunts current through a resistor to ground to perform the test. (While it is not practical, you could test an ungrounded GFCI by connecting a 22,000 Ohm resistor between the hot, side, and some other grounded circuit element. Not the neutral wire!)
GFCIs are prone to "nuisance tripping". I have found portable hair dryers, and vacuum cleaners to be common causes of this problem. The common feature these devices share are universal motors. The only cure I have found for nuisance tripping is to not use the equipment that causes the problem.
So to be completely safe from shock, or electrocution by a ground fault, all cord connected equipment you may come in contact with should be connected to a GFCI.
Especially if you are outdoors, or standing on a concrete floor.