Recording with Garage Band is easy enough just about anyone can do it. You get a free, fully working* version on any Mac computer running OS X (that I know of, could be wrong) with all kinds of easy to use instructions and help files, and it's very intuitive as far as recoding software goes. There's even introductionary videos on Apple's home page. If you're using a PC computer, I'm guessing it's not that much different, although I've never tried, or even seen Garage Band on a PC.
It is limited in some ways, but realistically, do you really want to start with a fully professional program anyway? There's tones of technical stuff I have trouble keeping track of in bigger software like Pro Tools or Logic and I've been using those for 4-5 years now, the learning curve can be pretty steep for beginners-intermediate like me.
If you're "just starting", and still have to get used to stuff like arming a track before recording, muting, soloing, basic E-Qing, plug-ins... then Garage Band is as good place to start as any until you get to the point where you're trying to do something and realize the program just can't do it. And even after that point it's still great for songwriting, demos and practicing.
* - There are upgrades (that come with iLife I think) with a few added functions, extra audio loops and stuff, but the free version has more than enough functionality to keep you going for a long time if you're just starting. With the free version you can easily produce a decent sounding demo (or even a great demo if you turn out to be good at this) with a microphone and a good USB interface (the box you'll be plugging your instruments and mics into). Heck I don't even use an interface box on my Mac, I have a 1/8 audio jack built right into my laptop that records 24 bit and it works great.