Alright, I just joined the Coast Guard a few months ago and my parents are trying to persuade me into buying some property. There doesn't even have to be a house on it. Just so I have some land to my name. They make a decent argument and I've been doing some research. Looks like I could get a few acres in PA or NY for under $20,000. And the monthly payments would be manageable given I save up enough to give a decent down payment.  I would really like to have a small farm when I eventually retire and find out where I'll be living more permanatley, so it sounds like a good idea.
My questions are...

Even a poor structure will need home owners insurance. You would have to carry insurance on vacant land as well. Some stupid kids get on 4-wheelers and go mudding on your property, they are trespassing but they fall into a ravine of sorts that you knew about, as the land owner, but they didn't as the interloper. Guess what... no insurance, their mommy & daddy sue you for having such open, dangerous, unmarked property. Dumb? Absolutely! Conceivable? Absolutely! So you will need insurance regardless. Home owners tax would just be assesed as land value only, no buliding if it was vacant land. It used to be an excelent investment. If you were looking at this for short term, I would say bad idea. But since you are looking at this for the long haul you will have appreciation in value, even in this still somewhat stagnant real estate climate. We owned property while I was still married but it was houses to live in. You buy & sell like a shell game in the military, if that's your desire. Sometimes you get stuck with a house somewhere and then you rent to people. But even that isn't so terrible. You can make enough to pay your first mortgage on that place, BAH covers mortgage on the 2nd place (if entitled) and you have enough generally speaking to pocket some cash for any future issues on either house, more the rental property since you want to keep happy tenants.

It isn't a horrible idea. Just make sure you are in a financial position to carry a mortgage. It sounds like you have the skills to weigh your options carefully and you won't buy Donald Trump's place on a non-rate salary. It also sounds like your parents are giving you sound advice. Start looking... if you find something, make an offer. If you don't, hold out and wait until you do! You have time on your side right now, take advantage of that. Good luck!

Thats a bummer about insurance on vacant land. But sound advice none the less.
I hear its easier to get morgage loans while in the military. Is this true? and is it at a lower interest or just overall easyer to be approved for?

Since you can VA loan, it can be easier. Lower interest, and easier to get approved. However, that said -

Have you considered other types of investments? Real estate can be great, but there are other options. I obviously am not a financial planner, nor do I play one on TV, but just throwing that out there.

I have. But the land would be less of an investment in the sense of me reselling it later on in life. It was more so for 'buying land now while the market sucks and its cheap, then I can build a home on it later in life when I have more money and I'm about to retire.'