Oh, absolutely.
Houses facing the ocean in St. John's are expensive by our standards, but still cheap. If it looks like the $150,000 example above, but is located in the Battery (that cliffhanging neighbourhood), it'll be $300,000. If it's nice and out there, it'll be $1 million+.
Anything over $100,000 in rural areas would be a bit of an anomaly. You can get a fixer-upper rural house for a few thousand - but keep in mind that might mean outhouse, no indoor plumbing except a faucet in the kitchen/basement connected to a nearby spring for cold drinking water. However, if you want something move-in ready, it can still be dirt cheap.
Even if you need to be within an easy day's drive of a city, you can still get it pretty cheap in the middle of nowhere: