Got my SES in a Maule Amphibean. Seaplane flying to me, is what flying is all about...gives you a bit more freedom as there are more destinations to choose from! I have friends who own an Albatross, and though I have not earned the MES...it's a blast!!!
Go for it, but I would suggest getting your SES first...it will be cheaper to learn the basics of taxi, docking, and the various landings: rough water, glassy water etc....that could take a few hours. All seaplanes fly the same but they do not react the same on the water, keep that in mind as it will be helpful to get rated in the plane you plan to fly the most.