It’s in the immediate interest of healthy single people with earning potential to opt out of societies where they are required to pay a high proportion of their earnings to support families and the elderly. Whether you have the right to is not quite the question. The question is what you would be opting into. You cant stay where you are physically, because you would be free riding on infrastructure you’re refusing to pay for.
Moreover, you can’t move to Tir naNog, the land of the forever young, because biology is against you. A biologically self sustaining society will have babies and oldsters who need looking after.
But maybe it doesn’t need to be biologically self sustaining. It could have babies constant influx of young adults; they could save for their own retirements, and then be looked after by hirelings out of their own funds. They would have to be celibate, or at least in reproductive, of course.
Its been done before: it’s called a monastery.