The real comparison
Name the thing you'd actually be replacing
A reverse osmosis system never competes against an abstract idea of pure water. It competes against whatever you already do at four o'clock on a Tuesday when you want a cold glass of something. There are three honest alternatives, and RO has to beat the one you use — not the worst of the three.
Bottled or delivered water. The alternative RO wins against most often, because it's the only one with a running cost as large as its own — and the one people underestimate: the case in the trunk, the empties by the door, the 11pm discovery that you're out. If this is you, skip to the arithmetic; the answer is probably yes, and the only question is which route.
A carbon pitcher or faucet filter. Be fair to this one, because the industry rarely is. For twenty to forty dollars plus a cartridge every couple of months, activated carbon removes chlorine taste and odour, and certified models are rated for specific contaminants too. On a great many US municipal supplies that is genuinely enough: the water is already treated and tested against federal limits, and the usual complaint is that it tastes of the chlorine that made it safe.
Where carbon stops is dissolved solids. It's a screen and a sponge, not a membrane, so it can't meaningfully reduce nitrate, fluoride, arsenic, sodium or the TDS load that makes some tap water taste chalky — which is why RO exists, and why NSF/ANSI 58, written for reverse osmosis systems and their contaminant reduction, isn't what a pitcher is certified against. If your problem is taste, carbon is the cheap answer. If it's what's dissolved in the water, carbon isn't an answer at all.
Doing nothing. We run an affiliate site and we'll still say it: if your utility's annual water quality report comes back clean, your kettle isn't furring up and you're happy drinking from the tap, doing nothing is legitimate and costs nothing.