Kingston Council says the site, which was closed last December over safety concerns, is coming to the end of its life.
It wants to build a brand-new centre rather than just replacing the roof, which would cost an estimated £5 million.
The authority has started to prepare a business case so that work can start before the end of the year.