The development, which includes a pocket park, will be situated at the Cocks Crescent tower block near the high street.
The square is the first phase of the scheme and work on the wider development is due to commence in the summer of 2023.
Design work is also starting on proposals to improve the Fountain Roundabout with a public consultation starting next month.