Epsom and Ewell Council says work in Aragon Avenue had begun before the level of the foundations had been agreed.
This means the authority would have had no control over the height of the finished building.
The council also temporarily stopped work on 160 housing units in the town this week following concerns about traffic and noise.