Jersey's planning and environment minister Senator Freddie Cohen said buildings in town should be no more than four or five storeys high.
Senator Cohen told BBC News he had strong views about the height limits in St Helier.
But the minister said there could be exceptions, such as at the site of new homes on the old Westmount quarry.
The Westmount quarry is a site with a high cliff, so Senator Cohen said they could be taller buildings.
He said: "The concept of littering the town with a multiplicity of tall buildings is a non-starter.
"There is opportunity for tall buildings, particularly if they are beautifully designed, but it should be very limited indeed."