Do my neighbours have to agree to it?

Not under permitted development, though a friendly word is worth it if the building will sit near a shared boundary. Where an application is needed, neighbours are consulted as part of the process. Most objections come from noise or overlooking rather than the building itself, so we think carefully about where it sits and which way the glazing faces.