We consider the problem of reconstructing architectural scenes from multiple photographs taken from arbitrary viewpoints. The original contribution is the use of a map as a source of geometric constraints to obtain in a fast and simple way a detailed model of a scene. We suppose that images are uncalibrated and have at least one planar structure as a faade for exploiting the planar homography induced between world plane and image to calculate a first estimation of the projection matrix. Estimations are improved by using correspondences between images and map. We show how these simple constraints can be used to calibrate the cameras and recover the projection matrices for each viewpoint. Finally, triangulation is used to recover 3D models of the scene and to visualise new viewpoints. Our approach needs minimal a priori information about the camera being used. A working system has been designed and implemented to allow the user to interactively build a model from uncalibrated images from arbitrary viewpoints and a simple map.