Information retrieval and automated progress estimation of on-going construction projects have been an area of interest for researchers in the field of civil engineering. It is done using 3D point cloud as-built and as-planned model. Advancements in the field of photogrammetry and computer vision have made 3D reconstruction of buildings easy and affordable. But the high variability of construction sites, in terms of lighting conditions, material appearance, etc. and error-prone data collection techniques tend to make the reconstructed 3D model erroneous and incorrect representation of the actual site. This eventually affects the result of progress estimation step. To overcome these limitations, this paper presents a novel approach for improving the results of 3D reconstruction of a construction site by employing two-step process for the reconstruction as compared to the traditional approach. In the proposed method, the first step is to obtain an as-built 3D model of the construction site using 3D scanning techniques or photogrammetry in the form of point cloud data. In the second step, the model is passed through pre-trained machine learning binary classification model for identifying and removing erroneous data points in the captured point cloud. Erroneous points are removed by identifying the correct building points. This processed as-built model is compared with an as-planned model for progress estimation. Based on the proposed method, experiments are carried out using commercially available stereo vision camera for 3D reconstruction. © ISARC 2018 - 35th International Symposium on Automation and Robotics in Construction and International AEC/FM Hackathon: The Future of Building Things. All rights reserved.