Recognizing the activities of workers helps to measure and control safety, productivity, and quality in construction sites. Automated activity recognition can enhance the efficiency of the measurement system. The present study investigates accelerometer-based activity classification for automating the work-sampling process. A methodology is developed for evaluating classifiers for recognizing activities based on the features generated from accelerometer data segments. An experimental study is carried out in instructed and uninstructed modes for classifying masonry activities by using accelerometers attached to the waist of the mason. Three types of classifiers were evaluated, and multilayer perceptron, a neural network classifier, gave the best results. A 50% overlap for data segments enhanced classifier performance. The study showed that the utilization of best features instead of all features did not affect the classification accuracy significantly but reduced the run time considerably. An accuracy of 80% was obtained with accelerometers attached at both sides of the waist in an uninstructed environment. The results from preliminary studies have shown the potential of the proposed method for automating the activity recognition in construction sites. © 2011 American Society of Civil Engineers.