Due to the large annual production of construction waste in China, the rapid changes in construction waste materials, and the need to quickly obtain high-precision 3D change information for construction waste, we have used a rapid monitoring method for construction waste accumulations, which uses unmanned aerial vehicle (UAV) photogrammetry to obtain a digital surface model (DSM) and a digital orthophoto map (DOM) of two study areas located in Pingdingshan City, China. Then, we built 3D models of waste accumulations in 2019 and 2020 for the two study areas. We also proposed a 3D change detection model combined with self-adaptive roughness quantification and supervised classification based on the elevation threshold to extract construction waste accumulations, and the extraction accuracies in 2019 and 2020 were 84.9 and 85.6%, respectively. Also, we used the adaptive threshold method and the discrete integral method to calculate the changes in areas and volumes of the accumulations. The calculation accuracy of the volume of construction waste reached 88%. This study provides a method for quickly obtaining 3D change information for construction waste accumulations.