The ability to precisely map urban land use types can significantly aid urban planning and urban system understanding. In recent years, remote sensing images and social sensing data have been frequently used for urban land use mapping. However, there still remains a problem: what is the best basic unit for fusing remote sensing images with social sensing data? The aim of this study is to explore the impact of spatial units on urban land use mapping, with remote sensing images and social sensing data of Shenzhen City, China. Three different basic units were first applied to delineate urban land use types, and for each unit, a word dictionary was built by fusing natural–physical features from high spatial resolution (HSR) remote sensing images and the socioeconomic semantic features from point of interest (POI) data. The latent Dirichlet allocation (LDA) algorithm and random forest methods were then applied to map the land use of the Futian district—the core region of Shenzhen. The experiment demonstrates that: (1) No matter what kind of spatial unit, it is beneficial to fuse multisource data to improve the performance. However, when using different spatial units, the importances of features are different. (2) Using block-based spatial units results in the final map looking the best. However, a great challenge of this approach is that the scale is too coarse to handle mixed functional areas. (3) Using grid- and object-based units, the problem of mixed functional areas can be better solved. Additionally, the object-based land use map looks better from our visual interpretation. Accordingly, the results of this study could give other researchers references and advice for future studies.