In recent years, deep learning, which is widely used in machine learning and computer vision, offers many new solutions, especially for agricultural problems. In this study, an approach based on the combination of Convolutional Neural Networks (CNN) and Color-Local Binary Pattern (C-LBP) method is recommended for the determination of plant species. Deep features have been obtained from the fc6 layer of the AlexNet model, a pre-trained ESA architecture. Then, LBP method is applied to each channel of color images (R, G, B). Finally, the deep features and LBP features from each color channel were combined and classified by Support Vector Machine (SVM). To test the accuracy of the proposed approach, ICL and Folio leaf data sets commonly used in the literature have been used. According to this results, accuracy rates of 98.50% and 99.48% were calculated for ICL and Folio data sets, respectively. The experimental results indicate that the proposed model achieves better accuracy compared to previous studies.