This research develops a palm kernel origin classification model by combining thermal images and numerical agricultural data using MobileNet architecture. The quality of palm kernels is highly influenced by origin and environmental conditions, but manual visual identification is difficult. Therefore, a machine learning-based approach is applied to improve classification accuracy. The dataset consists of 7.257 thermal images representing 73 seed origin classes, as well as supporting data in the form of soil, fruit, and socioeconomic information collected from plantations in Aceh, Indonesia. The MobileNet model was tested in two scenarios: using only thermal images, as well as a combination of thermal images with agricultural data. Results show that data integration provides significant performance improvement. The best model was obtained from MobileNet V3-Large with the optimal hyperparameter configuration (batch size 16, learning rate 0.001, and optimizer Adam), resulting in test accuracy of 99.04%, validation 97.25%, and training 98.77%. This finding opens up opportunities for the application of real-time classification technology in the plantation environment, especially to support precision and sustainable agriculture.