Nowadays, herb plants are importance to medical field and can give benefit to human. In this research, Phyllanthus Elegans Wall (Asin-Asin Gajah) is used to analyse and to classify whether it is healthy or unhealthy leaf. This plant was chosen because its function can cure breast cancer. Therefore, there is a need for alternative cure for patient of breast cancer rather than use the technology such as Chemotherapy, surgery or use of medicine from hospital. The purpose of this research to identify the quality of leaf and using technology in agriculture field. The process to analysis the leaf quality start from image acquisition, image processing, and classification. For image processing method, the most important for this part is the segmentation using HSV to input RGB image for the color transformation structure. The analysis of leaf disease image is applied based on colour and shape. Finally, the classification method use feed-forward Neural Network, which uses Back-propagation algorithm. The result shows comparison between Multi-layer Perceptron (MLP) and Radial Basis Function (RBF) and comparison between MLP and RBF shown in percentage of accuracy. MLP and RBF is algorithm for Neural Network. Conclusively, classifier of Neural Network shows better performance and more accuracy.