An image analysis-based soft sensor is designed and applied to automatic quality classification of product appearance with color-textural characteristics. In this work, multiresolutional multivariate image analysis (MR-MIA) is used in order to analyze product images with color as well as texture. Fisher’s discriminant analysis (FDA) is also used as a supervised learning method for automatic classification. The use of FDA, one of latent variable methods, enables us not only to classify products appearance into distinct classes, but also to numerically and consistently estimate product appearance with continuous variations and to analyze characteristics of appearance. This approach is successfully applied to automatic quality classification of intermediate and final products in industrial manufacturing of engineered stone countertops.