CAD systems play an essential role in product concept design and color planning. The representations produced in computer-based color simulations are generated mainly using the CIE color system. Accordingly, this study uses color harmony theory and gray theory to develop a quantitative aesthetic measurement and linguistic evaluation method based on the primary colors, i.e. R (Red), G (green), B (Blue), for the CIE color planning stage of product design. In an inverse process, genetic algorithms are applied to search for a near-optimal color combination which satisfies the designer’s required product-color linguistic image on a qualified aesthetic level. The automatic design system proposed in this study enables designers to rapidly simulate the designed colors of a product and then obtain its corresponding image evaluation, or to search for the ideal color combination which generates the required image perception.