Finding the right makeup color can be quite confusing when you buy cosmetic products. Many virtual makeup tools overlay effects on a phone screen, which makes experimenting easier but they often look artificial, and it can be overwhelming with hundreds of color choices.
The results also appear on a flat screen, which rarely matches how makeup actually looks on real skin under natural light. This is why researchers have developed a system that can project makeup directly onto your face just by describing the look you want.
Scientists at the Institute of Science Tokyo have created an experimental tech that uses artificial intelligence with projection mapping to simulate makeup on a real face.
Instead of physically applying cosmetics or relying on typical augmented reality filters, the system beams the makeup directly onto the user’s skin, allowing them to see how it would appear under real lighting.
AI translates moods into real makeup projections
The system works through what researchers call an impression guided text to makeup color model. Instead of choosing shades manually, you can simply describe the mood or vibe you are aiming for.
You can say “Sakura in spring,” “night rose,” or even “autumn forest with warm sunlight.” The AI interprets that description and generates a reference image that captures the vibe.
After that, it produces five suggested color palettes for key areas, including the cheeks, eyeshadow, and lips. The generated shades are refined using real cosmetic color distributions so they look more like real makeup.
Once the colors are created, a projection system displays the makeup directly on the user’s face. A high speed camera constantly tracks facial movement while motion detection helps the projection stay aligned with the eyes, lips, and cheeks.
Since the system adjusts in real time, the makeup stays locked in place even when the user turns their head or changes expressions.
That real time tracking is important because traditional virtual makeup filters can glitch or slide off the face when someone moves quickly. In this setup, the projection mapping keeps the design stable, allowing the simulated makeup to behave more like real cosmetics.
Potential real world uses for AI powered makeup projection
This technology opens up interesting possibilities beyond personal beauty experiments. Makeup artists could quickly test bold color combinations before applying real products.
Fashion designers could preview makeup concepts for runway shows. Beauty brands might even use similar systems in stores to help customers explore new looks without touching a single brush.
The researchers believe this technology could make experimenting with cosmetics easier while helping people discover makeup styles that better match their personal taste.