This was a fun little project combining realtime AI generative images and a 2D fluid simulation with a touch screen.
Tapping and dragging on the touchscreen, using this point as the input to the fluid simulation. Then, feeding the resulting images to an image2image Stream-Diffusion image generator from Dotsimulate. A range of different prompts can be used to style the AI images.
The results feel like you are painting detailed themed images with your fingers in a fun and playful way.
Because I only had a touch screen on my laptop but the laptop didnt have a powerfull enough GPU to run the AI Stream-Diffusion, I had to use a remote desktop to connect the laptop touch input to my desktop which generated the images. It worked really well with minimal latency but would be even slicker using a touch screen connected directly to the desktop PC. This would work well in a table top interactive setup.
Project featured in Solarflare’s Launch https://solarflarestudio.co.uk/launch/ai-touch-painting-with-light-and-gesture/