PhD Proposal: ML for Anime: Illustration, Animation, and 3D Characters
As anime-style content becomes more popular on the global stage, we ask whether new vision/graphics techniques could contribute to the artform. However, the highly-expressive and non-photorealistic nature of anime poses additional challenges not addressed by standard ML models, and much of the existing work in the domain does not align with real artist workflows. In this preliminary exam, we will present several works building foundational 2D/3D infrastructure for ML in anime, including pose estimation, video frame interpolation, and 3D character reconstruction. In addition, we will outline ongoing/future projects designing targeted interactive tools for 2D animators.
Dr. Matthias Zwicker
Dr. Leo Zhicheng Liu
Dr. Abhinav Shrivastava