Votes
0
Product:
iClone 8
Version:
8.12
Status:
Active
Issue 9168
Auto Detect Light angle from video backgrounds to add matching shadows and lights into scenes -Alternate AI Enhanced Match Moving
It often takes a lot of skill to replicate scene lighting for Characters and or landscapes and we are currently only have hardware intensive IBL to work with. This method is an alternative to existing match moving procedure -instead of only having match moving applied to a camera whereas the camera angles and lighting have to be tracked, a more automated process maybe done in less time within iC8

1. Creation of Lights, color, brightness and direction are created via detection within video and are locked to the pixels in the video of the lights.

2. Humans are detected in the video and can apply selected Transforms to a selected Character (Humans could be erased from the footage from either software Davinci Resolve or AI background replacement from a couple frames such as discussed from the two minute papers video https://youtu.be/aQctoORQwLE?t=64 - once the human is detected, it could select frames without the human to rebuild and replace the video background so an iC8 character should blend seamlessly with proper lighting etc.

This method could be the fastest and picture perfect method to do match moving work.

Feature requirements:
Two different AI components (Human & light source) and one pixel tracking and 3D translation would be required.
This alternate matchmoving with elements repositioned such as character, lights, landscape & props could be automatically added to it's own animation layer so users can go back to a normal view if they need to add more animation etc.
OS: Windows 10
  •  0
  •  262
Submitted byAscensi
COMMENTS (0)