I have also thought about this, and whether I could live with myself after making a huge pile of money to relentlessly annoy every other human on Earth.
I conceived it as video bloggers setting up a dynamic replacement volume in their scenes, and compositing a 3-D scene for the sponsored product into it as the stream goes out. One viewer might see an open Coke bottle. Another might see a half-eaten package of Oreos. Another might see framed photographs of adoptable rescue pets. All the vlogger does is avoid entering the ad-volume and the software does the rest.
Inserting into old movies would require a bit more sophistication, I think. You have to discern the geometry of the scene, model it, then discover the insertable volumes, match the camera movement in software, and finally use a shader to match the object textures to the film grain.
> Inserting into old movies would require a bit more sophistication, I think. You have to discern the geometry of the scene, model it, then discover the insertable volumes, match the camera movement in software, and finally use a shader to match the object textures to the film grain.
Only if you're changing volume. We can start with swapping flat surfaces (say, cereal boxes).
A cereal box face is still two triangles (or a quad). It's simple geometry, but still geometry. If you can do two triangles, you could do 12. If you kept it simple, you could get away with image planes and occlusion masks, I guess.
I'm guessing this would dovetail nicely with up-converting 2-D movies to work with VR rigs. If you can reconstruct a scene well enough to fake some depth, it wouldn't be difficult to insert extra models into it.
The dystopic endgame would be to automatically generate the models from the 2-D video and randomly fill some of the volumes that don't interfere with the existing scene with advertising models.
I conceived it as video bloggers setting up a dynamic replacement volume in their scenes, and compositing a 3-D scene for the sponsored product into it as the stream goes out. One viewer might see an open Coke bottle. Another might see a half-eaten package of Oreos. Another might see framed photographs of adoptable rescue pets. All the vlogger does is avoid entering the ad-volume and the software does the rest.
Inserting into old movies would require a bit more sophistication, I think. You have to discern the geometry of the scene, model it, then discover the insertable volumes, match the camera movement in software, and finally use a shader to match the object textures to the film grain.
But let's not do this. Please.