Apple won 63 Patents yesterday that covered a Series of Augmented Reality Systems and more – Patently Apple
The U.S. Patent and Trademark Office officially published a series of 63 newly granted patents for Apple Inc. yesterday. In this particular report we briefly cover a series of four patents relating to Augmented Reality. And as always, we wrap up this week’s granted patent report w…….
The U.S. Patent and Trademark Office officially published a series of 63 newly granted patents for Apple Inc. yesterday. In this particular report we briefly cover a series of four patents relating to Augmented Reality. And as always, we wrap up this week’s granted patent report with our traditional listing of the remaining granted patents that were issued to Apple yesterday.
Method and System for representing a Virtual Object in a view of a Real Environment
Yesterday, the U.S. Patent Office granted Apple patent 11,182,961 which covers a method and system of representing a virtual object in a view of a real environment is provided which includes providing image information of a first image of at least part of a human face captured by a camera, providing at least one human face specific characteristic, determining an image area of the face in the first image as a face region, determining at least one first light falling on the face according to the face region and the at least one human face specific characteristic, and blending in the virtual object on a display device in the view of the real environment according to at least one first light.
The method further includes providing a plurality of face sample positions, providing for each of the plurality of face sample positions a radiance transfer function, determining image positions of the face sample positions in the first image, and determining a first light according to intensity information associated with the image positions of the face sample positions in the first image and the radiance transfer functions associated with the face sample positions in the first image.
Apple’s patent FIG. 1 below illustrates a method of capturing a user’s face in an image, and a general set-up; FIG. 4 shows a differential rendering step.
More specifically, Apple’s patent FIG. 4 above illustrates a differential rendering step that can be used for blending in a virtual object on a display device in a view of the real environment according to the at least one first light determined in the illumination estimation step.
Based on a proxy object #401 which substitutes the 3D geometry and material part of the real-world scene that is influenced by the addition of the virtual content, two global illumination solutions are rendered. The first one is an image (#403) of the proxy object (#401) alone under the estimated lighting conditions (#402) of the real world.
The second one is an image #404 of the proxy object under the estimated lighting conditions #402 …….
