Methods and systems for freeform irradiance tailoring for light fields

公开(公告)号:
US10837621B2
公开(公告)日:
2020-11-17
申请号:
US16/258091
申请日:
2019-01-25
授权日:
2020-11-17
受理局:
美国
专利类型:
授权发明
简单法律状态:
有效
法律状态/事件:
授权
IPC分类号:
F21V5/04 | F21V7/04
战略新兴产业分类:
电子核心产业
国民经济行业分类号:
C4350 | C3874 | C4090 | C3879
当前申请(专利权)人:
MITSUBISHI ELECTRIC RESEARCH LABORATORIES, INC.
原始申请(专利权)人:
MITSUBISHI ELECTRIC RESEARCH LABORATORIES, INC.
当前申请(专利权)人地址:
Cambridge, MA, US
工商统一社会信用代码:
-
工商登记状态:
-
工商注册地址:
-
工商成立日期:
1991-01-01
工商企业类型:
-
发明人:
BRAND, MATTHEW | BIRCH, DANIEL
代理机构:
-
代理人:
VINOKUR, GENNADIY | MCALEENAN, JAMES | TSUKAMOTO, HIRONORI
摘要:
Devices, systems and methods including an optic having an optical surface partitioned into a plurality of facets. Wherein a geometry of the plurality of facets are configured to rearrange the rays in an incident light field to form a desired irradiance pattern on a projection surface, partitioned into a plurality of pixels, each of which may receive light from a multiplicity of facets. Wherein the configured geometry of the plurality of facets is corrected to minimize a difference between an observed irradiance pattern and a desired irradiance pattern provided by a user.
技术问题语段:
The technical problem addressed in this patent text is the inability of conventional methods to design optics that can effectively transform the light from extended light sources (e.g., actual light emitting diodes) into highly detailed illumination patterns, such as graphics or signs, that meet the needs and requirements of today's illumination technologies. Most conventional methods rely on the mathematical fiction of an ideal light source and can only produce blurred patterns when used with real extended light sources. There is a need for an optic that can design a lens or mirror surface that rorganizes a field of light rays to project a highly structured pattern of light onto a surface.
技术功效语段:
The present patent describes a new method for designing optics that can create precise and detailed light patterns with high efficiency and clarity. The method uses a combination of mathematical calculations and experimentation to determine the shape and density of the optic's field local curvatures, which can then be corrected to match the desired illumination pattern. This allows for the creation of optics that can control the shape and density of the illumination pattern, resulting in higher clarity and efficiency compared to conventional methods. The optics can be used in various applications such as lighting and display technology.
权利要求:
1. An optic, comprising: an optical surface partitioned into a plurality of facets, wherein a geometry of the plurality of facets are configured to rearrange the rays of light in an incident light field to form a desired irradiance pattern on a projection surface, partitioned into a plurality of pixels, each of which may receive light from a multiplicity of facets, wherein the configured geometry of the plurality of facets is corrected to minimize a difference between an observed irradiance pattern and a desired irradiance pattern provided by a user, wherein an irradiance error is calculated as the subtractive difference between the observed irradiance pattern and the desired irradiance pattern, such that the irradiance error identifies a correction configuration to be applied to configuring an initial geometry of the plurality of facets, that results in the configured geometries of the plurality of facets better forming the target irradiance pattern. 2. The optic of claim 1, wherein the optical surface is one of refractive, reflective or having a varying refractive index. 3. The optic of claim 1, wherein the incident light field is identified as one of: directional radiant intensities that vary over a two dimensional (2D) surface, a list of light rays, a wavefront, a collection of mathematical radiance functions, or a plenoptic function. 4. The optic of claim 1, wherein the desired irradiance pattern is specified by intensity values in an image that has been mapped onto the projection surface. 5. The optic of claim 1, wherein the partitioning of the optical surface into the plurality of facets is determined by conceptually imposing a grid on the optical surface, such that each cell of the grid contains one facet and defines an aperture through which a unique subset of rays in the light field propagates to the projection surface. 6. The optic of claim 1, wherein the observed irradiance pattern is obtained by calculating, for each possible pairing of one optical surface facet and one projection surface pixel, the energy in the subset of the light field that irradiates the pixel through the facet, then, for each projection surface pixel, summing the energy that pixel receives through all facets. 7. The optic of claim 1, wherein the irradiance error is the result of a nonstationary convolution that mixes unwanted artifacts due to the light field and unwanted artifacts due to incorrect shaping of the optic, such that the shape errors can be isolated via deconvolution and then corrected. 8. The optic of claim 7, wherein a light field convolution operator is represented by a matrix containing paired facet-pixel irradiance energies, each scaled according to a geometry of a facet-pair path, and wherein an unknown optical surface shape error is represented by a vector of unknown curvature corrections, one for each facet, and a deconvolution is achieved by solving a system of linear equations for curvature-correction values that make a matrix-vector product most accurately reproduce the irradiance error, in a minimum squared error sense. 9. The optic of claim 8, wherein the curvature corrections are applied to the optical surface by solving a two-dimensional Poisson problem for field of height values whose local curvatures match the curvature correction values, then the height values are added to the field of height values that determine the shape of the optical surface. 10. The method of claim 8, wherein when a light source has near-zero étendue such that no two facets illuminate overlapping areas on the projection surface, the curvature corrections are calculated directly from the pixel irradiance errors. 11. The optic of claim 1, wherein the optical surface is part of an optical path that includes additional optical elements such as lenses, mirrors, and baffles, producing optical phenomena such as partial occlusion, internal reflection, and Fresnel losses, the effects of which are absorbed into the irradiance simulations. 12. The optic of claim 1, wherein the optic is made of one of a transparent optical polymer, a transparent glass or a specular reflecting material. 13. The optic of claim 1, wherein the optic is a freeform lens or mirror manufactured by one of molding, milling, lathing, 3D printing, electroforming, stereolithography or mechanical forming. 14. The optic of claim 1, wherein the desired irradiance pattern reproduces any combination of a photograph, a picture, a drawing, a graphic, a sign or one or more symbols. 15. The optic of claim 1, wherein the projection surface is partitioned into a plurality of non-overlapping equal-area pixels, and is one of an optical diffuser, a curved surface or the projection surface is a virtual surface in 3D space that is focused by subsequent optics in an optical path. 16. An optic, comprising: an optical surface partitioned into a plurality of facets, wherein the partitioning of the optical surface into the plurality of facets is determined by conceptually imposing a grid on the optical surface, such that each cell of the grid contains one facet and defines an aperture through which a unique subset of rays in the light field propagates to a projection surface, and the projection surface is partitioned into a plurality of non-overlapping equal-area pixels, and wherein a geometry of the plurality of facets are configured to rearrange the rays of light in an incident light field to form a desired irradiance pattern on the projection surface, partitioned into the plurality of non-overlapping equal-area pixels, each of which may receive light from a multiplicity of facets, such that the configured geometry of the plurality of facets is corrected to minimize a difference between an observed irradiance pattern and a desired irradiance pattern provided by a user, and that the desired irradiance pattern is specified by intensity values in an image that has been mapped onto the projection surface, wherein an irradiance error is calculated as the subtractive difference between the observed irradiance pattern and the desired irradiance pattern, such that the irradiance error identifies a correction configuration to be applied to configuring an initial geometry of the plurality of facets, that results in the configured geometries of the plurality of facets better forming the target irradiance pattern. 17. A method of forming an optic device, comprising: providing an optical surface having a plurality of facets with an initial geometry; using a processor in communication with a memory, the processor is configured for determining a refraction or reflection of incident illumination from an incident light field through the plurality of facets with the initial geometry to create an observed irradiance pattern on a specified projection surface; determining a shape of each facet of the plurality of facets that results in producing a target irradiance pattern on the specified projection surface correcting a difference between the observed irradiance pattern and a desired irradiance pattern provided by a user; using an output interface connected to the processor to send data to a controller; using an input interface of the controller to receive the data, wherein the controller is connected to a device, and sends the data via a transceiver to the device, such that the device is configured to change surfaces of optic surfaces; receiving the data by the device, wherein the data includes the determine shape of each facet of the plurality of facets that results in producing the target irradiance pattern on the specified projection surface matching a desired irradiance pattern.
技术领域:
[0001]The present disclosure relates generally to optics, and more specifically to optics having a freeform optical surface transforming incident light to produce an illumination pattern.
背景技术:
[0002]The state of the art of conventional methods for designing freeform illumination optics can be divided into those that rely on the mathematical fiction of an ideal light source (i.e., a zero-étendue beam from a hypothetical point source, usually located infinitely far away to provide collimation) and those for extended light sources (e.g., positive-étendue beams from actual extended light sources, usually light emitting diodes located nearby). [0003]Some conventional methods for freeform design for ideal light sources include ray mapping, Monge-Ampere solutions, and a Supporting Quadric Method. In principle, optics designed via these methods can convert unstructured idealized beams into highly detailed illumination patterns on a projection surface. Such patterns are called “irradiance images,” and can in principle surpass photographs in detail, tonal grading, and contrast. However, when optics designed via these conventional methods and similar methods are used with real extended light sources, they produce blurry illumination patterns. Generally, these blurred patterns do not meet the needs and requirements of today's illumination technologies. [0004]Some conventional methods for non-ideal (extended) light sources include simultaneous multiple surfaces in their three-dimensional version (SMS3D), optimization-based design, and feedback design. SMS3D requires at least two optical surfaces to create a desired illumination pattern, and while SMS3D provides limited control of the illumination boundary, it does not provide control of the illumination density inside the boundary. Further, neither optimization-based design methods nor feedback design methods are able to produce detailed illumination patterns, such as letters and graphics, from extended light sources. These conventional methods were developed for and are used for producing simple illumination patches, e.g., uniformly illuminated disks or rectangles, typically with blurry edges. Further, most of these conventional methods assume a single square or disk-shaped light source, and do not generalize to other shapes, such as notched LED dies, or to multiple light sources. [0005]More generally, none of these conventional methods can handle light fields. [0006]Accordingly, there is need for an optic that can transform incident light from the spatially extended light source or light field by designing a lens or mirror surface that reorganizes a field of light rays to project a highly structured pattern of light onto a surface, such as a graphic or a sign.
发明内容:
[0007]The present disclosure relates generally to optics, and more specifically to optics having an optical surface or a freeform optical surface, transforming incident light to produce an illumination pattern. [0008]Aspects of the present disclosure address solving the conventional problems of tailoring an optical surface to form a prescribed target irradiance pattern from an incident light field, by exploiting an exchangeability relationship between optical surfaces and wavefronts. The intensity of light on the projection surface is determined in a complementary manner by the local curvatures of the optical surface and of the wavefront. Wherein the present disclosure exploits this relationship to isolate local corrections to the optical surface from global errors in the wavefront. Based on experimentation, the present disclosure overcomes the conventional problems of unacceptable blurry target irradiance patterns from poorly tailored optical surfaces, to produce acceptable un-blurred illumination patterns. [0009]Some embodiments of the present disclosure use a surface-correcting algorithm that accommodates a base surface, any twice-differentiable incident wavefront, and a projection surface that can be flat or curved or even discontinuous. Wherein a base surface is an initial surface that will be minimally altered to attain the desired illumination pattern; and a twice-differentiable incident wavefront is the frontier of light emanating from the source, considered at the instant when it reaches the freeform surface, wherein the frontier is itself considered as a surface that has finite local slope and curvature. During experimentation, the surface-correcting method was found to design optical surfaces that transform source radiance fields into target illumination fields with high fidelity and contrast ratios. Wherein the source radiance field is the spatial pattern of light intensity associated with the incident wavefront; and a target illumination field is the pattern of light desired on the projection surface(s). [0010]By exchanging the roles of the source and the target fields, a generalized tailoring algorithm can be obtained that accommodates arbitrary incident light fields, including multiple and/or extended light source(s). In this exchange, the physics of the system is simulated backward, with points on the projection surface emitting fictive spherical wavefronts that propagate backwards thought the freeform optic to the actual extended light source, where the amount of fictive light emitted backwards is compared with the amount of real light emitted forwards in the opposite direction. From many such comparisons it is determined what regions of the freeform optical surface are to be modified and by how much. [0011]Some embodiments of the present disclosure include the design of lens or mirror surface that reorganizes a field of light rays to project a highly structured pattern of light onto a surface, e.g., a photograph or a sign. Most conventional prior art methods assume that the light rays are all emitted from an infinitesimal point. Some conventional prior art methods assume that the rays are emitted from a disc or square, and that if the edge rays are controlled, the rest of the light will do something reasonable, because all remaining rays will strike the projection surface somewhere between the edge rays. However, aspects of the present disclosure through experimentation, had the realization that these unrealistic assumptions by these conventional methods lead to physical illumination systems with low efficiency and poor rendering of the desired illumination pattern. Poor rendering is obtained when the extended light source is close to the freeform, because proximity of the source ensures that a wide cone of light passes through each point on the optical surface, producing significant blurring on the projection surface. Low efficiency is obtained when the light source is not close to the optical surface, because most of the emitted light entirely misses the optical surface. [0012]Another realization of the present disclosure, is that after using fictive reverse wavefronts to tabulate fluxes from the light field to individual points on the projection surface, illumination errors due to defects in the shape of the optical surface can be teased apart from illumination errors due to the blurring effect of the light source, yielding corrections to the optical surface's field local curvatures. Each observed flux measures the amount of light energy emitted from the light field and redirected by a small patch of the optical surface to strike a small patch of the projection surface. If we measure fluxes for a suitable set of patch-pairs on the two surfaces, the measurements can be rearranged into a set of linear equations whose solution indicates how local curvatures of the optical surface should be corrected. Upon further experimentation, aspects of the present disclosure later realized that this provides for high efficiency and high rendering clarity, among other benefits. [0013]In other words, the problem of freeform illumination design, in its broadest form, is to make an optic that converts a field of light rays into an illumination pattern on some surface or surfaces. The forward problem, i.e. simulation, is well understood. For example, a unique bundle of light rays strikes each point on the optical surface, the optical surface uniquely alters each bundle, and the superposition of all the altered bundles at a projection surface yields an illumination pattern. Mathematically, this is a non-stationary convolution. However, the inverse problem, i.e. design, is not well understood. Mathematically, there is not enough information to deconvolve (tease apart) the contributions of the optical surface and the incident light field, nor to determine improvements to the optical surface from the deconvolution, were it available. In short, the problem is ill-posed. In other words, if some part of the projected pattern is wrong, it was not known what part of the optical surface should be modified, or how. [0014]To get around this problem, most conventional freeform design methods rely on the fiction that each point on the optical surface controls only one ray of light; equivalently, that the incident wavefront has zero étendue (entropy). In principle, such conventional methods offer total control over the illumination pattern, but naturally does not allow point light sources. In practice, these conventional methods are demonstrated with low-étendue beams obtained by filtering light through a very small aperture, resulting in extremely low efficiencies. Thus, these types of conventional methods were not further pursued. [0015]Some conventional design methods rely on two less egregious fictions, i.e. that each point on the optical surface controls a simple cone of rays, and that if the rays at the edge of the cone are properly managed, the interior rays will do something reasonable. According to this conventional thinking, these edge rays are presumed to come from the borders of extended light source of simple convex shape, e.g., a square light-emitting diode. Such conventional methods offer far less control over the illumination pattern. Realistic conventional lighting systems are often unkind to these two fictions, for example, the incident light cones may have no clear boundaries; the energy density inside the cones may be significantly variable; there may be more than one light source, also the light may be collected by reflectors before being passed to the optic. In practice, such conventional systems demonstrate poor control of the illumination pattern and/or low efficiencies. Thus, these types of conventional methods were also not further pursued. [0016]However, according to some embodiments of the present disclosure, at least one key insight or realization, among many, is that: (1) one can obtain a correction to the optical surface by performing a deconvolution in the curvature domain instead of the energy domain, and (2) the well-understood simulation procedure, applied backwards, produces enough information to make the curvature deconvolution well posed. Wherein the curvature domain is space of possible fields of local surface curvature, the energy domain is the space of possible fields of flux densities, and a field is an assignment of quantities to each point in a mathematical space. [0017]The correction process, according to the present disclosure, can be iterated to design a freeform lens or mirror that transforms an arbitrarily complicated light field into a highly structured illumination image. Wherein an arbitrarily complicated light field can be any specification of the intensity of light that depends only on 3D position and direction. As much as is physically possible, this optic according to the present disclosure can control both a shape and density of the illumination pattern. Wherein the shape is the boundary of the illuminated area and the density is the intensity of light incident on any point inside the boundary. In practice, the methods and systems according to the present disclosure provide freeform illumination systems that project detailed light patterns with much higher clarity and efficiency than the current state of the art of conventional methods. The higher clarity of the present disclosure can be obtained because it makes no false assumptions about the structure of the incident light (as assumed by conventional methods) nor does it depend on paraxial approximations (also assumed by conventional methods). Consequently, the present disclosure can design optical surfaces for very short optical paths where the light source is very close to the freeform, yielding high efficiencies. Further efficiencies can be obtained by placing ancillary optics before and after the freeform, to collect and direct more light than allowed by the fictive frameworks; among other aspects, the present disclosure can compensate for the effects of these ancillary optics. [0018]Aspects of the present disclosure includes methods and systems for an optic having a freeform optical surface that transforms incident light emitted by a positive-étendue light source to form a prescribed illumination pattern, wherein the freeform optical surface is shaped by surface corrections that remedy defects in the curvature of the wavefront. Other aspects of the present disclosure include fabricating an optic, wherein a freeform optical surface of the optic transforms incident light into an illumination pattern. To create a desired illumination pattern, some embodiments of the present disclosure only require a single optical surface whereas, conventional methods, such as SMS3D requires at least two optical surfaces to create a desired illumination pattern. Also noted, is that SMS3D does not provide control of the illumination density along with very limited control of illumination boundary (i.e. to a degree that does not meet the standards of the present disclosure), whereas some embodiments of the present disclosure provide complete control of both, i.e. control of the illumination density and control of illumination boundary, insofar as the laws of physics allow. [0019]According to an embodiment of the present disclosure, an optic, including an optical surface partitioned into a plurality of facets. Wherein a geometry of the plurality of facets are configured to rearrange the rays in an incident light field to form a desired irradiance pattern on a projection surface, partitioned into a plurality of pixels, each of which may receive light from a multiplicity of facets. Wherein the configured geometry of the plurality of facets is corrected to minimize a difference between an observed irradiance pattern and a desired irradiance pattern provided by a user. [0020]According to an embodiment of the present disclosure, a method of forming an optic device, including providing an optical surface having a plurality of facets with an initial geometry. Using a processor in communication with a memory/The processor is configured for determining a refraction or reflection of incident illumination from an incident light field through the plurality of facets with the initial geometry to create an observed irradiance pattern on a specified projection surface. Determining a shape of each facet of the plurality of facets that results in producing a target irradiance pattern on the specified projection surface correcting a difference between the observed irradiance pattern and a desired irradiance pattern provided by a user. [0021]According to an embodiment of the present disclosure, an optic, including an optical surface partitioned into a plurality of facets. Wherein the partitioning of the optical surface into the plurality of facets is determined by conceptually imposing a grid on the optical surface. Such that each cell of the grid contains one facet and defines an aperture through which a unique subset of rays in the light field propagates to a projection surface, and the projection surface is partitioned into a plurality of non-overlapping equal-area pixels. Wherein a geometry of the plurality of facets are configured to rearrange the rays in an incident light field to form a desired irradiance pattern on the projection surface, partitioned into the plurality of non-overlapping equal-area pixels, each of which may receive light from a multiplicity of facets. Such that the configured geometry of the plurality of facets is corrected to minimize a difference between an observed irradiance pattern and a desired irradiance pattern provided by a user, and that the desired irradiance pattern is specified by intensity values in an image that has been mapped onto the projection surface.
具体实施方式:
[0034]While the above-identified drawings set forth presently disclosed embodiments, other embodiments are also contemplated, as noted in the discussion. This disclosure presents illustrative embodiments by way of representation and not limitation. Numerous other modifications and embodiments can be devised by those skilled in the art which fall within the scope and spirit of the principles of the presently disclosed embodiments. DETAILED DESCRIPTION [0035]FIG. 1A is a schematic diagram illustrating a large double LED (left) having subsets of an incident light field illuminating a geometry of a plurality of facets of an optical surface (middle) configured to convert the subsets of the incident light field to form a target irradiance pattern, cast on pixels of a specified projection surface, i.e. projection surface, according to embodiments of the present disclosure. [0036]Some embodiments of the present disclosure provide a general solution for the irradiance tailoring problem for a considerably wider range of sources, and demonstrate pictorial illumination with large extended light sources, steep slopes, and short focal length. In regard with a zeroétendue case, shown are corrections to the optical surface that can be determined directly from beam dilation errors, as revealed by comparing the target irradiance with an actual radiance or irradiance, when these fields are suitably unwarped to the optical surface. In practice, this reduces to a ray-trace and an FFT. [0037]Through experimentation, some processes then generalize to an arbitrary incident light field (plenoptic function). This includes multiple extended light sources of arbitrary shape and directionality. At least one historical difficulty is that irradiance is a nonstationary convolution of the light field and the optical surface ray-mapping function. At least one realization gained is that by exchanging the roles of the radiant and irradiant surfaces, the problem can be decomposed into a superposition of spherical wavefronts, such that the freeform's curvature errors can be isolated by solving a sparse system of linear equations. Where étendue or optical path physics do not allow an exact solution, the method of the present disclosure can approximate the target irradiance. At least one resulting method of some embodiments of the present disclosure can be simple, fast, and versatile accommodating nontrivial wavefronts, optical paths, and transport phenomena, over conventional methods that are more complicated, and take more computational costs & time. Specifically, the methods of the present disclosure when compared to conventional methods, provide less computational time and expense by having simple, fast, and versatile approaches that can accommodate nontrivial wavefronts, optical paths, and transport phenomena, i.e. very complicated problems. Other advantages over the conventional methods is that the embodiments of the present disclosure provide a design of highly efficient and compact freeform illumination systems, with unprecedented control over the projected irradiance pattern. [0038]Some embodiments of the present disclosure generally relate to a transparent or reflective surface (such as a milled acrylic or aluminum, respectively) that projects a desired image when illuminated, as well as to techniques for designing such a surface. For example, aspects of the present disclosure provide an optical surface configuration that is partitioned, for the purposes of design and manufacture, into a plurality of patches regarded as facets. Each facet has a local curvature, such that the optical surface composed of said facets is smooth but has spatially varying curvature. For purposes of design, the projection surface is also partitioned into patches regarded as pixels, and the desired irradiance pattern is specified as an image composed of per-pixel intensity values. Each possible pairing of facet and pixel is associated with a subset of the incident light field that propagates through the facet and reaches the pixel. Collectively, the determined geometry of the plurality of facets are configured to combine subsets of an incident light field to form a target irradiance pattern on a specified projection surface. Specifically, the local curvatures of the plurality of facets are adjusted to form an irradiance pattern on the projection surface that matches a desired irradiance pattern provided by a user. In most instances, any two nearby facets chosen from the plurality of facets will illuminate overlapping regions on the projection surface, due to the étendue of the light field. This provides an advantage over prior art in which it is assumed that no two facets of the plurality of facets can illuminate overlapping regions on the projection surface, because that assumption is satisfied only in very inefficient optical paths where the light source is extremely small or very far away from the freeform optic. Contemplated is at least one embodiment having the plurality of facets on the transparent or reflective surface, i.e. optical surface, arranged as a substantially continuous surface created by machining or molding an optical materiel, i.e., optical plastics, glasses, or metals. [0039]Some embodiments of the present disclosure provide techniques for designing and manufacturing an optical surface that produces a geometry of the plurality of facets, configured to convert an incident light field to form a target irradiance pattern, such that each facet is associated with a corresponding subset of the incident light field and a corresponding region on the specified projection surface. Wherein this allows the optical surface to be designed and manufactured to cast a custom image, i.e. target irradiance pattern, on a specified projection surface, when lit by an incident light field. [0040]FIG. 1A is a schematic diagram showing a light field represented as a radiant surface (11) that emits different amounts of light in different directions from different points (1). A subset (3AA) of the rays in that light field passes through a facet (5AA) of the freeform surface (13AA). This subset of rays is bent and concentrated or dilated by the freeform surface, then continues to propagate (7AA) to the projection surface (15) where it irradiates an area (9AA). The present disclosure adjusts the shape of the freeform surface (13AA) so that the total irradiance on the projection surface, summed over all ray subsets and facets, best reproduces the distribution of intensities associated with the pixel values of the desired irradiance image (17AA), here shown schematically superimposed on the projection surface. [0041]According to some embodiments of the present disclosure, at least one key insight or realization, among many, is that, one can obtain a correction to the optical surface by solving a linear deconvolution problem in the curvature domain instead of attempting to solve a non-stationary deblurring problem in the energy domain, and the well-understood ray-tracing process produces enough information to make the curvature deconvolution problem well-posed. The main difficulty is that if a freeform optic projects an irradiance image that deviates from the desired irradiance image, defects in the projected image are due to a complicated mix of the étendue of the light field and incorrect geometry of the optical surface, and it was not known how to isolate the effect of incorrect geometry and correct it. In particular, any region on the projection surface can be illuminated through many facets on the freeform surface, consequently, if said region receives too much or too little light, it was unknown how to determine which facets are at fault, in what proportion, and how to correct them. In prior art, there have been attempts to approximately separate the effects of optical surface geometry from the effects of a single extended light source's étendue by treating their admixture as a deblurring problem, with limited success that depended on the light source being relatively small, simple in shape, and far from the freeform optic. In the present disclosure, provides for determining defects in the projected irradiance image are related to flaws in the local curvatures of the optical surface through a system of linear equations; solution of this system of equations is a well-posed deconvolution in the space of curvatures. The solution yields an accurate correction that works for complicated light sources with significant étendue that are large and close to the freeform optic. This is advantageous because it enables the design of highly efficient and compact freeform illumination systems, with unprecedented control over the projected irradiance pattern. [0042]FIG. 1B is a schematic diagram illustrating a radiant surface (11) that simulates a large double-width LED (1) that radiates in all directions, but with varying intensity. A subset of the emitted rays (3BB) refracts through a facet (5BB) of a freeform optical surface (13BB) and continues to propagate (7BB) to a projection surface (15) where it contributes to the total irradiance (17BB) on that surface. The pattern of total irradiance (17BB) approximates the target irradiance image (17AA in FIG. 1A) as closely as physical law allows. [0043]FIG. 1C is a schematic diagram illustrating a point (5CC) on the optical surface (31K) that receives and modifies a bundle of rays (31A-J) from a radiant surface (31L) and distributes the modified bundle of rays (71A-J) to a projection surface (71K), according to embodiments of the present disclosure. In some embodiments, the intensity of each ray (31A-J) depends uniquely on the location and direction it is emitted from the radiant surface (31L) and the modification depends uniquely on the location and slope of the optical surface point (5CC). [0044]FIG. 1D is a block diagram (100A) of flow steps of a method forming an optic device, according to some embodiments of the present disclosure. The design problem is specified (110) as an initial optical surface, a projection surface, a light field, and a target irradiance pattern on the projection surface. A sequence (115) of corrections is made to the optical surface, first by simulating the irradiance pattern (120) delivered to the projection surface from the light field by the optical surface, then determining a set of corrections (125) to the local curvatures of the optical surface that reduce unwanted differences between the simulated and desired irradiance patterns. These two steps are repeated until the simulated irradiance pattern is satisfactory or no further improvements are possible, at which point the corrected shape of the optical surface is transmitted (130) to a machine that fabricates an optic with the same geometry (e.g., an optical lathe or 3D printer) or reproduces its optical effect diffractively (e.g., a diffractive optical element or spatial light modulator). [0045]FIG. 1E is a schematic illustrating a computing apparatus that can be used to implement some techniques of the methods and systems, according to embodiments of the present disclosure. For example, the computing system 40 can be configured to develop an optical surface having a plurality of facets, wherein a geometry of the plurality of facets are configured to convert patches of an incident light field to form a target irradiance pattern focused along surfaces of the plurality of facets, cast on pixels of a specified projection surface. Wherein each facet is associated with a corresponding patch of the incident light field and a corresponding pixel of the specified projection surface. Specifically, each facet geometry is configured to form the target irradiance pattern that matches a difference between an observed irradiance pattern and a desired irradiance pattern provided by a user. The computing system 40 can include, by-non-limiting example, a central processing unit (CPU) 41, a network interface 26, an interconnect 44, a memory 50, and storage 60. The computing system 40 may also include input/output devices 70, such that connecting the input/output devices may include a keyboard, a display and mouse devices, etc., by non-limiting example) to the computing system 40. [0046]The CPU 41 can retrieve and execute programming instructions stored in the memory 50. Similarly, the CPU 41 can store and retrieve application data located in the memory 50. The interconnect 44 can facilitate transmission, such as of programming instructions and application data, between the CPU 40, I input/output devices 70, storage 60, network interface 26, and memory 50. CPU 41 is being a single CPU (with one or more processors) or include multiple CPUs (with one or more processors). The memory 50 can include a Facet Surface Design Component 52. The storage 60 can include a desired irradiance Pattern 61 and Processing Material plan or milling plan 62. For example, the Facet Identifying Component 51 can be a data structure that records the shape of the optical surface, then in the algorithm, can provide a grid of elevation values, like in a topo map. [0047]In some embodiments, the Facet Identifying Component 51 can provide a software component configured to identify each facet of the plurality of facets of the optical surface, and provide its local elevation, slope, and curvature. The Facet Surface Design Component 52 uses an algorithm to derive each facet surface for plurality of facets of the optical surface. Once the facet surfaces have been determined, the Facet Surface Design Component 52 may be configured to generate a fabrication plan that can be stored in the storage 60, which can be used to physically realize/process each facet surface so that the entire optic will produce the target irradiance pattern on the specified projection surface when illuminated by the specified light field. [0048]The computer system 40 can include a network 21 connected to a data communications network 24, user computer 25, data sources 22 and exterior data storage 23, wherein the network 21 is connected to the network interface 26. [0049]FIG. 2A is a flow diagram for the tailoring process according to embodiments of the present disclosure. The process begins with an initial surface 205 that is chosen by the user. Light propagation is simulated 215 as follows: For each facet on the optical surface and pixel on the projection surface, the computer calculates the total flux from the light field that propagates through the facet and reaches the pixel. Wherein this flux is the cumulative light energy associated with all rays from the light field that are incident both on the facet and on the pixel. Flux calculations may be done via exact integration of equation 9 (see FIGS. 3A-3F in the section titled “With light fields, including extended light sources”, below), or via well-understood approximations such the camera equation of geometric optics, Monte Carlo simulation in a ray-tracer, or the ray-casting method of computer graphics. The irradiance pattern 17BB provided by the optical surface is determined 225 by summing all fluxes incident on a pixel from all facets to obtain a total irradiant intensity for that pixel as per equation 9 or equation 10 (see FIGS. 3A-3F in the section titled “With light fields, including extended light sources”, below); this is repeated for each pixel. The simulated irradiance pattern is subtracted from 235, the desired irradiance pattern, and if, the resulting irradiance error is within a satisfactory range, i.e. YES, then the process terminates 245. Otherwise, i.e. NO, a system of linear equations is constructed 255 in which the fluxes are scaled as per equation 11 (see FIGS. 3A-3F in the section titled “With light fields, including extended light sources”, below), and arranged in a matrix as per equation 12 (see FIGS. 3A-3F in the section titled “With light fields, including extended light sources”, below), with each row containing fluxes incident on a specific pixel and each column containing fluxes incident on a specific facet; the irradiance error is similarly arranged in a vector. This system of linear equations relates pixel irradiance errors on the projection surface to facet curvature errors on the optical surface. The system of equations is solved 265 in a minimum squared error sense using standard numerical methods, yielding a vector of curvature correction values, one of each facet. These values are arranged in a matrix to form a two-dimensional Poisson problem, which is solved 275 using standard numerical methods, yielding an array of height corrections for the optical surface. The corrections are added 285 to the height values that specify the optical surface shape, and the entire process repeats with a new flux simulation 215. [0050]FIG. 2B is a flow diagram illustrating an algorithm for implementing the method of FIG. 2A for optical systems that have near-zero étendue, according to embodiments of the present disclosure. The process begins with an initial surface 210 that is chosen by the user. Light propagation is simulated 220 as follows: A ray from the light source is propagated through each facet, where its intensity is diluted or concentrated by the curvature of the facet, and then on to the projection surface. The simulated irradiance pattern is subtracted 230 from the desired irradiance pattern, and if, the resulting irradiance error is within a satisfactory range, i.e. YES, then the process terminates 240. Otherwise a Poisson problem is constructed 250 by scaling the irradiance errors as per equation 8 (see section titled “Via Poisson corrections”, below). The Poisson problem is solved 260 using standard numerical methods, yielding an array of height corrections for the optical surface. The corrections are added 270 to the height values that specify the optical surface shape, and the entire process repeats with a new flux simulation 220. [0051]FIG. 2C illustrates aspects of examples of the algorithm (model) for implementing methods of FIG. 2A and FIG. 2B, according to some embodiments of the present disclosure. Initially, FIG. 2C relates surface curvature to dilations, where a wavefront w (white isocontours 268A, 268B, 268C) of local average intensity s bends through a surface area element dA (grid square 269A) on surface z 269A, and the ray bundle dilates (dotted lines 271A, 271B, 271C, 271D, 271E) to irradiate a (white) quadrilateral dB 273 on the projection surface 272A with average intensity u. The dilation, obtained by comparing the diagonals (solid black arrows 273A &273B, 274A &274B) of two parallel cuts through the ray bundle (dashed quadrilaterals 269B, 272B), relates the flux density dilution s/u to the Laplacians of the surface z and wavefront w via eq. (4). Givens of Model [0052]Still regarding FIG. 2C, most quantities are interchangeably treated as points, fields, or functions, e.g., n can represent a scalar refractive index, a gradient index field, or a differentiable function n(x, y, z). All varieties are tabulated in Table 1. [0053]TABLE 1SymbolMeaningcOptical surface correctiondALens elementdBProjection plane element, (G = 0)dBpRadiant area element, (G > 0)dTProjection plane element, (G > 0)GÉtendueI, IpTarget irradianceÎoActual irradiance at p, (G > 0)e, epRadiancenRefractive index ratioo, opObliquitypTest point locationr, rpz-component of displacementsIncident intensity at zs−Flux density at zuTarget unwarped irradianceu−Actual unwarped irradianceWWavefront functionwLocal wavefront isosurfacezOptical surface height fieldθA, θA, pAngle of incidence at zθBAngle of incidence at dBθB, pAngle of exitance at dBpθQRay angle to the z-axis [0054]Given a base surface described as a height field z:(x,y) and a target irradiance unwarp function u:(x,y)+∪0 which simulates ray transport and then samples the intensity from the desired irradiance field at the point where a ray from optical surface point (x, y, z (x, y)) would meet the projection surface. This is known as the pullback of the irradiance to the coordinate system of the optical surface. For each ray the simulator also provides a z-axis-parallel propagation distance r:(x,y)+ from the optical surface to the projection surface and an obliquity angle θB:(x,y)∩(−π/2, π/2) between the ray and the projection surface normal at the ray terminus. On the radiant side, some embodiments assume a wavefront function W:(x,y)+ which provides the direction ∇W:(x,y,z)3 and divergence ∇2W:(x,y,z) of the incident rays at any surface point (x, y, z (x, y)). For notational convenience, w:(x,y) can be defined as the isosurface of W in the neighborhood of (x, y, z (x, y)). Finally, an incident flux density ś:(x,y)+ can be assumed at any optical surface point (x, y, z (x, y)), or equivalently, a surface irradiant intensity s=s− cos θA where θA:(x,y)∩(−π/2, π/2) is the angle of the incident ray with the z-axis. The incident wavefront w plays a role in derivations but is cancelled out in the solutions, so it need not be mathematically characterized for the reduction to practice. Transport from Surface Gradients [0055]Still regarding FIG. 2C, a simple geometric fact governing ray propagation at an interface between two homogeneous media: The interface normal n satisfies [0056]n∝n⁢riri-rere,(Eq.<mspace width="0.8em" height="0.8ex"/>⁢1) where ri∈3 is the incident ray, ri∈3 is the extent ray, nni/ne is the ratio of refractive indices on either side of the interface (n=−1 for mirrors), and ∥·∥ is the Euclidean norm. [0057]In the model, the surface normal is n=(−∇z, 1)=(−∂x z, −∂y z, 1), the incident direction is n=(−∇z, 1)=(−∂xz, −∂yz, 1), the incident direction is ri=∇W∝sign(n)(−∇w, 1), and an exit ray rooted at interface point (x, y, z) meets the projection surface at ray terminus (x,y,x)+rre. Solving eq. (1) for the existent direction re and dropping the higher order terms, providing re≈nri+(1−n)n=((n−1)∇z−n∇w,1)  (Eq. 2) Dilations from Surface Laplacians [0058]Specifically, the bundle of rays that travel from area element dA on the optical surface to area element dB on the projection surface (FIG. 2C) is the interest. Conservation of energy requires identical flux totals through the two area elements: ∫s dA=∫u dB. In any area small enough that s and u are essentially constant, there is s dA=u dB, and therefore, to achieve a desired intensity dilution s u, we seek to control the local geometric dilation dB/dA. This can be reduced to plane geometry in a local Cartesian coordinate frame, where dAdx dy is a square area element with average incident intensity s and dB is a quadrilateral area with average irradiant intensity u: The area of quadrilateral dB is half the cross product of its vector diagonals, ½(d1×d2). These vectors are the change in the ray terminus as the ray root moves across the two diagonals of dA: specifically d1,d2≈dx(ex+r∂xre)∓dy(ey+r∂yre) where ex and ey are the unit vectors in the x- and y-directions. It is more convenient to calculate the area dQ of a quadrilateral formed by taking a constant-z cut through the bundle where it meets the projection surface, in which case the diagonals simplify to 2D vectors d1,d2≈dx(e1+r∂x∇q)∓dy(e2+r∂y∇q), with q=((n−1)z−nw) from eq. (2). For small dA, the two quadrilateral areas are related by dQ cos θQ=dB cos θB where θB (resp. θQ) is the angle between the local normal of the projection surface (resp. constant-z plane) and the central ray re of the bundle. Putting this all together yields dB cos θB=(1+r∇2q+r2((∂xxq)(∂yyq)−(∂xxq)2)cos θQdA).  (Eq. 3) [0059]If by assuming that the surface exhibits little curvature inside dA, then the coefficients to r2 in eq. (3) are negligible and the area dilation can be obtained [0060]dBdA=(1+r⁢∇2⁢((n-1)2⁢z-nw))⁢/⁢o,(Eq.<mspace width="0.8em" height="0.8ex"/>⁢4) where corrections for non-orthogonal projections are absorbed into the obliquity term o≈cos θB/cos θQ. [0061]Alternately, if by assuming that the quadrilateral dQ is approximately square, such that ∂xxq≈∂yyq and ∂xyq≈0, dB cos θB=(1+r∇2q+r2(∇2q)2/4)cos θQ dA, yielding [0062]dBdA=(1+r2⁢∇2⁢((n-1)⁢z-nw))2⁢/⁢o.(Eq.<mspace width="0.8em" height="0.8ex"/>⁢5) Tailoring As a Poisson Problem [0063]Combining dilation (4) or (5) with a pointwise conservation constraint s/u=dB/dA and isolating z reveals the Poisson problem [0064]∇2⁢z=1n-1⁢(mr+n⁢∇2⁢w),(Eq.<mspace width="0.8em" height="0.8ex"/>⁢6) where in is the mismatch between the light incident on the optic from the source and the light pulled back to the optic from the target: in =s o/u−1 for eq. (4) or m=2(√{square root over (so/u)}−1) for eq. (5). Here the obliquity term is ocos θA cos θB sec θQ. Treating eq. (6) as a fixpoint yields a simple tailoring algorithm: Use a provisional surface estimate z to calculate (via simulated transport) the ray-dependent r.h.s. terms (unwarped target irradiance samples u, propagation depths r, obliquities o); solve the Poisson problem via FFT to update z; repeat until convergence. The fixpoint works well for substantially linear problems where ray bends are modest. In the very linear case of uniform collimated light (s=o=1, ∇2w=0), a long focal length (r»0), and a nearly flat optical surface (z≈0), eq. (6) contains as special cases freeform methods that view the irradiance as the Laplacian of z [6, 11]. Via Poisson Corrections [0065]A more effective fix point is obtained by comparing the desired irradiance u with the irradiance u{circumflex over ( )}=s dA dB actually produced by a provisional surface z. We will seek a field c of corrections to surface z that satisfies the linear dilations model, [0066]u=s⁢dAdBc=s_⁢o1+r⁢∇2⁢((n-1)⁢(c+z)-nw),(Eq.<mspace width="0.8em" height="0.8ex"/>⁢7) in which dBc is simply dB in eq. (4) with c added to z. Then, eq. (7) can be written for u and u{circumflex over ( )} (with and without c), difference them, and solve for the Laplacian of c to obtain a Poisson correction [0067]∇2⁢c=s_⁢o(n-1)⁢r⁢(1u-1u^)=1u⁢(u^-u)(n-1)⁢dB_dA,(Eq.<mspace width="0.8em" height="0.8ex"/>⁢8) where dB/dA is the dilation dB/dA in eq. (4) without the obliquity terms. Note that once u and u{circumflex over ( )} are identified, via simulation, then the incident intensities (first form) or dilations (second form) need to be computed for the correction. Algorithmically, we proceed as above but update z←z+c. In regard to numerical considerations, see section below titled “Numerical considerations”. [0068]The correction method has some advantages: Most of the nonlinearities of the optical path are captured on the r.h.s. of eq. (8) and can be calculated exactly in the simulation of transport, while the linearization's noted above, are at play only in the relatively small curvature corrections, where they are accurate. Referring to the mirror of FIG. 3C and the mirror of FIG. 3F, the two mirrors estimated via eq. (8) produce the same irradiance, but from different base surfaces, as per schematic ray transport diagrams. Grayscale shading (335 and 375) on the depicted mirror surfaces (330 and 370) indicates local surface curvature. Further, this yields superior results when steep slopes, high curvatures, short focal lengths, Fresnel losses, or high contrast ratios are present. Additionally, the tailored optic can inherit some useful properties from a suitably designed base surface, e.g., demagnifying to increase brightness, or crossing all rays to force surface convexity, as in r.h.s. (see FIGS. 3A, 3B, 3C, 3D, 3E and 3F). [0069]FIGS. 3A, 3B, 3C, 3D, 3E and 3F illustrate two mirrors that produce photographic projections, demonstrating the ability to implement transforms, the mirror at right reflects at a 45 degrees angle and forces all rays to cross so that the beam fits through a small aperture, the greyscale texture on the black mirror surfaces indicates local curvature, according to embodiments of the present disclosure. [0070]FIG. 3A illustrates the desired irradiance pattern 305 that will be reproduced by the mirrors in FIG. 3C and FIG. 3F mirrors. The pattern is specified as an image 305 whose pixel intensities will be reproduced as irradiance intensities on the projection surfaces. [0071]FIG. 3B illustrates the optical path in the first example. Collimated light rays 310 are incident on a mirror 315 and their reflection 320 is incident on a planar projection surface 325. [0072]FIG. 3C illustrates the tailored mirror shape 330 obtained by the application of the method summarized in FIG. 2B. The mirror 330 is nearly flat, except for some regions of high curvature 335 that divert rays away from the regions of the projection plane where the desired irradiance pattern should be dark, namely the pupil, iris, and eyelashes in the target image 305. [0073]FIG. 3D is the irradiance pattern 340 obtained on the projection surface 325 by simulating the action of the tailored mirror 330 in FIG. 3C in the optical path of FIG. 3B. [0074]FIG. 3E illustrates the optical path in the second example. Diverging light rays 345 from a common radiant point 350 are incident on a concave mirror 355 and their reflection 360 is incident on a planar projection surface 365. Due to the concavity of the mirror, the reflected rays 360 all cross before reaching the projection surface 365. [0075]FIG. 3F illustrates the tailored mirror shape 370 obtained by the application of the method summarized in FIG. 2B to an initially concave mirror 355. The mirror 370 remains concave after tailoring, with some regions of higher curvature 375 that divert rays away from the regions of the projection plane where the desired irradiance pattern should be dark, namely the pupil, iris, and eyelashes in the target image 305. The resulting irradiance pattern on the projection surface 365 is identical to the irradiance result 340 depicted in FIG. 3D. With Light Fields, Including Extended Light Sources [0076]Regarding FIGS. 3A, 3B, 3C, 3D, 3E and 3F, thus far assumed is that the wavefront W associates a single ray vector ∇W to every point in space. While more general than a collimated or point light source, this falls far short of nature's full plenoptic function. For the purposes of tailoring, the plenoptic function can be summarized as a light field of directional flux densities s(μ,ν,ϕ,θ) sampled at a (possibly fictive) radiant surface, i.e., s− gives the flux passing through the surface point μ, ν in the global direction ϕ, θ. This contains multiple/extended/asymmetric light sources as special cases. In such cases, the law of étendue almost always excludes the possibility of an exact tailoring solution, but good approximations have practical utility. [0077]To extend the correction method to incident light fields, both the radiant and irradiant surfaces are considered, but reverse their roles. It is useful to imagine a camera that views the optical surface through an infinitesimal aperture dT located at a point p∈ on the projection surface. The camera sees a distorted image of the light source(s) on a subset Ω of the optical surface. Ideally, the total observed flux matches IpdT, where Ip is the desired irradiant intensity at p. In other words, we want IpdT=∫spdA for the flux field sp that the camera at p observes on the optical surface. To calculate this quantity from the dilation eq. (4) by reversing the roles of the radiant and irradiant surfaces: We imagine projection surface point p emitting a spherical wavefront wp back through the optical surface z, and calculate a field of dilations [0078]dAdT⁢dBpdA of this wavefront as it propagates backward from the projection surface to the optical surface z and then to the radiant surface, where we sample a 2D field :(x,y)∪0 of p-destined radiance values from the 4D light field function s−. This radiance push forward field plays an analogous role to the irradiance pullback field u in previous sections and is similarly parameterized by the optical surface's coordinate system. Conservation of energy requires that each step have the same [0079]Ip⁢dT=∫Ω⁢sp⁢dA=∫Ω⁢ip⁡(cos⁢<mspace width="0.8em" height="0.8ex"/>⁢θQ,prp)2⁢cos⁢<mspace width="0.8em" height="0.8ex"/>⁢θB,p⁢dBp⁢<mspace width="0.8em" height="0.8ex"/>⁢cos⁢<mspace width="0.8em" height="0.8ex"/>⁢θA,p⁢dA,Eq.<mspace width="0.8em" height="0.8ex"/>⁢9) where the integrand on the right-hand side is the standard radiometric calculation of flux from an infinitesimal source dBp through an aperture dA. [0080]We adapt eq. (7) to find dBp by noting in the extended source case, where we are tracing the light backward, the
返回