Xian Jing
Shitao Li
Rongxin Zhu2- 1College of Electronic Science and Engineering, Jilin University, Changchun, China
- 2Jilin Provincial Key Laboratory of Micro/Nano and Ultra-precision Manufacturing, School of Mechatronic Engineering, Changchun University of Technology, Changchun, China
As an outstanding visual system for insects and crustaceans to cope with the challenges of survival, compound eye has many unique advantages, such as wide field of view, rapid response, infinite depth of field, low aberration and fast motion capture. However, the complex composition of their optical systems also presents significant challenges for manufacturing. With the continuous development of advanced materials, complex 3D manufacturing technologies and flexible electronic detectors, various ingenious and sophisticated compound eye imaging systems have been developed. This paper provides a comprehensive review on the microfabrication technologies, photoelectric detection and functional applications of miniature artificial compound eyes. Firstly, a brief introduction to the types and structural composition of compound eyes in the natural world is provided. Secondly, the 3D forming manufacturing techniques for miniature compound eyes are discussed. Subsequently, some photodetection technologies for miniature curved compound eye imaging are introduced. Lastly, with reference to the existing prototypes of functional applications for miniature compound eyes, the future development of compound eyes is prospected.
1 Introduction
Organisms have evolved diverse and superior visual systems, which enable them to effectively navigate, find food, communicate and avoid predators in their complex and dangerous natural environments (Smolka et al., 2011; Lim and Ben-Yakir, 2020; Casares and McGregor, 2021). Inspired by the visual systems of biological organisms in the natural world, a wide range of artificial biomimetic visual systems has been developed in the both macroscale and microscale (Liu et al., 2019; Wang et al., 2019; Ma et al., 2021). However, despite the significant advancements in size and weight, micro vision cameras still have some shortcomings, including low image quality, limited focal length, narrow field of view, and high precision requirements for detection. Compound eyes (CEs) with clusters of functional ommatidia, which are found in the insect (such as bees, flies, ants, and beetles), crustaceans (crabs, lobsters), arachnids (spiders, scorscpions), and some species of mollusks (such as certain types of snails), provide viable approaches to address the aforementioned deficiency (Somanathan et al., 2008; Somanathan et al., 2009; Alkaladi and Zeil, 2014; Morehouse et al., 2017; Arganda et al., 2020).
Compound eye consists of closely arranged ommatidia, which provide distinct advantages like a wide field of view, infinite depth of field, and sensitive response (Matsuda and Wilder, 2014; Deng et al., 2016; Hu et al., 2022). These advantages have tremendous potential applications in areas such as infrared guidance, radar warning, robot vision, medical endoscopy (Wang et al., 2021; Deng et al., 2015; Wang et al., 2022; Huang et al., 2023). The numerous advantages of compound eyes stem from their unique visual structure. Correspondingly, in order to replicate similar functionalities, artificial biomimetic compound eyes should also possess the same structural characteristics. Firstly, miniature compound eyes consist of a large number of ommatidia with individual dimension in micro/nano-scale but overall dimension probably in millimeter-scale to meet the requirements of detection range, exhibiting a cross-scale characteristic (Chen et al., 2016; Peng et al., 2016; Zhai et al., 2021). Secondly, in some cases, a single-layer planar lens array may not be able to meet the imaging precision requirements of compound eye, necessitating the combination of double or even multiple layers of planar or curved lens array to improve imaging quality, showcasing a complex 3D structure characteristic of compound eye (Chen et al., 2017; Lin et al., 2018; Ke et al., 2022). Finally, in order to meet the needs of the miniaturization of compound eye cameras, the adaptive integrated manufacturing of optical components and photoelectric sensors is also an important issue for compound eye, exhibiting a characteristic of micro-assembly (Viollet et al., 2014; Kuo et al., 2015; Xu et al., 2022). All the aforementioned characteristics pose significant challenges to the microfabrication of miniature compound eyes. With the continuous advancement of advanced materials, complex 3D manufacturing technologies, and flexible electronic detectors, a range of microfabrication technologies and photoelectric detection methods have been developed for miniature bioinspired artificial compound eyes. Scholars have gone beyond simple replication in the manufacturing of compound eyes. They have optimized the design of the structure and incorporated advanced functional materials to meet specific needs. As a result, some artificial compound eyes not only possess the advantages of natural compound eyes but also exhibit high resolution and adjustable focal capabilities similar to those of single-chambered eyes.
In this work, a comprehensive review is provided from the aspects of the microfabrication technologies, photodetection and applications of miniature compound eye. Firstly, a concise introduction is provided on the types and structural composition of compound eyes found in the natural world. Secondly, a discussion is provided on the 3D forming manufacturing techniques for miniature compound eyes. Subsequently, some photodetection approaches for diversiform artificial compound eyes are introduced. Lastly, the existing prototypes of functional applications for miniature compound eyes are listed and prospects for the future development of compound eyes are explored.
2 Structural composition of the compound eye
The earliest known compound eyes were discovered in the trilobites, arthropods from the Cambrian period (Land, 2005). From the birth to extinction of trilobites over billions of years, the early compound eyes have evolved along with changes in the environment. The compound eyes can be classified into two major categories based on the processing of light beams received by the ommatidia: apposition compound eyes and superposition compound eyes, catering to various visual demands (Nilsson, 1989).
2.1 Apposition compound eye
Apposition compound eyes consist of independent ommatidium imaging channels, which are composed of refractive devices (such as cornea and crystal cone) and a rhabdom. As light enters the refractive device, it is focused onto the rhabdom through the refractive apparatus. The rhabdom then transmits the focused light to the optic nerve for further processing and imaging. Additionally, to enhance the quality of imaging, the imaging channels of adjacent ommatidia are separated in all directions by pigment cells, preventing any interference or crosstalk of light (Guo et al., 2021). Based on the actual structure of the biological compound eye, the schematic diagram of the apposition compound eye can be simplified and depicted as shown in Figure 1A. Similarly, an imaging schematic diagram of an artificial apposition compound eye can also be obtained, as shown in Figure 1B, where the focusing lens corresponds to the cornea, the substrate lens corresponds to the crystalline cone, and the detector corresponds to the rhabdom and retinula cells.
FIGURE 1. (A) Structure schematic diagram of the biological apposition compound eye. (B) Imaging schematic diagram of artificial apposition compound eye.
2.2 Superposition compound eye
Although both the apposition compound eye and the superposition compound eye have a similar structural composition, the imaging principles are significantly different. The photoreceptive cells in superposition compound eyes receive incident light from multiple corneas, whereas the photoreceptive cells in apposition eyes receive incident light solely from the corresponding cornea.
The superposition compound eye can be further categorized into optical superposition compound eyes and neural superposition compound eyes, depending on the different mechanisms of light perception. In optical superposition compound eyes, incident light is focused onto a specific region of photoreceptive cells through optical reflection or refraction. As a result, optical superposition compound eyes exhibit higher sensitivity and smaller focal ratios (F-numbers) compared to apposition compound eyes (Land et al., 1979). Figure 2 illustrates three types of optical compound eyes with superposition, namely, optical refraction superposition, optical reflection superposition, and parabolic superposition, corresponding to optical propagation paths generated by the mechanisms of refraction, reflection, and a combination of both, respectively (Land, 1981; Wagner et al., 2022). Organisms with optical superposition compound eyes inhabit dark environments and possess remarkable light-capturing capabilities and efficient utilization of light energy (Frederiksen and Warrant, 2008; Song et al., 2017). Whereas the neural superposition compound eye receives incident light through the photoreceptive nerve from multiple ommatidia. Therefore, when the number of ommatidium is the same, the neural superposition compound eye has higher resolution.
FIGURE 2. Superposition compound eyes. (A) Reflection superposition compound eye. (B) Refraction superposition compound eye. (C) Parabolic superimposed compound eye. (D) Neural superposition compound eye.
3 Microfabrication technologies for artificial compound eye
These characteristics of functional components in micro systems present significant challenges to existing microfabrication technologies. A variety of advanced technologies and materials have been employed in the manufacturing of micro compound eyes. The following is a review based on the different manufacturing technologies for planar compound eyes and curved compound eyes.
3.1 Microfabrication technologies for planar compound eye
Prior to the 21st century, manufacturing artificial compound eyes primarily concentrated on flat compound eyes due to the limitations of processing technology during that period (Oikawa et al., 1981; Borrelli et al., 1985; Popovic et al., 1988; Cheng et al., 2019). Various technologies, including stamping, reversal replication, droplet deposition, thermal reflow and lithography, were employed to enhance the precision and efficiency of manufacturing planar compound eyes (Yang et al., 2005; Hong et al., 2006; Chang et al., 2007; Pan and Su, 2008; Yu et al., 2013; Cherng and Su, 2014; Park et al., 2014; Yong et al., 2015; Grigaliunas et al., 2016). Among these technologies, the processing methods for planar compound eyes can be roughly divided into two categories: direct forming technology and indirect forming technology. Unlike direct forming technology, which directly deals with the contour of compound eyes using one or more specialized manufacturing technique, indirect forming technology involves initially producing the mold of the compound eyes and then obtaining the planar compound eye structure through demolding or hot embossing processes.
3.1.1 Direct forming technology
Direct forming technology for planar compound eyes primarily relies on micro-droplet manufacturing and femtosecond laser processing techniques. Micro inkjet printing is a commonly used micro-droplet manufacturing technology, widely applied in fabricating microstructures for electronic communication devices, micro-optic systems, and optical interconnections (Cox et al., 1996; Cox et al., 2001; Lee et al., 2010; Yu et al., 2013). Micro inkjet printing technology allows for speedy prototyping over large areas, making it highly efficient for microlens preparation. Furthermore, it provides a simple and rapid approach to microlens processing.
Inkjet printing offers the advantage of flexibility, allowing for the easy fabrication of microlens arrays with various curvatures and sizes. E. Parry et al. demonstrated the tunability of the lens focal lengths by adjusting the temperature (Parry et al., 2017). While the inkjet printing process enables the quick fabrication of a large-area microlens array, it is necessary to combine it with voltage-tunable focal length technology in order to fully utilize the capability of adjusting the focal length. W. Kamal et al. proposed the use of inkjet printing to fabricate thermally tunable liquid crystal (LC) microlenses. The inkjet printing process is illustrated in Figure 3A. A Lecithin-coated substrate at 20°C was employed to promote a plano-convex lens configuration with a homeotropic alignment of the LC director. Indium-tin-oxide (ITO) was deposited on the glass substrate using the multiple droplet deposition technique. The cross-section of the glass substrate with in-plane electrodes and a single microlens is shown in Figure 3B. Multiple droplets were deposited at the same location on the glass to increase the microlens volume. Figure 3C displays five microlenses with diameters ranging from 210–255 μm. The relationship between lens diameter and number of droplets is depicted in Figure 3D, clearly indicating that the lens diameter is governed by the drop volume and aligns well with the modeled drop diameter for a 32° contact angle spherical cap. The light intensity profile of the focused spot from a 255 µm diameter microlens is shown in Figure 3E. Figure 3F emphasizes that the focal length of the microlenses, dependent on the radius of curvature, changes with different voltages. It is showed an electrical tunability of microlenses on the in-plane electrodes (Kamal et al., 2020). In addition, V. Vespini et al. proposed a forward pyro-electrohydrodynamic inkjet printing system that utilizes a temperature gradient to address the issue of limited working distance in a contact-free mode (Grimaldi et al., 2012; Grimaldi et al., 2013; Vespini et al., 2016). This system is capable of printing and transferring liquid shots and pixels with defined dimensions, achieving high resolution even over long distances. Meanwhile, the fabrication of microlenses in a tunable multiscale range is an important issue. Vespini et al. proposed an electrohydrodynamic assembly method to achieve this goal (i.e., between 25 and 200 μm diameter) Vespini et al. (2015).
FIGURE 3. The schematic diagram of processing and change curves of microlenses (Reproduced with permission from (Kamal et al., 2020)). (A) Schematic of the fabrication process. (B) A cross-section of a glass substrate with in-plane electrodes and a single microlens. (C) Image of five microlenses with different diameters and same contact angles. (D) The relationship between lens diameter and number of drops. (E) Intensity of 255 μm diameter lens at the image plane with CCD images at insets. (F) The relationship between focal length and lens position.
Femtosecond laser processing is currently widely regarded as one of the most promising micro/nano processing technologies due to its ability to prepare small-sized and high-precision structures. It offers advantages such as short processing cycles and high instantaneous power, enabling the processing of high-hardness materials. Femtosecond laser processing can be classified into two main categories: femtosecond laser modification (Pan et al., 2014; Deng et al., 2015; Wei et al., 2018) and femtosecond laser two-photon polymerization technology (Guo et al., 2006).
Femtosecond laser modification technology utilizes a point-by-point processing method, which typically results in rough processing quality and low imaging quality of optical components. To enhance the image quality of optical lenses following femtosecond laser modification, the commonly used approach involves the utilization of wet etching technology to reduce surface roughness. This etching process exhibits selectivity, occurring exclusively within the region subjected to laser irradiation. This directional material removal enables the formation of high-quality concave microlens arrays (Liu et al., 2020). This method involves using femtosecond laser to induce the formation of modified regions on the surface, followed by the application of hydrofluoric acid to, etch the modified region, thereby accelerating the formation of microlenses (Chen et al., 2014).
In the study conducted by F. Chen et al., femtosecond laser ablation combined with wet etching was employed to fabricate both rectangular and hexagonal concave microlens arrays. The process involved three steps: firstly, ablation-induced craters with diameters of a few micrometers were created on polished silica glass chips. Subsequently, the samples with craters were treated in a 5% hydrofluoric (HF) acid solution with the assistance of an ultrasonic bath at 23°C. During this process, the chemical etching velocity was accelerated in the laser-induced craters, leading to the formation of concave spherical surfaces. The fabrication of the microlens arrays was completed in tens of minutes. Finally, the samples were cleaned using an ultrasonic bath in acetone, alcohol, and deionized water for 15 min each, followed by drying in ambient air (Chen et al., 2010).
On certain intricate structures, femtosecond laser two-photon polymerization technology has the capability to achieve precise point-by-point processing (Kawata et al., 2001; Tian et al., 2015) proposed a microlens array with differently curved unit lenses known as MLADC (Microlens Array with Different Curvature). The process involved spin-coating SU-8 photoresist onto a glass slide that had been cleaned with acetone and anhydrous ethanol. The lenses were then processed using femtosecond laser pulses. The resulting microlenses were placed in a developer solution to eliminate any unpolymerized photoresist, leading to the complete structure of the compound eye lens (Tian et al., 2015).
3.1.2 Indirect forming technology
In the planar compound eye processing discussed in this paper, the method used for replicating and embossing the compound eye model can be described as indirect molding technology. Specifically, in the replication method for the planar compound eye model, a polymer replication process has been employed for the mass production of a microlens array due to its cost effectiveness (Hocheng et al., 2008; Chang and Tsai, 2015; Chakrabarti et al., 2016; Chen et al., 2016). However, the use of a polymer microlens array is limited when it comes to applications in high optical, thermochemical, or mechanical environments. To address this limitation, researchers have discovered that a glass microlens array possesses excellent properties such as acid, moisture, and wear resistance. Glass microlens arrays can be fabricated through chemical etching and mechanical machining. However, mechanical machining is not only inefficient but also makes it challenging to achieve high quality results at a low cost.
In order to enhance processing efficiency and achieve a high-quality glass microlens array, Y.K. Kim et al. proposed a glass molding technology to replicate the mold shape onto a glass substrate. The process for manufacturing the microlens array is illustrated in Figure 4A. Firstly, a microlens array master pattern was created using a thermal reflow process. A polymer master was then obtained by a double-replication process involving PDMS molding and UV imprinting, which served to protect the master pattern. Next, a mixture of furan resin, initiator, and organic solvent was poured onto the polymer master, resulting in the formation of a furan precursor after thermal curing. By carbonizing the curved furan precursor, a vitreous carbon mold was obtained. Both the carbonization of the furan precursor and the glass molding process were carried out in a vacuum with heating. Finally, using the motor-driven pressure, the glass microlens array was formed using the vitreous carbon mold. The AFM and SEM measurements in Figures 4B, C reveal that the glass molded microlens array possesses a uniform and high-quality surface. This confirms the success of the glass molding replication process in manufacturing the microlens array with a high surface quality. Additionally, Figure 4C demonstrates the high precision of the glass molded microlens, with a diameter of 8.4 μm, pitch of 9.9 μm, and sag height of 0.699 μm. To examine the optical properties of the fabricated microlens array, the energy intensity distribution was measured. Figures 4D, E displays the 3D intensity profile and cross-section profile, revealing uniform light intensity in the microlens spots (Kim et al., 2018).
FIGURE 4. The schematic diagram of processing and measurement results of microlenses (Reproduced with permission from (Kim et al., 2018)). (A) Schematic of the fabrication process. (B) AFM and (C) SEM measurement results of glass molded microlens array. (D) 3D intensity profile and (E) cross-sectional profile of the focused laser beam of the glass molded microlens array.
The embossing process typically involves several consecutive stages, which require thermal cycling. However, the large thermal mass of the embossing tool leads to long cycle times, exceeding 10 min. Prolonged exposure to elevated temperatures can result in polymer degradation. To address this issue, D. G. Yao et al. proposed a sequential heating and cooling embossing strategy to reduce cycle times in hot embossing of polymer microstructures Yao et al. (2010). The embossing process for manufacturing microlens arrays is illustrated in Figure 5A. The polymer is heated and softened at 250°C using a hot station, and then transferred to a cold station for cooling until reaching the mold opening temperature. This significantly reduces the cycle time of the hot-pressed microstructure, with heating time less than 3 s and a total cycle time of approximately 10 s. SEM images of the microlenses are presented in Figures 5B–E, demonstrating good replication fidelity, including sharp edge replication and minimal mold surface defects. However, after a 10-s contact heating time, some detached residuals were observed at the center of the embossed microlenses, as depicted in Figures 5F, G. This suggests that prolonged embossing and high temperatures can lead to excessive adhesion, emphasizing the importance of strict control over factors such as pressure, temperature, and time during the fabrication process. Surface defects are prone to develop, which can compromise the shape accuracy of the microlens.
FIGURE 5. Embossing technology (Reproduced with permission from (Yao et al., 2010)). (A) Schematic of the fabrication process. (B) The embossing master and (C) partial enlarge image. (D, E) The image of embossed copolymer surface. (F) The embossed microlenses after contact heating 10 s and (G) partial enlarge image.
A comparison of microfabrication technologies for miniature planar compound eyes is presented in Table 1. The technologies are evaluated based on processing efficiency, surface quality, and the reported diameter of the ommatidium (do). Inkjet printing enables direct droplet deposition on flexible or rigid substrates. The volume and arrangement of droplets can be controlled by adjusting the pulse duration and amplitude of the electrical actuation. However, deformation may occur after the solidification of photosensitive materials, resulting in certain deformations. The femtosecond laser-enhanced wet etching method utilizes femtosecond laser irradiation to modify the pit array on the surface. Hydrofluoric acid is then used to, etch the modified region, thus accelerating the formation of microlenses. This method is suitable for processing hard materials, offering good stability and surface quality. Femtosecond laser two-photon polymerization technology allows for true three-dimensional processing with high accuracy. However, the point-to-point processing approach used in this method results in lower processing efficiency. Glass molding replication technology is a cost-effective method for producing microlens arrays. It allows for the mass production of large-area microlenses with high precision. The process can be repeated multiple times to produce microlenses over a large area. While this technology offers high processing efficiency, achieving a completely smooth surface can be challenging due to material adhesion during replication. Embossing technology performs similarly to glass molding replication. It also offers high machining efficiency, but the surface quality can be affected by material adhesion.
TABLE 1. Microfabrication technologies for miniature planar compound eye.
3.2 Microfabrication technologies for curved compound eye
Although the planar compound eye has significantly enhanced the imaging clarity of optical systems, its planar arrangement restricts its applications in various fields. To address these limitations, a curved structure has been explored as a potential solution. Researchers are now shifting their focus from planar compound eyes to curved compound eyes in order to achieve larger field of view, higher integration, and intelligence (Maddern and Wyeth, 2008; Li and Yi, 2010; Deng et al., 2016; Liang et al., 2019). The advancement of micro-nano processing technology and flexible materials has led to significant progress in improving the resolution, field of view, antifouling ability, and zoom integration of curved compound eyes. This section aims to discuss the curved compound eye under different processing types, including single manufacturing technologies such as femtosecond laser two-photon polymerization, as well as other composite manufacturing methods. The objective is to explore the various advancements and achievements in this field.
In previous research on natural compound eyes and artificial compound eyes, it has been observed that both types have ommatidia with fixed focal lengths, limiting their ability to achieve variable focal length imaging. To address this limitation, Z.C. Ma et al. developed an intelligently tunable compound eye lens. They fabricated a stimuli-responsive compound eye based on bovine serum albumin (BSA) using femtosecond laser two-photon polymerization. The compound eye lens consists of a double-layer structure. The outer layer is created using two-photon polymerization technology to drop BSA aqueous solution gel onto a glass substrate, while the inner layer is made using the same processing method but with SU-8 photoresist solution. Figure 6A illustrates the contraction and expansion of BSA at different pH values, demonstrating that not only can the focal length of the compound eye lens be adjusted, but also the field of view (FOV) can be modified within the range of 35°–80°. Furthermore, Figure 6B presents the imaging quality and imaging distance of the compound eye under different pH values (Ma et al., 2019). These findings showcase the potential of intelligently tunable compound eyes in achieving variable focal length and adjusting the FOV.
FIGURE 6. Fabrication of compound eyes using femtosecond laser two-photon polymerization technology. (Reproduced with permission from (Wu et al., 2014; Ma et al., 2019)). (A) The contraction and expansion of BSA. (B) Zoom and imaging of BSA compound eye. (C) Schematic of the fabrication process. (D) SEM of the artificial compound eye. (E–G) The imaging of the letters “P”, “T” and “L”.
Although femtosecond laser two-photon polymerization technology has been used to fabricate 3D high-precision compound eye lenses, the processing efficiency is hindered by the point-to-point processing method. To overcome this challenge, D. Wu et al. proposed a scanning strategy to control the voxel size and introduced a high-speed voxel-modulated femtosecond laser direct writing technology to achieve the three-dimensional structure of artificial compound eyes. This advancement not only enables rapid processing of artificial compound eyes but also realizes a small (84 μm) wide-field imaging system without distortions. The artificial compound eye was fabricated using laser direct writing, as shown in Figures 6C, D. The first step involved scanning the inner macrobase with a 400 nm fs laser, followed by the scanning of small ommatidia on the macrobase using a 100 nm fs laser without any gap. While the small voxel mode allows for highly precise devices, it is limited by prolonged fabrication times, which can make this method impractical. However, an improved laser direct writing strategy has been developed, achieving a large aperture (0.4), a high fill factor (100%), and ultra-low surface roughness. The images of the letters in Figures 6E–G demonstrate that the artificial compound eye exhibits high optical imaging quality and uniformity in all directions (Wu et al., 2014).
Compound processing involves creating a curved compound eye using two or more methods. Mechanical deformation, imprinting, vacuum absorption, and mold rotation are commonly employed techniques. These methods are straightforward and efficient. In the field of zoom imaging for curved compound eyes, L. Li et al. proposed a design for a flexible zoom artificial compound eye Li et al. (2018). The surface compound eye is divided into three fan-shaped regions with different focal lengths, as depicted in Figure 7A. Through aspheric optimization, the spherical aberration of each region is reduced to 1% of the initial value. The design not only allows for focal length adjustment but also addresses the issue of poor imaging quality at the edges of curved compound eyes. The structure of the artificial curved compound eye is formed using mold processing. The mold is created using a precision five-axis CNC machine, and the molding material used is polydimethylsiloxane (PDMS). A mixture of curing agent and PDMS, in a ratio of 1:10, is poured into the mold and cured at a fixed temperature of 80°C for 1 h to obtain the complete structure shown in Figure 7B. The imaging effect of the compound eye and a multi-eye positioning experiment are demonstrated in Figures 7C, D.
FIGURE 7. Ultra-precision machining of flexible zoom compound eye. [Reproduced with permission from (Li et al., 2018)]. (A) Flexible zoom compound eye distribution map. (B) PDMS compound eye model. (C) Flexible zoom compound eye positioning map. (D) Flexible zoom compound eye imaging.
The design of the flexible zoom compound eye incorporates a regional zoom approach. However, traditional designs have limited flexibility and can only zoom within a certain range. To address this issue, J. J. Cao et al. developed a tunable bionic compound eye Cao et al. (2020). The structure is created using femtosecond laser wet etching technology. Initially, the silicon wafer template, which underwent laser processing, is etched in a solution containing hydrofluoric acid (HF), nitric acid (HNO3), and acetic acid (CH3COOH). Subsequently, the microstructure of the template is transferred onto a PDMS substrate through the demolding process. The resulting PDMS microlens array (MLA) is flexible and deformable, and it is integrated with a microfluidic chamber to enable zoom imaging, as shown in Figure 8A. By adjusting the volume of water injected into the microfluidic chamber, the compound eye can transition from a planar structure to a hemispherical shape, achieving a field of view (FOV) of 180° and a variable focal length ranging from 3.03 mm to infinity. The angular resolution of the compound eye is 3.86 × 10−4 rad, granting it the capability to detect targets at different distances, as depicted in Figures 8B–G.
FIGURE 8. Fabrication of zoom compound eye using femtosecond processing wet-etching metho. (Reproduced with permission from (Cao et al., 2020)). (A) Processing flow and working principle of tunable bionic compound eye. (B–F) Compound eye zoom under different liquid volumes, (B) 0.13 cubic millimeter, (C) 0.7 cubic millimeter, (D) 1.21 cubic millimeter, (E) 1.55 cubic millimeter and (F) 2.09 cubic millimeter. (G) Changes of liquid volume and compound eye focal length.
Although the tunable bionic compound eye can achieve flexible focal length, it needs to zoom through the solution volume, and the response time is slow, which limits the practical application of the compound eye. In response to this problem, S.Y. Luan et al. inspired by the bionic design of ancient trilobites, created an artificial super compound eye (AHCE) Luan et al. (2022). It is a microlens with five different curvatures, which can be regarded as a small eye with five different focal lengths. The surface and plane zoom functions are realized under the composition of five small eyes, as shown in Figures 9A, B. The structure obtains the planar zoom MLA of the required mold by laser direct writing technology and controlling the exposure position and intensity through the optical system. After putting the PDMS-coated zoom MLA into the oven, the soft film of the zoom MLA was obtained by demoulding or soft lithography. The soft film of zoom MLA is bonded to the concave lens to obtain the template of AHCE. Then, the cyclic olefin copolymer (COC) was poured on the PDMS on the concave lens and covered with a glass substrate. Finally, through UV curing and demolding, the artificial super compound eye lens is obtained as shown in Figure 9C. Since AHCE is composed of five small eyes with different focal lengths, the structure can not only perform zoom imaging on the surface, but also form zoom imaging functions on planes with different distances through information sharing and scaling functions, as shown in Figures 9D–J. J. Li et al. also proposed a curved compound eye lens based on inkjet printing and air-assisted deformation for the zoom response of the compound eye Li et al. (2023).
FIGURE 9. Femtosecond laser etching manufacturing zoom compound eye and inkjet printing and air assisted deformation manufacturing zoom compound eye diagram. [Reproduced with permission from (Luan et al., 2022)]. (A) AHCE curved surface zoom. (B) AHCE plane zoom image. (C) AHCE processing flow chart. (D–H) Curved zoom imaging at different distances. (I) Relative distance between different types of ommatidia and AHCE. (J) Planar compound eye imaging in different regions.
The development of curved zoom compound eye lenses has addressed the zoom problem encountered in artificial compound eyes and has played a significant role in integrating curved compound eye systems. However, the compound eye system often operates in humid or harsh environments, making it susceptible to a decline in imaging quality caused by water mist. Therefore, it is crucial to enhance the lens’s hydrophobicity and self-cleaning ability.
In a study by J. Li et al., a combination of modified laser swelling, air-assisted techniques, and controlled crystal growth was employed to create an artificial compound eye without distortion Li et al. (2019). Initially, a microlens array was fabricated using laser swelling technology on a substrate. The convex array template was then fixed onto 184 elastic slabs. By attaching a concave membrane to a circular chamber connected to a vacuum pump, the membrane was deformed from a plane to a surface. The process is shown in Figure 10A. This process resulted in a bioinspired compound eye with nano structures, as observed in the scanning electron microscope (SEM) image shown in Figures 10B, C. The introduced nano structures effectively reduced surface reflectance and improved surface hydrophobicity. The bioinspired compound eye exhibited a nearly normal incidence distribution along the x and y directions, with a decrease in central light intensity as the angle of incidence increased. It demonstrated excellent imaging properties and focusing ability under tilted incident light.
FIGURE 10. Laser swelling air assisted deformation technology and Jet printing with electrohy-drodynamic. (Reproduced with permission from (Li et al., 2019; Zhou et al., 2020)]. (A) Schematic of the fabrication process. (B) SEM image of convex structure after swelling. (C) SEM of fabricated bioinspired compound eye. (D, E) Intensity distribution of bioinspired compound eye along x and y direction, respectively. (F) Schematic of the fabrication process. (G–I) Imaging of “SIA” from center, middle and edge region. (J–L) Focusing ability text for tunable artificial compound eye with variable FOVs of 0°, 128° and 161°. (M–O) Intensity distribution of the focal spots from the ommatidia in regions corresponding to (J–L).
Another approach using an electro-hydrodynamic jet printing technology for manufacturing waterproof artificial compound eyes was proposed by Zhou et al. (2020). The processing scheme, as illustrated in Figure 10F, involved spraying a microlens array onto a flexible PDMS film and deforming the film using an integrated microfluidics chip to create the artificial compound eye with a variable field of view (FOV). The flexible film, consisting of a hybrid of microlens and nanolens arrays, exhibited superb superhydrophobic properties with a water contact angle of 158°. Experimental tests on the imaging ability were conducted, and Figures 10G–I shows the imaging results of the letters “SIA” captured from the center, middle, and edge regions. The focused lens at the center of the microlens array can be clearly observed, as the film transitions from a planar to a curved surface upon deformation. Figures 10J–L depicts the deformation state of the microlens array film for the artificial compound eyes, and Figures 10M–O illustrates the intensity distribution of the circled positions. The microfluidics chip enabled the creation of artificial compound eyes with a variable FOV ranging from 0° to 160°.
Although the above two kinds of compound eyes can achieve hydrophobicity, the superhydrophobic surface is obtained at the expense of the transparency of the compound eye, and the micro-nano manufacturing process used is not conducive to large-scale production. At the same time, when subjected to high pressure, long-term work or wear, these superwetting surfaces have poor stability, which can lead to the loss of hydrophobicity. In response to this problem, M.J. Li et al. inspired by the Nepenthes capture, designed an anti-fog and anti-fouling compound eye structure Li et al. (2022). The structure uses femtosecond laser wet etching method to, etch the required microstructure template on the curved K9 optical glass, apply PDMS to the template, and obtain the required ACE after cooling and demoulding. The structure uses femtosecond laser wet etching method to, etch the required microstructure template on the curved K9 optical glass, apply PDMS to the template, and obtain the required ACE after cooling and demoulding. ACE was immersed in silicone oil for several hours to form a smooth surface injected with lubricant. The processing flow is shown in Figure 11A. The compound eye structure integrates more than 3,000 microlenses, which not only achieves 64°FOV, but also has a spatial resolution of 50.8 lp mm–1. It can withstand continuous water mist exposure of 1.45 mL min–1 at least 144s as shown in Figure 11B. The structure has high self-cleaning performance and can repel complex liquids as shown in Figure 11C. It has great potential in autonomous driving, medical or visual systems in harsh environments.
FIGURE 11. The schematic diagram of anti-fog and antifouling compound eye made by femtosecond laser wet etching method. [Reproduced with permission from (Li et al., 2022)]. (A) Anti-fouling and anti-fog compound eye processing flow chart. (B) 0–144 s continuous water mist exposure imaging of compound eye lens. (C) Antifouling ability test of compound eye under different solutions.
The compound visual organs mentioned earlier are fabricated mainly from synthetic polymers. But regretfully, this restricts their potential applicability due to their susceptibility to distortion when exposed to elevated temperatures and intense pressures. Conversely, artificial compound eyes constructed from glass present a promising prospect for expansive imaging and swift detection, owing to their extraordinary thermal and mechanical resiliency.
To address this challenge, X.Q. Liu et al. proposed a technology that utilizes sapphire concave compound eyes as high-temperature and hard-casting templates Liu et al. (2019a). A dry etching assisted femtosecond laser processing method was used to create centimeter-sized concave compound eyes on a curved sapphire substrate. The process involved carving microholes on the curved sapphire substrate through femtosecond laser scanning, followed by dry etching to form the concave compound eyes. By employing a femtosecond laser manufacturing system, they rapidly fabricated a uniform concave compound eye with a diameter of 20 μm and a depth of 1.5 μm. Subsequently, a glass compound eye was created using a high-temperature casting method, as illustrated in Figure 12A. The resulting compound eye produced clear images of the letter “F” from the center, middle, and edge regions, as shown in Figures 12B–D. When the objective lens was adjusted from far to near, clear images of the letter “F” could be observed across the compound eye, from the center to the edge. Similarly, the focus points were clear in all three regions when the objective lens was adjusted from far to near. Figures 12I–K demonstrates the corresponding intensities, with the grayscale intensities of the focal spots being nearly identical on the same focal plane formed by ommatidia at the same distance from the center. Compared to direct laser ablation, this approach significantly improves processing efficiency by more than two orders of magnitude. The combination of dry etching assisted femtosecond laser machining and casting replication technologies holds promising prospects for micro/nanofabrication of hard materials.
FIGURE 12. Femtosecond laser direct writing with dry etching assisted [Reproduced with permission from (Liu et al., 2019)]. (A) Schematic of the fabrication process. (B–D) Imaging of “F” from three regions. (E–G) Focusing properties from three regions. (H) The schematic diagram of the measured regions. (I–K) Intensities of the focal spots from the ommatidia in regions corresponding to (E–G).
Table 2 presents a comparison of microfabrication technologies for miniature curved compound eyes. The technologies were evaluated based on processing efficiency, surface quality, 3D fabrication capacity, and the reported do. Among these technologies femtosecond laser direct writing involves scanning the contour point by point, resulting in lower processing efficiency. However, it offers higher 3D flexibility compared to other methods. Surface quality is primarily influenced by the control of stair effects and the self-smoothing effect of materials. Ultra-precision machining, as a true three-dimensional processing method, holds a significant position in microlens manufacturing. Nevertheless, the wear of the tool over time can reduce machining accuracy and increase processing costs. Femtosecond laser wet etching with thermal embossing, modified laser swelling with air-assisted techniques, and inkjet printing with air-assisted microfabrication are all based on bending the flexible planar compound eye using physical force. The mold reproduction method enhances machining efficiency for planar compound eyes, but it limits the contour of curved compound eyes to simple curved surfaces due to the expansion caused by physical forces. Jet printing with electrohydrodynamics is a non-contact printing technology that employs an electric field to trigger ink injection onto the substrate. Surface quality mainly depends on material shrinkage before and after curing. Femtosecond laser-enhanced wet and dry etching can produce fine molds with a certain level of 3D complexity. Surface quality relies primarily on the mold’s surface quality and the material surface’s adhesion.
TABLE 2. Microfabrication technologies for miniature curved compound eye.
4 Photoelectric detection of miniature compound eye
To achieve high-precision detection in miniature compound eye imaging, it is crucial to have precise matching between the compound eye and the photoelectric sensor. Currently, commercially available photoelectric sensors are planar, while advanced miniature compound eyes have curved surfaces. This creates a mismatch between the focal plane of the compound eye and the planar photoelectric sensor. To address this issue, there are two main approaches. The first approach is to develop miniature curved photoelectric sensors. This involves designing and manufacturing sensors with a curved surface that matches the curvature of the compound eye. By doing so, the focal plane of the sensor can align with the compound eye, improving the overall imaging precision. The second approach is to modify the structure of the compound eye itself. Researchers can explore techniques to adjust the focal plane of the compound eye to match the planar photoelectric sensor. This may involve manipulating the shape or arrangement of the individual optical elements within the compound eye or incorporating additional optical components to redirect the light onto the planar sensor. Both approaches aim to achieve a better alignment between the compound eye and the photoelectric sensor, improving the precision of detection in miniature compound eye imaging.
4.1 Microfabrication technologies for planar photoelectric detection
A series of solutions have been proposed for planar photoelectric detection, for example, focal distance-tunable flexible materials (Ma et al., 2019), self-writing waveguide (Kim et al., 2005), optical fiber guidance (Liu et al., 2019), refractive lens array (Li and Yi, 2012; Jing et al., 2021), multiple spherical microlenses array (Jing et al., 2022) and so on.
A double-layer curved compound eye (DLCCE) was proposed by (Jing et al., 2022) to solve the existing problems. For each ommatidium, a corresponding modified microlens was designed to refract and focus the incident rays on the photoelectric detector. The structure of the double-layer curved compound eye is shown in Figure 13A. The DLCCE was fabricated by two-photon polymerization microfabrication technology. The fabrication processing is shown in Figure 13B. Figures 13C, D show the partial enlarged detail of a through-hole and ommatidia, respectively. The imaging comparisons of single-layer curved compound eye (SLCCE) and DLCCE are shown in Figures 13F–I. Figures 13F, H show the imaging of “I” and “T” of SLCCE, respectively, the imaging of “I” and “T” of DLCCE are shown in Figures 13G, I. The DLCCE shows a uniform light intensity at each level (Jing et al., 2021). Although two-photon polymerization microfabrication can achieve the integrated fabrication of double-layer microlens directly, the imaging quality also suffers from processing errors of two layers.
FIGURE 13. The schematic diagram of processing and imaging [Reproduced with permission from (Jing et al., 2021)]. (A) The structure of the DLCCE. (B) Schematic of the fabrication process. (C) Partial enlarged detail of through-hole. (D) Partial enlarged detail of ommatidia. (E) SEM image of the compound eye. (F) Detected “I” image from SLCCE. (G) Detected “I” image from DLCCE. (H) Detected “T” image from SLCCE. (I) Detected “T” image from DLCCE.
Furthermore, an ultra-compact micro multi-spherical compound eye (MSCE) was proposed to achieve the focus on the planar photoelectric detector. The structure of the MSCE is shown in Figure 14A. Through adjusting the structural distance along the optical axis of each ommatidium at each level, it can achieve the synchronous focus of all the ommatidia on the planar photoelectric detector with a single-layer compound eye, but without additional adjustable components. The MSCE was fabricated by two-photon polymerization technology. The fabrication processing is shown in Figure 14B. SEM image of the compound eye is shown in Figure 14C. The image of single-spherical compound eye (SSCE) in Figure 14D was used to compare with MSCE. Figures 14E–G show the imaging of “T,” “U,” “C” detected by MSCE. The results show relatively good imaging quality at the edge of MSCE, and the intensity is uniform at each level (Jing et al., 2022). The MSCE structure requires a high 3D controllability of microfabrication technology.
FIGURE 14. The structure and imaging detection of multi-spherical compound eye [Reproduced with permission from (Jing et al., 2022)]. (A) The structure chart of the multi-spherical compound eye. (B) Schematic of the fabrication process. (C) SEM image of the multi-spherical compound eye. (D) Imaging of “T” through single-spherical compound eye. (E) Imaging of “T” through single-spherical compound eye. (F) Imaging of “U” through single-spherical compound eye. (G) Imaging of “C” through single-spherical compound eye.
Hu et al. (2022) also proposed a miniature photoelectric compound eye camera (μ-CE) for planar sensors (Hu et al., 2022). The camera utilizes a uniformly logarithmic profile, as depicted in Figure 15A, eliminating the need to calculate the focal lengths of individual small eyes. This facilitates the design and manufacturing process, even with an increased number of compound eyes. Unlike spherical compound eyes, shown in Figure 15B, the logarithmic configuration of μ-CE extends the focusing range, albeit resulting in slight dimming of the image. Nonetheless, this unique focusing characteristic effectively eliminates defocus issues, as shown in Figures 15C, D. The μ-CE has a compact structural size of approximately 400 μm, similar to that of a mosquito’s compound eye, and weighs only 230 mg. Additionally, it enables wide-angle imaging up to 90°, which is crucial for object recognition and trajectory detection in space, as demonstrated in Figures 15E–G. Due to its small size and excellent imaging capabilities, the μ-CE can be seamlessly integrated with microfluidic devices for live microorganism detection, as displayed in Figures 15H–J. Furthermore, M.C. Ma et al. designed a single-pixel superimposed compound eye system (SPSCE) with integrated microlenses, optical fibres and photoreceptors to reduce the complexity of optical design and develop an artificial superimposed compound eye system with higher imaging resolution Ma et al. (2021).
FIGURE 15. Micro photoelectric compound eye camera. (Reproduced with permission from (Hu et al., 2022)). (A) Logarithmic CEs. (B) Spherical CEs. (C) Spherical compound eye imaging. (D) Logarithmic compound eye imaging. (E) μ-CE space recognition. (F) Beetle motion map of μ-CE at 0s. (G)Beetle movement diagram at 15s. (H) μ-CE microbial detection diagram. (I) Microscopic images of a paramecium. (J) The 3D trajectory of the paramecium.
4.2 Microfabrication technologies for curved photoelectric detection
Besides adjusting the microlens array, the development of curved photoelectric detectors is another effective approach to enable simultaneous imaging of all the ommatidia within the curved compound eye.
D. Floreano et al. presented a miniature curved artificial compound eye with flexible printed circuit board, the layers of the curved compound eye are shown in Figure 16A Floreano et al. (2013). The design consists of three layers of arrays: a microlens array, a photoelectric detector array and a curved flexible imager. Figure 16B illustrates the precise alignment and assembly process. Figure 16C demonstrates the dicing of the assembled array into columns, down to the flexible interconnection layer, which remains undamaged. Figure 16D depicts the curvature of the ommatidial array. The designed artificial compound eye bearing a hemispherical field of view with embedded and programmable low-power signal processing, high temporal resolution, and local adaptation to illumination. Y.M. Song et al. presented a camera design inspired by arthropods, featuring nearly full hemispherical shapes Song et al. (2013). The surface of the digital camera is densely populated with imaging elements, with 180 artificial ommatidia, comparable to the eyes of fire ants and bark beetles.
FIGURE 16. Design and assembly of curved compound eye [Reproduced with permission from (Floreano et al., 2013)]. (A) Assembly schematic of the curved compound eye. (B) Accurate alignment and assembly process. (C) Dicing of the assembled array in columns down to the flexible interconnection layer, which remains intact. (D) Curving of the ommatidial array.
5 Application and outlook
5.1 Applications of artificial compound eyes
The purpose of bionic compound eyes is to replicate the structures, characteristics, and behaviors of natural compound eyes, with the aim of providing valuable insights for designing innovative optical systems applicable to various facets of manufacturing and daily existence. The utilization of artificial compound eyes has found widespread application across diverse domains, owing to their advantageous attributes such as an expansive field of view, heightened sensitivity, boundless depth of field, and other remarkable features. These domains encompass large FOV perception (Huang et al., 2014; Cogal and Leblebici, 2017; Wang et al., 2019), fast recognition (Shi et al., 2017; Xu et al., 2020), high depth of field (DOF) perception (Kagawa et al., 2012a; Lee and Lee, 2018), spectral perception (Rui et al., 2004; Jin et al., 2013; Chen et al., 2017; Cao et al., 2019; Yu et al., 2020; Zhang et al., 2021), polarization imaging (Kagawa et al., 2012b; Kagawa et al., 2012c; Miyata et al., 2020), and numerous others.
5.1.1 Large FOV perception
Artificial compound eyes can achieve a large FOV perception, similar to the compound eyes of insects in the natural world, through the arrangement of micro lenses on a curved substrate. Indeed, this is also the main reason why curved compound eyes have received more attention in recent years compared to planar compound eyes. C.C. Huang et al. proposed reflect superposition compound eyes (RSCEs), which exhibit minimal chromatic aberration, an exceptional field of view of up to 165° without distortion, moderate aberrations, and comparable imaging quality Huang et al. (2014). Figure 17A illustrates the schematic diagram of RSCE imaging. The detailed structure of the designed RSCE is shown in Figure 17B. Figure 17C showcases the imaging performance of RSCE with a 165° FOV. O. Cogal et al. proposed a multi-camera endoscopic compound eye with a 180° FOV and a radius size of 18 mm Cogal and Leblebici (2017). This system can capture 25 frames per second (fps) video with a resolution of 1,080 × 1,080 pixels, operating at a processing clock frequency of 120 MHz.
FIGURE 17. Large FOV perception. (Reproduced with permission from (Huang et al., 2014)). (A) Schematic diagram of RSCE imaging. (B) Images of the detailed microstructures of a 3D hemispherical artificial RSCE. (C) Imaging performance of RSCE with a FOV of 165°.
5.1.2 Fast recognition
Compared to single-chambered eyes, compound eyes have a tendency to perceive shapes and outlines rather than clear and precise details. However, compound eyes have the advantage of fast recognition imaging due to the overlapping FOV between adjacent ommatidia. C.Y. Shi et al. proposed a kind of hemispherical compound eye camera (SCECam), which utilizes the imaging differences of neighboring ommatidia to recognize objects Shi et al. (2017). Figures 18A, B shows the exploded view and imaging principle of SCECam. The recognition speed of SCECam is significantly faster compared to conventional methods such as Canny and Log edge-detection techniques, with an improvement of two to three orders of magnitude. The running time of Canny, Zerocross, Log, Sobel, Prewitt Robert and SCECam edge detection method is shown in Figure 18C. Figures 18D–G display the edge detection results for SCECam method and conventional Canny edge detection method, respectively. Another advancement in this field is the design and fabrication of a biomimetic curved compound-eye camera (BCCEC) by Xu et al. (2020). This camera successfully detected and captured a moving silver box measuring 230 mm × 250 mm at a distance of 25 m. The algorithm used in this camera was optimized based on the fast discriminative scale space tracker, resulting in improved detection and capture speed.
FIGURE 18. Fast detection and capture of object. [Reproduced with permission from (Shi et al., 2017)]. (A) Exploded view of the SCECam. (B) Schematic illustration of SCECam imaging priciple. (C) Processing speed comparison of different methods. (D) Raw image of symbol “+” captured by SCECam. (E) The image obtained by edge detection based on SCECam method. (F) Raw image of symbol “+” captured by one conventional camera with same resolution as the SCECam. (G) The image obtained by the Canny edge-detection method.
5.1.3 High DOF perception
The depth cues can be derived from the subtle variations in the views of adjacent ommatidia in a compound eye, especially when the ommatidia are closely positioned and have overlapping fields of view. K. Kagawa et al. proposed a compound-eye camera TOMBO (Thin Observation Module by Bound Optics) inspired by the insect eye structure as an endoscope capable of acquiring depth information Kagawa et al. (2012a). Figure 19A shows the TOMBO endoscope prototype. A wavefront coding (WFC) technique and a 640 × 480-pixel color imager was used to demonstrate extended depth of field. Figure 19B shows the images of 1951 USAF test chart detected by TOMBO camera. The results show that almost constant resolution is provided at distances to the object of 20–80 mm. Figure 19C show the all-focus image and the estimated depth map of the cork board sample. W.B. Lee et al. proposed a method for estimating object depths in a monocular compound eye imaging system based on the computational compound eye (COMPU-EYE) framework Lee and Lee (2018). In the COMPU-EYE system, acceptance angles are considerably larger than interommatidial angles, causing overlap between the ommatidial receptive fields. In the proposed depth estimation technique, the disparities between these receptive fields are used to determine object distances.
FIGURE 19. High DOF perception. [Reproduced with permission from (Kagawa et al., 2012a)]. (A) TOMBO compound-eye camera. (B) The images of 1951 USAF test chart detected by TOMBO camera. (C) The all-focus image and the estimated depth map of the cork board sample.
5.1.4 Spectral perception
Multispectral perception technology can achieve accurate spectral separation and obtain different band image information. Combined with digital image processing technology, it can reveal the hidden information that is difficult to observe by ordinary cameras and accurately reproduce the color, luster, and texture of the real-world objects.
S.J. Rui et al. presented an optimized multispectral TOMBO camera capable of capturing spectral information in different spectral bands of a target by utilizing multiple photodetectors to observe the same point Rui et al. )(2004). J. Jian et al. proposed a new method for the integration of microlens array and multi-channel filter based on MEMS Jin et al. (2013). The structure has multiple optical units, each of which can capture the information of a certain band. By combining with CMOS photodetectors, a multi-spectral imaging system is established. Due to the various production processes of multi-channel filters by pigment dispersion method, the large-scale production efficiency is low. Based on micro-electro-mechanical system (MEMS) technology, A.X. Cao et al. fabricated a compact structure that integrates a microlens array with a multi-channel filter, which can simultaneously achieve imaging and spectral functions through a diffractive beam splitter lens Cao et al. (2019). Diffractive spectral imaging is a staring imaging technology based on diffractive beam splitting lens, which images the scene in the field of view and reads it once through the focal plane array detector. As shown in Figures 20A, B. The spectral image received by the detector is the focused image of a single wavelength at the focal plane and the defocused image of other wavelengths at this position, which will cause interference and blur to the image. The image needs to be processed to obtain a clearer spectral image.
FIGURE 20. Planar spectral imaging. [Reproduced with permission from (Cao et al., 2019)]. (A) Distribution of red, green and blue focus. (B) Red-green-blue multispectral imaging effect.
The field of view of the planar spectral compound eye is small, and the poor imaging quality of the lens edge seriously hinders its wide application. The curved ACE can effectively solve the problem.
J.W. Chen et al. used a hybrid imprinting method to fabricate a multilayer micro-nano optical structure on a non-planar substrate, that is, a multilayer artificial compound eye multispectral imaging system Chen et al. (2017b). The system can realize curved surface spectral imaging, but the system configuration and image processing complexity are high, and the field of view is relatively small. X.D. Yu et al. proposed a new multi-spectral curved compound eye camera (MCCEC) Yu et al. (2020). The system consists of a narrow-band filter, an optical transformation subsystem, and an image sensor. The system can achieve multi-spectral imaging in a large field of view and obtain information in multiple spectral bands. The system has a super large field of view of 120°, which can realize multi-spectral imaging of seven bands, and solve a series of problems such as small field of view. The optical design of the system is shown in Figures 21A, B. According to the new curved surface spectral imaging system proposed by X.D. Yu et al., Y.J. Zhang et al. made further innovations for this system, improved the focal length of the original system, so that it can meet the long-distance work, with high resolution Zhang et al. (2021). The curved image plane formed by the curved compound eye is converted into a plane image plane by using an optical relay system. The Dalsa C5180M industrial camera with a total pixel of 5,120 × 5,120 and a pixel size of 4.5 μm × 4.5 μm is used as the image sensor. The whole sample is shown in Figures 21C–E. The system maintains the advantages provided by the curved compound eye structure, such as large field of view and special multi-aperture imaging without optical crosstalk. In addition, the multi-spectral imaging experiments of the field of view and different targets are carried out. The imaging effect is shown in Figures 21F–K.
FIGURE 21. Curved spectral compound eye imaging. (Reproduced with permission from (Yu et al., 2020; Zhang et al., 2021)). (A) MCCEC cross section diagram. (B) MCCEC multi-spectral channel layout. (C) Bionic multispectral bending compound eye camera structure diagram. (D) Bionic multispectral curved compound eye camera assembly original image. (E) Multispectral curved compound eye display. (F) Spectral imaging of the intermediate field of view. (G) Spectral imaging of the edge field of view. (H) Spectral curves under different field of view. (I) Real plant spectra. (J) Pseudo-plant spectra. (K) Spectral reflectance of true and false plants.
5.1.5 Polarization imaging
Polarization compound eye imaging consists of a lens array and polarization analysis and imaging technology. This technique allows for capturing and analyzing polarization information to provide additional insights beyond conventional intensity-based images. Polarization imaging offers benefits in characterizing surface roughness, texture direction, surface tendencies, surface conductivity, material properties, chemical characteristics, and water content properties of objects. It particularly excels in identifying surface contours and orientations. Moreover, polarization imaging technology has distinct advantages in remote image acquisition, capturing fine details, and recognizing targets with camouflage in challenging environments.
K. Kagawa et al. presented a polarization filter deep-focus compound eye camera for three-dimensional endoscopy Kagawa et al. (2012b). The camera incorporates polarization filters parallel and perpendicular to the polarized light in specific areas of the lens. Additionally, it employs wavefront coding (WFC) technology based on spherical aberration to achieve an extended depth of focus. A prototype called TOMBO, consisting of a 3 × 3 lens configuration and a 2.2 μm pixel color CMOS image sensor, was developed. Although the camera can achieve super-resolution image processing, its field of view (FOV) is limited. To address this, K. Kagawa et al. designed visible and near-infrared polarized compound eyes with a variable FOV by introducing fixed and moving small mirrors Kagawa et al. (2012c). Furthermore, M. Miyata et al. proposed a polarized compound eye camera with compound eye surface optics Miyata et al. (2020). The system consists of a standard image sensor and a metasurface layer. By eliminating the need for filters, the camera significantly reduces the required optical path length for imaging, surpassing the efficiency and size limitations of traditional polarization cameras. It achieves a 2-fold increase in the detected light and reduces the overall thickness to 1/10 of current polarization cameras. The camera exhibits exceptional sensitivity in imaging, with the imaging effect demonstrated in Figures 22C–H. Figures 22A, B depict the configuration of the proposed camera.
FIGURE 22. Polarized compound eye imaging. [Reproduced with permission from (Miyata et al., 2020)]. (A) Conventional focal plane division (DoFP) polarization camera. (B) Cross section of polarization camera based on metasurface. (C–E) composite compound eye imaging and magnification. (F–H) 200 × 200 pixel AoP and linear polarization (DoLP) images.
5.2 Outlook
Over the course of previous decades, significant advancements have been made in the research of artificial compound eyes pertaining to the design of their structures, fabrication techniques, and optical capabilities. Despite these successes, there is still significant room for improvement in artificial compound eyes. The prospects of four anticipated research focus on compound eye especially for curved compound eye are presented as follows.
1) Multi-material integrated manufacturing
Achieving a fully functional compound eye imaging system requires the replication of various components such as the cornea, crystalline cone, pigment cell, rhabdom, and retinula cell. Currently, research efforts are focusing on the precise manufacturing of compound eye lenses, which play a crucial role in image formation. However, to create a comprehensive and autonomous compound eye visual apparatus, it is necessary to integrate multiple components of the imaging system. This integration can be achieved through multi-material integrated manufacturing techniques. By utilizing this approach, different materials can be combined and fabricated together, resulting in a more seamless and efficient assembly of the compound eye imaging system. Multi-material integrated manufacturing allows for the precise placement and alignment of different components, reducing errors that may occur during subsequent assembly processes. This integration enhances the overall performance of the compound eye imaging system and improves its functionality as a whole. By replicating and integrating the various components accurately, researchers aim to create a fully functional, autonomous compound eye visual apparatus that can provide unique imaging capabilities, mimic the natural vision of insects, and find applications in fields like robotics, surveillance, and medical imaging.
Continued research and advancements in multi-material integrated manufacturing techniques will contribute to the development of more sophisticated compound eye imaging systems, bringing us closer to achieving a comprehensive and autonomous visual apparatus based on the principles of compound eyes.
2) Mass production of complex 3D compound eyes
The current mass production of compound eyes relies heavily on mold technology, which has limited three-dimensional controllability. This can restrict the level of precision and flexibility in manufacturing the compound eyes. To address this limitation, advanced 3D forming technologies for compound eyes with higher three-dimensional controllability are still required. These technologies aim to provide more precise and flexible manufacturing processes for compound eyes, allowing for improved functionalities and performance. By utilizing advanced 3D forming technologies, manufacturers can enhance the controllability of the compound eye’s three-dimensional structure, leading to better replication of the natural optical properties and functionalities of compound eyes.
This has significant industrial values in applications such as imaging systems, optical sensors, and other fields where the unique capabilities of compound eyes are desired. Continued research and development in this area can potentially drive advancements in manufacturing techniques, enabling the mass production of compound eyes with higher precision, performance, and industrial applicability.
3) High-stability material compound eye manufacturing technology
The current micro-compound eye structures made primarily of organic or organic-inorganic hybrid materials have indeed shown excellent performance. However, to overcome the limitations in corrosion resistance, heat resistance, mechanical strength, and high damage threshold, the utilization of high stability materials in manufacturing technology is of utmost importance. High stability materials offer enhanced properties in terms of corrosion resistance, heat resistance, mechanical strength, and high damage threshold, which are critical for the practical application of micro-compound eyes in engineering fields. These materials, such as advanced ceramics, engineered alloys, or innovative polymer composites, can provide the necessary durability and stability required for demanding applications. By incorporating high stability materials into the manufacturing process of micro-compound eyes, their performance and applications can be significantly improved. Researchers and engineers are actively exploring and developing new materials and manufacturing techniques to enhance the properties of micro-compound eyes and expand their potential uses in various engineering applications.
The pursuit of manufacturing technology using high stability materials is indeed essential for advancing the development and integration of micro-compound eyes in practical engineering applications. Continued research, collaboration, and innovation in this area will ultimately enable us to overcome the existing limitations and fully unlock the potential of micro-compound eyes.
4) Miniaturized high-resolution curved sensors
Commercially available photoelectric sensors are primarily planar sensors. However, the development of miniaturized high-resolution curved surface sensors has the potential to bring about significant improvements in various performance aspects of compound eye imaging systems. Curved surface sensors, also known as curved image sensors, are designed to mimic the structure of natural compound eyes found in insects and some other organisms. These sensors feature a curved shape that allows for a larger field of view and improved image resolution compared to traditional planar sensors. The main advantage of curved surface sensors is that each pixel on the sensor is oriented towards the center of the curved surface. This means that light rays from different angles can be more accurately captured by the individual pixels, resulting in improved imaging accuracy and a higher resolution across the entire field of view. The curved shape also reduces image distortion and glare, leading to better image quality. In addition to improved resolution and imaging accuracy, curved surface sensors can also offer faster response speeds. By curving the sensor, the distance between the lens and the pixels can be reduced, resulting in shorter optical paths and faster image capture.
Overall, the development of miniaturized high-resolution curved surface sensors has the potential to revolutionize imaging technology by significantly improving the performance of compound eye imaging systems. These sensors can enhance resolution, imaging accuracy, response speed, and other crucial aspects, opening up new possibilities in various industries such as robotics, medical imaging, and surveillance.
6 Conclusion
This paper provides a comprehensive review of microfabrication technologies, photoelectric detection, and applications of miniature compound eyes. The paper begins with an introduction to the structural composition and imaging principles of compound eyes, highlighting the similarities and distinctions. Next, it discusses the microfabrication technologies used for both planar and curved compound eyes, comparing their advantages and disadvantages. The paper then reviews the microfabrication approaches for photoelectric detection in different types of curved artificial compound eyes. Afterward, it lists the existing and potential functional applications of miniature compound eyes. Finally, the future development of compound eyes is discussed, focusing on areas such as multi-material integrated manufacturing technologies, mass production technologies for complex 3D compound eyes, and advancements in high-stability materials and miniaturized high-resolution curved sensors.
In conclusion, compound eyes have significant potential and unique advantages. However, further advancements in materials, microfabrication technologies, and detection are necessary to fully realize their practical applications in various fields.
Author contributions
XJ: Conceptualization, Investigation, Supervision, Visualization, Writing–original draft, Writing–review and editing. SL: Investigation, Visualization, Writing–original draft, Writing–review and editing. RZ: Investigation, Visualization, Writing–original draft. XN: Writing–review and editing. JL: Conceptualization, Supervision, Writing–review and editing.
Funding
The author(s) declare financial support was received for the research, authorship, and/or publication of this article. This research was supported by Science and Technology Department of Jilin Province (20220203034SF).
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
References
Alkaladi, A., and Zeil, J. (2014). Functional anatomy of the fiddler crab compound eye (Uca vomeris: ocypodidae, Brachyura, Decapoda). J. Comp. Neurol. 522 (6), 1264–1283. doi:10.1002/cne.23472
Arganda, S., Hoadley, A. P., Razdan, E. S., Muratore, I. B., and Traniello, J. F. A. (2020). The neuroplasticity of division of labor: worker polymorphism, compound eye structure and brain organization in the leafcutter ant Atta cephalotes. J. Comp. Physiol. A 206 (4), 651–662. doi:10.1007/s00359-020-01423-9
Borrelli, N., Morse, D., Bellman, R., and Morgan, W. (1985). Photolytic technique for producing microlenses in photosensitive glass. Apply Opt. 24, 2520–2525. doi:10.1364/AO.24.002520
Cao, A. X., Pang, H., Zhang, M., Shi, L. F., Deng, Q. L., and Hu, S. (2019). Design and fabrication of an artificial compound eye for multi-spectral imaging. Micromachines 10, 208. doi:10.3390/mi10030208
Cao, J. J., Hou, Z. S., Tian, Z. N., Hua, J. G., Zhang, Y. L., and Chen, Q. D. (2020). Bioinspired zoom compound eyes enable variable-focus imaging. ACS Appl. Mater. interfaces 12, 10107–10117. doi:10.1021/acsami.9b21008
Casares, F., and McGregor, A. P. (2021). The evolution and development of eye size in flies. Wires. Dev. Biol. 10 (2), e380. doi:10.1002/wdev.380
Chakrabarti, M., Hansen, C. D., Stubager, J., Pedersen, T. F., and Pedersen, H. C. (2016). Replication of optical microlens array using photoresist coated molds. Opt. Express 24, 9528–9540. doi:10.1364/OE.24.009528
Chang, C. Y., and Tsai, M. H. (2015). Development of a continuous roll-to-roll processing system for mass production of plastic optical film. J. Micromech Microeng 25, 125014. doi:10.1088/0960-1317/25/12/125014
Chang, C. Y., Yang, S. Y., and Chu, M. H. (2007). Rapid fabrication of ultraviolet-cured polymer microlens arrays by soft roller stamping process. Microelectron. Eng. 84, 355–361. doi:10.1016/j.mee.2006.11.004
Chen, F., Liu, H. W., Yang, Q., Wang, X. H., Hou, C., Bian, H., et al. (2010). Maskless fabrication of concave microlens arrays on silica glasses by a femtosecond-laser-enhanced local wet etching method. Opt. Express 18, 20334–20343. doi:10.1364/OE.18.020334
Chen, F., Yang, Q., Bian, H., Du, G. Q., Liu, K. Y., Meng, X. W., et al. (2014). Micro-nano fabrication of femtosecond laser wet etch. J. Appl. Opt. 35, 150–154. doi:10.5768/JAO201435.0107001
Chen, J., Lee, H. H., Wang, D., Di, S., and Chen, S. C. (2017a). Hybrid imprinting process to fabricate a multi-layer compound eye for multispectral imaging. Opt. Express 25, 4180–4189. doi:10.1364/oe.25.004180
Chen, J. W., Cheng, J. Y., Zhang, D. P., and Chen, S. C. (2016). Precision UV imprinting system for parallel fabrication of large-area micro-lens arrays on non-planar surfaces. Precis. Eng. 44, 70–74. doi:10.1016/j.precisioneng.2015.10.003
Chen, J. W., Lee, H. H., Wang, D. P., Di, S., and Chen, S. C. (2017b). Hybrid imprinting process to fabricate a multi-layer compound eye for multispectral imaging. Opt. Express 25 (4), 4180–4189. doi:10.1364/OE.25.004180
Cheng, Y., Cao, J., Zhang, Y. K., and Hao, Q. (2019). Review of state-of-art artificial compound eye imaging systems. Bioinspir Biomim. 14, 1–37. doi:10.1088/1748-3190/aaffb5
Cherng, Y. S., and Su, G. D. (2014). Fabrication of polydimethylsiloxane microlens array on spherical surface using multi-replication process. Micromech Microeng 24, 015016–15111. doi:10.1088/0960-1317/24/1/015016
Cogal, O., and Leblebici, Y. (2017). An insect eye inspired miniaturized multi-camera system for endoscopic imaging. IEEE Biomed. Circ. S 11, 212–224. doi:10.1109/tbcas.2016.2547388
Cox, W. R., Chen, T., Hayes, D. J., and Grove, M. E. (2001). “Microjet printing of micro-optical interconnects for telecom devices,” in Proc. SPIE 4292 optoelectronic interconnects VIII (San Jose, CA, United States: SPIE), 208–213. doi:10.1117/12.428032
Cox, W. R., Chen, T., Hayes, D. J., Hoenigman, R. F., and Macfarlane, D. L. (1996). “Microjet printing of micro-optical waveguides,” in Conference Proceedings LEOS'96 9th Annual Meeting IEEE Lasers and Electro-Optics Society, Boston, MA, USA, 18-21 November 1996 (IEEE), 40–41. doi:10.1109/LEOS.1996.571538
Deng, S. F., Lyu, J. K., Sun, H. D., Cui, X. B., Wang, T., and Lu, M. (2015a). Fabrication of a chirped artificial compound eye for endoscopic imaging fiber bundle by dose-modulated laser lithography and subsequent thermal reflow. Opt. Eng. 54 (3), 033105. doi:10.1117/1.OE.54.3.033105
Deng, Z., Yong, C., Shan, X., Yang, Q., Bian, H., Du, G., et al. (2016). Dragonfly-eye-inspired artificial compound eyes with sophisticated imaging. Adv. Funct. Mat. 26, 1995–2001. doi:10.1002/adfm.201504941
Deng, Z. F., Yang, Q., Chen, F., Meng, X. W., Bian, H., Yong, J. L., et al. (2015b). Fabrication of large-area concave microlens array on silicon by femtosecond laser micromachining. Opt. Lett. 40, 1928–1931. doi:10.1364/OL.40.001928
Floreano, D., Pericet-Camara, R., Viollet, S., Ruffier, F., Bruckner, A., Leitel, R., et al. (2013). Miniature curved artificial compound eyes. Proc. Natl. Acad. Sci. 110, 9267–9272. doi:10.1073/pnas.1219068110
Frederiksen, R., and Warrant, E. J. (2008). Visual sensitivity in the crepuscular owl butterfly Caligo memnon and the diurnal blue morpho Morpho peleides: a clue to explain the evolution of nocturnal apposition eyes? J. Exp. Biol. 211, 844–851. doi:10.1242/jeb.012179
Grigaliunas, V., Lazauskas, A., Jucius, D., Vironis, D., Abakeviien, B., Smetona, S., et al. (2016). Microlens fabrication by 3D electron beam lithography combined with thermal reflow technique. Microelectron. Eng. 164, 23–29. doi:10.1016/j.mee.2016.07.003
Grimaldi, I. A., Coppola, S., Loffredo, F., Villani, F., Minarini, C., Vespini, V., et al. (2012). Printing of polymer microlenses by a pyro-electrohydrodynamic dispensing approach. Opt. Lett. 37 (13), 2460–2462. doi:10.1364/ol.37.002460
Grimaldi, I. A., Coppola, S., Loffredo, F., Villani, F., Nenna, G., Minarini, C., et al. (2013). Graded-size microlens array by the pyro-electrohydrodynamic continuous printing method. Appl. Opt. 52 (32), 7699–7705. doi:10.1364/ao.52.007699
Guo, F. Z., Ning, S. Y., Feng, J. N., Liu, B., and He, X. H. (2021). Ultrastructure and morphology of the compound eyes of the predatory bug Montandoniola moraguesi (Insecta: Hemiptera: anthocoridae). Arthropod Struct. Dev. 61, 101030. doi:10.1016/j.asd.2021.101030
Guo, R., Xiao, S. Z., Zhai, X. M., Li, J. W., Xia, A. D., and Huang, W. (2006). Micro lens fabrication by means of femtosecond two photon photopolymerization. Opt. express 14, 810–816. doi:10.1364/OPEX.14.000810
Hocheng, H., Wen, T. T., and Yang, S. Y. (2008). Replication of microlens arrays by gas-assisted hot embossing. Mater Manuf. Process 23, 261–268. doi:10.1080/10426910701860830
Hong, M. H., Lin, Y., Xie, Q., Lukyanchuk, B. S., and Senthil Kumar, A. (2006). Microlens array fabrication by laser interference lithography for super-resolution surface nanopatterning. Apply Phys. Lett. 89, 191125. doi:10.1063/1.2374809
Hu, X. J., Zhu, J. M., Hu, Q. H., Zheng, J. J., Yang, D. Y., Zhou, F. L., et al. (2022a). Digital optofluidic compound eyes with natural structures and zooming capability for large-area fluorescence sensing. Biosens. Bioelectron. 195, 113670. doi:10.1016/j.bios.2021.113670
Hu, Z. Y., Zhang, Y. L., Pan, C., Dou, J. Y., Li, Z. Z., Tian, Z. N., et al. (2022b). Miniature optoelectronic compound eye camera. Nat. Commun. 13, 5634. doi:10.1038/s41467-022-33072-8
Huang, C. C., Wu, X. D., Liu, H. W., Aldalali, B., Rogers, J. A., and Jiang, H. R. (2014). Large-field -of-view wide-spectrum artificial reflecting superposition compound eyes. Small 10, 3050–3057. doi:10.1002/smll.201400037
Huang, L. X., Duan, Y. P., Shi, Y. P., and Pang, H. F. (2023). Bioinspired multiple-degrees-of-freedom responsive metasurface by high-entropy-alloy ribbons with hierarchical nanostructures for electromagnetic wave absorption. J. Colloid Interf. Sci. 636, 1–10. doi:10.1016/j.jcis.2023.01.001
Jin, J., Di, S., Yao, Y., Du, R., Gu, M., Yuan, X., et al. (2013). “Design and fabrication of filtering artificial-compound-eye and its application in multispectral imaging,” in International symposium on photoelectronic detection and imaging micro/nano optical imaging technologies and applications SPIE 2013 (Beijing, China: SPIE), 18–24. doi:10.1117/12.2032485
Jing, X., Wang, K. X., Zhu, R. X., Lin, J. Q., Yu, B. J., and Lu, M. M. (2021). Design and fabrication of double-layer curved compound eye via two-photon polymerization. IEEE Photonic Tech. L 33, 231–234. doi:10.1109/LPT.2021.3053584
Jing, X., Zhu, R. X., Wang, K. X., Si, W. F., Zhu, Z. Y., Chen, X. Y., et al. (2022). Transverse additive manufacturing and optical evaluation of miniature thin lenses in ultracompact micro multi-spherical compound eye. Opt. Lasers Eng. 151, 106913. doi:10.1016/j.optlaseng.2021.106913
Kagawa, K., Shogenji, R., Tanaka, E., Yamada, K., and Tanida, J. (2012c). “Variable field-of-view visible and near-infrared polarization compound-eye endoscope,” in Annual International Conference of the IEEE Engineering in Medicine and Biology Society, San Diego, CA, USA, 28 August 2012 - 01 September 2012 (IEEE), 3720–3723. doi:10.1109/EMBC.2012.6346775
Kagawa, K., Tanaka, E., Yamada, K., Kawahito, S., and Tanida, J. (2012b). “Deep-focus compound-eye camera with polarization filters for 3D endoscopes,” in Proceedings of SPIE - the international society for optical engineering (San Francisco, California, United States: SPIE), 24. doi:10.1117/12.908415
Kagawa, K., Yamada, K., Tanaka, E., and Tanida, J. (2012a). A three-dimensional multifunctional compound-eye endoscopic system with extended depth of field. Electron. Commun. Jpn. 95, 14–27. doi:10.1002/ecj.11431
Kamal, W., Lin, J. D., Eleston, S. J., Ali, T., Castrejon-Pita, A. A., and Morris, S. M. (2020). Electrically tunable printed bifocal liquid crystal microlens arrays. Adv. Mater Interfaces 7, 2000578. doi:10.1002/admi.202000578
Kawata, S., Sun, H. B., Tanaka, T., and Takada, K. (2001). Finer features for functional microdevices. Nature 412, 697–698. doi:10.1038/35089130
Ke, X. Z., Yang, S. J., Sun, Y., Liang, J. Y., and Pan, X. Y. (2022). Underwater blue-green LED communication using a double-layered, curved compound-eye optical system. curved compound-eye Opt. Syst. 30 (11), 18599–18616. doi:10.1364/OE.457052
Kim, J., Jeong, K. H., and Lee, L. P. (2005). Artificial ommatidia by self-aligned microlenses and waveguides. Opt. Lett. 30, 5–7. doi:10.1364/OL.30.000005
Kim, Y. K., Ju, J. H., and Kim, S. M. (2018). Replication of a glass microlens array using a vitreous carbon mold. Opt. Express 26, 14936–14944. doi:10.1364/OE.26.014936
Kuo, W. K., Kuo, G. F., Lin, S. Y., and Yu, H. H. (2015). Fabrication and characterization of artificial miniaturized insect compound eyes for imaging. Bioinspir. Biomim. 10 (5), 056010. doi:10.1088/1748-3190/10/5/056010
Land, M. F. (1981). Optics and vision in invertebrates. Handb. Sens. physiology 6, 471–592. doi:10.1007/978-3-642-66907-1_4
Land, M. F. (2005). The optical structures of animal eyes. Curr. Biol. 15, R319–R323. doi:10.1016/j.cub.2005.04.041
Land, M. F., Burton, F. A., and Rochow, V. B. (1979). The optical geometry of euphausiid eyes. J. Comp. Physiol. 130, 49–62. doi:10.1007/bf02582973
Lee, H. S., Park, I., Jeon, K. S., and Lee, E. H. (2010). Fabrication of micro-lenses for optical interconnection using micro ink-jetting technique. Microelectron. Eng. 87, 1447–1450. doi:10.1016/j.mee.2009.11.116
Lee, W. B., and Lee, H. N. (2018). Depth-estimation-enabled compound eyes. Opt. Commun. 412, 178–185. doi:10.1016/j.optcom.2017.12.009
Li, J., Wang, W., Fu, Z., Zhu, R., and Huang, Y. (2023). Fabrication of a dual-focus artificial compound eye with improved imaging based on modified microprinting and air-assisted deformation. Appl. Opt. 62, D125–D130. doi:10.1364/AO.476320
Li, J., Wang, W. J., Mei, X. S., Pan, A. F., Sun, X. F., Liu, B., et al. (2019). Artificial compound eyes prepared by a combination of air-assisted deformation modified laser swelling, and controlled crystal growth. ACS Nano 13, 114–124. doi:10.1021/acsnano.8b04047
Li, L., Hao, Y. P., Xu, J. L., Liu, F. L., and Lu, J. (2018). The design and positioning method of a flexible zoom artificial compound eye. Micromachines 9, 319. doi:10.3390/mi9070319
Li, L., and Yi, A. Y. (2010). Development of a 3D artificial compound eye. Opt. Express 18, 18125–18137. doi:10.1364/OE.18.018125
Li, L., and Yi, A. Y. (2012). Design and fabrication of a freeform microlens array for a compact large-field-of-view compound-eye camera. Appl. Opt. 51, 1843–1852. doi:10.1364/AO.51.001843
Li, M. J., Yang, T. Z., Yang, Q., Fang, Z., Bian, H., Zhang, C. J., et al. (2022). Bioinspired anti-fogging and anti-fouling artificial compound eyes. Adv. Opt. Mater. 10, 2200861. doi:10.1002/adom.202200861
Liang, W. L., Pan, J. G., and Su, G. D. (2019). One-lens camera using a biologically based artificial compound eye with multiple focal lengths. Optica 6, 326–334. doi:10.1364/OPTICA.6.000326
Lim, U. T., and Ben-Yakir, D. (2020). Visual sensory systems of predatory and parasitic arthropods. Biocontrol Sci. Tech. 30 (7), 728–739. doi:10.1080/09583157.2020.1752362
Lin, J. Q., Kan, Y. D., Jing, X., and Lu, M. M. (2018). Design and fabrication of a three-dimensional artificial compound eye using two-photon polymerization. Micromachines 9 (7), 336. doi:10.3390/mi9070336
Liu, F., Yang, Q., Bian, H., Zhang, F., Hou, X., Kong, D., et al. (2019b). Artificial compound eye-tipped optical fiber for wide field illumination. Opt. Lett. 44, 5961–5964. doi:10.1364/OL.44.005961
Liu, F., Zhang, F., Bian, H., Yang, Q., Li, M. J., and Chen, F. (2020). Development and preparation of refractive infrared microlens array device. Laser Optoelectron. Prog. 57, 071607. doi:10.3788/LOP57.071607
Liu, X. Q., Yang, S. N., Yu, L., Chen, Q. D., Zhang, Y. L., and Sun, H. B. (2019a). Rapid engraving of artificial compound eyes from curved sapphire substrate. Adv. Funct. Mat. 29 (18), 1900037. doi:10.1002/adfm.201900037
Luan, S. Y., Cao, H., Deng, H. F., Zhang, G. X., Song, Y., and Gui, C. Q. (2022). Artificial hyper compound eyes enable variable-focus imaging on both curved and flat surfaces. ACS Appl. Mater. Interfaces 14, 46112–46121. doi:10.1021/acsami.2c15489
Ma, M. C., Zhang, Y., Deng, H. X., Gao, X. C., Gu, L., Sun, Q. Z., et al. (2021). Super-resolution and super-robust single-pixel superposition compound eye. Opt. Laser. Eng. 146, 106699. doi:10.1016/j.optlaseng.2021.106699
Ma, Z. C., Hu, X. Y., Zhang, Y. L., Liu, X. Q., Hou, Z. S., Niu, L. G., et al. (2019). Smart compound eyes enable tunable imaging. Adv. Funct. Mat. 29, 1903340. doi:10.1002/adfm.201903340
Maddern, W., and Wyeth, G. (2008). “Development of a hemispherical compound eye for egomotion estimation,” in Proceedings of the 2008 australasian conference on robotics and automation (Australia: Australian Robotics & Automation Association ARAA), 1–8. Avaliable at: http://espace.library.uq.edu.au/view/UQ:176364.
Matsuda, K., and Wilder, M. N. (2014). Eye structure and function in the giant freshwater prawn Macrobrachium rosenbergii. Macrobrachium Rosenb. 80 (3), 531–541. doi:10.1007/s12562-014-0734-x
Miyata, M., Nakajima, M., and Hashimoto, T. (2020). Compound-eye metasurface optics enabling a high-sensitivity, ultra-thin polarization camera. Opt. express 28, 9996–10014. doi:10.1364/OE.389591
Morehouse, N. I., Buschbeck, E. K., Zurek, D. B., Steck, M., and Porter, M. L. (2017). Molecular evolution of spider vision: new opportunities, familiar players. Fam. Play. Biol. Bull. 233 (1), 21–38. doi:10.1086/693977
Nilsson, D. E. (1989). Optics and evolution of the compound eye. Berlin Heidelberg: Springer, 30–73. doi:10.1007/978-3-642-74082-4_3
Oikawa, M., Iga, K., Sanada, T., Yamamoto, N., and Nishizawa, K. (1981). Array of distributed-index planar micro-lenses prepared from ion exchange technique. Jpn. J. Appl. Phys. 20, 296–298. doi:10.1143/JJAP.20.L296
Pan, A., Gao, B., Chen, T., Si, J., Li, C., Chen, F., et al. (2014). Fabrication of concave spherical microlenses on silicon by femtosecond laser irradiation and mixed acid etching. Opt. express 22, 15245–15250. doi:10.1364/OE.22.015245
Pan, C. T., and Su, C. H. (2008). Fabrication of high fill factor optical film using two-layer photoresists. J. Mod. Opt. 55, 33–42. doi:10.1080/09500340701260032
Park, M. K., Lee, H. J., Park, J. S., Kim, M., Bae, J. M., Mahmud, I., et al. (2014). Design and fabrication of multi-focusing microlens array with different numerical apertures by using thermal reflow method. J. Opt. Soc. Korea 18, 71–77. doi:10.3807/JOSK.2014.18.1.071
Parry, E., Boils, S., Elston, S. J., Castrejon-Pita, A. A., and Morris, S. M. (2017). Drop-on-Demand inkjet printing of thermally tunable liquid crystal microlenses. Adv. Eng. Mater 20, 1700774. doi:10.1002/adem.201700774
Peng, L. F., Zhang, C. P., Wu, H., Yi, P. Y., Lai, X. M., and Ni, J. (2016). Continuous fabrication of multiscale compound eyes arrays with antireflection and hydrophobic properties. IEEE Trans. Nanotechnol. 15 (6), 971–976. doi:10.1109/tnano.2016.2618005
Popovic, Z. D., Sprague, R. A., and Connell, G. (1988). Technique for monolithic fabrication of microlens arrays. Apply Opt. 27, 1281–1284. doi:10.1364/AO.27.001281
Rui, S., Kitamura, Y., Yamada, K., Miyatake, S., and Tanida, J. (2004). Multispectral imaging using compact compound optics. Opt. Express 12, 1643–1655. doi:10.1364/OPEX.12.001643
Shi, C. Y., Wang, Y. Y., Liu, C. Y., Wang, T. S., Zhang, H. X., Liao, W. X., et al. (2017). SCECam: a spherical compound eye camera for fast location and recognition of objects at a large field of view. Opt. Express 25, 32333–32345. doi:10.1364/OE.25.032333
Smolka, J., Zeil, J., and Hemmi, J. M. (2011). Natural visual cues eliciting predator avoidance in fiddler crabs. Proc. R. Soc. B Biol. Sci. 278, 3584–3592. doi:10.1098/rspb.2010.2746
Somanathan, H., Borges, R. M., Warrant, E. J., and Kelber, A. (2008). Visual ecology of Indian carpenter bees I: light intensities and flight activity. J. Comp. Physiola. 194 (1), 97–107. doi:10.1007/s00359-007-0291-1
Somanathan, H., Kelber, A., Borges, R. M., Wallén, R., and Warrant, E. J. (2009). Visual ecology of Indian carpenter bees II: adaptations of eyes and ocelli to nocturnal and diurnal lifestyles. J. Comp. Physiola. 195 (6), 571–583. doi:10.1007/s00359-009-0432-9
Song, Y. M., Park, H. G., Lee, G. J., and Park, J. S. (2017). Artificially engineered compound eye sensing systems. Springer International Publishing, 157–174. doi:10.1007/978-3-319-33201-7
Song, Y. M., Xie, Y. Z., Malyarchuk, V., Xiao, J. L., Jung, I., Choi, K. J., et al. (2013). Digital cameras with designs inspired by the arthropod eye. Nature 497, 95–99. doi:10.1038/nature12083
Tian, Z. N., Yao, W. G., Xu, J. J., Yu, Y. H., Chen, Q. D., and Sun, H. B. (2015). Focal varying microlens array. Opt. Lett. 40, 4222–4225. doi:10.1364/OL.40.004222
Vespini, V., Coppola, S., Todino, M., Paturzo, M., Bianco, V., Grillia, S., et al. (2016). Forward electrohydrodynamic inkjet printing of optical microlenses on microfluidic devices. Lab a Chip 16, 326–333. doi:10.1039/c5lc01386k
Vespini, V., Gennari, O., Coppola, S., Nasti, G., Mecozzi, L., Pagliarulo, V., et al. (2015). Electrohydrodynamic assembly of multiscale PDMS microlens arrays. IEEE J. Sel. Top. quantum Electron. 21 (4), 399–406. doi:10.1109/jstqe.2014.2367656
Viollet, S., Godiot, S., Leitel, R., Buss, W., Breugnon, P., Menouni, M., et al. (2014). Hardware architecture and cutting-edge assembly process of a tiny curved compound eye. Sensors 14 (11), 21702–21721. doi:10.3390/s141121702
Wagner, H. J., Genner, M. G., Partridge, J. C., Chung, W. S., Marshall, N. J., Robison, B. H., et al. (2022). Diversity and evolution of optically complex eyes in a family of deep-sea fish: ocular diverticula in barreleye spookfish (Opisthoproctidae). Front. Ecol. Evol. 10, 1044565. doi:10.3389/fevo.2022.1044565
Wang, S. K., Zhang, F., Yang, Q., Li, M. J., Hou, X., and Chen, F. (2022). Chalcogenide glass IR artificial compound eyes based on femtosecond laser microfabrication. Adv. Mat. Technol. 8 (2), 745–747. doi:10.1002/admt.202200741
Wang, W. J., Li, J., Li, R. H., Li, B. Q., Mei, X. S., and Sun, X. F. (2019a). Fabrication of hierarchical micro/nano compound eyes. ACS Appl. Mat. Interfaces 11 (37), 34507–34516. doi:10.1021/acsami.9b13355
Wang, Y., Gong, Y., Huang, S. M., Xing, X. C., Lv, Z. Y., Wang, J. J., et al. (2021). Memristor-based biomimetic compound eye for real-time collision detection. Nat. Commun. 12 (1), 5979. doi:10.1038/s41467-021-26314-8
Wang, Y. Y., Shi, C. Y., Liu, C. Y., Yu, X. D., Xu, H. R., Wang, T. S., et al. (2019b). Fabrication and characterization of a polymeric curved compound eye. J. Micromech Microeng 29, 055008. doi:10.1088/1361-6439/ab0e9f
Wei, Y., Yang, Q., Bian, H., Chen, F., Li, M. J., Dai, Y. Z., et al. (2018). Fabrication of high integrated microlens arrays on a glass substrate for 3D micro-optical systems. Appl. Surf. Sci. 457, 1202–1207. doi:10.1016/j.apsusc.2018.06.267
Wu, D., Wang, J. N., Niu, L. G., Zhang, X. L., Wu, S. Z., Chen, Q. D., et al. (2014). Bioinspired fabrication of high-quality 3D artificial compound eyes by voxel-modulation femtosecond laser writing for distortion-free wide-field-of-view imaging. Adv. Opt. Mat. 2, 751–758. doi:10.1002/adom.201400175
Xu, H. R., Zhang, Y. J., Wu, D. S., Zhang, G., Wang, Z. Y., Feng, X. P., et al. (2020). Biomimetic curved compound-eye camera with a high resolution for the detection of distant moving objects. Opt. Lett. 45, 6863–6866. doi:10.1364/OL.411492
Xu, M., Li, S. H., Li, J., Zhang, L., and Lu, H. B. (2022). Fabrication of a bionic compound eye on a curved surface by using a self-assembly technique. Opt. Express 30 (17), 30750–30759. doi:10.1364/OE.467657
Yang, D., Jhaveri, S. J., and Ober, C. K. (2005). Three-dimensional microfabrication by two-photon lithography. MRS Bull. 30, 976–982. doi:10.1557/mrs2005.251
Yao, D. G., Nagarajan, P., Li, L., and Yi, A. Y. (2010). A two-station embossing process for rapid fabrication of surface microstructures on thermoplastic polymers. Polym. Eng. Sci. 47, 530–539. doi:10.1002/pen.20721
Yong, J., Yang, Q., Chen, F., Du, G., Shan, C., Farooq, U., et al. (2015). Using an "underwater superoleophobic pattern" to make a liquid lens array. RSC Adv. 5, 40907–40911. doi:10.1039/C5RA04671H
Yu, L., Li, W., Ding, Y., Wei, H., Shi, J., Wang, D., et al. (2013). Direct fabrication of microlens arrays with high numerical aperture by ink-jetting on nanotextured surface. Appl. Surf. Sci. 279, 36–40. doi:10.1016/j.apsusc.2013.03.148
Yu, X. D., Liu, C. Y., Zhang, Y. J., Xu, H. R., Wang, Y. Y., and Yu, W. X. (2020). Multispectral curved compound eye camera. Opt. express 28, 9216–9231. doi:10.1364/OE.385368
Zhai, Y. Q., Niu, J. Q., Liu, J. Q., and Yang, B. (2021). A rapid precision fabrication method for artificial compound eyes. Int. J. Optomechatroni. 15 (1), 160–169. doi:10.1080/15599612.2021.1968084
Zhang, Y. J., Xu, H. R., Guo, Q., Wu, D. S., and Yu, W. X. (2021). Biomimetic multispectral curved compound eye camera for real-time multispectral imaging in an ultra-large field of view. Opt. Express 29, 33346–33356. doi:10.1364/OE.438710
Keywords: compound eye, bionic manufacturing, microfabrication, vision imaging, microoptics
Citation: Jing X, Li S, Zhu R, Ning X and Lin J (2024) Miniature bioinspired artificial compound eyes: microfabrication technologies, photodetection and applications. Front. Bioeng. Biotechnol. 12:1342120. doi: 10.3389/fbioe.2024.1342120
Received: 21 November 2023; Accepted: 11 January 2024;
Published: 16 February 2024.
Edited by:
Nic Davis Leipzig, University of Akron, United StatesReviewed by:
Huan Hu, Zhejiang University, ChinaSara Coppola, National Research Council (CNR), Italy
Copyright © 2024 Jing, Li, Zhu, Ning and Lin. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Xian Jing, jingxian@ccut.edu.cn; Jieqiong Lin, linjieqiong2018@126.com