- Tsinghua Shenzhen International Graduate School, Tsinghua University, Shenzhen, China
Due to convenient operation and robust imaging, multi-wavelength phase retrieval has been widely applied in lensfree on-chip digital holographic microscope (LFOCDHM). Nevertheless, the insufficient diffraction variation and small number of measurements on the LFOCDHM make it difficult to eliminate the twin image by multi-wavelength phase retrieval. We propose a multi-wavelength phase retrieval for LFOCDHM based on energy constraint, global update strategy, and vector extrapolation acceleration. Simulations and experiments on the LFOCDHM show that our proposed method realizes efficient elimination effect and robust reconstruction with three wavelengths for illumination while maintaining fast convergence. More importantly, the proposed method is simple and non-parametric. It is believed that the proposed method could provide a promising solution for LFOCDHM.
1 Introduction
Lensfree on-chip digital holographic microscope (LFOCDHM) is a new computational imaging technology. Due to its large field of view, high resolution, cost-effectiveness, perfect portability, and easy operation (Ozcan and McLeod 2016; Zhang et al., 2020), LFOCDHM plays an important role in analysis applications requiring large statistics, such as the Papanicolaou smear test for cervical cancer (Greenbaum and Ozcan 2012; Greenbaum et al., 2014) and blood smear inspection for malaria diagnosis (Bishara et al., 2011). LFOCDHM is essentially in-line holography that has the twin image in the direct reconstruction result and the twin image reduces the imaging quality. Iterative phase retrieval (IPR) method provides a feasible and simple computational method to eliminate the twin image (Gerchberg 1972; Fienup 1982; Latychevskaia 2019). To avoid the need for prior knowledge of samples, different multi-intensity IPRs have been proposed, including lateral translation of image sensors (Wu et al., 2016), axial scanning of sample-to-sensor distances (Zhang et al., 2017), etc.
In contrast to the IPR algorithm described above, wavelength-scanning (Bao et al., 2012; Noom et al., 2014; Sanz et al., 2015; Zuo et al., 2015) is a common practice on LFOCDHM, which avoids complex and time-consuming mechanical operations and steadily eliminates the twin image through multi-wavelength phase retrieval (MWPR). Due to the close sample-to-sensor distance and the small number of measurements required to ensure imaging resolution and convenient operation, LFOCDHM cannot produce sufficient diffraction diversity. This limitation leads to a series of problems such as low convergence accuracy, susceptibility to noise interference, and slow convergence speed of MWPR, making it difficult to eliminate the twin image. Therefore, a MWPR with effective elimination, stable reconstruction, and fast convergence is essential for LFOCDHM.
The performance of MWPR is mainly improved from three aspects. First, when appropriate constraints are imposed on the object plane, efficient elimination effect will be realized with a small number of wavelengths. For example, the weighted feedback constraint (Cheng et al., 2018) and the energy constraint (Latychevskaia and Fink, 2007; Li et al., 2016) realized efficient elimination effect without prior knowledge about the sample. Second, an appropriate updating strategy will improve the stability and robustness against the interference of noise. For example, the adaptive step-size strategy (Zuo et al., 2016; Wu et al., 2021) and the global update strategy (Liu et al., 2015; Gao and Cao, 2021) reinforced the true signal while reducing the influence of noise without prior knowledge about the noise statistics. Last but not least, the technique for the acceleration of iterative image restoration algorithms ensures great convergence accuracy while improving the convergence speed significantly. For instance, the vector extrapolation acceleration method (Biggs and Mark 1997) achieved favorable convergence performance without complex parameter calibration. Nevertheless, none of the existing research was carried out from all three aspects simultaneously. The potential of MWPR has not been fully explored. It is desirable that a new MWPR can be proposed for LFOCDHM to realize simple, clear, stable, and fast imaging.
In this work, we propose a MWPR based on energy constraint, global update strategy and vector extrapolation acceleration named MWPREGV for fast and robust elimination of the twin image on LFOCDHM. MWPREGV realizes more efficient elimination effect and more stable reconstruction by energy constraint and global update strategy, and meanwhile it improves the convergence speed by vector acceleration method. At the same time, the MWPREGV is simple and non-parametric. By numerical simulation and experimental verification, LFOCDHM with MWPREGV is able to provide simple, clear, stable, and fast imaging under three wavelength illumination.
2 Principles
2.1 Multi-Wavelength Lensfree On-Chip Digital Holographic Microscope
The LFOCDHM is a cost-effective and compact system without any lenses or other optical elements between the object and the sensor plane, and it places the sample as close as possible to the imaging sensor to obtain a wide-field hologram. Multi-wavelength LFOCDHM uses different wavelengths of light sources to irradiate the sample to record different holograms shown in Figure 1.
The hologram recorded by LFOCDHM under the assumption of a thin sample is given by
where
where
This assumption implies that
Due to the inherent ill-posedness of the phase retrieval problem, finding the desired
FIGURE 2. Two-dimensional illustration of the IPR reconstruction from (A) a single-intensity image (
The size of the intersection set is related to the diffraction diversity determined by the difference and number of holograms. When there is sufficient diffraction diversity, the size of the intersection will be small and the MWPR will find the desired
2.2 Energy Constraint
The intensity of the hologram is mainly influenced by the intensity of the reference light. Dividing the measured hologram
The basic physical notion of energy conservation requires that absorption will not lead to an increased amplitude following a scattering process. Since the normalized hologram eliminates the effect of the reference light intensity which is equivalent to irradiating the sample with a unit light wave, the amplitude
where
2.3 Global Update Strategy
Figure 3 shows the computational flowchart of two common update strategies for MWPR in the
The incremental update strategy converges quickly. However, it is an error accumulation process, resulting in iterative computation being sensitive to noise in the case of a small number of measurements. As a result, the incremental update strategy leads to unstable convergence and imaging artifacts under noise interference. Inexpensive imaging sensors are prone to introduce a series of disturbances such as scattering noise, dark noise, and readout noise during image acquisition, which is especially challenging for low-cost LFOCDHM. Compared with the incremental update strategy, the averaging operation in the global update strategy can effectively suppress the effect of noise and improves the convergence stability. Therefore, the global update strategy is more suitable for LFOCDHM. However, it converges slowly.
2.4 Vector Extrapolation Acceleration Method
The use of acceleration methods can compensate for the disadvantage of slow convergence of global update strategy. Compared with other acceleration methods, the vector extrapolation acceleration method requires only a small amount of information about the iterative algorithm to improve the convergence speed and convergence accuracy, which is nonparametric. This acceleration method is a form of vector extrapolation, which gains a correction step and information for adjusting the step length based on previous iteration. Since IPR is to recover the missing phase, we chose the vector extrapolation acceleration method to update the phase. This process in the
where
3 Performance Analysis of Multi-Wavelength Phase Retrieval
3.1 Numerical Results
Algorithmic details about the MWPREGV are shown in Figure 4 as follows: (1) initializing the first estimation of
To produce sufficient diffraction variations, a virtual object is illuminated by
where
We first compared the performance of MWPR and MWPR based on energy constraint (MWPRE). When the distance from the virtual object to sensor is 30 mm, MWPR eliminates most of the twin image after 50 iterations, as shown in Figure 6A. When the distance from the virtual object to sensor is 1 mm, MWPR only partially eliminates the twin image after 50 iterations due to insufficient diffraction variation, resulting in a large deviation between
FIGURE 6. Reconstruction by (A) MWPR when the distance from the virtual object to sensor is 30 mm. Reconstruction by (B) MWPR and (C) MWPRE when the distance from the virtual object to sensor is 1 mm. (D) Convergence performance of MWPR and MWPRE.
Next, we compared the convergence behavior of the incremental update strategy and global update strategy on the MWPRE (MWPREI and MWPREG). The MWPREI converges much faster than the global update strategy and has a better convergence accuracy when the ideal holograms and background images without noise are used, as shown in Figure 7A. Nevertheless, when adding white Gaussian noise to obtain holograms and background images with a signal-to-noise ratio of 30 dB, we find that the MWPREG achieves better convergence accuracy as expected, as shown in Figure 7B. Therefore, the global update strategy is more suitable for LFOCDHM with a lot of noisy interferences.
Finally, we tested the impact of the acceleration algorithm on the MWPREG, as shown in Figure 8. Compared with the MWPREG, the MWPREGV achieves more efficient elimination and faster convergence, which compensates for the disadvantage of slow convergence due to the global update strategy without tedious parameter calibration.
FIGURE 8. Reconstruction by (A) MWPREG and (B) MWPREGV. (C) Convergence performance of MWPREG and MWPREGV.
3.2 Validation on Experimental Data
We tested the proposed method on ant mounts, housefly leg mounts, and bee wing mounts. The experimental setup is shown in Figure 1. An RGB LED (LZ4-04DCA,
Figure 9B shows full FOV(∼27.78 mm2) holograms of the LFOCDHM captured at the 523 nm wavelength, which has a larger field of view than microscopic images taken with a 4 × times objective lens shown in the Figure 9A and Figure 9C show the reconstructed amplitude distribution by using MWPR after 15 iterations, indicating that only partial elimination of the twin image can be achieved. In contrast, MWPRE eliminates most of the twin image after 15 iterations, as shown in Figure 9D. However, the reconstruction by MWPRE is not satisfactory due to the interference of noise, which is far from the microscopic images taken with a ×4 objective lens. Under the same conditions, MWPREGV realizes more efficient elimination effect after the same number of iterations, making the reconstruction similar to the microscopic images taken with a ×4 objective lens, as shown in Figure 9E. And as shown in Figure 9F, MWPREGV converges to a stable value with a faster rate compared to MWPREG.
FIGURE 9. (A) Microscope images taken with a ×4 objective lens. (B) Full-FOV raw hologram captured at the 523 nm wavelength. The reconstructed amplitude by (C) MWPR, (D) MWPRE, and (E) MWPREGV. (F) Convergence performance of MWPREG and MWPREGV.
4 Conclusion
In this study, we propose a MWPR based on energy constraint, global update strategy, and vector extrapolation acceleration for LFOCDHM, termed MWPREGV. MWPREGV realizes efficient elimination effect by imposing energy constraint on the object plane, and meanwhile it combines the global update strategy and the vector extrapolation acceleration to improve the stability and robustness of the reconstruction towards noise yet retains the fast convergence speed. More importantly, MWPREGV avoids the need for complex parameter calibrations, which is attractive for simplifying the operation of LFOCDHM. Simulation and experimental results show that LFOCDHM with MWPREGV is feasible to realize clear, stable, and fast imaging under three-wavelength illumination. Compared to the microscope with a ×4 objective lens, LFOCDHM with MWPREGV realizes almost the same imaging effect with a larger field of view at a lower cost, which is believed to have more potential application directions in the future.
Data Availability Statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.
Author Contributions
QW, JM, and PS performed the research and wrote the manuscript. All authors have read and approved the content of the manuscript.
Funding
This work was supported by Shenzhen general research fund (JCYJ20190813172405231 and JCYJ20200109143031287).
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s Note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
References
Bao, P., Situ, G., Pedrini, G., and Osten, W. (2012). Lensless Phase Microscopy Using Phase Retrieval with Multiple Illumination Wavelengths. Appl. Opt. 51 (22), 5486. doi:10.1364/ao.51.005486
Biggs, D., and Mark, A. (1997). Acceleration of Iterative Image Restoration Algorithms. Appl. Opt. 36 (8), 1766. doi:10.1364/ao.36.001766
Bishara, W., Sikora, U., Mudanyali, O., Su, T.-W., Yaglidere, O., Luckhart, S., et al. (2011). Holographic Pixel Super-resolution in Portable Lensless On-Chip Microscopy Using a Fiber-Optic Array. Lab. Chip 11 (7), 1276–1279. doi:10.1039/c0lc00684j
Gao, Y., and Cao, L. (2021). Generalized Optimization Framework for Pixel Super-resolution Imaging in Digital Holography. Opt. Express 29 (18), 28805–28823. doi:10.1364/OE.434449
Gerchberg, R. W. (1972). A Practical Algorithm for the Determination of Phase from Image and Diffraction Plane Pictures. Optik 35, 237–250.
Greenbaum, A., Zhang, Y., Feizi, A., Chung, P. L., Luo, W., Kandukuri, S. R., et al. (2014). Wide-field Computational Imaging of Pathology Slides Using Lens-free On-Chip Microscopy. Sci. Transl Med. 6 (267), 267ra175. doi:10.1126/scitranslmed.3009850
Greenbaum, A., and Ozcan, A. (2012). Maskless Imaging of Dense Samples Using Pixel Super-resolution Based Multi-Height Lensfree On-Chip Microscopy. Opt. Express 20 (3), 3129–3143. doi:10.1364/oe.20.003129
Guo, C., Li, Q., Zhang, X., Tan, J., Liu, S., and Liu, Z. (2018). Enhancing Imaging Contrast via Weighted Feedback for Iterative Multi-Image Phase Retrieval. J. Biomed. Opt. 23 (1), 1–10. doi:10.1117/1.JBO.23.1.016015
Latychevskaia, T., and Fink, H.-W. (2007). Solution to the Twin Image Problem in Holography. Phys. Rev. Lett. 98 (23), 233901. doi:10.1103/PhysRevLett.98.233901
Latychevskaia, T. (2019). Iterative Phase Retrieval for Digital Holography: Tutorial. J. Opt. Soc. Am. A. 36 (12), D31–D40. doi:10.1364/JOSAA.36.000D31
Li, Y., Xiao, W., and Pan, F. (2016). Phase Retrieval Method from Multiple-Wavelength Holograms for In-Line Holography. Optik 127 (1), 90–95. doi:10.1016/j.ijleo.2015.10.017
Liu, Z., Guo, C., Tan, J., Wu, Q., Pan, L., and Liu, S. (2015). Iterative Phase-Amplitude Retrieval with Multiple Intensity Images at Output Plane of Gyrator Transforms. J. Opt. 17 (2), 025701. doi:10.1088/2040-8978/17/2/025701
Noom, D. W. E., Boonzajer Flaes, D. E., Labordus, E., Eikema, K. S. E., and Witte, S. (2014). High-speed Multi-Wavelength Fresnel Diffraction Imaging. Opt. Express 22 (25), 30504–30511. doi:10.1364/OE.22.030504
Ozcan, A., and McLeod, E. (2016). Lensless Imaging and Sensing. Annu. Rev. Biomed. Eng. 18, 77–102. doi:10.1146/annurev-bioeng-092515-010849
Sanz, M., Picazo-Bueno, J. A., García, J., and Micó, V. (2015). Improved Quantitative Phase Imaging in Lensless Microscopy by Single-Shot Multi-Wavelength Illumination Using a Fast Convergence Algorithm. Opt. Express 23 (16), 21352–21365. doi:10.1364/OE.23.021352
Wu, X., Sun, J., Zhang, J., Lu, L., Chen, R., Chen, Q., et al. (2021). Wavelength-scanning Lensfree On-Chip Microscopy for Wide-Field Pixel-Super-Resolved Quantitative Phase Imaging. Opt. Lett. 46 (9), 2023–2026. doi:10.1364/OL.421869
Wu, Y., Zhang, Y., Luo, W., and Ozcan, A. (2016). Demosaiced Pixel Super-resolution for Multiplexed Holographic Color Imaging. Sci. Rep. 6, 28601. doi:10.1038/srep28601
Zhang, J., Sun, J., Chen, Q., Li, J., and Zuo, C. (2017). Adaptive Pixel-Super-Resolved Lensfree In-Line Digital Holography for Wide-Field On-Chip Microscopy. Sci. Rep. 7 (1), 11777. doi:10.1038/s41598-017-11715-x
Zhang, J., Sun, J., Chen, Q., and Zuo, C. (2020). Resolution Analysis in a Lens-free On-Chip Digital Holographic Microscope. IEEE Trans. Comput. Imaging 6, 697–710. doi:10.1109/tci.2020.2964247
Zuo, C., Sun, J., and Chen, Q. (2016). Adaptive Step-Size Strategy for Noise-Robust Fourier Ptychographic Microscopy. Opt. Express 24 (18), 20724–20744. doi:10.1364/OE.24.020724
Keywords: phase retrieval, computational imaging, lensfree on-chip holography, image reconstruction, multi-wavelength
Citation: Wang Q, Ma J and Su P (2022) A Multi-Wavelength Phase Retrieval With Multi-Strategy for Lensfree On-Chip Holography. Front. Photonics 3:865666. doi: 10.3389/fphot.2022.865666
Received: 30 January 2022; Accepted: 21 February 2022;
Published: 28 March 2022.
Edited by:
Jun Wang, Sichuan University, ChinaReviewed by:
Chao Zuo, Nanjing University of Science and Technology, ChinaJianglei Di, Guangdong University of Technology, China
Copyright © 2022 Wang, Ma and Su. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Ping Su, su.ping@sz.tsinghua.edu.cn