Abstract
A deep neural network for non-orthogonal input channel encoding is proposed to recover speckle images through a multimode fiber. This novel approach could shed new light on the non-orthogonal optical multiplexing over a scattering medium.
Subject terms: Fibre optics and optical communications, Imaging and sensing
Optical multiplexing is one of the key technologies of modern fiber communication, where wavelength division multiplexing, polarization division multiplexing, and space division multiplexing are typical examples1–5. The fundamental enabler of division multiplexing is orthogonality among multiplexing channels in a single-mode fiber, where the cost of digital signal postprocessing can be substantially reduced1,3. Distinct from the single-mode fiber, a multimode fiber that supports thousands of propagation modes could be a potential candidate for achieving high-throughput transmission of optical information5.
Nowadays, deep learning has become a popular and promising tool in many aspects of optics, including but not limited to holography6,7, optical metrology8, inverse design of optical devices9, and computational imaging10–13, etc. Particularly, deep neural networks have been applied in tackling multiple scattering problems in strongly scattering media14–18, where the disturbed information encoded on the input wavefront can be effectively retrieved from a speckle output in a one-to-one manner.
In a recent publication by Pan et al. in Nature Communications, the research team introduced a concept of non-orthogonal optical multiplexing through a multimode fiber by the deep neural network19, where multiple information sources encoded in spatial overlapping non-orthogonal input channels mediated by the same polarization and wavelength can be demultiplexed using a single-shot intensity detection. In this process, the information encoded in phase and amplitude dimensions is thoroughly scrambled, resulting in a chaotic speckle output.
This important work solved an inversion problem that the complicated mapping relationship between two non-orthogonal multiplexing input channels and a speckle output of the multimode fiber can be acquired using a deep neural network (Fig. 1), where the neural network consists of a fully connected network and a ConvNet. The multiplexed information at the input of the multimode fiber dramatically increases the complexity of information retrieval from a single speckle image compared with the one-to-one mapping case. Essentially, this one-to-multiple mapping is enabled by the multiple scattering of the multimode fiber that slightly different inputs will result in distinct speckle patterns at the output of the multimode fiber, facilitating the distinct identification of given non-orthogonal inputs in parametric space. Even multiplexing uncorrelated binary information and natural scene images with diverse properties can be effectively retrieved with high fidelity utilizing a single-shot speckle pattern, indicating the possibility of generalizing the proposed network to other scenarios of scattering.
Fig. 1. Schematic of non-orthogonal optical multiplexing over an multimode fiber.
Non-orthogonal optical multiplexing via spatial overlapped input channels with the same polarization and wavelength through a multimode fiber using deep learning
Utilizing advanced neural networks can further boost the fidelity of non-orthogonal multiplexing over a strongly scattering medium. As envisioned by the authors, one of the future works that can be carried out is the combination of a neural network with a physical model to release the data burden and facilitate the broader applications of this concept in other disciplines.
Conflict of interest
The authors declare no competing interests.
References
- 1.Liu JY, et al. 1-Pbps orbital angular momentum fibre-optic transmission. Light Sci. Appl. 2022;11:202. doi: 10.1038/s41377-022-00889-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Zou KH, et al. High-capacity free-space optical communications using wavelength- and mode-division-multiplexing in the mid-infrared region. Nat. Commun. 2022;13:7662. doi: 10.1038/s41467-022-35327-w. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Chen ZY, et al. Use of polarization freedom beyond polarization-division multiplexing to support high-speed and spectral-efficient data transmission. Light Sci. Appl. 2017;6:e16207. doi: 10.1038/lsa.2016.207. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Huang ZZ, Cao LC. High bandwidth-utilization digital holographic multiplexing: an approach using Kramers–Kronig relations. Adv. Photonics Res. 2022;3:2100273. doi: 10.1002/adpr.202100273. [DOI] [Google Scholar]
- 5.Richardson DJ, Fini JM, Nelson LE. Space-division multiplexing in optical fibres. Nat. Photonics. 2013;7:354–362. doi: 10.1038/nphoton.2013.94. [DOI] [Google Scholar]
- 6.Liu KX, et al. 4K-DMDNet: diffraction model-driven network for 4 K computer-generated holography. Opto-Electron. Adv. 2023;6:220135. doi: 10.29026/oea.2023.220135. [DOI] [Google Scholar]
- 7.Wu JC, et al. High-speed computer-generated holography using an autoencoder-based deep neural network. Opt. Lett. 2021;46:2908–2911. doi: 10.1364/OL.425485. [DOI] [PubMed] [Google Scholar]
- 8.Zuo C, et al. Deep learning in optical metrology: a review. Light Sci. Appl. 2022;11:39. doi: 10.1038/s41377-022-00714-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Ma W, et al. Deep learning for the design of photonic structures. Nat. Photonics. 2021;15:77–90. doi: 10.1038/s41566-020-0685-y. [DOI] [Google Scholar]
- 10.Barbastathis G, Ozcan A, Situ GH. On the use of deep learning for computational imaging. Optica. 2019;6:921–943. doi: 10.1364/OPTICA.6.000921. [DOI] [Google Scholar]
- 11.Wu JC, Cao LC, Barbastathis G. DNN-FZA camera: a deep learning approach toward broadband FZA lensless imaging. Opt. Lett. 2021;46:130–133. doi: 10.1364/OL.411228. [DOI] [PubMed] [Google Scholar]
- 12.Luo Y, et al. Computational imaging without a computer: seeing through random diffusers at the speed of light. eLight. 2022;2:4. doi: 10.1186/s43593-022-00012-4. [DOI] [Google Scholar]
- 13.Lin HN, Cheng JX. Computational coherent Raman scattering imaging: breaking physical barriers by fusion of advanced instrumentation and data science. eLight. 2023;3:6. doi: 10.1186/s43593-022-00038-8. [DOI] [Google Scholar]
- 14.Rahmani B, et al. Multimode optical fiber transmission with a deep learning network. Light Sci. Appl. 2018;7:69. doi: 10.1038/s41377-018-0074-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Borhani N, et al. Learning to see through multimode fibers. Optica. 2018;5:960–966. doi: 10.1364/OPTICA.5.000960. [DOI] [Google Scholar]
- 16.Caramazza P, et al. Transmission of natural scene images through a multimode fibre. Nat. Commun. 2019;10:2029. doi: 10.1038/s41467-019-10057-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Rahmani B, et al. Actor neural networks for the robust control of partially measured nonlinear systems showcased for image propagation through diffuse media. Nat. Mach. Intell. 2020;2:403–410. doi: 10.1038/s42256-020-0199-9. [DOI] [Google Scholar]
- 18.Matthes MW, et al. Learning and avoiding disorder in multimode fibers. Phys. Rev. X. 2021;11:021060. [Google Scholar]
- 19.Pan TQ, et al. Non-orthogonal optical multiplexing empowered by deep learning. Nat. Commun. 2024;15:1580. doi: 10.1038/s41467-024-45845-4. [DOI] [PMC free article] [PubMed] [Google Scholar]

