An All-Optical General-Purpose CPU and Optical Computer Architecture (2403.00045v2)
Abstract: Energy efficiency of electronic digital processors is primarily limited by the energy consumption of electronic communication and interconnects. The industry is almost unanimously pushing towards replacing both long-haul, as well as local chip interconnects, using optics to drastically increase efficiency. In this paper, we explore what comes after the successful migration to optical interconnects, as with this inefficiency solved, the main source of energy consumption will be electronic digital computing, memory and electro-optical conversion. Our approach attempts to address all these issues by introducing efficient all-optical digital computing and memory, which in turn eliminates the need for electro-optical conversions. Here, we demonstrate for the first time a scheme to enable general purpose digital data processing in an integrated form and present our photonic integrated circuit (PIC) implementation. For this demonstration we implemented a URISC architecture capable of running any classical piece of software all-optically and present a comprehensive architectural framework for all-optical computing to go beyond.
- P. Ambs, “Optical computing a 60-year adventure,” Advances in Optical Technologies, vol. 2010, 2010.
- J. von Neumann, “Non-linear capacitance or inductance switching, amplifying, and memory organs,” US Patent No. 2,815,488, 1957.
- A. Huang, “Architectural considerations involved in the design of an optical digital computer,” Proceedings of the IEEE, vol. 72, no. 7, pp. 780–786, 1984.
- K.-H. Brenner, A. Huang, and N. Streibl, “Digital optical computing with symbolic substitution,” Applied Optics, vol. 25, no. 18, pp. 3054–3060, 1986.
- M. J. Murdocca, A. Huang, J. Jahns, and N. Streibl, “Optical design of programmable logic arrays,” Applied Optics, vol. 27, no. 9, pp. 1651–1660, 1988.
- K.-H. Brenner, “Programmable optical processor based on symbolic substitution,” Applied Optics, vol. 27, no. 9, pp. 1687–1691, 1988.
- P. S. Guilfoyle and R. V. Stone, “Digital optical computer ii,” Proceedings of the SPIE, vol. 1563, pp. 214–222, 1991.
- D. A. B. Miller, “Attojoule optoelectronics for low-energy information processing and communications – a tutorial review,” arXiv:1609.05510, 2016.
- P. L. McMahon, “The physics of optical computing,” Nature Reviews Physics, vol. 5, pp. 717–734, 2023.
- A. Tsakyridis, M. Moralis-Pegios, G. Giamougiannis, M. Kirtas, N. Passalis, A. Tefas, and N. Pleros, “Photonic neural networks and optics-informed deep learning fundamentals,” APL Photonics, vol. 9, no. 1, 2024.
- H. J. Caulfield, “Perspectives in optical computing,” IEEE Computer, vol. 31, no. 2, pp. 22–25, 1998.
- S. Y. Siew, B. Li, F. Gao, H. Y. Zheng, W. Zhang, P. Guo, S. W. Xie, A. Song, B. Dong, L. W. Luo et al., “Review of silicon photonics technology and platform development,” Journal of Lightwave Technology, vol. 39, no. 13, pp. 4374–4389, 2021.
- S. Shekhar, W. Bogaerts, L. Chrostowski, J. E. Bowers, M. Hochberg, and R. S. . B. J. Shastri, “Roadmapping the next generation of silicon photonics,” Nature Communications, vol. 15, no. 751, 2024.
- D. A. B. Miller, “Are optical transistors the logical next step?” Nature Photonics, vol. 4, pp. 3–5, 2010.
- W. T. Cathey, K. Wagner, and W. Miceli, “Digital computing with optics,” Proceedings of the IEEE, vol. 77, no. 10, pp. 1558–1572, 1989.
- D. Jackson, “A structural approach to the photonic processor,” RAND Note, 1991.
- ——, “Photonic processors: a systems approach,” Applied Optics, vol. 33, no. 23, pp. 5451–5466, 1994.
- A. Sawchuk and T. Strand, “Digital optical computing,” Proceedings of the IEEE, vol. 72, no. 7, pp. 758–779, 1984.
- J. Touch, Y. Cao, M. Ziyadi, A. Almaiman, A. Mohajerin-Ariaei, and A. E. Willner, “Digital optical processing of optical communication - towards an optical turing machine,” Nanophotonics, 2016.
- P. Toliver, R. Runser, I. Glesk, and P. Prucnal, “Comparison of three nonlinear optical switch geometries,” CLEO, 2000.
- A. Ellis, A. Kelly, D. Nesset, D. Pitcher, D. Moodie, and R. Kashyap, “Error free 100 gbit/s wavelength conversion using grating assisted cross-gain modulation in 2 mm long semiconductor amplifier,” Electronics Letters, vol. 34, no. 20, pp. 1958–1959, 1998.
- L. Lei, J. Dong, Y. Yu, and X. Zhang, “All-optical programmable logic arrays using soa-based canonical logic units,” Photonics Asia, 2012.
- M. Cabezon, F. Sotelo, J. A. Altabas, J. I. Garces, and A. Villafranca, “Integrated all-optical 2-bit decoder based on semiconductor optical amplifiers,” ICTON, vol. 16, 2014.
- O. Leclerc, “All-optical signal regeneration,” Encyclopedia of Modern Optics, vol. 1, pp. 364–372, 2005.
- T. Vivero, N. Calabretta, I. T. Monroy, G. Kassar, F. Ohman, K. Yvind, A. Gonzalez-Marcos, and J. Mork, “2r-regeneration in a monolithically integrated four-section soa–ea chip,” Optics Communications, vol. 282, pp. 117–121, 2009.
- H. T. Nguyen, C. Fortier, J. Fatome, G. Aubin, and J.-L. Oudar, “A passive all-optical device for 2r regeneration based on the cascade of two high-speed saturable absorbers,” Journal of Lightwave Technology, vol. 29, no. 9, 2011.
- Y. Liu, E. Tangdiongga, Z. Li, H. d. Waardt, A. M. J. Koonen, G. D. Khoe, X. Shu, I. Bennion, and H. J. S. Dorren, “Error-free 320-gb/s all-optical wavelength conversion using a single semiconductor optical amplifier,” Journal of Lightwave Technology, vol. 25, no. 1, 2007.
- H. Ju, S. Zhang, D. Lenstra, H. d. Waardt, E. Tangdiongga, G. D. Khoe, and H. J. Dorren, “Soa-based all-optical switch with subpicosecond full recovery,” Optics Express, vol. 13, no. 3, pp. 942–947, 2005.
- B. Tossoun, A. Jha, G. Giamougiannis, S. Cheung, X. Xiao, T. V. Vaerenbergh, G. Kurczveil, and R. G. Beausoleil, “Heterogeneously integrated iii–v on silicon photonics for neuromorphic computing,” IEEE Photonics Society Summer Topicals Meeting Series (SUM), 2023.
- W. Liu, M. Liu, X. Liu, X. Wang, H.-X. Deng, M. Lei, Z. Wei, and Z. Wei, “Recent advances of 2d materials in nonlinear photonics and fiber lasers,” Advanced Optical Mater, vol. 8, 2020.
- W. Li, B. Chen, C. Meng, W. Fang, Y. Xiao, X. Li, Z. Hu, Y. Xu, L. Tong, H. Wang, W. Liu, J. Bao, and Y. R. Shen, “Ultrafast all-optical graphene modulator,” Nano Letters, vol. 14, no. 2, pp. 955–959, 2014.
- K. J. A. Ooi, P. C. Leong, L. K. Ang, and D. T. H. Tan, “All-optical control on a graphene-on-silicon waveguide modulator,” Scientific Reports, vol. 7, no. 12748, 2017.
- H. Wang, N. Yang, L. Chang, C. Zhou, S. Li, M. Deng, Z. Li, Q. Liu, C. Zhang, Z. Li, and Y. Wang, “Cmos-compatible all-optical modulator based on the saturable absorption of graphene,” Photonic Research, vol. 8, no. 4, pp. 468–474, 2020.
- P. Demongodin, H. E. Dirani, J. Lhuillier, R. Crochemore, M. Kemiche, T. Wood, S. Callard, P. Rojo-Romeo, C. Sciancalepore, C. Grillet, and C. Monat, “Ultrafast saturable absorption dynamics in hybrid graphene/si3n4 waveguides,” APL Photonics, vol. 4, no. 7, 2019.
- M. Lukosius, R. Lukose, M. Lisker, P. Dubey, A. Raju, D. Capista, F. Majnoon, A. Mai, and C. Wenger, “Developments of graphene devices in 200 mm cmos pilot line,” IEEE Nanotechnology Materials and Devices Conference (NMDC), pp. 505–506, 2023.
- K. Alexander, Y. Hu, M. Pantouvaki, S. Brems, I. Asselberghs, S.-P. Gorza, C. Huyghebaert, J. V. Campenhout, B. Kuyken, and D. V. Thourhout, “Electrically controllable saturable absorption in hybrid graphene-silicon waveguides,” CLEO, no. STh4H.7, 2015.
- C. Lian, C. Vagionas, T. Alexoudi, N. Pleros, N. Youngblood, and C. Ríos, “Photonic memories - tunable nanophotonics for data storage and computing,” Nanophotonics, 2022.
- T. Alexoudi, G. T. Kanellos, and N. Pleros, “Optical ram and integrated optical memories: a survey,” Light Science and Applications, vol. 9, no. 91, 2020.
- C. Vagionas, S. Markou, G. Dabos, T. Alexoudi, D. Tsiokos, A. Miliou, N. Pleros, and G. Kanellos, “Column address selection in optical rams with positive and negative logic row access,” IEEE Photonics Journal, vol. 5, no. 6, 2013.
- S. Simos, T. Moschos, K. Fotiadis, D. Chatzitheocharis, T. Alexoudi, C. Vagionas, D. Sacchetto, M. Zervas, and N. Pleros, “An all-passive si3n4 optical row decoder circuit for addressable optical ram memories,” J. Phys. Photonics, vol. 5, 2023.
- A. E. Ulanov, T. Wildi, N. G. Pavlov, J. D. Jost, M. Karpov, and T. Herr, “Synthetic reflection self-injection-locked microcombs,” Nature Photonics, 2024.
- J. Feldmann, N. Youngblood, M. Karpov, H. Gehring, X. Li, M. Stappers, M. L. Gallo, X. Fu, A. Lukashchuk, A. S. Raja, J. Liu, C. D. Wright, A. Sebastian, T. J. Kippenberg, W. H. P. Pernice, and H. Bhaskaran, “Parallel convolutional processing using an integrated photonic tensor core,” Nature, vol. 589, pp. 52–60, 2020.
- X. Xiao, S. Cheung, S. Hooten, Y. Peng, B. Tossoun, T. V. Vaerenbergh, G. Kurczveil, and R. G. Beausoleil, “Wavelength-parallel photonic tensor core based on multi-fsr microring resonator crossbar array,” OFC, 2023.
- H. Zhu, J. Gu, H. Wang, Z. Jiang, Z. Zhang, R. Tang, C. Feng, S. Han, R. T. Chen, and D. Z. Pan, “Lightening-transformer: A dynamically-operated optically-interconnected photonic transformer accelerator,” IEEE International Symposium on High-Performance Computer Architecture (HPCA), 2024.
- A. M. Turing, “On computable numbers, with an application to the entscheidungsproblem,” Proceedings of the London Mathematical Society, vol. 58, pp. 230–265, 1936.
- F. Mavaddat and B. Parhami, “Urisc: The ultimate reduced instruction set computer,” Int. J. Elect. Enging Educ., vol. 25, pp. 327–334, 1988.
- O. Mazonka and A. Kolodin, “A simple multi-processor computer based on subleq,” arXiv:1106.2593, 2011.
- D. W. Jones, “The ultimate risc,” ACM Computer Architecture News, vol. 16, no. 3, 1988.
- L. Klemmer, S. Gurtner, and D. Große, “Formal verification of subleq microcode implementing the rv32i isa,” Forum on Specification, Verification and Design Languages, FDL, 2022.
- C. Domas, “Breaking the x86 isa,” Black Hat, 2017.
- G. M. Amdahl, “Validity of the single processor approach to achieving large scale computing capabilitie,” AFIPS spring joint computer conference, vol. 30, pp. 483–485, 1967.
- A. H. Ibrahim, M. B. Abdelhalim, H. Hussein, and A. Fahmy, “Analysis of x86 instruction set usage for windows 7 applications,” International Conference on Computer Technology and Development, vol. 2, 2010.
- “x86 machine code statistics,” https://www.strchr.com/x86_machine_code_statistics, 2009.
- G. Ndu, “Boosting single thread performance in mobile processors using reconfigurable acceleration,” PhD Thesis - University of Manchester, 2012.
- “Spec cpu 2017,” https://www.spec.org/benchmarks.html#cpu, 2017.
- Y. Chen, H. Lan, Z. Du, S. Liu, J. Tao, D. Han, L. Tuo, G. Quo, L. Li, Y. Xie, and T. Chen, “An instruction set architecture for machine learning,” ACM Transactions Computer Systems, vol. 36, no. 3, p. 9, 2019.
- A. Gholami, S. Kim, Z. Dong, Z. Yao, M. W. Mahoney, and K. Keutzer, “A survey of quantization methods for efficient neural network inference,” Book Chapter: Low-Power Computer Vision: Improving the Efficiency of Artificial Intelligence, 2021.
- X. Sun, N. Wang, C.-y. Chen, J.-m. Ni, A. Agrawal, X. Cui, S. Venkataramani, K. E. Maghraoui, V. Srinivasan, and K. Gopalakrishnan, “Ultra-low precision 4-bit training of deep neural networks,” NeurIPS, 2020.
- T. Dettmers and L. Zettlemoyer, “The case for 4-bit precision: k-bit inference scaling laws,” ICML, 2023.
- T. Dettmers, A. Pagnoni, A. Holtzman, and L. Zettlemoyer, “Qlora: Efficient finetuning of quantized llms,” arXiv:2305.14314v1, 2023.
- “Hugging face 4-bit community,” https://huggingface.co/4bit, 2024.
- M. v. Baalen, A. Kuzmin, S. S. Nair, Y. Ren, E. Mahurin, C. Patel, S. Subramanian, S. Lee, M. Nagel, J. Soriaga, and T. Blankevoort, “Fp8 versus int8 for efficient deep learning inference,” arXiv:2303.17951, 2023.
- I. IEEE, “Ieee 754,” IEEE Computer Society, 2019.
- J. L. Gustafson and I. T. Yonemoto, “Beating floating point at its own game: Posit arithmetic,” Supercomputing Frontiers and Innovations, 2017.
- Y. Lecerf, “Logique mathematique : Machines de turing reversibles,” Comptes rendus des seances de l’academie des sciences, vol. 257, pp. 2597–2600, 1963.
- C. H. Bennett, “Logical reversibility of computation,” IBM Journal of Research and Development, vol. 17, no. 6, pp. 525–532, 1973.
- M. P. Frank, “Fundamental physics of reversible computing - an introduction,” CCC Workshop on Physics and Engineering Challenges in Adiabatic/Reversible Classical Computing, 2020.
- “Data centres and data transmission networks,” https://www.iea.org/energy-system/buildings/data-centres-and-data-transmission-networks, 2022.
- J. Zhang, A. Cerkauskaite, R. Drevinskas, A. Patel, M. Beresna, and P. G. Kazansky, “Eternal 5d data storage by ultrafast laser writing in glass,” SPIE LASE Proceedings, no. 9736, 2016.
- H. Wang, Y. Lei, L. Wang, M. Sakakura, Y. Yu, X. Chang, G. Shayeganrad, and P. G. Kazansky, “5d optical data storage with 100silica glass,” CLEO, 2021.
- H. Huang, Z. Wang, J. Zhang, Z. He, C. Wu, J. Xiao, and G. Alonso, “Shuhai: A tool for benchmarking high bandwidth memory on fpgas,” IEEE 28th Annual International Symposium on Field-Programmable Custom Computing Machines (FCCM), 2020.
- M. Kissner and L. D. Bino, “Challenges in digital optical computing,” SPIE OPTO Optical Interconnects XXIII, vol. 12427, 2023.
- H. Wang, “A variant to turing’s theory of computing machines,” Journal of the ACM, vol. 4, no. 1, 1957.
- M. L. Minsky, “Recursive unsolvability of post’s problem of “tag“ and other topics in theory of turing machines,” The Annals of Mathematics, vol. 74, no. 3, 1961.
- J. Backus, “Can programming be liberated from the von neumann style?: a functional style and its algebra of programs,” Communications of the ACM, vol. 21, no. 8, 1978.
- H. Barendregt, “The lambda calculus, its syntax and semantics,” Studies in Logic and the Foundations of Mathematics, vol. 103, 1984.
- A. A. Chien, L. Lin, H. Nguyen, V. Rao, T. Sharma, and R. Wijayawardana, “Reducing the carbon impact of generative ai inference (today and in 2035),” Proceedings of the 2nd Workshop on Sustainable Computer Systems, 2023.
- D. Kong, Z. Geng, B. Foo, V. Rozental, B. Corcoran, and A. J. Lowery, “All-optical digital-to-analog converter based on cross-phase modulation with temporal integration,” Optics Letters, vol. 42, no. 21, 2017.
- G. A. Vawter, J. Raring, and E. J. Skogen, “Optical analog-to-digital converter,” US Patent No. US7564387B1, 2009.
- A. Sakaguchi, S. Konno, F. Hanamura, W. Asavanant, K. Takase, H. Ogawa, P. Marek, R. Filip, J.-i. Yoshikawa, E. Huntington, H. Yonezawa, and A. Furusawa, “Nonlinear feedforward enabling quantum computation,” Nature Communications, vol. 14, no. 3817, 2023.
- N. Takanashi, A. Inoue, T. Kashiwazaki, T. Kazama, K. Enbutsu, R. Kasahara, T. Umeki, and A. Furusawa, “All-optical phase-sensitive detection for ultra-fast quantum computation,” Optics Express, vol. 28, no. 23, 2020.
- I. TA, “The infiniband trade association specifications volume 1 release 1.7 and volume 2 release 1.5,” IBTA, 2023.
- “Sycl specification,” https://registry.khronos.org/SYCL/specs/sycl-2020/html/sycl-2020.html, 2020.
- “Message passing interface (mpi) standard,” https://www.mpi-forum.org/docs/, 2023.
- “Uxl foundation oneapi,” https://www.oneapi.io/community/foundation/, 2024.
- “Spir-v specification,” https://registry.khronos.org/SPIR-V/specs/unified1/SPIRV.html, 2023.
- H. Wong, M.-M. Papadopoulou, M. Sadooghi-Alvandi, and A. Moshovos, “Demystifying gpu microarchitecture through microbenchmarking,” IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS), 2010.
- G. Xing, H. Guo, X. Zhang, T. C. Sum, and C. H. A. Huan, “The physics of ultrafast saturable absorption in graphene,” Optics Express, vol. 18, no. 5, pp. 4564–4573, 2010.
- N. Pleros, D. Apostolopoulos, D. Petrantonakis, C. Stamatiadis, and H. Avramopoulos, “Optical static ram cell,” IEEE Photonics Technology Letters, vol. 21, no. 2, 2009.
- E.-. Standard, “120 mm (4,7 gbytes per side) and 80 mm (1,46 gbytes per side) dvd rewritable disk (dvd-ram),” ECMA, 2005.
- J. Faneca, S. G.-C. Carrillo, E. Gemo, C. R. d. Galarreta, T. D. Bucio, F. Y. Gardes, H. Bhaskaran, W. H. P. Pernice, C. D. Wright, and A. Baldycheva, “Performance characteristics of phase-change integrated silicon nitride photonic devices in the o and c telecommunications bands,” Optical Materials Express, vol. 10, no. 8, pp. 1778–1791, 2020.
- C. G. Littlejohns, D. J. Rowe, H. Du, K. Li, W. Zhang, W. Cao, T. D. Bucio, X. Yan, M. Banakar, D. Tran, S. Liu, F. Meng, B. Chen, Y. Qi, X. Chen, M. Nedeljkovic, L. Mastronardi, R. Maharjan, S. Bohora, A. Dhakal, I. Crowe, A. Khurana, K. C. Balram, L. Zagaglia, F. Floris, P. OBrien, E. D. Gaetano, H. M. Chong, F. Y. Gardes, D. J. Thomson, G. Z. Mashanovich, M. Sorel, and G. T. Reed, “Cornerstone’s silicon photonics rapid prototyping platforms: Current status and future outlook,” Applied Sciences, vol. 10, no. 22, p. 8201, 2020.
- M. Delaney, I. Zeimpekis, D. Lawson, D. W. Hewak, and O. L. Muskens, “A new family of ultralow loss reversible phase-change materials for photonic integrated circuits: Sb2s3 and sb2se3,” Advanced Functional Materials, vol. 30, 2020.
- “Openlane,” https://github.com/The-OpenROAD-Project/OpenLane, 2024.
- “The openroad project,” https://github.com/The-OpenROAD-Project, 2024.
- “Yosys,” https://github.com/YosysHQ/yosys, 2024.
- W. Bogaerts, D. Pérez, J. Capmany, D. A. Miller, J. Poon, D. Englund, F. Morichetti, and A. Melloni, “Programmable photonic circuits,” Nature, vol. 585, no. 7828, 2020.
- “ipronics,” https://www.ipronics.com, 2024.