Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
169 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

SpatialVisVR: An Immersive, Multiplexed Medical Image Viewer With Contextual Similar-Patient Search (2401.02882v3)

Published 5 Jan 2024 in cs.HC and q-bio.TO

Abstract: In contemporary pathology, multiplexed immunofluorescence (mIF) and multiplex immunohistochemistry (mIHC) present both significant opportunities and challenges. These methodologies shed light on intricate tumor microenvironment interactions, emphasizing the need for intuitive visualization tools to analyze vast biological datasets effectively. As electronic health records (EHR) proliferate and physicians face increasing information overload, the integration of advanced technologies becomes imperative. SpatialVisVR emerges as a versatile VR platform tailored for comparing medical images, with adaptability for data privacy on embedded hardware. Clinicians can capture pathology slides in real-time via mobile devices, leveraging SpatialVisVR's deep learning algorithm to match and display similar mIF images. This interface supports the manipulation of up to 100 multiplexed protein channels, thereby assisting in immuno-oncology decision-making. Ultimately, SpatialVisVR aims to streamline diagnostic processes, advocating for a comprehensive and efficient approach to immuno-oncology research and treatment.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (25)
  1. Spatially variant immune infiltration scoring in human cancer tissues. NPJ Precision Oncology 6, 1 (2022), 60.
  2. Stain specific standardization of whole-slide histopathological images. IEEE transactions on medical imaging 35, 2 (2015), 404–415.
  3. CODEX multiplexed tissue imaging with DNA-conjugated antibodies. Nature protocols 16, 8 (2021), 3802–3835.
  4. Harnessing multimodal data integration to advance precision oncology. Nature Reviews Cancer 22, 2 (2022), 114–126.
  5. Anika Cheerla and Olivier Gevaert. 2019. Deep learning with multimodal representation for pancancer prognosis prediction. Bioinformatics 35, 14 (2019), i446–i454.
  6. MicroMagnify: A Multiplexed Expansion Microscopy Method for Pathogens and Infected Tissues. Advanced Science (2023), 2302249.
  7. High-throughput adaptive sampling for whole-slide histopathology image analysis (HASHI) via convolutional neural networks: Application to invasive breast cancer detection. PloS one 13, 5 (2018), e0196828.
  8. Exploring virtual reality technology and the Oculus Rift for the examination of digital pathology slides. Journal of pathology informatics 7, 1 (2016), 22.
  9. Deep profiling of mouse splenic architecture with CODEX multiplexed imaging. Cell 174, 4 (2018), 968–981.
  10. Multimodal Pathology Image Search Between H&E Slides and Multiplexed Immunofluorescent Images. arXiv preprint arXiv:2306.06780 (2023).
  11. Multiplex immunohistochemistry and immunofluorescence: a practical update for pathologists. Modern Pathology 36, 7 (2023), 100197.
  12. Minerva: a light-weight, narrative image browser for multiplexed tissue images. Journal of open source software 5, 54 (2020).
  13. Augmented Reality: Mapping Methods and Tools for Enhancing the Human Role in Healthcare HMI. Applied Sciences 12 (04 2022), 4295. https://doi.org/10.3390/app12094295
  14. Mohd Javaid and Abid Haleem. 2020. Virtual reality applications toward medical field. Clinical Epidemiology and Global Health 8, 2 (2020), 600–605.
  15. Vitessce: a framework for integrative visualization of multi-modal and spatially-resolved single-cell data. (2021).
  16. Multiplexed 3D atlas of state transitions and immune interaction in colorectal cancer. Cell 186, 2 (2023), 363–381.
  17. Viv: multiscale visualization of high-resolution multiplexed bioimaging data on the web. Nature Methods 19, 5 (2022), 515–516.
  18. An Analysis of Public REST Web Service APIs. IEEE Transactions on Services Computing 14, 4 (2021), 957–970. https://doi.org/10.1109/TSC.2018.2847344
  19. Highly multiplexed phenotyping of immunoregulatory proteins in the tumor microenvironment by CODEX tissue imaging. Frontiers in Immunology 12 (2021), 687673.
  20. H. Sakoe and S. Chiba. 1978. Dynamic programming algorithm optimization for spoken word recognition. IEEE Transactions on Acoustics, Speech, and Signal Processing 26, 1 (1978), 43–49. https://doi.org/10.1109/TASSP.1978.1163055
  21. Coordinated cellular neighborhoods orchestrate antitumoral immunity at the colorectal cancer invasive front. Cell 182, 5 (2020), 1341–1359.
  22. The human body at cellular resolution: the NIH Human Biomolecular Atlas Program. 574, 7777 ([n. d.]), 187–192. https://doi.org/10.1038/s41586-019-1629-x Number: 7777 Publisher: Nature Publishing Group.
  23. ConfocalVR: immersive visualization for confocal microscopy. Journal of molecular biology 430, 21 (2018), 4028–4035.
  24. An ultra-high speed whole slide image viewing system. Analytical Cellular Pathology 35, 1 (2012), 65–73.
  25. BioVR: a platform for virtual reality assisted biological data integration and visualization. BMC bioinformatics 20 (2019), 1–10. https://doi.org/10.1186/s12859-019-2666-z

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now