Papers
Topics
Authors
Recent
AI Research Assistant
AI Research Assistant
Well-researched responses based on relevant abstracts and paper content.
Custom Instructions Pro
Preferences or requirements that you'd like Emergent Mind to consider when generating responses.
Gemini 2.5 Flash
Gemini 2.5 Flash 74 tok/s
Gemini 2.5 Pro 46 tok/s Pro
GPT-5 Medium 13 tok/s Pro
GPT-5 High 20 tok/s Pro
GPT-4o 87 tok/s Pro
Kimi K2 98 tok/s Pro
GPT OSS 120B 464 tok/s Pro
Claude Sonnet 4 40 tok/s Pro
2000 character limit reached

Experience deploying an analysis facility for the Rubin Observatory's Legacy Survey of Space and Time (LSST) data (2403.19321v1)

Published 28 Mar 2024 in astro-ph.IM

Abstract: The Vera C. Rubin Observatory is preparing for the execution of the most ambitious astronomical survey ever attempted, the Legacy Survey of Space and Time (LSST). Currently in its final phase of construction in the Andes mountains in Chile and due to start operations in 2025 for 10 years, its 8.4-meter telescope will nightly scan the southern sky and collect images of the entire visible sky every 4 nights using a 3.2 Gigapixel camera, the largest imaging device ever built for astronomy. Automated detection and classification of celestial objects will be performed by sophisticated algorithms on high-resolution images to progressively produce an astronomical catalog eventually composed of 20 billion galaxies and 17 billion stars and their associated physical properties. In this paper, we briefly present the infrastructure deployed at the French Rubin data facility (operated by IN2P3 computing center, CC-IN2P3) to deploy the Rubin Science Platform, a set of web-based services to provide effective and convenient access to LSST data for scientific analysis. We describe the main services of the platform, the components that provide those services and our deployment model. We also present the Kubernetes-based infrastructure we are experimenting with for hosting the LSST astronomical catalog, a petabyte-scale relational database developed for the specific needs of the project.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (16)
  1. Qserv: petascale distributed database, https://github.com/lsst/qserv
  2. KeyCloak, https://www.keycloak.org
  3. Kubernetes, https://kubernetes.io
  4. OpenStack, https://www.openstack.org
  5. sciSQL 0.3: Science tools for mysql, https://smonkewitz.github.io/scisql/
  6. Operator Framework for kubernetes, https://operatorframework.io
  7. qserv-operator: a qserv operator for Kubernetes, https://github.com/lsst/qserv-operator
  8. Argo Workflow a workflow engine for orchestrating parallel jobs on kubernetes, https://argoproj.github.io/argo-workflows
  9. Firefly a browser-based interactive particle visualization app, http://firefly-viz.com
  10. Jupyter, https://jupyter.org
  11. Helm the package manager for kubernetes, https://helm.sh
  12. Phalanx a gitops repository for rubin observatoryâs kubernetes environments, https://phalanx.lsst.io
  13. Phalanx, https://github.com/lsst-sqre/phalanx
  14. Gafaelfawr rsp identity management, https://github.com/lsst-sqre/gafaelfawr
  15. LDAP, https://ldap.com
  16. OpenId, https://openid.net
Citations (1)

Summary

We haven't generated a summary for this paper yet.

Lightbulb On Streamline Icon: https://streamlinehq.com

Continue Learning

We haven't generated follow-up questions for this paper yet.

List To Do Tasks Checklist Streamline Icon: https://streamlinehq.com

Collections

Sign up for free to add this paper to one or more collections.

X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets

This paper has been mentioned in 1 post and received 0 likes.