Experience deploying an analysis facility for the Rubin Observatory's Legacy Survey of Space and Time (LSST) data (2403.19321v1)
Abstract: The Vera C. Rubin Observatory is preparing for the execution of the most ambitious astronomical survey ever attempted, the Legacy Survey of Space and Time (LSST). Currently in its final phase of construction in the Andes mountains in Chile and due to start operations in 2025 for 10 years, its 8.4-meter telescope will nightly scan the southern sky and collect images of the entire visible sky every 4 nights using a 3.2 Gigapixel camera, the largest imaging device ever built for astronomy. Automated detection and classification of celestial objects will be performed by sophisticated algorithms on high-resolution images to progressively produce an astronomical catalog eventually composed of 20 billion galaxies and 17 billion stars and their associated physical properties. In this paper, we briefly present the infrastructure deployed at the French Rubin data facility (operated by IN2P3 computing center, CC-IN2P3) to deploy the Rubin Science Platform, a set of web-based services to provide effective and convenient access to LSST data for scientific analysis. We describe the main services of the platform, the components that provide those services and our deployment model. We also present the Kubernetes-based infrastructure we are experimenting with for hosting the LSST astronomical catalog, a petabyte-scale relational database developed for the specific needs of the project.
- Qserv: petascale distributed database, https://github.com/lsst/qserv
- KeyCloak, https://www.keycloak.org
- Kubernetes, https://kubernetes.io
- OpenStack, https://www.openstack.org
- sciSQL 0.3: Science tools for mysql, https://smonkewitz.github.io/scisql/
- Operator Framework for kubernetes, https://operatorframework.io
- qserv-operator: a qserv operator for Kubernetes, https://github.com/lsst/qserv-operator
- Argo Workflow a workflow engine for orchestrating parallel jobs on kubernetes, https://argoproj.github.io/argo-workflows
- Firefly a browser-based interactive particle visualization app, http://firefly-viz.com
- Jupyter, https://jupyter.org
- Helm the package manager for kubernetes, https://helm.sh
- Phalanx a gitops repository for rubin observatoryâs kubernetes environments, https://phalanx.lsst.io
- Phalanx, https://github.com/lsst-sqre/phalanx
- Gafaelfawr rsp identity management, https://github.com/lsst-sqre/gafaelfawr
- LDAP, https://ldap.com
- OpenId, https://openid.net
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Collections
Sign up for free to add this paper to one or more collections.