Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
126 tokens/sec
GPT-4o
47 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Design and Implementation of a Scalable Financial Exchange in the Public Cloud (2402.09527v9)

Published 14 Feb 2024 in cs.NI

Abstract: Financial exchanges are migrating to the cloud, but the best-effort nature of the public cloud is at odds with the stringent latency requirements of exchanges. We present Jasper, a system for meeting the networking requirements of financial exchanges on the public cloud. Jasper uses an overlay tree to scalably multicast market data from an exchange to ~1000 participants with low latency (250 microseconds) and a 1-microsecond difference in data reception time between any two participants. Jasper reuses the same tree for scalable inbound communication (participants to exchange), augmenting it with order pacing and a new priority queue, Limit Order Queue (LOQ), to efficiently handle bursts of market orders. Jasper achieves better scalability and 50% lower latency than the AWS multicast service. During bursty market activity, LOQ nearly doubles the order processing rate.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (48)
  1. [n. d.]. Matching Orders Definition. https://www.investopedia.com/terms/m/matchingorders.asp. Accessed: 2021-02-02.
  2. Firecracker: Lightweight virtualization for serverless applications. In 17th USENIX symposium on networked systems design and implementation (NSDI 20). 419–434.
  3. Scalable application layer multicast. SIGCOMM Comput. Commun. Rev. 32, 4 (aug 2002), 205–217. https://doi.org/10.1145/964725.633045
  4. Construction of an efficient overlay multicast infrastructure for real-time applications. In IEEE INFOCOM 2003. Twenty-second Annual Joint Conference of the IEEE Computer and Communications Societies (IEEE Cat. No.03CH37428), Vol. 2. 1521–1531 vol.2. https://doi.org/10.1109/INFCOM.2003.1208987
  5. The High-Frequency Trading Arms Race: Frequent Batch Auctions as a Market Design Response *. The Quarterly Journal of Economics 130, 4 (07 2015), 1547–1621. https://doi.org/10.1093/qje/qjv027 arXiv:https://academic.oup.com/qje/article-pdf/130/4/1547/30637414/qjv027.pdf
  6. Sara Castellanos. [n. d.]. Nasdaq Ramps Up Cloud Move. https://www.wsj.com/articles/nasdaq-ramps-up-cloud-move-11600206624. Accessed: 2024-01-31.
  7. High-Performance MPI Broadcast Algorithm for Grid Environments Utilizing Multi-lane NICs. In Seventh IEEE International Symposium on Cluster Computing and the Grid (CCGrid ’07). 487–494. https://doi.org/10.1109/CCGRID.2007.59
  8. Jeffrey Dean and Luiz André Barroso. 2013. The Tail at Scale. Commun. ACM 56 (2013), 74–80. http://cacm.acm.org/magazines/2013/2/160173-the-tail-at-scale/fulltext
  9. Techniques for low-latency proxy selection in wide-area P2P networks. In 2010 IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum (IPDPSW). 1–8. https://doi.org/10.1109/IPDPSW.2010.5470939
  10. Nezha: Deployable and High-Performance Consensus Using Synchronized Clocks. Proc. VLDB Endow. 16, 4 (dec 2022), 629–642. https://doi.org/10.14778/3574245.3574250
  11. Exploiting a Natural Network Effect for Scalable, Fine-grained Clock Synchronization. In Proceedings of the 15th USENIX Conference on Networked Systems Design and Implementation (Renton, WA, USA) (NSDI’18). USENIX Association, Berkeley, CA, USA, 81–94.
  12. CloudEx: A Fair-Access Financial Exchange in the Cloud. In Proceedings of the Workshop on Hot Topics in Operating Systems (Ann Arbor, Michigan) (HotOS ’21). Association for Computing Machinery, New York, NY, USA, 96–103. https://doi.org/10.1145/3458336.3465278
  13. GitHub. [n. d.]. Performance in terms of PPS. https://github.com/amzn/amzn-drivers/issues/68.
  14. Piotr J. Gmytrasiewicz and Edmund H. Durfee. 1992. Decision-theoretic recursive modeling and the coordinated attack problem. In Proceedings of the First International Conference on Artificial Intelligence Planning Systems (College Park, Maryland, USA). Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 88–95.
  15. Octopus: A Fair Packet Delivery Service. arXiv preprint arXiv:2401.08126 (2024).
  16. DBO: Fairness for Cloud-Hosted Financial Exchanges. In Proceedings of the ACM SIGCOMM 2023 Conference (New York, NY, USA) (ACM SIGCOMM ’23). Association for Computing Machinery, New York, NY, USA, 550–563. https://doi.org/10.1145/3603269.3604871
  17. The gVisor Authors. [n. d.]. gVisor: The Container Security Platform. https://gvisor.dev/. Accessed: 2023-01-18.
  18. Michael T. Helmick and Fred S. Annexstein. 2007. Depth-Latency Tradeoffs in Multicast Tree Algorithms. In 21st International Conference on Advanced Information Networking and Applications (AINA ’07). 555–564. https://doi.org/10.1109/AINA.2007.52
  19. Cloudy Forecast: How Predictable is Communication Latency in the Cloud? arXiv preprint arXiv:2309.13169 (2023).
  20. A case for end system multicast. IEEE Journal on Selected Areas in Communications 20, 8 (2002), 1456–1471. https://doi.org/10.1109/JSAC.2002.803066
  21. Intel. [n. d.]. DPDK Programmer’s Guide: Ring Library. https://doc.dpdk.org/guides/prog_guide/ring_lib.html. Accessed: 2024-01-31.
  22. Intel James E Chamings. [n. d.]. Intel Clear Containers. https://www.intel.com/content/www/us/en/developer/articles/technical/intel-clear-containers-1-the-container-landscape.html. Accessed: 2023-01-18.
  23. Triangle inequality variations in the internet. In Proceedings of the 9th ACM SIGCOMM Conference on Internet Measurement (Chicago, Illinois, USA) (IMC ’09). Association for Computing Machinery, New York, NY, USA, 177–183. https://doi.org/10.1145/1644893.1644914
  24. Donald MacKenzie. 2021. Trading at the speed of light: How ultrafast algorithms are transforming financial markets. Princeton University Press.
  25. Vasilios Mavroudis and Hayden Melton. 2019. Libra: Fair Order-Matching for Electronic Financial Exchanges. arXiv:1910.00321 [cs.CR]
  26. TIMELY: RTT-based Congestion Control for the Datacenter (SIGCOMM ’15). Association for Computing Machinery, New York, NY, USA, 537–550. https://doi.org/10.1145/2785956.2787510
  27. Kianoosh Mokhtarian and Hans-Arno Jacobsen. 2015. Minimum-Delay Multicast Algorithms for Mesh Overlays. IEEE/ACM Transactions on Networking 23, 3 (2015), 973–986. https://doi.org/10.1109/TNET.2014.2310735
  28. NASDAQ. [n. d.]. Nasdaq TotalView-ITCH 5.0. https://www.nasdaqtrader.com/content/technicalsupport/specifications/dataproducts/NQTVITCHSpecification.pdf. Accessed: 2024-02-02.
  29. Nasdaq.com. [n. d.]. Nasdaq and AWS Partner to Transform Capital Markets. https://www.nasdaq.com/press-release/nasdaq-and-aws-partner-to-transform-capital-markets-2021-12-01. Accessed: 2024-01-26.
  30. Brian Nigito. [n. d.]. Multicast and the Markets. https://signalsandthreads.com/multicast-and-the-markets. Accessed: 2024-01-30.
  31. Alexander Osipovich. [n. d.]. Google Invests 1 Billion in Exchange Giant CME, Strikes Cloud Deal. https://www.wsj.com/articles/google-invests-1-billion-in-exchange-giant-cme-strikes-cloud-deal-11636029900. Accessed: 2021-02-02.
  32. An iterative algorithm for delay-constrained minimum-cost multicasting. IEEE/ACM Transactions on Networking 6, 4 (1998), 461–474. https://doi.org/10.1109/90.720901
  33. When to Hedge in Interactive Services. In 18th USENIX Symposium on Networked Systems Design and Implementation (NSDI 21). USENIX Association, 373–387. https://www.usenix.org/conference/nsdi21/presentation/primorac
  34. G.N. Rouskas and I. Baldine. 1997. Multicast routing with end-to-end delay and delay variation constraints. IEEE Journal on Selected Areas in Communications 15, 3 (1997), 346–356. https://doi.org/10.1109/49.564133
  35. Vighnesh Sachidananda. [n. d.]. LemonDrop. https://stacks.stanford.edu/file/druid:xq718qd4043/Vig_thesis_submission-augmented.pdf. Accessed: 2024-01-30.
  36. Two-tree algorithms for full bandwidth broadcast, reduction and scan. Parallel Comput. 35, 12 (2009), 581–594. https://doi.org/10.1016/j.parco.2009.09.001 Selected papers from the 14th European PVM/MPI Users Group Meeting.
  37. Amazon Web Services. [n. d.]. Multicast on transit gateways. https://docs.aws.amazon.com/vpc/latest/tgw/tgw-multicast-overview.html.
  38. Elmo: source routed multicast for public clouds. In Proceedings of the ACM Special Interest Group on Data Communication (Beijing, China) (SIGCOMM ’19). Association for Computing Machinery, New York, NY, USA, 458–471. https://doi.org/10.1145/3341302.3342066
  39. Andrew Smith. 2014. Fast money: the battle against the high frequency traders. The Guardian 7 (2014).
  40. Ernest: Efficient Performance Prediction for Large-Scale Advanced Analytics. In 13th USENIX Symposium on Networked Systems Design and Implementation (NSDI 16). USENIX Association, Santa Clara, CA, 363–378. https://www.usenix.org/conference/nsdi16/technical-sessions/presentation/venkataraman
  41. Low latency via redundancy. In Proceedings of the Ninth ACM Conference on Emerging Networking Experiments and Technologies (Santa Barbara, California, USA) (CoNEXT ’13). Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/2535372.2535392
  42. Stockyard: a discrete event-based stock market exchange simulator. In Proceedings of the 2017 Winter Simulation Conference (Las Vegas, Nevada) (WSC ’17). IEEE Press, Article 89, 11 pages.
  43. Stochastic Forecasts Achieve High Throughput and Low Delay over Cellular Networks. In 10th USENIX Symposium on Networked Systems Design and Implementation (NSDI 13). USENIX Association, Lombard, IL, 459–471. https://www.usenix.org/conference/nsdi13/technical-sessions/presentation/winstein
  44. Bobtail: Avoiding Long Tails in the Cloud. In 10th USENIX Symposium on Networked Systems Design and Implementation (NSDI 13). USENIX Association, Lombard, IL, 329–341. https://www.usenix.org/conference/nsdi13/technical-sessions/presentation/xu_yunjing
  45. PeerCast: Churn-resilient end system multicast on heterogeneous overlay networks. Journal of Network and Computer Applications 31, 4 (2008), 821–850. https://doi.org/10.1016/j.jnca.2007.05.001
  46. Liangyu Zhao and Arvind Krishnamurthy. 2023. Bandwidth Optimal Pipeline Schedule for Collective Communication. arXiv:2305.18461 [cs.NI]
  47. Efficient Direct-Connect Topologies for Collective Communications. arXiv:2202.03356 [cs.NI]
  48. Hoplite: Efficient and Fault-Tolerant Collective Communication for Task-Based Distributed Systems. In Proceedings of the 2021 ACM SIGCOMM 2021 Conference (Virtual Event, USA) (SIGCOMM ’21). Association for Computing Machinery, New York, NY, USA, 641–656. https://doi.org/10.1145/3452296.3472897

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now