2000 character limit reached
Sharding Distributed Databases: A Critical Review (2404.04384v2)
Published 5 Apr 2024 in cs.DC
Abstract: This article examines the significant challenges encountered in implementing sharding within distributed replication systems. It identifies the impediments of achieving consensus among large participant sets, leading to scalability, throughput, and performance limitations. These issues primarily arise due to the message complexity inherent in consensus mechanisms. In response, we investigate the potential of sharding to mitigate these challenges, analyzing current implementations within distributed replication systems. Additionally, we offer a comprehensive review of replication systems, encompassing both classical distributed databases as well as Distributed Ledger Technologies (DLTs) employing sharding techniques. Through this analysis, the article aims to provide insights into addressing the scalability and performance concerns in distributed replication systems.
- Team, Zilliqa. "The zilliqa technical whitepaper." Retrieved September 16 (2017): 2019.
- Ethereum community. Consensus mechanism, Sybil resistance & chain selection. “PoW and PoS alone are not consensus protocols, but they are often referred to as such for simplicity.” Available onlaine at https://ethereum.org/en/developers/docs/consensus-mechanisms/#sybil-chain. Also available in the Internet Archive at: https://web.archive.org/web/20230727221549/https://ethereum.org/en/developers/docs/consensus-mechanisms/
- Gün Sirer, Emin. “there is a terribly wrong framework emerging around consensus protocols. People think that PoW and PoS are consensus protocols, and that they are the only two consensus protocols out there. This is false.” 13 jun 2018. Tweet. Also available in the Internet Archive at: https://web.archive.org/web/20230728023656/https://twitter.com/el33th4xor/status/1006931658338177024
- Zhelezov, Dmitrii. “PoW, PoS and DAGs are NOT consensus protocols.” (2018). Medium. Available online at: https://medium.com/coinmonks/a-primer-on-blockchain-design-89605b287a5a
- Beyer, S. “Proof-of-Work Is Not a Consensus Protocol: Understanding the Basics of Blockchain Consensus.” Medium. Available online at: https://medium.com/cryptronics/proof-of-work-is-not-a-consensus-protocol-understanding-the-basics-of-blockchain-consensus-30aac7e845c8 (accessed April 1, 2019) (2019).
- The Bitcoin Wiki, Category: Proof-of-x. Available online at: https://en.bitcoin.it/wiki/Category:Proof-of-x
- Limitations of Zilliqa’s sharding approach. Available online at: https://medium.com/nearprotocol/limitations-of-zilliqas-sharding-approach-8f9efae0ce3b
- Team, Harmony. "Harmony: Technical Whitepaper." (2018).
- Wood, Gavin. "Polkadot: Vision for a heterogeneous multi-chain framework." White paper 21.2327 (2016): 4662.
- Danksharding Ethereum 2.0. The original link: https://ethereum.org/en/roadmap/danksharding. The backup link saved in the Wayback Machine - Internet Archive website: https://web.archive.org/web/20240128121338/https://ethereum.org/en/roadmap/danksharding#what-is-sharding
- Vitalik’s Annotated Ethereum 2.0 Spec. The document was written in July-Aug 2020. The original link: https://notes.ethereum.org/@vbuterin/SkeyEI3xv#Vitalik%E2%80%99s-Annotated-Ethereum-20-Spec. The backup link saved in the Wayback Machine - Internet Archive website: https://web.archive.org/web/20231219093907/https://notes.ethereum.org/@vbuterin/SkeyEI3xv#Vitalik%E2%80%99s-Annotated-Ethereum-20-Spec
- Mosakheil, Jamal Hayat. "Security threats classification in blockchains." (2018).
- Vitalek Buterin, "Merge blocks and synchronous cross-shard state execution." Available online at: https://ethresear.ch/t/merge-blocks-and-synchronous-cross-shard-state-execution/1240
- Casey Detrio, "Synchronous cross-shard transactions with consolidated concurrency control and consensus (or how I rediscovered Chain Fibers)" Available online at: https://ethresear.ch/t/synchronous-cross-shard-transactions-with-consolidated-concurrency-control-and-consensus-or-how-i-rediscovered-chain-fibers/2318
- Vlad Zamfir, Ethereum Sharding Proof of Concept. Available online at: https://github.com/smarx/ethshardingpoc/tree/a0ec249f3fec61279fcde30b403cefebfb23580d#ethereum-sharding-proof-of-concept
- "Parity Ethereum client." Available online at: https://github.com/openethereum/parity-ethereum
- Polkadot Wiki. Available online at: https://wiki.polkadot.network/docs/getting-started
- Ethereum 2.0 Block Time. Available online at: https://github.com/ethereum/consensus-specs/blob/676e216/specs/phase0/beacon-chain.md#time-parameters
- Ethereum Developers Docs Consensus Mechanism Gasper. Available online at: https://ethereum.org/en/developers/docs/consensus-mechanisms/pos/gasper/
- Ethereum 2.0 Phase 0 – Beacon Chain Fork Choice. Available online at: https://github.com/ethereum/annotated-spec/blob/master/phase0/fork-choice.md
- MongoDB’s official documentation. Available online at: https://docs.mongodb.com/
- Apache HBase Reference Guide. Available online at: https://hbase.apache.org/apache_hbase_reference_guide.pdf
- Google Cloud Bigtable Documentation. Available online at: https://cloud.google.com/bigtable/docs
- Couchbase Documentation. Available online at: https://docs.couchbase.com/home/index.html
- The official Apache Cassandra documentation. https://cassandra.apache.org/doc/
- Amazon DynamoDB. Available online at https://aws.amazon.com/dynamodb/
- Amazon DynamoDB Developer Guide. ISBN-10 : 9888408771. ISBN-13 : 978-9888408771. Author: Amazon Web Services. (June 26, 2018).
- Google Cloud Whitepapers. https://cloud.google.com/whitepapers
- Google Cloud Spanner Documentation. Available online at: https://cloud.google.com/spanner/docs
- ScyllaDB Documentation. Available online at: https://docs.scylladb.com/
- GitHub Repository: ScyllaDB. Available online at: https://github.com/scylladb/scylladb/wiki