Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
133 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
46 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

What Blocks My Blockchain's Throughput? Developing a Generalizable Approach for Identifying Bottlenecks in Permissioned Blockchains (2404.02930v1)

Published 2 Apr 2024 in cs.CR and cs.DB

Abstract: Permissioned blockchains have been proposed for a variety of use cases that require decentralization yet address enterprise requirements that permissionless blockchains to date cannot satisfy -- particularly in terms of performance. However, popular permissioned blockchains still exhibit a relatively low maximum throughput in comparison to established centralized systems. Consequently, researchers have conducted several benchmarking studies on different permissioned blockchains to identify their limitations and -- in some cases -- their bottlenecks in an attempt to find avenues for improvement. Yet, these approaches are highly heterogeneous, difficult to compare, and require a high level of expertise in the implementation of the underlying specific blockchain. In this paper, we develop a more unified and graphical approach for identifying bottlenecks in permissioned blockchains based on a systematic review of related work, experiments with the Distributed Ledger Performance Scan (DLPS), and an extension of its graphical evaluation functionalities. We conduct in-depth case studies on Hyperledger Fabric and Quorum, two widely used permissioned blockchains with distinct architectural designs, demonstrating the adaptability of our framework across different blockchains. We provide researchers and practitioners working on evaluating or improving permissioned blockchains with a toolkit, guidelines on what data to document, and insights on how to proceed in the search process for bottlenecks.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (77)
  1. Alastria. 2024. How to Install a Node in Alastria Red-T. https://github.com/alastria/alastria-node-quorum
  2. Hyperledger Fabric: A Distributed Operating System for Permissioned Blockchains. In Proceedings of the 13th EuroSys Conference. ACM. https://doi.org/10.1145/3190508.3190538
  3. Endorsement in Hyperledger Fabric. In Proceedings of the International Conference on Blockchain. IEEE, 510–519. https://doi.org/10.1109/Blockchain.2019.00077
  4. Performance Characterization of Hyperledger Fabric. In Proceedings of the Crypto Valley Conference on Blockchain Technology. 65–74. https://doi.org/10.1109/CVCBT.2018.00013
  5. Performance Evaluation of the Quorum Blockchain Platform. http://arxiv.org/abs/1809.03421
  6. An Evaluation of Blockchain Application Requirements and their Satisfaction in Hyperledger Fabric: A Practical Experience Report. In Distributed Applications and Interoperable Systems: 22nd International Conference. Springer, 3–20. https://doi.org/10.1007/978-3-031-16092-9_1
  7. A Comparative Analysis of Distributed Ledger Technologies for Smart Contract Development. In Proceedings of the 30th Annual International Symposium on Personal, Indoor and Mobile Radio Communications. IEEE. https://doi.org/10.1109/PIMRC.2019.8904256
  8. Permissioned Blockchains and Distributed Databases: A Performance Study. Concurrency and Computation: Practice and Experience 32, 12 (2020). https://doi.org/10.1002/cpe.5227
  9. Miguel Castro and Barbara Liskov. 2002. Practical Byzantine Fault Tolerance and Proactive Recovery. ACM Transactions on Computer Systems 20, 4 (2002), 398–461. https://doi.org/10.1145/571637.571640
  10. Why do my Blockchain Transactions Fail? A Study of Hyperledger Fabric. In Proceedings of the International Conference on Management of Data. ACM, 221–234. https://doi.org/10.1145/3448016.3452823
  11. Consensys. 2022. Quorum Documentation. https://github.com/Consensys/quorum/blob/6cf0f5aa6d870b6d727d80a7b0d074c444369b81/cmd/utils/flags.go
  12. Consensys. 2024. Quorum GitHub Repository. https://github.com/Consensys/quorum/blob/master/README.md
  13. Performance Analysis of Blockchain Platforms: Empirical Evaluation of Hyperledger Fabric and Ethereum. In Proceedings of the 2nd International Conference on Artificial Intelligence in Engineering and Technology. IEEE. https://doi.org/10.1109/IICAIET49801.2020.9257811
  14. Blockchain for Internet of Things: A Survey. IEEE Internet of Things Journal 6, 5 (2019), 8076–8094. https://doi.org/10.1109/JIOT.2019.2920987
  15. DeFiLlama. 2024. Smart Contract Language Dominance. https://defillama.com/languages
  16. Untangling Blockchain: A Data Processing View of Blockchain Systems. IEEE Transactions on Knowledge and Data Engineering 30, 7 (2018), 1366–1385. https://doi.org/10.1109/TKDE.2017.2781227
  17. Blockbench: A Framework for Analyzing Private Blockchains. In Proceedings of the International Conference on Management of Data. ACM, 1085–1100. https://doi.org/10.1145/3035918.3064033
  18. Performance Analysis of Hyperledger Fabric 2.0 Blockchain Platform. In Proceedings of the Workshop on Cloud Continuum Services for Smart IoT Systems. ACM, 32–38. https://doi.org/10.1145/3417310.3431398
  19. Performance Evaluation of Blockchain Systems: A Systematic Survey. IEEE Access 8 (2020), 126927–126950. https://doi.org/10.1109/ACCESS.2020.3006078
  20. Hyperledger Fabric Blockchain: Chaincode Performance Analysis. In Proceedings of the International Conference on Communications. https://doi.org/10.1109/ICC40277.2020.9149080
  21. Cross-Organizational Workflow Management Using Blockchain Technology – Towards Applicability, Auditability, and Automation. In Proceedings of the 51st Hawaii International Conference on System Sciences. 3507–3516. https://doi.org/10.24251/hicss.2018.444
  22. Gartner. 2021. Emerging Technology Roadmap for Large Enterprises 2021 – 2023. https://emtemp.gcom.cloud/ngw/globalassets/en/publications/documents/le-emerging-tech-roadmap-2021-2023.pdf
  23. Hybrid Blockchain Database Systems: Design and Performance. Proceedings of the VLDB Endowment 15, 5 (2022), 1092–1104. https://doi.org/10.14778/3510397.3510406
  24. Blockchain Performance Analysis for Supporting Cross-Border E-Government Services. IEEE Transactions on Engineering Management 67, 4 (2020), 1310–1322. https://doi.org/10.1109/TEM.2020.2979325
  25. Performance Perspective on Private Distributed Ledger Technologies for Industrial Networks. In International Conference on Networked Systems. https://doi.org/10.1109/NetSys.2019.8854512
  26. An End-to-End Performance Comparison of Seven Permissioned Blockchain Systems. In Proceedings of the 24th International Middleware Conference. 71–84. https://doi.org/10.1145/3590140.3629106
  27. FastFabric: Scaling Hyperledger Fabric to 20,000 Transactions Per Second. International Journal of Network Management 30, 5 (2020), e2099. https://doi.org/10.1109/BLOC.2019.8751452
  28. Improving Interorganizational Information Sharing for Vendor Managed Inventory: Toward a Decentralized Information Hub Using Blockchain Technology. IEEE Transactions on Engineering Management 67, 4 (2020), 1074–1085. https://doi.org/10.1109/TEM.2020.2978628
  29. An In-Depth Investigation of the Performance Characteristics of Hyperledger Fabric. Computers & Industrial Engineering 173 (2022), 108716. https://doi.org/10.1016/j.cie.2022.108716
  30. Michael Gusenbauer. 2019. Google Scholar to Overshadow them All? Comparing the Sizes of 12 Academic Search Engines and Bibliographic Databases. Scientometrics 118, 1 (2019), 177–214. https://doi.org/doi.org/10.1007/s11192-018-2958-5
  31. Performance Analysis of Consensus Algorithm in Private Blockchain. In Intelligent Vehicles Symposium. IEEE, 280–285. https://doi.org/10.1109/IVS.2018.8500557
  32. GriDB: Scaling Blockchain Database via Sharding and Off-Chain Cross-Shard Mechanism. Proc. VLDB Endow. 16, 7 (2023), 1685–1698. https://doi.org/10.14778/3587136.3587143
  33. Hyperledger. 2023. RAFT Configuration. https://github.com/hyperledger/fabric/blob/111cff51600d26d4b4b05f52825da11e7629e971/docs/source/raft_configuration.md?plain=1#L22
  34. Hyperledger Fabric Architecture Reference. 2020. Read-Write Set Semantics. https://hyperledger-fabric.readthedocs.io/en/release-2.2/readwrite.html
  35. Hyperledger Fabric Operations Guides. 2020. Metrics Reference. https://hyperledger-fabric.readthedocs.io/en/release-2.2/metrics_reference.html
  36. Optimizing Validation Phase of Hyperledger Fabric. In 27th International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems. IEEE, 269–275. https://doi.org/10.1109/MASCOTS.2019.00038
  37. Attila Klenik and Imre Kocsis. 2021. Porting a Benchmark with a Classic Workload to Blockchain: TPC-C on Hyperledger Fabric. https://doi.org/10.1145/3477314.3507006
  38. Kafka: A Distributed Messaging System for Log Processing. In Proceedings of the NetDB, Vol. 11. https://api.semanticscholar.org/CorpusID:18534081
  39. Performance Analysis of a Hyperledger Fabric Blockchain Framework: Throughput, Latency and Scalability. In International Conference on Blockchain. IEEE, 536–540. https://doi.org/10.1109/Blockchain.2019.00003
  40. Performance Evaluation of Private Ethereum Networks. SN Computer Science 1, 5 (2020), 285. https://doi.org/10.1007/s42979-020-00289-7
  41. Adaptive Blocksize for IoT Payload Data on Fabric Blockchain. In 30th Wireless and Optical Communications Conference. 92–96. https://doi.org/10.1109/WOCC53213.2021.9602935
  42. Toward Trust in Internet of Things (IoT) Ecosystems: Design Principles for Blockchain-Based IoT Applications. IEEE Transactions on Engineering Management 67 (2020), 1256–1270. Issue 4. https://doi.org/10.1109/TEM.2020.2978014
  43. Performance Evaluation of Permissioned Blockchains for Financial Applications: The ConsenSys Quorum Case Study. Blockchain: Research and Applications (2021), 100026. https://doi.org/10.1016/j.bcra.2021.100026
  44. Performance Evaluation of Permissioned Blockchain Platforms. In Asia-Pacific Conference on Computer Science and Data Engineering. IEEE. https://doi.org/10.1109/CSDE50874.2020.9411380
  45. Performance Evaluation of Different Hyperledger Sawtooth Transaction Processors for Blockchain log Storage with Varying Workloads. In International Conference on Blockchain. IEEE, 476–481. https://doi.org/10.1109/Blockchain50366.2020.00069
  46. Hyperledger Fabric Performance Characterization and Optimization Using GoLevelDB Benchmark. In International Conference on Blockchain and Cryptocurrency. IEEE. https://doi.org/10.1109/ICBC48266.2020.9169454
  47. Satoshi Nakamoto. 2008. Bitcoin: A Peer-to-Peer Electronic Cash System. https://bitcoin.org/bitcoin.pdf
  48. Performance Analysis of Hyperledger Fabric Platforms. Security and Communication Networks 2018 (Sept. 2018). https://doi.org/10.1155/2018/3976093
  49. FabricCRDT: A Conflict-Free Replicated Datatypes Approach to Permissioned Blockchains. In Proceedings of the 20th International Middleware Conference. ACM, 110–122. https://doi.org/10.1145/3361525.3361540
  50. Blockchain Meets Database: Design and Implementation of a Blockchain Relational Database. Proceedings of the VLDB Endowment 12, 11 (2019), 1539–1552. https://doi.org/10.14778/3342263.3342632
  51. Impact of Network Delays on Hyperledger Fabric. In IEEE INFOCOM 2019 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS). 222–227. https://doi.org/10.1109/INFCOMW.2019.8845168
  52. Diego Ongaro and John Ousterhout. 2014. In Search of an Understandable Consensus Algorithm. In USENIX Annual Technical Conference. 305–319. https://raft.github.io/raft.pdf
  53. FalconDB: Blockchain-Based Collaborative Database. In Proceedings of the ACM SIGMOD International Conference on Management of Data. 637–652. https://doi.org/10.1145/3318464.3380594
  54. Performance Analysis of Private Blockchain Platforms in Varying Workloads. In 26th International Conference on Computer Communication and Networks. https://doi.org/10.1109/ICCCN.2017.8038517
  55. Sara Rouhani and Ralph Deters. 2017. Performance Analysis of Ethereum Transactions in Private Blockchain. In 8th International Conference on Software Engineering and Service Science. IEEE, 70–74. https://doi.org/10.1109/ICSESS.2017.8342866
  56. A Transactional Perspective on Execute-Order-Validate Blockchains. In Proceedings of the ACM SIGMOD International Conference on Management of Data (Portland, OR, USA) (SIGMOD ’20). 543–557. https://doi.org/10.1145/3318464.3389693
  57. Enhancing the Performance of the Blockchain Consensus Algorithm Using Multithreading Technology. In Shams Engineering Journal 12, 3 (2021), 2709–2716. https://doi.org/10.1016/j.asej.2021.01.019
  58. Performance and Scalability of Private Ethereum Blockchains. In Business Process Management: Blockchain and Central and Eastern Europe Forum. Vol. 361. Springer, 103–118. https://doi.org/10.1007/978-3-030-30429-4_8
  59. The Transparency Challenge of Blockchain in Organizations. Electronic Markets 32 (2022), 1779–1794. Issue 3. https://doi.org/10.1007/s12525-022-00536-0
  60. The DLPS: A New Framework for Benchmarking Blockchains. In 54th Hawaii International Conference on System Sciences. 6855–6864. https://hdl.handle.net/10993/45620
  61. A Serverless Distributed Ledger for Enterprises. In 55th Hawaii International Conference on System Sciences. 7382–7391. https://arxiv.org/abs/2110.09221
  62. Performance Evaluation of Hyperledger Fabric. In Proceedings of the International Conference on Informatics, IoT, and Enabling Technologies. IEEE, 608–613. https://doi.org/10.1109/ICIoT48696.2020.9089614
  63. The Performance of Byzantine Fault Tolerant Blockchains. In 19th International Symposium on Network Computing and Applications. IEEE. https://doi.org/10.1109/NCA51143.2020.9306742
  64. How to Databasify a Blockchain: The Case of Hyperledger Fabric. http://arxiv.org/abs/1810.13177
  65. Operating Permissioned Blockchain in Clouds: A Performance Study of Hyperledger Sawtooth. In Proceedings of the 18th International Symposium on Parallel and Distributed Computing. IEEE, 50–57. https://doi.org/10.1109/ISPDC.2019.00010
  66. Performance Modeling of Hyperledger Fabric (Permissioned Blockchain Network). In Proceedings of the 17th International Symposium on Network Computing and Applications. IEEE. https://doi.org/10.1109/NCA.2018.8548070
  67. Parth Thakkar and Senthilnathan Natarajan. 2021. Scaling Blockchains Using Pipelined Execution and Sparse Peers. In Proceedings of the ACM Symposium on Cloud Computing. ACM, 489–502. https://doi.org/10.1145/3472883.3486975
  68. Performance Benchmarking and Optimizing Hyperledger Fabric Blockchain Platform. In Proceedings of the 26th International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems. IEEE, 264–276. https://doi.org/10.1109/MASCOTS.2018.00034
  69. A Framework of Blockchain Technology Adoption: An Investigation of Challenges and Expected Value. Information & Management 58, 3 (2021), 103444. https://doi.org/10.1016/j.im.2021.103444
  70. Function-Level Bottleneck Analysis of Private Proof-of-Authority Ethereum Blockchain. IEEE Access 8 (2020), 141611–141621. https://doi.org/10.1109/ACCESS.2020.3011876
  71. Blockchain-Based Database in an IoT Environment: Challenges, Opportunities, and Analysis. Cluster Computing 23, 3 (2020), 2151–2165. https://doi.org/10.1007/s10586-020-03138-7
  72. VAKT. 2024. Technology. https://www.vakt.com/technology
  73. Marko Vukolić. 2015. The Quest for Scalable Blockchain Fabric: Proof-of-Work vs. BFT Replication. In International Workshop on Open Problems in Network Security. Springer, 112–125. https://doi.org/10.1007/978-3-319-39028-4_9
  74. Canhui Wang and Xiaowen Chu. 2020. Performance Characterization and Bottleneck Analysis of Hyperledger Fabric. Proceedings of the 40th International Conference on Distributed Computing Systems (2020), 1281–1286. https://doi.org/10.1109/ICDCS47774.2020.00165
  75. Performance Benchmarking and Optimization for Blockchain Systems: A Survey. In Second International Conference on Blockchain. Springer. https://doi.org/10.1007/978-3-030-23404-1
  76. Latency Performance Modeling and Analysis for Hyperledger Fabric Blockchain Network. Information Processing & Management 58, 1 (2021), 102436. https://doi.org/10.1016/j.ipm.2020.102436
  77. Steven Zheng. 2019. Nearly 75% of Fortune 100 Firms Have Explored Blockchain Initiatives. http://www.theblockresearch.com/nearly-75-of-fortune-100-firms-have-explored-blockchain-initiatives-68506

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets