Optimizing Intensive Database Tasks Through Caching Proxy Mechanisms
Abstract: Web caching is essential for the World Wide Web, saving processing power, bandwidth, and reducing latency. Many proxy caching solutions focus on buffering data from the main server, neglecting cacheable information meant for server writes. Existing systems addressing this issue are often intrusive, requiring modifications to the main application for integration. We identify opportunities for enhancement in conventional caching proxies. This paper explores, designs, and implements a potential prototype for such an application. Our focus is on harnessing a faster bulk-data-write approach compared to single-data-write within the context of relational databases. If a (upload) request matches a specified cacheable URL, then the data will be extracted and buffered on the local disk for later bulk-write. In contrast with already existing caching proxies, Squid, for example, in a similar uploading scenario, the request would simply get redirected, leaving out potential gains such as minimized processing power, lower server load, and bandwidth. After prototyping and testing the suggested application against Squid, concerning data uploads with 1, 100, 1.000, ..., and 100.000 requests, we consistently observed query execution improvements ranging from 5 to 9 times. This enhancement was achieved through buffering and bulk-writing the data, the extent of which depended on the specific test conditions.
- A survey of web caching and prefetching a survey of web caching and prefetching. International Journal of Advances in Soft Computing and its Applications, 3.
- Intelligent web proxy caching approaches based on machine learning techniques. Decision Support Systems, 53(3):565–579.
- Round robin scheduling algorithm in cpu and cloud computing: A review. In 2019 2nd International Conference on Computer Applications & Information Security (ICCAIS), pages 1–7.
- World wide web caching: trends and techniques. IEEE Communications Magazine, 38(5):178–184.
- World wide wait: A study of internet scalability and cache-based approaches to alleviate it. Management Science, 49(10):1425–1444.
- Abstract enhancement and validation of squid’s cache replacement policy.
- Garrett, O. (2016). Cache Placement Strategies for NGINX and NGINX Plus.
- Golang (v1.22). Documentation net/http.
- Gorm (v1.25.7). The fantastic ORM library for Golang.
- A survey of caching policies and forwarding mechanisms in information-centric networking. IEEE Communications Surveys & Tutorials, 18(4):2847–2886.
- libev (2024). Documentation libev.
- Linux Kernel Organization. Page Frame Reclamation.
- Understanding application-level caching in web applications: A comprehensive introduction and survey of state-of-the-art approaches. ACM Comput. Surv., 50(6).
- A review of web caching techniques and caching algorithms for effective and improved caching. International Journal of Computer Applications, 128:41–45.
- Oracle (v8). Optimizing INSERT Statements.
- PostgreSQL Global Dev Group (v16a). SQL ANALYZE.
- PostgreSQL Global Dev Group (v16b). SQL EXPLAIN.
- PostgreSQL Global Dev Group (v16c). Using EXPLAIN.
- Mitigating prefetcher-caused pollution using informed caching policies for prefetched blocks. ACM Trans. Archit. Code Optim., 11(4).
- Squid-Cache (2024). Squid: Optimising Web Delivery.
- The kernel development community. Sphinx 5.0.1 & Alabaster 0.7.12 . Page cache.
- Why events are a bad idea (for high-concurrency servers). In Proceedings of the 9th Conference on Hot Topics in Operating Systems - Volume 9, HOTOS’03, page 4, USA. USENIX Association.
- Wessels, D. (2001). Web Caching. O’Reilly Series. O’Reilly & Associates.
- Caching strategy for web application – a systematic literature review. International Journal of Web Information Systems, 16:545–569.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.