Collectively Simplifying Trajectories in a Database: A Query Accuracy Driven Approach (2311.11204v2)
Abstract: Increasing and massive volumes of trajectory data are being accumulated that may serve a variety of applications, such as mining popular routes or identifying ridesharing candidates. As storing and querying massive trajectory data is costly, trajectory simplification techniques have been introduced that intuitively aim to reduce the sizes of trajectories, thus reducing storage and speeding up querying, while preserving as much information as possible. Existing techniques rely mainly on hand-crafted error measures when deciding which point to drop when simplifying a trajectory. While the hope may be that such simplification affects the subsequent usability of the data only minimally, the usability of the simplified data remains largely unexplored. Instead of using error measures that indirectly may to some extent yield simplified trajectories with high usability, we adopt a direct approach to simplification and present the first study of query accuracy driven trajectory simplification, where the direct objective is to achieve a simplified trajectory database that preserves the query accuracy of the original database as much as possible. Specifically, we propose a multi-agent reinforcement learning based solution with two agents working cooperatively to collectively simplify trajectories in a database while optimizing query usability. Extensive experiments on four real-world trajectory datasets show that the solution is capable of consistently outperforming baseline solutions over various query types and dynamics.
- Z. Chen, H. T. Shen, and X. Zhou, “Discovering popular routes from trajectories,” in ICDE, 2011, pp. 900–911.
- Q. Zhang, Z. Wang, C. Long, C. Huang, S.-M. Yiu, Y. Liu, G. Cong, and J. Shi, “Online anomalous subtrajectory detection on road networks with deep reinforcement learning,” in ICDE. IEEE, 2023, pp. 246–258.
- Z. Li, J. Han, M. Ji, L.-A. Tang, Y. Yu, B. Ding, J.-G. Lee, and R. Kays, “Movemine: Mining moving object data for discovery of animal movement patterns,” TIST, vol. 2, no. 4, pp. 1–32, 2011.
- Z. Wang, C. Long, G. Cong, and C. Ju, “Effective and efficient sports play retrieval with deep representation learning,” in SIGKDD, 2019, pp. 499–509.
- Z. Wang, C. Long, and G. Cong, “Similar sports play retrieval with deep reinforcement learning,” TKDE, 2021.
- Q. Zhang, Z. Wang, C. Long, and S.-M. Yiu, “On predicting and generating a good break shot in billiards sports,” in SDM. SIAM, 2022, pp. 109–117.
- X. Lin, S. Ma, J. Jiang, Y. Hou, and T. Wo, “Error bounded line simplification algorithms for trajectory compression: An experimental evaluation,” TODS, vol. 46, no. 3, pp. 1–44, 2021.
- D. Zhang, M. Ding, D. Yang, Y. Liu, J. Fan, and H. T. Shen, “Trajectory simplification: an experimental study and quality analysis,” PVLDB, vol. 11, no. 9, pp. 934–946, 2018.
- H. Cao, O. Wolfson, and G. Trajcevski, “Spatio-temporal data reduction with deterministic error bounds,” The VLDB Journal, vol. 15, no. 3, pp. 211–228, 2006.
- P.-F. Marteau and G. Ménier, “Speeding up simplification of polygonal curves using nested approximations,” Pattern Analysis and Applications, vol. 12, no. 4, pp. 367–375, 2009.
- C. Long, R. C.-W. Wong, and H. Jagadish, “Trajectory simplification: on minimizing the direction-based error,” PVLDB, vol. 8, no. 1, pp. 49–60, 2014.
- Z. Wang, C. Long, and G. Cong, “Trajectory simplification with reinforcement learning,” in ICDE, 2021, pp. 684–695.
- M. Potamias, K. Patroumpas, and T. Sellis, “Sampling trajectory streams with spatiotemporal criteria,” in SSDBM, 2006, pp. 275–284.
- J. Muckell, J.-H. Hwang, V. Patil, C. T. Lawson, F. Ping, and S. Ravi, “Squish: an online approach for gps trajectory compression,” in Computing for Geospatial Research & Applications, 2011, pp. 1–8.
- J. Muckell, P. W. Olsen, J.-H. Hwang, C. T. Lawson, and S. Ravi, “Compression of trajectory data: a comprehensive evaluation and new approach,” GeoInformatica, vol. 18, no. 3, pp. 435–460, 2014.
- Z. Wang, C. Long, G. Cong, and Q. Zhang, “Error-bounded online trajectory simplification with multi-agent reinforcement learning,” in KDD, 2021, pp. 1758–1768.
- J. L. Bentley, “Multidimensional binary search trees used for associative searching,” Communications of the ACM, vol. 18, no. 9, pp. 509–517, 1975.
- D. H. Douglas and T. K. Peucker, “Algorithms for the reduction of the number of points required to represent a digitized line or its caricature,” Cartographica, vol. 10, no. 2, pp. 112–122, 1973.
- X. Lin, S. Ma, H. Zhang, T. Wo, and J. Huai, “One-pass error bounded trajectory simplification,” PVLDB, vol. 10, no. 7, pp. 841–852, 2017.
- X. Lin, J. Jiang, S. Ma, Y. Zuo, and C. Hu, “One-pass trajectory simplification using the synchronous euclidean distance,” VLDBJ, vol. 28, no. 6, pp. 897–921, 2019.
- J. Liu, K. Zhao, P. Sommer, S. Shang, B. Kusy, and R. Jurdak, “Bounded quadrant system: Error-bounded trajectory compression on the go,” in ICDE, 2015, pp. 987–998.
- N. Meratnia and A. Rolf, “Spatiotemporal compression techniques for moving point objects,” in EDBT, 2004, pp. 765–782.
- W. S. Chan and F. Chin, “Approximation of polygonal curves with minimum number of line segments or minimum error,” International Journal of Computational Geometry & Applications, vol. 6, no. 01, pp. 59–77, 1996.
- C. Long, R. C.-W. Wong, and H. Jagadish, “Direction-preserving trajectory simplification,” PVLDB, vol. 6, no. 10, pp. 949–960, 2013.
- E. Keogh, S. Chu, D. Hart, and M. Pazzani, “An online algorithm for segmenting time series,” in ICDM, 2001, pp. 289–296.
- S. Wang and H. Ferhatosmanoglu, “Ppq-trajectory: spatio-temporal quantization for querying in large trajectory repositories,” PVLDB, vol. 14, no. 2, pp. 215–227, 2020.
- M. van de Kerkhof, I. Kostitsyna, M. Löffler, M. Mirzanezhad, and C. Wenk, “Global curve simplification,” arXiv preprint arXiv:1809.10269, 2018.
- Y. Han, W. Sun, and B. Zheng, “Compress: A comprehensive framework of trajectory compression in road networks,” TODS, vol. 42, no. 2, pp. 1–49, 2017.
- R. Song, W. Sun, B. Zheng, and Y. Zheng, “Press: A novel framework of trajectory compression in road networks,” arXiv preprint arXiv:1402.1546, 2014.
- T. Li, R. Huang, L. Chen, C. S. Jensen, and T. B. Pedersen, “Compression of uncertain trajectories in road networks,” PVLDB, vol. 13, no. 7, pp. 1050–1063, 2020.
- T. Li, L. Chen, C. S. Jensen, and T. B. Pedersen, “Trace: real-time compression of streaming trajectories in road networks,” Proceedings of the VLDB Endowment, vol. 14, no. 7, pp. 1175–1187, 2021.
- D. A. Huffman, “A method for the construction of minimum-redundancy codes,” Proceedings of the IRE, vol. 40, no. 9, pp. 1098–1101, 1952.
- Z. Wang, C. Long, G. Cong, and Y. Liu, “Efficient and effective similar subtrajectory search with deep reinforcement learning,” PVLDB, vol. 13, no. 12, pp. 2312–2325, 2020.
- Z. Yang, B. Chandramouli, C. Wang, J. Gehrke, Y. Li, U. F. Minhas, P.-Å. Larson, D. Kossmann, and R. Acharya, “Qd-tree: Learning data layouts for big data analytics,” in SIGMOD, 2020, pp. 193–208.
- K. Lin, R. Zhao, Z. Xu, and J. Zhou, “Efficient large-scale fleet management via multi-agent deep reinforcement learning,” in SIGKDD, 2018, pp. 1774–1783.
- J. Liu, K. Zhao, P. Sommer, S. Shang, B. Kusy, J.-G. Lee, and R. Jurdak, “A novel framework for online amnesic trajectory compression in resource-constrained environments,” TKDE, vol. 28, no. 11, pp. 2827–2841, 2016.
- R. Bellman, “On the approximation of curves by line segments using dynamic programming,” Communications of the ACM, vol. 4, no. 6, p. 284, 1961.
- B. Ke, J. Shao, Y. Zhang, D. Zhang, and Y. Yang, “An online approach for direction-based trajectory compression with error bound guarantee,” in APWeb, 2016, pp. 79–91.
- B. Ke, J. Shao, and D. Zhang, “An efficient online approach for direction-preserving trajectory simplification with interval bounds,” in MDM, 2017, pp. 50–55.
- S. Wang, Z. Bao, J. S. Culpepper, and G. Cong, “A survey on trajectory data management, analytics, and learning,” CSUR, vol. 54, no. 2, pp. 1–36, 2021.
- H. Cao, O. Wolfson, and G. Trajcevski, “Spatio-temporal data reduction with deterministic error bounds,” in Proceedings of the 2003 joint workshop on Foundations of mobile computing, 2003, pp. 33–42.
- E. Frentzos, K. Gratsias, N. Pelekis, and Y. Theodoridis, “Nearest neighbor search on moving object trajectories,” in International Symposium on Spatial and Temporal Databases. Springer, 2005, pp. 328–345.
- L. Chen, M. T. Özsu, and V. Oria, “Robust and fast similarity search for moving object trajectories,” in SIGMOD, 2005, pp. 491–502.
- X. Li, K. Zhao, G. Cong, C. S. Jensen, and W. Wei, “Deep representation learning for trajectory similarity computation,” in ICDE, 2018, pp. 617–628.
- Y. Chen and J. M. Patel, “Design and evaluation of trajectory join algorithms,” in Proceedings of the 17th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems, 2009, pp. 266–275.
- J.-G. Lee, J. Han, and K.-Y. Whang, “Trajectory clustering: a partition-and-group framework,” in SIGMOD, 2007, pp. 593–604.
- V. Mnih, K. Kavukcuoglu, D. Silver, A. Graves, I. Antonoglou, D. Wierstra, and M. Riedmiller, “Playing atari with deep reinforcement learning,” arXiv preprint arXiv:1312.5602, 2013.
- H. Samet, “The quadtree and related hierarchical data structures,” ACM Computing Surveys (CSUR), vol. 16, no. 2, pp. 187–260, 1984.
- “Collectively simplifying trajectories in a database: A query accuracy driven approach (technical report),” https://zhengwang125.github.io/paper/RL4QDTS-TR.pdf.