Reinforcement Learning Paycheck Optimization for Multivariate Financial Goals
Abstract: We study paycheck optimization, which examines how to allocate income in order to achieve several competing financial goals. For paycheck optimization, a quantitative methodology is missing, due to a lack of a suitable problem formulation. To deal with this issue, we formulate the problem as a utility maximization problem. The proposed formulation is able to (i) unify different financial goals; (ii) incorporate user preferences regarding the goals; (iii) handle stochastic interest rates. The proposed formulation also facilitates an end-to-end reinforcement learning solution, which is implemented on a variety of problem settings.
- The future of financial planning and counseling: An introduction to financial therapy. In Financial planning and counseling scales, pp. 33–59. Springer, 2011.
- A survey of inverse reinforcement learning: Challenges, methods and progress. Artificial Intelligence, 297:103500, 2021.
- Explainable artificial intelligence for crypto asset allocation. Finance Research Letters, 47:102941, 2022.
- Variance allocation and shapley value. Methodology and Computing in Applied Probability, 20:919–933, 2018.
- New frontiers of robo-advising: Consumption, saving, debt management, and taxes. Saving, Debt Management, and Taxes (February 1, 2021), 2021.
- Robo-advising. In The Palgrave Handbook of Technological Finance, pp. 725–749. Springer, 2021.
- The promises and pitfalls of robo-advising. The Review of Financial Studies, 32(5):1983–2020, 2019.
- Parathyroid hormone independently predicts fracture, vascular events, and death in patients with stage 3 and 4 chronic kidney disease. Osteoporosis International, 30:2019–2025, 2019a.
- Temporal poisson square root graphical models. In International Conference on Machine Learning, pp. 1714–1723. PMLR, 2018.
- Partially linear additive gaussian graphical models. In International Conference on Machine Learning, pp. 2180–2190. PMLR, 2019b.
- Joint nonparametric precision matrix estimation with confounding. In Uncertainty in Artificial Intelligence, pp. 378–388. PMLR, 2020a.
- Deep pqr: Solving inverse reinforcement learning using anchor actions. In International Conference on Machine Learning, pp. 3431–3441. PMLR, 2020b.
- Factor learning portfolio optimization informed by continuous-time finance models. In ICML Workshop on New Frontiers in Learning, Control, and Dynamical Systems, 2023a.
- A data-driven state aggregation approach for dynamic discrete choice models. In Uncertainty in Artificial Intelligence, pp. 647–657. PMLR, 2023b.
- Improving offline RL by blending heuristics. arXiv preprint arXiv:2306.00321, 2023c.
- Network models to improve robot advisory portfolios. Annals of Operations Research, pp. 1–25, 2022.
- Effective financial planning for retirement. 2013.
- Adam: A method for stochastic optimization, 2014. URL https://arxiv.org/abs/1412.6980.
- A screening rule for l1-regularized ising model estimation. Advances in neural information processing systems, 30, 2017.
- Offline reinforcement learning: Tutorial, review, and perspectives on open problems. arXiv preprint arXiv:2005.01643, 2020.
- Deterministic policy gradient algorithms. In International conference on machine learning, pp. 387–395. PMLR, 2014.
- Nico Swart. Personal financial management. Juta and Company Ltd, 2004.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.