Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
125 tokens/sec
GPT-4o
47 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Adapting Amidst Degradation: Cross Domain Li-ion Battery Health Estimation via Physics-Guided Test-Time Training (2402.00068v3)

Published 30 Jan 2024 in cs.LG and cs.AI

Abstract: Health modeling of lithium-ion batteries (LIBs) is crucial for safe and efficient energy management and carries significant socio-economic implications. Although Machine Learning (ML)-based State of Health (SOH) estimation methods have made significant progress in accuracy, the scarcity of high-quality LIB data remains a major obstacle. Existing transfer learning methods for cross-domain LIB SOH estimation have significantly alleviated the labeling burden of target LIB data, however, they still require sufficient unlabeled target data (UTD) for effective adaptation to the target domain. Collecting this UTD is challenging due to the time-consuming nature of degradation experiments. To address this issue, we introduce a practical Test-Time Training framework, BatteryTTT, which adapts the model continually using each UTD collected amidst degradation, thereby significantly reducing data collection time. To fully utilize each UTD, BatteryTTT integrates the inherent physical laws of modern LIBs into self-supervised learning, termed Physcics-Guided Test-Time Training. Additionally, we explore the potential of LLMs in battery sequence modeling by evaluating their performance in SOH estimation through model reprogramming and prefix prompt adaptation. The combination of BatteryTTT and LLM modeling, termed GPT4Battery, achieves state-of-the-art generalization results across current LIB benchmarks. Furthermore, we demonstrate the practical value and scalability of our approach by deploying it in our real-world battery management system (BMS) for 300Ah large-scale energy storage LIBs.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (31)
  1. Christoph Birkl. Oxford battery degradation dataset 1. 2017.
  2. Main aging mechanisms in li ion batteries. Journal of power sources, 146(1-2):90–96, 2005.
  3. Language models are few-shot learners. Advances in neural information processing systems, 33:1877–1901, 2020.
  4. Rich Caruana. Multitask learning. Machine learning, 28:41–75, 1997.
  5. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805, 2018.
  6. Test-time training with masked autoencoders. Advances in Neural Information Processing Systems, 35:29374–29385, 2022.
  7. Towards the development of a hotel-based e-bike rental service: Results from a stated preference survey and techno-economic analysis. Energy, 215:119052, 2021.
  8. End-to-end capacity estimation of lithium-ion batteries with an enhanced long short-term memory network considering domain adaptation. Journal of Power Sources, 520:230823, 2022.
  9. Prognostics of lithium-ion batteries based on dempster–shafer theory and the bayesian monte carlo method. Journal of Power Sources, 196(23):10314–10321, 2011.
  10. Lora: Low-rank adaptation of large language models. In International Conference on Learning Representations, 2021.
  11. Martin Linder Mikael Hanicke Evan Horetsky Dina Ibrahim Sören Jautelat ukas Torscht Alexandre van de Rijt Jakob Fleischmann, Patrick Schaufuss. Battery 2030: Resilient, sustainable, and circular. 2023. January 16, 2023.
  12. Visual prompt tuning. In European Conference on Computer Vision, pages 709–727. Springer, 2022.
  13. Is bert a cross-disciplinary knowledge learner? a surprising finding of pre-trained models’ transferability. arXiv preprint arXiv:2103.07162, 2021.
  14. Prefix-tuning: Optimizing continuous prompts for generation. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), pages 4582–4597, 2021.
  15. One-shot battery degradation trajectory prediction with deep learning. Journal of Power Sources, 506:230024, 2021.
  16. Frozen pretrained transformers as universal computation engines. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 36, pages 7628–7636, 2022.
  17. Deep learning to estimate lithium-ion battery state of health without additional degradation experiments. Nature Communications, 14(1):2760, 2023.
  18. Predicting the state of charge and health of batteries using data-driven machine learning. Nature Machine Intelligence, 2(3):161–170, 2020.
  19. Frozen transformers in language models are effective visual encoder layers. arXiv preprint arXiv:2310.12973, 2023.
  20. Improving language understanding by generative pre-training. 2018.
  21. Language models are unsupervised multitask learners. OpenAI blog, 1(8):9, 2019.
  22. Machine learning pipeline for battery state-of-health estimation. Nature Machine Intelligence, 3(5):447–456, 2021.
  23. Data-driven prediction of battery cycle life before capacity degradation. Nature Energy, 4(5):383–391, 2019.
  24. A flexible state-of-health prediction scheme for lithium-ion battery packs with long short-term memory network and transfer learning. IEEE Transactions on Transportation Electrification, 7(4):2238–2248, 2021.
  25. Test-time training with self-supervision for generalization under distribution shifts. In International conference on machine learning, pages 9229–9248. PMLR, 2020.
  26. Transfer learning with long short-term memory network for state-of-health prediction of lithium-ion batteries. IEEE Transactions on Industrial Electronics, 67(10):8723–8731, 2020.
  27. Deep neural network battery charging curve prediction using 30 points collected in 10 min. Joule, 5(6):1521–1534, 2021.
  28. Flexible battery state of health and state of charge estimation using partial charging data and deep learning. Energy Storage Materials, 51:372–381, 2022.
  29. Long short-term memory network with transfer learning for lithium-ion battery capacity fade and cycle life prediction. Applied Energy, 350:121660, 2023.
  30. State-of-health estimation for lithium-ion batteries using domain adversarial transfer learning. IEEE Transactions on Power Electronics, 37(3):3528–3543, 2021.
  31. One fits all: Power general time series analysis by pretrained lm. arXiv preprint arXiv:2302.11939, 2023.
Citations (1)

Summary

We haven't generated a summary for this paper yet.