Intelligent Data Pipelines for Self-Governing Global Payment Networks
DOI:
https://doi.org/10.5281/kt41vz23Keywords:
Real-Time Payment Processing, Cross-Border Payment Systems, AI-Driven Data Engineering, Autonomous Payment Integration, Financial Data Streaming, Payment Compliance Automation, Low-Latency Data Pipelines, Streaming Data Fusion, Payment Data Quality, Real-Time Financial Analytics.Abstract
Real-time processing, AI-driven data engineering, and the autonomous integration of payment and compliance functions are critical to improving the efficiency and effectiveness of cross-border payments. Despite recent innovations, truly autonomous cross-border payment systems remain out of reach: most existing systems still rely on human intervention, since real-time capability is typically limited to the payment step itself, while compliance processes are applied afterward in a force-fitted manner. This sequential, disjointed approach reduces overall efficiency and increases systemic risk.
This work outlines the formal principles of real-time data processing and formalizes a real-time data engineering pipeline capable of processing the data required to support autonomous cross-border payments. Central to this formalization is the definition of latency requirements for financial data streams and the steps necessary to satisfy them. Particular attention is given to the various dimensions of data quality, the concept of streaming data fusion, and the supporting role of the underlying system components.
References
1. Abdallah, A., Maarof, M. A., & Zainal, A. (2020). Fraud detection system: A survey. Journal of Network and Computer Applications, 135, 141–160.
2. Auer, R., Haene, P., & Holden, H. (2021). Multi-CBDC arrangements and the future of cross-border payments. Bank for International Settlements.
3. Challa, K., Challa, S. R., Pamisetty, A., Kaulwar, P. K., & Krishna Reddy Koppolu, H. (2025). Transforming Payments: The Role of AI and Big Data in Fraud Alerts, Credit Monitoring, and Secure Transactions. In 2025 IEEE International Conference on Communication Networks and Computing (CNC) (pp. 1406–1414). IEEE. 2025 IEEE International Conference on Communication Networks and Computing (CNC). https://doi.org/10.1109/cnc68716.2025.11484733
4. Canhoto, A. I. (2021). Leveraging machine learning in the global fight against money laundering and terrorism financing: An affordances perspective. Journal of Business Research, 131, 441–452. ScienceDirec
5. Cherif, A., Ammar, H., Kalkatawi, M., Alshehri, S., & Imine, A. (2024). Encoder–decoder graph neural network for credit card fraud detection. Journal of King Saud University Computer and Information Sciences, 36, 102003. Springer Link
6. Genc, H. O., & Takagi, S. (2024). A literature review on the design and implementation of central bank digital currencies. International Journal of Economic Policy Studies, 18, 197–225. Springer Nature Link
7. Gebara, N., Ghobadi, M., & Costa, P. (2021). In-network aggregation for shared machine learning clusters. Proceedings of Machine Learning and Systems, 3. MLSys Proceedings
8. Ghosh Dastidar, K., Jurgovsky, J., Siblini, W., & Granitzer, M. (2022). NAG: Neural feature aggregation framework for credit card fraud detection. Knowledge and Information Systems, 64, 831–858. Springer Link
9. Sivanand, R., Kumar, D. P., Nagabhyru, K. C., Natarajan, E. P., Pamisetty, V., & Kapila, D. (2025, September). IoT and AI for Real-Time Monitoring in Substation Automation. In 2025 International Conference on Computing and Communications (COMPUTINGCON) (pp. 1-5). IEEE.
10. Gupta, A., Dwivedi, D. N., Shah, J., & Jain, A. (2022). Data quality issues leading to sub optimal machine learning for money laundering models. Journal of Money Laundering Control, 25(3), 551–555. ScienceDirect
11. Hu, H., Jiang, C., Zhong, Y., Peng, Y., Wu, C., Zhu, Y., Lin, H., & Guo, C. (2022). dPRO: A generic performance diagnosis and optimization toolkit for expediting distributed DNN training. Proceedings of Machine Learning and Systems, 4. MLSys Proceedings
12. Hymel, S., Banbury, C., Situnayake, D., Elium, A., Ward, C., Kelsey, M., Baaijens, M., Majchrzycki, M., Plunkett, J., Tischler, D., Grande, A., Moreau, L., Maslov, D., Beavis, A., Jongboom, J., & Reddi, V. J. (2023). Edge Impulse: An MLOps platform for tiny machine learning. Proceedings of Machine Learning and Systems, 5. MLSys Proceedings
13. Ivanov, A., Dryden, N., Ben-Nun, T., Li, S., & Hoefler, T. (2021). Data movement is all you need: A case study on optimizing transformers. Proceedings of Machine Learning and Systems, 3. MLSys Proceedings
14. Jensen, R. I. T., & Iosifidis, A. (2022). Qualifying and raising anti-money laundering alarms with deep learning. Expert Systems with Applications, 202, 119037. ScienceDirect
15. Maguluri, K. K., Chandrasekar, M., Gorshetwar, S. D., Prasanna, S., Anusuya, M., & Vallarasu, K. (2025, February). Applications and advancements of nanoparticle-based drug delivery in lung cancer treatment. In 2025 3rd International Conference on Integrated Circuits and Communication Systems (ICICACS) (pp. 1-6). IEEE.
16. Kosson, A., Chiley, V., Venigalla, A., Hestness, J., & Koster, U. (2021). Pipelined backpropagation at scale: Training large models without batches. Proceedings of Machine Learning and Systems, 3. MLSys Proceedings
17. Kuchnik, M., Klimovic, A., Simsa, J., Smith, V., & Amvrosiadis, G. (2022). Plumber: Diagnosing and removing performance bottlenecks in machine learning data pipelines. Proceedings of Machine Learning and Systems, 4. MLSys Proceedings
18. Kuehnlenz, S., Orsi, B., & Kaltenbrunner, A. (2023). Central bank digital currencies and the international payment system: The demise of the US dollar? Research in International Business and Finance, 64, 101834. ScienceDirect
19. Ande, R., Pandugula, C., Mehta, D., Vankayalapati, R., Birbal, P., Verma, S., ... & Nanavati, N. (2025). Understanding climate change impacts on streamflow by using machine learning: case study of Godavari Basin. Water, 17(8), 1171.
20. Patel, M., Kasiyanto, S., & Reslow, A. (2024). Positioning central bank digital currency in the payments landscape. International Monetary Fund, FinTech Notes, 2024(006). IMF eLibrary
21. Rauschmayr, N., Kumar, V., Huilgol, R., Olgiati, A., Bhattacharjee, S., Harish, N., Kannan, V., Lele, A., Acharya, A., Nielsen, J., Ramakrishnan, L., Bhatt, I., Chia, K., Dodda, N., Li, Z., Choi, M., Nagarajan, B., Geevarghese, J., Davydenko, D., Li, S., Huang, L., Kim, E., Hill, T., & Kenthapadi, K. (2021). Amazon SageMaker Debugger: A system for real-time insights into machine learning model training. Proceedings of Machine Learning and Systems, 3. MLSys Proceedings
22. Reslow, A., Söderberg, G., & Tsuda, N. (2024). Cross-border payments with retail central bank digital currencies: Design and policy considerations. International Monetary Fund, FinTech Notes, 2024(002). IMF eLibrary
23. Shi, S., Zhou, X., Song, S., Wang, X., Zhu, Z., Huang, X., Jiang, X., Zhou, F., Guo, Z., Xie, L., Lan, R., Ouyang, X., Zhang, Y., Wei, J., Gong, J., Lin, W., Gao, P., Meng, P., Xu, X., Guo, C., Yang, B., Chen, Z., Wu, Y., & Chu, X. (2021). Towards scalable distributed training of deep learning on public cloud clusters. Proceedings of Machine Learning and Systems, 3. MLSys Proceedings
24. Shumovskaia, V., Fedyanin, K., Sukharev, I., Berestnev, D., & Panov, M. (2021). Linking bank clients using graph neural networks powered by rich transactional data. International Journal of Data Science and Analytics, 12, 135–145. Springer Link
25. Vanini, P., Rossi, S., Zvizdic, E., & Domenig, T. (2023). Online payment fraud: From anomaly detection to risk management. Financial Innovation, 9, 66. Springer Lin
26. Wang, C., Wu, Q., Weimer, M., & Zhu, E. (2021). FLAML: A fast and lightweight AutoML library. Proceedings of Machine Learning and Systems, 3.
27. Wang, H., & Gao, S. (2024). The future of the international financial system: The emerging CBDC network and its impact on regulation. Regulation & Governance. DO
28. Whang, S. E., Roh, Y., Song, H., & Lee, J.-G. (2023). Data collection and quality challenges in deep learning: A data-centric AI perspective. The VLDB Journal, 32(4), 791–813.
29. Ande, R., Mehta, D., Pandugula, C., Krishna AzithTejaGanti, V., & Kalisetty, S. (2025). Modeling the Som Kamla Amba sub-watershed using Artificial Neural Networks (ANN) and the SWAT tool. Available at SSRN 5341755.
30. Zha, D., Bhat, Z. P., Lai, K.-H., Yang, F., & Hu, X. (2023). Data-centric AI: Perspectives and challenges. Proceedings of the 2023 ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.
31. Alexandre, C. R., & Balsa, J. (2023). Incorporating machine learning and a risk-based strategy in an anti-money laundering multiagent system. Expert Systems with Applications, 217, 119500. ScienceDirect
32. Oztas, B. (2024). Transaction monitoring in anti-money laundering: A qualitative analysis and points of view from industry. Future Generation Computer Systems, 159, 161–171. ScienceDirect
33. Soderberg, G., & others. (2021). Options for access to and interoperability of CBDCs for cross-border payments. Bank for International Settlements, International Monetary Fund, & World Bank. Bank for International Settlement
34. Tuffveson, R. I., & Iosifidis, A. (2022). Qualifying and raising anti-money laundering alarms with deep learning. Expert Systems with Applications, 202, 119037. ScienceDirect
35. Gupta, A., Dwivedi, D. N., Shah, J., & Jain, A. (2022). Data quality issues leading to sub optimal machine learning for money laundering models. Journal of Money Laundering Control, 25(3), 551–555.
Additional Files
Published
Data Availability Statement
None
Issue
Section
License
Copyright (c) 2026 Mallesham Goli (Author)
This work is licensed under a Creative Commons Attribution 4.0 International License.
This work is licensed under a Creative Commons
Attribution 4.0 International License (CC BY 4.0).
You are free to:
- Share: copy and redistribute the material
- Adapt: remix, transform, and build upon the material
for any purpose, even commercially.
Under the following terms:
Attribution — You must give appropriate credit to
the original author(s) and source.
Full license text: https://creativecommons.org/licenses/by/4.0/
