Batch to Streaming in Financial Crime Compliance
DOI:
https://doi.org/10.5281/zenodo.22111661Keywords:
Anti-Money Laundering (AML) Platforms, Event-Driven Compliance Architectures, Batch vs. Streaming Processing, Near-Real-Time Transaction Monitoring, Financial Crime Detection Systems, Multi-Stage Detection Pipelines, Detection Timeliness and Coverage, False Positive and False Negative Management, Streaming Analytics for Compliance, Windowed Transaction Analysis, Operational Resilience in Compliance Systems, Fault-Tolerant Detection Architectures, Detection Model Validation, Data Freshness in AML Pipelines, Gating and Backtesting Strategies, Scalable Compliance Engineering, Deployment Complexity Trade-Offs, Cost-Aware Detection Models, Core Banking System Integration, Enterprise RegTech Platforms.Abstract
A growing number of financial crime compliance platforms support batch and streaming processing paradigms with event-driven architectures and streaming models servicing the streaming capability. The question arises as to whether these streaming capabilities should be deployed to complement or replace the batch processing capability. In batch implementations, transaction data produced in one period—typically daily—serves as the basis for detecting money laundering activity. Event-driven architectures also support near-real-time money laundering detection by examining transactions within windowed timeframes, thereby producing results sooner. Nevertheless, two latent data behaviours may undermine detection effectiveness. First, transaction data within a batch window may be stale, which is not true for transactions produced in a streaming architecture. Second, a very small percentage of transaction data, by design, is ungated by having an attached backtesting period. These behaviours can be the focus of successive stages of a multi-stage detection or AML programme; however, when they are not done or when their underlying pipelines cannot keep up with demand, extra transactions may be routed through money laundering detection models early but without the gating.
A comparison of an event-driven architecture with a batch-process architecture of a compliance platform shows differential effects on detection timeliness, coverage, false positives, false negatives, and the detection-validation process. The event-driven architecture also offers the potential for deployment with more resilience to operational impact from the failure of external systems, such as core-banking systems. However, operational resilience can come with increased operational complexity, and, depending on the detection models employed, such models may incur higher processing costs. Such trade-offs as detection effectiveness—timeliness, coverage, false positives, false negatives, and the validation process—and operational resilience—fault tolerance; deployment complexity; ongoing operational costs; and facilitation of operational maintenance—can help guide decisions regarding the streaming capability.
References
1. Alarab, I., & Prakoonwit, S. (2022). Graph-based LSTM for anti-money laundering: Experimenting temporal graph convolutional network with Bitcoin data. Neural Processing Letters. Advance online publication.
2. Ali, A., Abd Razak, S., Othman, S. H., Eisa, T. A. E., Al-Dhaqm, A., Nasser, M., Elhassan, T., Elshafie, H., & Saif, A. (2022). Financial fraud detection based on machine learning: A systematic literature review. Applied Sciences, 12(19), 9637.
3. Gottimukkala, V. R. R. (2020). Energy-Efficient Design Patterns for Large-Scale Banking Applications Deployed on AWS Cloud. International Journal of Advanced Research in Computer and Communication Engineering (IJARCCE), DOI, 10.
4. Canhoto, A. I. (2021). Leveraging machine learning in the global fight against money laundering and terrorism financing: An affordances perspective. Journal of Business Research, 131, 441–452.
5. Dumitrescu, B., Baltoiu, A., & Budulan, S. (2022). Anomaly detection in graphs of bank transactions for anti-money laundering applications. IEEE Access, 10.
6. Gerbrands, P., Unger, B., Getzner, M., & Ferwerda, J. (2022). The effect of anti-money laundering policies: An empirical network analysis. EPJ Data Science, 11, Article 15.
7. Granados, O. M., & Vargas, A. (2022). The geometry of suspicious money laundering activities in financial networks. EPJ Data Science, 11, Article 6.
8. Gupta, A., Dwivedi, D., Shah, J., et al. (2021). Data quality issues leading to sub optimal machine learning for money laundering models. Journal of Money Laundering Control, 25(3), 551–555.
9. Hayble-Gomes, E. (2022). The use of predictive modeling to identify relevant features for suspicious activity reporting. Journal of Money Laundering Control, 26(4), 806–830.
10. Jensen, R. I. T., & Iosifidis, A. (2022). Qualifying and raising anti-money laundering alarms with deep learning. Expert Systems with Applications. Advance online publication.
11. Segireddy, A. R. (2020). Cloud Migration Strategies for High-Volume Financial Messaging Systems.
12. Kumar, S., Ahmed, R., Bharany, S., Shuaib, M., Ahmad, T., Tag Eldin, E., Ur Rehman, A., & Shafiq, M. (2022). Exploitation of machine learning algorithms for detecting financial crimes based on customers’ behavior. Sustainability, 14(21), 13875.
13. Stojanović, B., Božić, J., Hofer-Schmitz, K., & Nahrgang, K. (2021). Follow the trail: Machine learning for fraud detection in Fintech applications. Sensors, 21(5), 1594.
14. Wronka, C. (2021). Anti-money laundering regimes: A comparison between Germany, Switzerland and the UK with a focus on the crypto business. Journal of Money Laundering Control, 25(3), 656–670.
15. Rocha-Salazar, J.-d.-J., Segovia-Vargas, M.-J., & Camacho-Miñano, M.-d.-M. (2021). Money laundering and terrorism financing detection using neural networks and an abnormality indicator. Expert Systems with Applications, 169, 114470.
16. Alarab, I., Prakoonwit, S., & other authors. (2022). Graph-based approaches for anti-money laundering using Bitcoin transaction data. Neural Processing Letters.
17. Inala, R. (2020). Building Foundational Data Products for Financial Services: A MDM-Based Approach to Customer, and Product Data Integration. Universal Journal of Finance and Economics, 1(1), 1-18.
18. Al-Hashedi, K. G., & Magalingam, P. (2021). Financial fraud detection applying data mining techniques: A comprehensive review from 2009 to 2019. Computer Science Review, 40, 100402.
19. Hayble-Gomes, E. (2022). Predictive modeling and machine learning for suspicious activity reporting in banking. Journal of Money Laundering Control, 26(4), 806–830.
20. Yu, Y., Xu, Y., Wang, J., Li, Z., & Cao, B. (2022). Anti-money laundering risk identification of financial institutions based on aspect-level graph neural networks. In Proceedings of the 2022 IEEE 22nd International Conference on Software Quality, Reliability and Security Companion (QRS-C) (pp. 542–546). IEEE.
21. Cardoso, M., Saleiro, P., & Bizarro, P. (2022). LaundroGraph: Self-supervised graph representation learning for anti-money laundering. arXiv.
22. Asgedom Gobena, M., & Kebede, D. G. (2021). Cash economy, criminality and cash regulation in Ethiopia. Journal of Money Laundering Control, 25(3), 645–655.
23. Aitha, A. R. (2021). Dev Ops Driven Digital Transformation: Accelerating Innovation In The Insurance Industry. Journal of International Crisis and Risk Communication Research.
24. Wronka, C. (2021). Anti-money laundering and cryptocurrency-related financial crime risks. Journal of Money Laundering Control.
25. Detection of fraudulent transactions using SAS Viya machine learning algorithms. (2021). Procedia Computer Science, 190, 204–209.
26. Usage of machine learning methods for early detection of money laundering schemes. (2021). Procedia Computer Science, 190, 184–192.
27. Credit card fraud detection using artificial neural network. (2021). Global Transitions Proceedings, 2(1), 35–41.
28. Inala, R. Designing Scalable Technology Architectures for Customer Data in Group Insurance and Investment Platforms.
29. Data engineering for fraud detection. (2021). Decision Support Systems, 150, 113492.
30. Cyber-laundering: The change of money laundering in the digital age. (2021). Journal of Money Laundering Control, 25(2), 330–344.
31. Combating money laundering with machine learning: Applicability of supervised-learning algorithms at cryptocurrency exchanges. (2021). Journal of Money Laundering Control, 25(4), 766–778.
32. Digital payment fraud detection methods in digital ages and Industry 4.0. (2022). Computers & Electrical Engineering, 100, 107734.
33. Nagabhyru, K. C. (2022). Bridging Traditional ETL Pipelines with AI Enhanced Data Workflows: Foundations of Intelligent Automation in Data Engineering. Available at SSRN 5505199.
34. An integrated machine learning framework for fraud detection. (2022). International Journal of Information Security and Privacy, 16(1).
35. Empirical analysis of machine learning algorithms on detection of fraudulent electronic fund transfer transactions. (2022). IETE Journal of Research.
36. Sustainable response system building against insider-led cyber frauds in banking sector: A machine learning approach. (2022). Journal of Financial Crime, 30(1), 48–85.
Additional Files
Published
Data Availability Statement
None
Issue
Section
License
Copyright (c) 2023 Luca Bianchi (Author)
This work is licensed under a Creative Commons Attribution 4.0 International License.
This work is licensed under a Creative Commons
Attribution 4.0 International License (CC BY 4.0).
You are free to:
- Share: copy and redistribute the material
- Adapt: remix, transform, and build upon the material
for any purpose, even commercially.
Under the following terms:
Attribution — You must give appropriate credit to
the original author(s) and source.
Full license text: https://creativecommons.org/licenses/by/4.0/
