Authors: Ngozi Nwankwo
Abstract: The rapid growth of distributed systems has led to an unprecedented increase in the volume, velocity, and variety of data generated across multiple nodes and environments. Efficient and intelligent data processing has become essential to extract meaningful insights and ensure optimal system performance. This study explores the role of intelligent data processing techniques in distributed systems, focusing on the integration of machine learning, artificial intelligence, and advanced data processing frameworks. It examines how distributed architectures leverage parallel processing, data partitioning, and real-time analytics to handle large-scale datasets efficiently. The paper also discusses the use of technologies such as Apache Hadoop, Apache Spark, and edge computing for scalable and low-latency data processing. Key challenges, including data consistency, fault tolerance, network latency, and security, are analyzed along with potential solutions. The findings highlight that intelligent data processing enhances system efficiency, scalability, and decision-making capabilities, making it a critical component of modern distributed computing environments.
DOI:
