Design of telecom operators IDC resale analysis system based on Spark

A design based on Spark technology is proposed to solve the problem that the telecom operators' network bandwidth resources are resold. We use big data components such as Hadoop, Spark, Hive, HBase, and Zookeeper to build a domain name server logs analysis system and improve the generalized suffix automaton algorithm to match the logs of telecom operator customers with the logs for building a registration information database. Finally, we make an online log analysis platform based on Spring boot to discriminate data. Experiments show that based on Spark technology, the operator resources resale analysis system can accurately match operator telecom customer logs from massive logs. This design is of great significance to realize the operator's network bandwidth business clean, efficient, and high-quality operation with building a harmonious development network environment.