A Parallel Multi-Objective Swarm Intelligence Framework For Big Data Analysis

Nowadays, data are generated from smart devices in huge volumes, different formats, and high pace, which comply with Big Data characteristics. Big Data led to the emergence of new technologies, such as Hadoop and Spark to provide both data management and analysis. Analysing Big Data is a time-consuming process. Particle swarm and ant colony optimisation are population-based meta-heuristic methods. They have been combined with data mining techniques to solve MultiObjective Problems (MOPs) of small and medium sized data, presenting good performance. However, when applying these methods to solve MOPs in Big data, an efficient scalable framework will be required. In this paper, we summarise new technologies proposed to manage and analyse Big Data. We present how meta-heuristics can be adapted with Big Data technologies. We characterise problems arose when analysing MO Big Data problems, in addition to proposed methods to overcome these problems, giving examples in Bioinformatics field.