Research Area:  Big Data
Many techniques have been proposed to implement the Apriori algorithm on MapReduce framework but only a few have focused on performance improvement. FPC (Fixed Passes Combined-counting) and DPC (Dynamic Passes Combined-counting) algorithms combine multiple passes of Apriori in a single MapReduce phase to reduce the execution time. In this paper, we propose improved MapReduce based Apriori algorithms VFPC (Variable Size based Fixed Passes Combined-counting) and ETDPC (Elapsed Time based Dynamic Passes Combined-counting) over FPC and DPC. Further, we optimize the multi-pass phases of these algorithms by skipping pruning step in some passes, and propose Optimized-VFPC and Optimized-ETDPC algorithms. Quantitative analysis reveals that counting cost of additional un-pruned candidates produced due to skipped-pruning is less significant than reduction in computation cost due to the same. Experimental results show that VFPC and ETDPC are more robust and flexible than FPC and DPC whereas their optimized versions are more efficient in terms of execution time.
Keywords:  
Author(s) Name:  Sudhakar Singh,Rakhi Garg and P K Mishra
Journal name:  Computers & Electrical Engineering
Conferrence name:  
Publisher name:  ELSEVIER
DOI:  10.1016/j.compeleceng.2017.10.008
Volume Information:  Volume 67, April 2018, Pages 348-364
Paper Link:   https://www.sciencedirect.com/science/article/abs/pii/S0045790617308534#!