Parallel algorithm for reduction of data processing time in big data
Date
2020
2020
Metadata
Show full item record
Show full item record
Abstract
Technological advances have allowed to collect and store large volumes of data over the years. Besides, it is significant that today's applications have high performance and can analyze these large datasets effectively. Today, it remains a challenge for data mining to make its algorithms and applications equally efficient in the need of increasing data size and dimensionality [1]. To achieve this goal, many applications rely on parallelism, because it is an area that allows the reduction of cost depending on the execution time of the algorithms because it takes advantage of the characteristics of current computer architectures to run several processes concurrently [2]. This paper proposes a parallel version of the FuzzyPred algorithm based on the amount of data that can be processed within each of the processing threads, synchronously and independently.
Referencias:
[1] Chapman B, G. Jost and R Van der Pas. Using OpenMP: Portable Shared Memory Parallel Programming Scientific and Engineering Computation. The MIT Press.Massachusetts Institutte of Technology. ISBN 978-0- 262-53302-7. pp 349. 2008.
[2] Jain, Mugdha, and Chakradhar Verma. "Adapting k-means for Clustering in Big Data." International Journal of Computer Applications 101.1 (2014): 19-24.
[3] Ceruto T, O. Lapeira, A. Rosete and R. ESPÍN.Discovery of fuzzy predicates in database. Advances in Intelligent Systems Research (AISR Journal), vol. 51, No 1, pp. 45-54, ISSN 19516851, Atlantis Press, 2013.
[4] Hariri S, and M. Parashar.Tools and Enviroments for Parallel and Distributed Computing. John Wiley & Sons. ISBN 0-471-33288-7, pag 229, 2014.
[5] Fernandez A, S. Del Rio, V. Lopez, M. J. Del Jesus and F. Herrera. Big Data with Colud Computing:an insight on the computing enviroment, Map Reduce and programming frameworks. WIREs Data Mining and Knowledge Discovery.John Wiley and Sons, vol 4, pp 380-409, 2014.
[6] Viloria, A. "Commercial strategies providers pharmaceutical chains for logistics cost reduction." Indian Journal of Science and Technology 8, no. 1 (2016).
[7] Viloria, A., & Gaitan-Angulo, M. (2016). Statistical Adjustment Module Advanced Optimizer Planner and SAP Generated the Case of a Food Production Company. Indian Journal Of Science And Technology, 9(47). doi:10.17485/ijst/2016/v9i47/107371.
[8] Pas, R. An Overview of OpenMP 3.0. In., 2009.IWOMP. Tu Dresden (Alemania). Disponible en http://iwomp.zih.tu-dresden.de/downloads/2.Overwiew_OpenMP.pdf.
[9] N. Sapankevych y R. Sankar, “Time Series Prediction Using Support Vector Machines: A Survey”, IEEE Computational Intelligence Magazine, vol. 4, núm. 2, pp. 24–38, may 2009.
[10] Reinders, J. Intel threading building blocks-outfitting C++ for multi-core processor parallelism. OReilly Media. ISBN 978-1449390860, pp 336, 2007.
[11] Kaminsky, A. The Parallel Java 2 Library Parallel Programming in 100 % Java. Rochester Institute of Technology, Department of Computer Science, Rochester, New York, EUA. 2015.
[12] F. Villada, N. Muñoz, y E. García, Aplicación de las Redes Neuronales al Pronóstico de Precios en Mercado de Valores, Información tecnológica, vol. 23, núm. 4, pp. 11–20. 2012.
[13] Venugopal K, K.G. Srinivasa and L. M. Patnaik. Soft Computing for Data Mining Applications. Springer Berlin Heidelberg: Springer-Verlag. ISBN 978-3-642-00192-5, pp 354, 2009.
[14] Brdar S., Culibrk D., Marinkovic B., Crnobarac J., Crnojevic V. Support Vector Machines with Features Contribution Analysis for Agricultural Yield Prediction, Second International Workshop on Sensing Technolo- gies in Agriculture, Forestry and Environment, 43-47, 2011
[15] Choudhury, A. and Jones, J. Crop yield prediction using time series models, Journal of Economics and Economic Education Research., 15, 53-68, 2014.
[16] R. Putha, L. Quadrifoglio, and E. Zechman. Comparing ant colony optimization and genetic algorithm approaches for solving traffic signal coordination under oversaturation conditions. Computer‐ Aided Civil and Infrastructure Engineering, 27(1), 14-28, 2012.
[17] D. Teodorović, and M. Dell’Orco. Mitigating traffic congestion: solving the ride-matching problem by bee colony optimization. Transportation Planning and Technology, 31(2), 135-152, 2008.
[18] A. L. Bazzan, and F. Klügl. A review on agent-based technology for traffic and transportation. The Knowledge Engineering Review, 29(3), 375-403, 2014.
[19] Amelec, V., & Alexander, P. (2015). Improvements in the automatic distribution process of finished product for pet food category in multinational company. Advanced Science Letters, 21(5), 1419-1421.
[20] Karatzoglou A., Smola A., Hornik K. and Zeileis A. kernlab - An S4 Package for Kernel Methods in R. Journal of Statistical Software, 11(9), 1-20, 2004
[1] Chapman B, G. Jost and R Van der Pas. Using OpenMP: Portable Shared Memory Parallel Programming Scientific and Engineering Computation. The MIT Press.Massachusetts Institutte of Technology. ISBN 978-0- 262-53302-7. pp 349. 2008.
[2] Jain, Mugdha, and Chakradhar Verma. "Adapting k-means for Clustering in Big Data." International Journal of Computer Applications 101.1 (2014): 19-24.
[3] Ceruto T, O. Lapeira, A. Rosete and R. ESPÍN.Discovery of fuzzy predicates in database. Advances in Intelligent Systems Research (AISR Journal), vol. 51, No 1, pp. 45-54, ISSN 19516851, Atlantis Press, 2013.
[4] Hariri S, and M. Parashar.Tools and Enviroments for Parallel and Distributed Computing. John Wiley & Sons. ISBN 0-471-33288-7, pag 229, 2014.
[5] Fernandez A, S. Del Rio, V. Lopez, M. J. Del Jesus and F. Herrera. Big Data with Colud Computing:an insight on the computing enviroment, Map Reduce and programming frameworks. WIREs Data Mining and Knowledge Discovery.John Wiley and Sons, vol 4, pp 380-409, 2014.
[6] Viloria, A. "Commercial strategies providers pharmaceutical chains for logistics cost reduction." Indian Journal of Science and Technology 8, no. 1 (2016).
[7] Viloria, A., & Gaitan-Angulo, M. (2016). Statistical Adjustment Module Advanced Optimizer Planner and SAP Generated the Case of a Food Production Company. Indian Journal Of Science And Technology, 9(47). doi:10.17485/ijst/2016/v9i47/107371.
[8] Pas, R. An Overview of OpenMP 3.0. In., 2009.IWOMP. Tu Dresden (Alemania). Disponible en http://iwomp.zih.tu-dresden.de/downloads/2.Overwiew_OpenMP.pdf.
[9] N. Sapankevych y R. Sankar, “Time Series Prediction Using Support Vector Machines: A Survey”, IEEE Computational Intelligence Magazine, vol. 4, núm. 2, pp. 24–38, may 2009.
[10] Reinders, J. Intel threading building blocks-outfitting C++ for multi-core processor parallelism. OReilly Media. ISBN 978-1449390860, pp 336, 2007.
[11] Kaminsky, A. The Parallel Java 2 Library Parallel Programming in 100 % Java. Rochester Institute of Technology, Department of Computer Science, Rochester, New York, EUA. 2015.
[12] F. Villada, N. Muñoz, y E. García, Aplicación de las Redes Neuronales al Pronóstico de Precios en Mercado de Valores, Información tecnológica, vol. 23, núm. 4, pp. 11–20. 2012.
[13] Venugopal K, K.G. Srinivasa and L. M. Patnaik. Soft Computing for Data Mining Applications. Springer Berlin Heidelberg: Springer-Verlag. ISBN 978-3-642-00192-5, pp 354, 2009.
[14] Brdar S., Culibrk D., Marinkovic B., Crnobarac J., Crnojevic V. Support Vector Machines with Features Contribution Analysis for Agricultural Yield Prediction, Second International Workshop on Sensing Technolo- gies in Agriculture, Forestry and Environment, 43-47, 2011
[15] Choudhury, A. and Jones, J. Crop yield prediction using time series models, Journal of Economics and Economic Education Research., 15, 53-68, 2014.
[16] R. Putha, L. Quadrifoglio, and E. Zechman. Comparing ant colony optimization and genetic algorithm approaches for solving traffic signal coordination under oversaturation conditions. Computer‐ Aided Civil and Infrastructure Engineering, 27(1), 14-28, 2012.
[17] D. Teodorović, and M. Dell’Orco. Mitigating traffic congestion: solving the ride-matching problem by bee colony optimization. Transportation Planning and Technology, 31(2), 135-152, 2008.
[18] A. L. Bazzan, and F. Klügl. A review on agent-based technology for traffic and transportation. The Knowledge Engineering Review, 29(3), 375-403, 2014.
[19] Amelec, V., & Alexander, P. (2015). Improvements in the automatic distribution process of finished product for pet food category in multinational company. Advanced Science Letters, 21(5), 1419-1421.
[20] Karatzoglou A., Smola A., Hornik K. and Zeileis A. kernlab - An S4 Package for Kernel Methods in R. Journal of Statistical Software, 11(9), 1-20, 2004
Collections
The following license files are associated with this item:
Except where otherwise noted, this item's license is described as CC0 1.0 Universal