Syncronize Data Using MapReduceModel Programming

  • Murti Retnowo Universitas Teknologi Yogyakarta
Keywords: data synchronization, mapreduce, message passing interface multithread, static tasks assigment

Abstract

Research in the processing of the data shows that the larger data increasingly requires a longer time. Processing huge amounts of data on a single computer has limitations that can be overcome by parallel processing. This study utilized the MapReduce programming model data synchronization by duplicating the data from database client to database server. MapReduce is a programming model that was developed to speed up the processing of large data. MapReduce model application on the training process performed on data sharing that is adapted to number of sub-process (thread) and data entry to database server and displays data from data synchronization. The experiments were performed using data of 1,000, 10,000, 100,000 and 1,000,000 of data, and use the thread as much as 1, 5, 10, 15, 20 and 25 threads. The results showed that the use of MapReduce programming model can result in a faster time, but time to create many thread that many require a longer time. The results of the use of MapReduce programming model can provide time efficiency in synchronizing data both on a single database or a distributed database.

References

Anung, T. B., 2001 Komputasi Paralel Sebagai Alternatif Solusi Peningkatan Kinerja Komputasi INTEGRAL, vol. 6, no. 2.

Dean, J., dan Ghemawat, S., 2004, MapReduce: Simplified Data Processing on Large Clusters, OSDI ’04: 6th Symposium on Operating Systems Design and Implementation.

Fayyad, U., dan Uthurusamy,R., 1996, "Data Mining and knowledge discovery in databases," Communications of the ACM, vol. 39,no. 11, pp. 24-26..

Gaspersz, V, 1998, Statistical process control, Gramedia Pustaka Utama, Jakarta.

Gusti, D. Z., 2012 Pemrograman terdistribusi MapReduce dengan framework Hadoop, Tugas Akhir, Institut Teknologi Sepuluh November, Surabaya

Handly, M., 2003 3C03 Concurrency: Message Passing, © Wolfgang Emmerich, Mark Handley 1998 - 2003

Ishikawa, K, 1976, Guide to Quality Control, Asian Productivity Organization, UNIPUB, ISBN 92-833-1036-5

Ikrimach and Retnowo, M, 2021, Multi Criteria Decision Making Untuk Menentukan Program Studi Calon Mahasiswa, http://papersmai.mercubuana-yogya.ac.id/index.php/smai/article/view/86

Khairul, F. A.,dan Suadi, W., 2014, Komputasi Pembobotan Dokumen Berbahasa IndonesiaMenggunakan MapReduce. Fakultas Teknologi Informasi Institut Teknologi Sepuluh Nopember

Kurniawan, E. K., 2010, Penerapan Model Pemrograman MapReduce Pada Sistem Pencarian Milis Linux Di Indonesia, Jurusan Teknik Informatika, Fakultas Teknik dan Ilmu Komputer, Universitas Komputer Indonesia.

Retnowo M., 2018, Optimize Production Based on Goods Using Supply Chain Management, https://senatik.itda.ac.id/index.php/senatik/article/download/288/pdf

Meriem, M dan Belabbas, Y., 2011, Tasks assignment for cluster computing, International Journal of Web Services Volume 7 Issue 4, January 2011 Pages 427-443

Nurwidyantoro, A., 2011, Paralelisasi Maximum Entropy Part Of Speech Tagging Untuk Bahasa Indonesia Dengan MapReduce, Tesis Program Studi S2 Ilmu Komputer, Fakultas Matematika Dan Ilmu Pengetahuan Alam, Niversitas Gadjah Mada, Yogyakarta.

Saleh, M. A., Deldari, H., and Dorri, B. M., 2008,“Balancing Load in a Computational Cluster Applying Adaptive, Intelligent Colonies of Ants”. Informatica.

Setiyo, R. W.,Sakti, E.P.,dan Amron, K., 2014, Rancang Bangun Kuis Online dari Layanan E-learning pada Lingkungan Hadoop Program Teknologi Informasi dan Ilmu Komputer Malang

Silberschatz, Galvin, P. and Gagne. G. 2005. Operating Systems Concepts. Seventh Edition.John Wiley & Sons.

Utdirartatmo, F., 2003, Pemrograman Paraleldi Linx berbasis DSM (Distributed Shared Memory), Penerbit Andi, Yogyakarta.

Wilkinson, B., and Allen, M., 2005, (Pararrel Programming Techniques and applications Using Networked Workstations and Computers~Second Edition, (diterjemahkan oleh Hidayat, s., Santosa, Y. B. Hery, A. P. dan Himamunanto, R 2010) Penerbit Andi Yogyakarta.

Submitted
2021-09-23
Accepted
2021-12-31
How to Cite
Retnowo, M. (2021). Syncronize Data Using MapReduceModel Programming. International Journal of Engineering Technology and Natural Sciences, 3(2), 82 - 88. https://doi.org/10.46923/ijets.v3i2.140