The Efficient Implementation of Distributed Indexing with Hadoop for Digital Investigations on Big Data

Taerim Lee1, Hyejoo Lee2, Kyung-Hyune Rhee1 and Sang Uk Shin1

  1. Pukyong National University
    Busan, Republic of Korea
    {taeri, khrhee, shinsu}@pknu.ac.kr
  2. Kongju National University
    Gongju, Republic of Korea
    hyejoo2010@gmail.com

Abstract

Big Data brings new challenges to the field of e-Discovery or digital forensics and these challenges are mostly connected to the various methods for data processing. Considering that the most important factors are time and cost in determining success or failure of digital investigation, the development of a valid indexing method for efficient search should come first to more quickly and accurately find relevant evidence from Big Data. This paper, therefore, introduces a Distributed Text Processing System based on Hadoop called DTPS and explains about the distinctions between DTPS and other related researches to emphasize the necessity of it. In addition, this paper describes various experimental results in order to find the best implementation strategy in using Hadoop MapReduce for the distributed indexing and to analyze the worth for practical use of DTPS by comparative evaluation of its performance with similar tools. To be short, the ultimate purpose of this research is the development of useful search engine specially aimed at Big Data indexing as a major part for the future e-Discovery cloud service.

Key words

Electronic Discovery, e-Discovery, Digital Forensics, Evidence Search, Indexing Performance, Hadoop MapReduce, Distributed Indexing

Digital Object Identifier (DOI)

https://doi.org/10.2298/CSIS130920063L

Publication information

Volume 11, Issue 3 (August 2014)
Special Issue on Mobile Collaboration Technologies and Internet Services
Year of Publication: 2014
ISSN: 2406-1018 (Online)
Publisher: ComSIS Consortium

Full text

DownloadAvailable in PDF
Portable Document Format

How to cite

Lee, T., Lee, H., Rhee, K., Shin, S. U.: The Efficient Implementation of Distributed Indexing with Hadoop for Digital Investigations on Big Data. Computer Science and Information Systems, Vol. 11, No. 3, 1037–1054. (2014), https://doi.org/10.2298/CSIS130920063L