Vol. 3 Issue 1
Year: 2016
Issue:Nov-Jan
Title:A Methodology for WebLog Data analysis using HadoopMapReduce and PIG
Author Name:Durga Prasad P S, T. Vivekanandan and A.Srinivasan
Synopsis:
In the recent time, world is severely facing the problem related to the data storage and processing. Especially, the size of weblog data is exponentially increasing in terms of petabytes and zettabytes. The dependency of weblog data shows its importance on the users' actions on web. To solve and improve the business in all aspects, web data is prominent and hence it is vital. The traditional data management system is not adequate to handle the data in very large size. The Map Reduce programming approach is introduced to deal with the large data processing. In this paper, the authors have proposed a large scale data processing system for analysing web log data through MapReduce programming in Hadoop framework using Pig script. The experimental results show the processing time for classification of different status code in the web log data is efficient, than the traditional techniques.
Year: 2016
Issue:Nov-Jan
Title:A Methodology for WebLog Data analysis using HadoopMapReduce and PIG
Author Name:Durga Prasad P S, T. Vivekanandan and A.Srinivasan
Synopsis:
In the recent time, world is severely facing the problem related to the data storage and processing. Especially, the size of weblog data is exponentially increasing in terms of petabytes and zettabytes. The dependency of weblog data shows its importance on the users' actions on web. To solve and improve the business in all aspects, web data is prominent and hence it is vital. The traditional data management system is not adequate to handle the data in very large size. The Map Reduce programming approach is introduced to deal with the large data processing. In this paper, the authors have proposed a large scale data processing system for analysing web log data through MapReduce programming in Hadoop framework using Pig script. The experimental results show the processing time for classification of different status code in the web log data is efficient, than the traditional techniques.
No comments:
Post a Comment