Weather data analysis using hadoop : Applications and challenges

Weather data is very crucial in every aspect of human daily life. It plays an important role in many sectors such as agriculture, tourism, government planning, industry and so on. Weather has a variety of parameters like temperature, pressure, humidity and wind speed. The meteorological department d...

Full description

Bibliographic Details
Main Authors: Mohammed Adam Ibrahim, Fakharaldien, Khalid, Adam, Noor Akma, Abu Bakar, Mazlina, Abdul Majid
Format: Conference or Workshop Item
Language:English
Published: IOP Publishing 2019
Subjects:
Online Access:http://umpir.ump.edu.my/id/eprint/26182/
http://umpir.ump.edu.my/id/eprint/26182/
http://umpir.ump.edu.my/id/eprint/26182/1/Weather%20data%20analysis%20using%20hadoop.pdf
id ump-26182
recordtype eprints
spelling ump-261822019-12-20T07:48:54Z http://umpir.ump.edu.my/id/eprint/26182/ Weather data analysis using hadoop : Applications and challenges Mohammed Adam Ibrahim, Fakharaldien Khalid, Adam Noor Akma, Abu Bakar Mazlina, Abdul Majid QA76 Computer software QC Physics TA Engineering (General). Civil engineering (General) Weather data is very crucial in every aspect of human daily life. It plays an important role in many sectors such as agriculture, tourism, government planning, industry and so on. Weather has a variety of parameters like temperature, pressure, humidity and wind speed. The meteorological department deployed sensors for each weather parameter at different geographical locations to collect data. This data is stored mostly in the unstructured format. Thus, a big amount of data has been collected and archived. Therefore, storage and processing of this big data for accurate weather prediction is a huge challenge. Hadoop an apache product it used to support big data sets in a distributed environment. Hadoop has greatest advantages over scalable and fault-tolerant distributed processing technologies. This paper explains a system that uses the historical weather data of a region and apply the MapReduce and Hadoop techniques to analysis these historical data. IOP Publishing 2019-08-14 Conference or Workshop Item PeerReviewed pdf en cc_by http://umpir.ump.edu.my/id/eprint/26182/1/Weather%20data%20analysis%20using%20hadoop.pdf Mohammed Adam Ibrahim, Fakharaldien and Khalid, Adam and Noor Akma, Abu Bakar and Mazlina, Abdul Majid (2019) Weather data analysis using hadoop : Applications and challenges. In: IOP Conference Series: Materials Science and Engineering, Joint Conference on Green Engineering Technology & Applied Computing 2019, 4-5 February 2019 , Bangkok, Thailand. pp. 1-6., 551 (012044). ISSN 1757-8981 (Print), 1757-899X (Online) https://doi.org/10.1088/1757-899X/551/1/012044
repository_type Digital Repository
institution_category Local University
institution Universiti Malaysia Pahang
building UMP Institutional Repository
collection Online Access
language English
topic QA76 Computer software
QC Physics
TA Engineering (General). Civil engineering (General)
spellingShingle QA76 Computer software
QC Physics
TA Engineering (General). Civil engineering (General)
Mohammed Adam Ibrahim, Fakharaldien
Khalid, Adam
Noor Akma, Abu Bakar
Mazlina, Abdul Majid
Weather data analysis using hadoop : Applications and challenges
description Weather data is very crucial in every aspect of human daily life. It plays an important role in many sectors such as agriculture, tourism, government planning, industry and so on. Weather has a variety of parameters like temperature, pressure, humidity and wind speed. The meteorological department deployed sensors for each weather parameter at different geographical locations to collect data. This data is stored mostly in the unstructured format. Thus, a big amount of data has been collected and archived. Therefore, storage and processing of this big data for accurate weather prediction is a huge challenge. Hadoop an apache product it used to support big data sets in a distributed environment. Hadoop has greatest advantages over scalable and fault-tolerant distributed processing technologies. This paper explains a system that uses the historical weather data of a region and apply the MapReduce and Hadoop techniques to analysis these historical data.
format Conference or Workshop Item
author Mohammed Adam Ibrahim, Fakharaldien
Khalid, Adam
Noor Akma, Abu Bakar
Mazlina, Abdul Majid
author_facet Mohammed Adam Ibrahim, Fakharaldien
Khalid, Adam
Noor Akma, Abu Bakar
Mazlina, Abdul Majid
author_sort Mohammed Adam Ibrahim, Fakharaldien
title Weather data analysis using hadoop : Applications and challenges
title_short Weather data analysis using hadoop : Applications and challenges
title_full Weather data analysis using hadoop : Applications and challenges
title_fullStr Weather data analysis using hadoop : Applications and challenges
title_full_unstemmed Weather data analysis using hadoop : Applications and challenges
title_sort weather data analysis using hadoop : applications and challenges
publisher IOP Publishing
publishDate 2019
url http://umpir.ump.edu.my/id/eprint/26182/
http://umpir.ump.edu.my/id/eprint/26182/
http://umpir.ump.edu.my/id/eprint/26182/1/Weather%20data%20analysis%20using%20hadoop.pdf
first_indexed 2023-09-18T22:40:37Z
last_indexed 2023-09-18T22:40:37Z
_version_ 1777416889657458688