Weather data analysis using hadoop : Applications and challenges
Weather data is very crucial in every aspect of human daily life. It plays an important role in many sectors such as agriculture, tourism, government planning, industry and so on. Weather has a variety of parameters like temperature, pressure, humidity and wind speed. The meteorological department d...
Main Authors: | , , , |
---|---|
Format: | Conference or Workshop Item |
Language: | English |
Published: |
IOP Publishing
2019
|
Subjects: | |
Online Access: | http://umpir.ump.edu.my/id/eprint/26182/ http://umpir.ump.edu.my/id/eprint/26182/ http://umpir.ump.edu.my/id/eprint/26182/1/Weather%20data%20analysis%20using%20hadoop.pdf |
id |
ump-26182 |
---|---|
recordtype |
eprints |
spelling |
ump-261822019-12-20T07:48:54Z http://umpir.ump.edu.my/id/eprint/26182/ Weather data analysis using hadoop : Applications and challenges Mohammed Adam Ibrahim, Fakharaldien Khalid, Adam Noor Akma, Abu Bakar Mazlina, Abdul Majid QA76 Computer software QC Physics TA Engineering (General). Civil engineering (General) Weather data is very crucial in every aspect of human daily life. It plays an important role in many sectors such as agriculture, tourism, government planning, industry and so on. Weather has a variety of parameters like temperature, pressure, humidity and wind speed. The meteorological department deployed sensors for each weather parameter at different geographical locations to collect data. This data is stored mostly in the unstructured format. Thus, a big amount of data has been collected and archived. Therefore, storage and processing of this big data for accurate weather prediction is a huge challenge. Hadoop an apache product it used to support big data sets in a distributed environment. Hadoop has greatest advantages over scalable and fault-tolerant distributed processing technologies. This paper explains a system that uses the historical weather data of a region and apply the MapReduce and Hadoop techniques to analysis these historical data. IOP Publishing 2019-08-14 Conference or Workshop Item PeerReviewed pdf en cc_by http://umpir.ump.edu.my/id/eprint/26182/1/Weather%20data%20analysis%20using%20hadoop.pdf Mohammed Adam Ibrahim, Fakharaldien and Khalid, Adam and Noor Akma, Abu Bakar and Mazlina, Abdul Majid (2019) Weather data analysis using hadoop : Applications and challenges. In: IOP Conference Series: Materials Science and Engineering, Joint Conference on Green Engineering Technology & Applied Computing 2019, 4-5 February 2019 , Bangkok, Thailand. pp. 1-6., 551 (012044). ISSN 1757-8981 (Print), 1757-899X (Online) https://doi.org/10.1088/1757-899X/551/1/012044 |
repository_type |
Digital Repository |
institution_category |
Local University |
institution |
Universiti Malaysia Pahang |
building |
UMP Institutional Repository |
collection |
Online Access |
language |
English |
topic |
QA76 Computer software QC Physics TA Engineering (General). Civil engineering (General) |
spellingShingle |
QA76 Computer software QC Physics TA Engineering (General). Civil engineering (General) Mohammed Adam Ibrahim, Fakharaldien Khalid, Adam Noor Akma, Abu Bakar Mazlina, Abdul Majid Weather data analysis using hadoop : Applications and challenges |
description |
Weather data is very crucial in every aspect of human daily life. It plays an important role in many sectors such as agriculture, tourism, government planning, industry and so on. Weather has a variety of parameters like temperature, pressure, humidity and wind speed. The meteorological department deployed sensors for each weather parameter at different geographical locations to collect data. This data is stored mostly in the unstructured format. Thus, a big amount of data has been collected and archived. Therefore, storage and processing of this big data for accurate weather prediction is a huge challenge. Hadoop an apache product it used to support big data sets in a distributed environment. Hadoop has greatest advantages over scalable and fault-tolerant distributed processing technologies. This paper explains a system that uses the historical weather data of a region and apply the MapReduce and Hadoop techniques to analysis these historical data. |
format |
Conference or Workshop Item |
author |
Mohammed Adam Ibrahim, Fakharaldien Khalid, Adam Noor Akma, Abu Bakar Mazlina, Abdul Majid |
author_facet |
Mohammed Adam Ibrahim, Fakharaldien Khalid, Adam Noor Akma, Abu Bakar Mazlina, Abdul Majid |
author_sort |
Mohammed Adam Ibrahim, Fakharaldien |
title |
Weather data analysis using hadoop : Applications and challenges |
title_short |
Weather data analysis using hadoop : Applications and challenges |
title_full |
Weather data analysis using hadoop : Applications and challenges |
title_fullStr |
Weather data analysis using hadoop : Applications and challenges |
title_full_unstemmed |
Weather data analysis using hadoop : Applications and challenges |
title_sort |
weather data analysis using hadoop : applications and challenges |
publisher |
IOP Publishing |
publishDate |
2019 |
url |
http://umpir.ump.edu.my/id/eprint/26182/ http://umpir.ump.edu.my/id/eprint/26182/ http://umpir.ump.edu.my/id/eprint/26182/1/Weather%20data%20analysis%20using%20hadoop.pdf |
first_indexed |
2023-09-18T22:40:37Z |
last_indexed |
2023-09-18T22:40:37Z |
_version_ |
1777416889657458688 |