Comprehensive Analysis of Big Data Challenges in IOT and CLOUD

This research report investigates the significant challenges posed by big data within the realms of the Internet of Things (IOT) and CLOUD computing. The report begins by defining big data, IOT, and CLOUD, establishing a foundational understanding of these technologies. It then delves into the core issues, particularly highlighting the security concerns arising from integrating big data with IOT and CLOUD environments, including platform heterogeneity and the challenges of data location and access. Through an annotated bibliography and a comprehensive literature review, the report explores the basic concepts of IOT and CLOUD, the impact of IOT on big data, the specific issues of big data in CLOUD, and potential solutions to overcome these challenges. The literature review synthesizes information from various sources to provide a well-rounded perspective. The report concludes by summarizing the main findings and implications of the research, offering insights into the current state and future directions of big data management in IOT and CLOUD.

RESEARCH
REPORT

Table of Contents
ANALYSE.......................................................................................................................................1
1.Purpose.....................................................................................................................................1
2. Topic.......................................................................................................................................1
3. Structure..................................................................................................................................1
4. Problem statement...................................................................................................................1
5. Annotated bibliography...........................................................................................................2
LITERATURE REVIEW ...............................................................................................................4
Introduction.................................................................................................................................4
Theme 1: Basic concept of IOT and CLOUD............................................................................4
Theme 2: Impact of IOT on Big data..........................................................................................6
Theme 3: The issues of Big data in CLOUD.............................................................................7
Theme 4: Analysis ways through which challenges of Big data in IOT and CLOUD can be
overcome.....................................................................................................................................8
CONCLUSION..............................................................................................................................10
REFERENCES..............................................................................................................................12

Topic: Big data challenges in IOT and CLOUD
ANALYSE
1.Purpose
Purpose behind this report is to identify big data challenges faced in CLOUD and IOT.
This report will cover all aspects related with big data challenges. Big data is defined as set of
unstructured, structured and semi-structured data along with analysis of it to attain business
trends. Cloud is referred as assessing information technology, computer and other software
applications with the help of network connection usually internet connectivity. IOT is a system
of physical objects which are connected with internet. Thing in IOT is specified to any device or
person that is assigned with the help of internet services. Main purpose of this research is to
acknowledge data challenges that are faced while implementing IOT and CLOUD technology.
This research will benefits the researcher in gaining best knowledge about data challenges in
CLOUD and IOT.
2. Topic
Chosen topic for this report is “Big data challenges in IOT and CLOUD”
3. Structure
Structure of this particular research is prepared in accordance a systematic order.
Structure of research will include main purpose behind this report , specific topic of research,
different problem statements, annotated bibliography along with other aspects which are
important to carry out this research. In this particular report, researcher can take help of different
concepts to make this study more accurate. For data collection both primary and secondary
methods can be used. Data gathered by these methods will be accurate due to which generated
results will be appropriate. Other than that researcher can take help of qualitative research
method in which non numerical data can be generated with the help of observations, focus
groups etc. There are different methods and approaches which are relevant and helps in carrying
out this research desirably.
4. Problem statement
Implementation of Big data in IOT and CLOUD is a challenging tasks and can results in
creating a disadvantageous situation. Major problem in this regard is security of big data in
CLOUD and IOT environment. This is because integration of big data with these aspects results
1

in creating a new unfamiliar platform. Due to this platform heterogeneity can take place that can
results in different security issues. Another problem in this regard is the location and nature of
data. This is due to fact that in big data, the available data can be stored in different locations.
CLOUD and IOT techniques may not have access to these locations due to which disruptions in
performing operations can be faced.
5. Annotated bibliography
Article 1
Big data is an emerging technology and a concept which defines the incapability of
traditional data architectures to effectively manage the sets of new data (Sofany and et. al.,
2017). There are four v's in big data i.e. velocity, veracity, volume and variety.
Article 2
In general, there are three categories associated with stakeholders of Big data. These
categories are Big data utilizers, Big data collectors and Big data generators (Zwitter, 2014).
Article 3
IOT is based on communication networks, intelligence and sensors which assists in
managing the entire procedure and generated data in a proper manner (Gaona-García and et. al.,
2017). Sensors are termed as sense of systems and can be used in large amount due to their
importance.
Article 4
IOT will comprises of billions of devices that can sense, communicate, compute and
potentially actuate (Zaslavsky and et. al., 2013). Data streams is comes from these devices would
challenge a traditional approach to data management and contributes to emerging problem of big
data.
Article 5
IOT majorly related to an applications that are emerged as an important field for both an
engineer and researcher's, reflecting upon magnitude and impact of data based problems which
needs to be solved in contemporary business issues (Cai and et. al., 2017).
Article 6
Major success of the IOT is required to be provisioned attributed with ubiquity,
efficiency, high performance and reliability (Biswas and Giaffreda, 2014) In order to continue
2

this attribution, future business and research vision is to led merge of the cloud computing and
IOT concepts.
Article 7
Cloud computing and internet of things are majorly two different technologies, which are
both parts of our life based scenario. (Botta and et. al., 2014). Also, massive adoption and use is
expected to increase further and also making them important components of the future internet.
Article 8
In the recent period of time, rapid development of internet of things and cloud computing
has led an explosive growth of data in almost every industry and also business area at a defined
stage (Jin and et. al., 2015) Also, big data is rapidly growing in an area of academia, industry and
governments all over the world.
Article 9
Internet of things is a concept that puts its major envisions all about a objects around us
are major part of internet (Rao and et. al., 2012) IOT coverage is very wide area and also which
includes various objects like smartphones, tablets, digital cameras, sensors etc.
Article 10
Data type and amount in human society is growing in amazing speed which is caused b
emerging new services such as cloud computing, internet of things and social network (Xiaofeng
and Xiang, 2013) Data has been fundamental resources from simple dealing object and how to
led management and also utilise big data better has attracted much attention.
Aim: To determine the challenges of Big data in IOT and CLOUD.
Objectives:
 To identify the basic concept of IOT and CLOUD.
 To analyse the impact of IOT on Big data.
 To identify the issues of Big data in CLOUD.
 To analysis ways through which challenges of Big data in IOT and CLOUD can be
overcome.
3

LITERATURE REVIEW
Introduction
Literature review is defined as a review article or scholarly paper that involves in-depth
knowledge about a particular topic or subject. There are the secondary resources and content of
these literature review is collected with the help of books, journals, online materials, papers etc.
These are the basis of research in every academic and professional field. There are some aspects
which are associated with literature review. One of them is that it helps in surveying literature
about the concerned topic. It also assists in critical evaluation of collected information by gap
identification in the current knowledge. Literature review will benefits the researcher in
acknowledging Big data challenges in IOT and CLOUD in an organised and systematic manner.
Theme 1: Basic concept of IOT and CLOUD
IOT is abbreviated as Internet of Things and it is defied as the extension of internet
connectivity. This extension is related with connectivity of internet in everyday objects and
physical devices. According to Tamboli, A., 2019, IOT is becoming a reality as developers are
giving their best efforts to make it a sophisticated network of things. Things in this respect is not
only related with machines, mobile phones or computers but it extends to things like smart
watches, diapers and door lock. IOT is a combination and aggregation of different technologies
which aims to make life of individuals simple and better. IOT requires three building blocks to
works in a functionalistic manner . One of the block is the thing which can either be a door lock,
watch, water tank or any other entity. Second building block will be a connecting mechanism
like Bluetooth, receiver, transmitter, NFC etc. Last building block in this regard is a
communication protocol or method that will helps in exchange of information and messages in a
clear and appropriate manner.
In general terms, IOT is referred as the connection of physical things with each other
through internet. Connection of different entities with network especially internet provides a new
application world which is never assumed by the people in past. To understand the concept of
IOT in more clear manner, some examples can be considered. For example, the connectivity of
fridge with internet will helps in acknowledging if there is any kind of shortage of any specific
food item. It can results in the communication and controlling of different home appliances such
as Refrigerators, lights, air conditioners etc. IOT managed supply chain will assists in timely
4

delivery of medicines, goods and food. In simplified context, IOT is spreading in every domain
either it is related with personal lives of an individual or any other business activity. CLOUD is
defined as the delivery associated with computing services such as storage, database, networking
software, intelligence, analytics etc.
As per the opinion of Cueli, M., 2010, CLOUD computing is not a technique or
technology but is a model associated with marketing, provisions and IT services which are
capable to meet different characteristics. It is associated with computer services, not the
products. There are some aspects that are related with CLOUD computing. Some of these aspects
are very essential and helps business persons to manage their business in a desired manner. Due
to cloud computing, multiple clients are able to share common technology platform. Beside this,
they are capable to use a single application instance also. In cloud computing, services can be
assessed in units in accordance with the demands of users. These services will be flexible in
nature and they can be accessed form any location around globe and by multiple devices. It have
two kind of clouds i.e. public and private cloud. These public CLOUD are those that provides IT
services to the consumers with the help of internet whereas the private clouds are tend to provide
IT services to the predefined group of clients by the access of private networks or internet.
There are some another terms which are associated with the concept of CLOUD. These
terms are internal and external clouds where internal clouds are considered as a sub group of
private clouds and are capable to offer services in same corporate group or organisation. External
cloud can either be related with private or public and offer services to another organisations.
According to Beal, V., 2019, there are some basic characteristics of cloud computing. Cloud
computing is capable to provide on-demand self service to the customers. Due to which clients
can easily sign up, pay and start using required cloud resources in accordance with the
requirement rather than considering the help from sales agent. People have the facility of broad
network access under which services can be easily enjoyed with the help of internet. It have
another characteristics which is related with the sharing of computing resources, storage and
servers by users at the same time without interfering with work of one another. There are
different sub categories in cloud computing. These subcategories depends upon the physical
location of computing resources. Along with public and private cloud, there are hybrid CLOUD
which is a combination of both private and public cloud. CLOUD bursting is a situation in which
an organisation can run their web servers for their private clouds and they can use public clouds
5

services for other purpose such as in conditions where additional capacity is required due to the
peak time.
Theme 2: Impact of IOT on Big data
According to Sahu, D., 2018, IOT is defined as the network of vehicles, home and office
appliance, physical devices and other items associated with software, actuators, electronics,
software which will allow different objects to interconnect and exchange data with one another.
It is defined to the network of objects which will have specific IP address that will allow them to
share information and messages in a desired manner. Big data is referred to the science of
predicting and understanding the behaviour of humans with the help of unstructured data. It is
also called as predictive analysis and helps in understanding different aspects like flight arrivals,
weather patterns, traffic data etc. The amount of data that will be generated by IOT will impacts
the Big data in a considerable manner due to which business organisations will get forced to
upgrade their tools, technologies and processes so that competitive advantage over rival
companies can be enjoyed in a desired manner.
As per the view points of Pal, K., 2015, While talking about IOT main thing that came in
mind is continuous and big data stream that will hit the storage device. This will impacts the Big
data storage infrastructure in a clear manner. Organisations are required to collect all relevant
data of their businesses to perform business activities desirably but it is a challenging task as they
have to eliminate the redundant data and require to protect their data from viruses and threats.
Data collection through IOT requires custom protocols such as MQTT and DDS, these two are
comprehensive protocols that are capable to include large amount of big data i.e. 500 zettabytes
every year. There are some security concerns associated with IOT that can impact Big data. In
this regard different security protocols has been used and verification & authentication of
different devices became a real concern. IOT is also called as a source of data generation.
Different devices and sensors which grows up IOT are responsible for gathering of data.
This data will join another data to enhance the amount of big data which is available to the
analysts and companies. With the help of gathering and transmitting data towards central servers,
companies can make useful decisions that will benefits them in enhancing their revenues and
profitability. It is a big challenge which is faced by IOT and Big data. In some cases, the
collected data became irrelevant and finding all the data over and over again became a
cumbersome task which can minimise the benefits of data.
6

Theme 3: The issues of Big data in CLOUD
According to Kohgadai, A., 2019, CLOUD technology is closely associated with internet.
Form last some years, in network diagrams the complexities which are faced by internet are
sorted out with the help of simple cloud Icon. Even though big data is capable to solve different
problems of large data and information in a proper manner, still it is a very challenging area
which faces some challenges. In business organisations, amount of data grows at a specific rate.
Keeping all the data is cost ineffective. Hence, business organisations are required to develop
policies which will define life cycle and expiration date of data. Also, it must also be defined that
which data can be accessed for which purpose. As the data passed on to CLOUD, privacy and
security of data became a big concern.
Big data DBMS prefers to deal with data loss from different sources. This heterogeneity
also became a problem. Other concerns are disaster recovery and uploading of data to CLOUD in
a proper manner. Main issues of Big data in CLOUD computing is security, heterogeneity,
disaster recovery, data governance and privacy. Big data and Cloud computing security is a big
concern in present time. It became a challenge when the business organisations have to upload
data and information on the cloud. Issues during this time are who is the owner of this data and
who will have access. Another concern is privacy which is related with use of analytical tools
and data harvesting. It is a difficult task as information passes and replicated around the globe.
Sensitive information of customers such as their online activity, super market records, energy
consumption etc. are exposed to the scrutiny which raises a high concern about the exclusion,
profiling, loss of control. Data protection laws are based on individual's control of information.
But collection of less information at a single place can't be a solution to data privacy. Big data
also concerns different velocities of data other than concerning its volume.
Theme 4: Analysis ways through which challenges of Big data in IOT and CLOUD can be
overcome
In current period of time, internet of things and also cloud computing is one of a major
topics, which is required in current time to enhance productivity and also efficiency for longer
period of time. IOT is an extension of an internet connectivity into a physical devices and objects
based on everyday usage. Embedded with an electronics, internet connectivity and also other
forms of hardware. These devices may lead to communicate and also interact with other's over an
usage of internet and also they can be remotely monitored or controlled. For this project, various
7

challenges in context of IOT and cloud computing has been found such as increased cost of
occupying database, expectancy over a resources, cost differentiation and also ineffective data
management. These challenges are required to be managed and also overcome with an
expectancy to raise general queries. Challenges of big data in IOT and cloud has been observed
on four different aspects such as people, processes, data and things. In given context, challenges
of big data on these four different entities are as follows:
People: This is being a major challenge for people to have a look on handling big data
with increasing priority and also suitability to handle regulation and movement of data from one
place to another. In this, people needs to put its focus or efforts on managing big data for an
optimised period of time.
Processes: In this context, it will be major challenge for business firms to handle bigger
data and information with increased cost to get its output in given period of time. This also
involves processes, includes machine or devices to storage suitable data and also information for
longer period of time.
Data: This varies in different context such as long term and short term, which varies in
context of its validity, suitability and relevancy for definite period of time. Data of high range is
relatively difficult to handle or operate, as because of its big suitability to make results, but major
chances of handling and auto-management is difficult to handle.
Things: In this, things such as technology, manpower or resources with productive level
of efficiency is required to find output and results at a given point of time. In this, challenges
such as increased cost, time or resource are required to make output, which is not that easy to
obtain.
In response, these challenges are required to be managed and also takes ways through
which these challenges can be overcome or observed, which are as follows:
There are different ways with help of which challenges of big data in IOT and cloud can
be overcome are as follow:
Centralising data: It is major thing here, in which data or information needs to manage
or centralise in order to protect or record it in an effective manner. This reduces risk of possible
breaches. This will assists in saving cost and information durability for longer period of time.
Automating data management: Automation is a vital tool which is to implement policies
and also procedures, as this is helpful to take up process vert quickly and efficiently. In response
8

to this, increasing number of data management software in also one most critical things to be
managed. DMS requires cost and expenses which is highly important to manage in order to
acquire suitable results or outcomes in given period of time.
Measuring success: When implementing data management software, this is high to be
focus on strategic planning in order to generate suitable outcomes or results to led rise its level of
efficiency for longer period of time. Also, this is prominent to analyse impact of it on greater
context and also to led growth of using of big data for productive period of time.
For overcoming challenges of this, it is necessary to identify concept of IOT and cloud
computing in an initial period of time to develop suitability of big data management on an
effective platform.
Problem or Challenges of the IOT
Internet of things is an extension of internet connectivity into physical devices and every
day objects. It is majorly embedded with electronics, internet of things and other forms of
hardware, these devices can communicate and interact with other's over an internet. A major
challenges of an IOT are as follows:
Consume time: Internet of things creates network of internet or devices which connects
object's together and also which are able to connect any information or knowledge. This can be
applied on any industry in which source of communication is majorly applied and also suitable to
handle to enhance productive outcomes over a given period of time. Implementation of IOT
requires big data and also a strategic planning which is necessary to led development of the
technology on a growth based level. Also, major implementation of it requires major time or
resource to rise its own growth or performance expectancy. IOT is majorly important to enhance
level of productivity to enhance over the given period of time.
Increase costs: Internet of things needs to have increase cost, which is majorly necessary
to led development of effective and also productive things to enhance suitable outcomes over the
given point of time. Business firm have no idea or strategic planning for how much expenses
needs to be bear or manage for business productivity to be enhanced for longer period of time.
Cost which generally incurred in IOT needs to have major strategic planning in order to
overcome negative impact of this leading sources. This is majorly prominent to led increase in
benefits or advantage of it major or utilised context to enhance suitability of its performance for
9

longer period of time. Internet of things is majorly important to led development of idea's or
knowledge on how to disclose issues on this matter.
Problem of pro-longed productivity: Internet of things(IOT) is required to be connected
with an effective computer systems, use of devices, hardware or software's etc. IOT majorly
utilizes in current form, power of the workstation, model of server client to provide necessary
level of connectivity to different servers and systems. This is heavily important to enhance pro-
longed relationship with other server to enhance an effective for sharing of an information using
of the online platform to raise productivity for longer period of time. This is highly active to led
overcoming of these issues to enhances productivity of it in given point of time.
Decentralisation of the data: This is a major issues to manage data or level of
information to get suitable outcomes in a given point of time. This is happened, because of
increasing scenario of business for longer period of time. Lack of an effective planning or non-
usage of control level is one major problem issues with an initialisation of the IOT and also big
data on a major level which in reality needs to be overcome to enhance effective working of the
IOT on a productive level. This data decentralisation needs to have major overcoming of issues
or level of problems.
CONCLUSION
From above mentioned report, it has been concluded that this report is based on the
challenges faced by big data in new emerging technologies like IOT and CLOUD. IOT and
CLOUD are two technologies which enables the business persons to perform their complex
business activities in a simplified and timely manner. Their are different issues which are faced
by Big data technology due to IOT and Cloud such as storage of data, protection of data form
threats and viruses etc. there are different measures by which the challenges faced by Bid data in
Cloud and IOT can be overcome. Some of these measures are centralising data and automation
data management.
10