Understanding Big Data: Characteristics, Challenges, and Techniques for Analysis

This report explains the concept of big data, its characteristics, and the challenges faced during gathering data. It also covers techniques for analyzing big data and how it can support businesses with examples. The report discusses the importance of big data in product development, predictive maintenance, customer experience, machine learning, and driving innovation. The challenges faced during data collection include lack of professional education, lack of understanding of big data, saving details, and confusion during selecting big data techniques. The report also covers various tools for analyzing big data, such as A/B testing, data fusion, data mining, casual analysis, and link prediction.

Big Data

Table of Contents
INTRODUCTION ........................................................................................................................1
MAIN BODY ..............................................................................................................................1
What is big data and its characteristics :...................................................................................1
Characteristics of big data :- ......................................................................................................2
Challenges for analysing big data :- .........................................................................................3
How Big Data technology could support business, please use examples wherever necessary...3
Techniques of analysing big data :- ...........................................................................................4
CONCLUSION .............................................................................................................................5
References:.......................................................................................................................................5

INTRODUCTION
Big data states to the huge information, different set of details that grow at ever
growing rates. It measures the volume of data, the velocity or capacity at which it is
designed and gathered, and the assortment or range of the details being collected. It often
gathered from data mining and arrives in aggregate structure. It can be collected from
public shared feedbacks on socials sites and web site, voluntarily collected from
individual response from personal technology and applications, through form, creation
buying and electronics appraisal in. it is majorly saved in information system, hardware and
software as well determined utilising software particularly created to manage huge, typical
data groups. This report will explain the concept of bid data with its characteristics, further it
will cover the importance of big data and challenges face during gathering a details.
MAIN BODY
What is big data and its characteristics :
It is a great measure of diverse details that get in gaining bulk and with ever
high speed. It can be classified as organised and unorganized in information and excel. It is
frequently numeric in nature. Unorganized data is details that is not well structured and
does not fall into a pre analysed theory or structure. It consist data gathered from digital
media sources, which assist institution collect details on users wants. The major aim of
big data is to gain the velocity at which goods get the market, to lower down the value
of time and resources needed to add market proceeding, marked viewers, and to ensure
users remain contented. Organisation which collect a data large amount of information
are provided with the chance to run deeper and richer determination for the advantages
of all stakeholders. The nature and structure of the data can needed special managing
previously it is acted upon. Organised data includes the numeric values can be simply
stored and secure. Unorganized data such as mails, visualised and text documents, may
required more imbalance tools to be implemented previously earlier before it becomes
essential. It is required to store at secure place, that it can be placed at clouds, on premises and
many others. The cloud basically gaining popularity because it help the current needs and
able the members to gain up resources as required. It consist a various kinds which are listed
in below :-
1

1. Organized - Any in formation can be saved, stock and prepared in the form of
fixed formatting is termed as a organized data. Over the duration, talent in machine
science has attained great happening in improving tools for operating with such
type of information and also explanation measure out of this.
2. Unorganized - Any data in unknown form or the construction is classified as
unorganized data poses multiple challenge in relation of its procedure for deriving
amount out of it. A representative illustration data is a disparate data source
consisting a sequence of easy text file, pictures, videos and many others.
3. Semi structured - this data can contain both the structure. Management can see
data as a structure in structure in form but it is not defined with just as excel and
data base management.
Characteristics of big data :-
here are some major classification of big data which is listed in below :-
1. volume :- The magnitude of information matters. With massive data the person will
have to process high volume of low denseness, unorganized data. This can be data
of unknown value, such as twitter collection feeds, clickstreams on a web page or a
mobile application , or sensor enable tools. For some company this may be tens of
terabytes of details . For others it may be 100 of computer memory unit.
2. Veracity :- it is all about making sure the details is correct, which needed processes
to keep the poor data from accumulating in system. The easiest illustration is
contact that marketing technology system with false details and wrong
information. It is main garbage in out challenge for company.
3. velocity :- It is the fast rate at which data is standard and acted on. Basically the
highest speed of data current straight into representation versus being cursive to
circle. Certain internet alter smart goods operate in actual time or near actual time
and will need correct duration determination and operations.
4. Variety :- it refers to the several kinds of details that are gettable. Traditional data
kinds were organized and set clearly in a interlinked database. With the growth of
big data, details comes in new unorganised data kinds. Unorganized and semi
integrated data kinds. Such as text, sound, and visualisation, needed pre processing to
campaign message and support information.
2

Challenges for analysing big data :-
This is the matter of business in regards to create to make an effective
organisation making for the development of the enterprise. This is the essential aspect
where the administration requires to analyse the various challenge because of the big
data. Here are some points that will describe the obstacles that has been faced during the
collecting data.
1. Lack of professional education :- It is very crucial for the concern organisation to
have the vocation and talented manpower in command to perform the various activities.
The business organisation needs skilled data collectors and analyst with data
reformers. This can be ambitious for the institution to have the expertise in the business
which can analyse the big data.
2. lack of educated understanding of big details :- the lack of the cognition of the
people that how the content need to be collected and processes in order to have an
effective finding making within the company. if there is the insufficiency in assemblage
the info which can lead to the ineffectual making of the prepared data. This lack of
unbefitting perceptive can lead to making in the wrong determination for the
improvement of the institution.
3. saving details :- It is the big ambitious for the establishment that at times they are not
aware that which collection is necessary and which is not. The saving of the information
in the big data sets is intriguing for the fellowship. This results in the ineffective of the
use of the content by the structure.
4. Disarray during selecting big data techniques :- this is the challenge where the
concern organisation requires to decide the most proper tool foe the company
which can leads to determine the most appropriate tool for the company which can
leads in the effective conclusion devising. This is the difficult task for the
managers to use the correct tool which can be utile as there is big data and the
various steps that can help the institution in good finding industry.
How Big Data engineering could activity concern, please use illustration wherever essential.
It can help the business activities to range, from users learnings to determine here are
certain points listed in below that will show the benefits for business:-
3

1. Product development :- organisation like Netflix and proctor and gamble use big
data to anticipate users demand. They design models for new goods and services
and outlining the relationships key attributes of earlier and present goods and
services.
2. Prognostic fixing :- components that can assume automatic losses may be leads in
system data like year, make and model of tools. As well as in unorganized data
that covers huge amount of log entries, detector data, error content and many others.
By determining these point of possible issues before the issues occur. Organization
can deploy fixing more value effectively and increase parts and provide time period.
3. Customer experience :- big data enables the person to gather data from social
media, web sites , call logs and other sources to develop the communication and
relation happening and maximise the value served. Start viscus personalize offers,
reduce users. And manage issues actively.
4. machine learnings :- It is heating title in current time. And data particularly is one
of the explanation of wherefore. Organisation are now able to teach machines
instead of events them. The availability of big data to procession machine
erudition makes that assert able.
5. Drive creation :- Big data can assist the person by perusal individuality among
humans initiation , business entities and procedure and then analysis new manner to
use those modality, utilisation data in order to develop about fiscal and planing
included.
Techniques of analysing big data :-
It procedure and users needs to access to a broad array of factors for both interactant and
experiment and running industry jobs. A big data solution includes all data includes
minutes, master data, references and many others. Here are few tools that helps in analysing
the big data for company.
1. A/B testing :- The data analysis tools consist comparison a control units with a
mixture of test in state to recognize what attention or alteration will acquire a
given clinical shifting.
4

2. Data fusion :- by union of a unit of method that analyze and integrated data from
multiple sources and solutions, the insight are more efficient and possible more
straight than if improved through a respective source of information.
3. Data mining :- A basic implement utilise with in big data analysis, data mining
extracts structure from big collection sets by combine tools from statics and
machine learning, within information management.
4. Casual analysis :- It is the method of forecasting by using the basic relationship of
the development and modification of sources . The basic analysis method is
utilised to create market analysis and articulation. Majorly using regression
analysis.
5. Fastener anticipation :- It is a acting of assuming the relation that should exits
between details. It can be divided into assumption on the basis on property and
observation on network construction. A main point of view in the area of
difficult network are not as essential as the relationship between individuals. Hence
link prediction is based on network cognition has conventional more and more
tending.
5

CONCLUSION
From the above report it is concluded that big data application is the most necessary for the
astonishing determination making within the business organisation. This helps the organisation
in assorted aspect for the alteration of state and increasing. There are various characteristics of
the big data such as value, velocity, volume, variety and veracity. There are antithetic method
which help the agreement in analyse the data data into the easy structure. As in respect this big
data is ambitious for the company. The big data supports the business enterprise in various ways
such as collection safety, improvement in the ware or employ.
References:
Books and Journals
Chang, V., 2021. An ethical framework for big data and smart cities. Technological Forecasting
and Social Change, 165, p.120559.
Chistyakova, T.B., Kleinert, F. and Teterin, M.A., 2020. Big data analysis in film production. In
Cyber-Physical Systems: Advances in Design & Modelling (pp. 229-236). Springer,
Cham.
Dey, N., Bhatt, C. and Ashour, A.S., 2018. Big data for remote sensing: Visualization, analysis
and interpretation. Cham: Springer, 104.
Guo, W.,and et.,al., 2019. An unsupervised embedding learning feature representation scheme
for network big data analysis. IEEE Transactions on Network Science and Engineering,
7(1), pp.115-126.
Podhoranyi, M. and Vojacek, L., 2019, September. Social media data processing infrastructure
by using Apache spark big data platform: Twitter data analysis. In Proceedings of the
2019 4th International Conference on Cloud Computing and Internet of Things (pp. 1-
6).
Priyanka, E.B., and et.,al., 2020. Fundamentals of Wireless Sensor Networks Using Machine
Learning Approaches: Advancement in Big Data Analysis Using Hadoop for Oil
Pipeline System with Scheduling Algorithm. In Deep Learning Strategies for Security
Enhancement in Wireless Sensor Networks (pp. 233-254). IGI Global.
Roccetti, M., and et.,al., 2020. A cautionary tale for machine learning design: why we still need
human-assisted big data analysis. Mobile Networks and Applications, 25(3), pp.1075-
1083.
Saraee, M. and Silva, C., 2018, April. A new data science framework for analysing and mining
geospatial big data. In Proceedings of the International Conference on Geoinformatics
and Data Analysis (pp. 98-102).
Xie, H., and et.,al., 2018. Big data analysis for monitoring of kick formation in complex
underwater drilling projects. Journal of Computing in Civil Engineering, 32(5),
p.04018030.
Yan, X.,and et.,al., 2018. Energy-efficient shipping: An application of big data analysis for
optimizing engine speed of inland ships considering multiple environmental factors.
Ocean Engineering, 169, pp.457-468.
6