Big Data: NoSQL Data Model, Database Management Systems, Implementation

Big Data

Table of Contents
1. Introduction............................................................................................................................2
2. Tasks........................................................................................................................................2
3. Database Management Systems............................................................................................2
3.1 Storage Paradigm............................................................................................................3
3.2 Data Replication..............................................................................................................4
3.3 Consistency Model of Data Centric...............................................................................6
4. NoSQL Data Model................................................................................................................7
4 Implementation.....................................................................................................................11
5. Conclusion.............................................................................................................................20
6. References.............................................................................................................................20
1

1. Introduction
No SQL is a database mechanism which helps for storage and retrieval of data in the set of
database. No SQL database is commonly used in real time web application and big data.
There are many tasks related to NoSQL. They will be explained clearly. The tasks are done
successfully as per the instructions. The main objective of the project is to convert sql dump to
nosql. There are many software to convert sql to nosql, such as Couch base, Mongo DB, Neo4j
etc. Dump sql will be converted into sql query using Xampp software. Open refine is the
software and will be used for data cleaning or cleaning of sql queries. Sql queries will be
generated from the output of Xampp will be cleaned using the Open refine software. Finally,
cleaned sql query will then be converted to nosql using Neo4j software. The output screenshots
are provided in the implementation part.
2. Tasks
MongoDB can be used as a nosql system: Neo4j is used for conversion of Sql to Nosql
queries.
Neo4j is used for implementation and is more popular for graph databases. This is written in
java. This follows ACID property
 A-Atomicity
 C-Consistency
 I-Isolation
 D-Durability
The data model of the given flight data is given below.
2

The structure is shown below
3

4

5

3. Database Management Systems
A database management system is software, used for manages and creates the databases
(Neo4j Graph Database Platform, 2018). It manages the three important tasks. They are
 Database Schema
 Database Engine and the
 Data
 Storage paradigm
The database management system consist of physical data and logical data, which means
it protect the application and the user from storing the data or to change the structure of the data.
Types of Database Management System
There are four types of DBMS, they are
 Relational Database Management System
 No SQL Database Management System
 In-Memory Database Management System
 Columnar Database Management System
 Cloud – based Data Management System
Components of Database Management System
 Software – easy to access, store and update the data.
 Hardware – It includes hard disk, I/O channels and some other physical component.
 Procedures – It provides procedure for setup and installation process
 Data – It is resource which is designed for DBMS
 Database Access Language – It is simple language to write command, update, inset and
delete the data in DBMS
3.1 Storage Paradigm
Databases are commonly stored as a file that contain records. Physically the data is stored
as electromagnetic format. It can be mainly categorized in three types, they are Primary memory,
Secondary memory, and Tertiary memory.
6

3.2 Data Replication
Data Replication is process of storing the data in more number of nodes. It is mainly
useful to improve the data availability (Neo4j Graph Database Platform, 2018). It copies the data
from one server to another server. So, the user can share the same kind of data, which is called as
distributed database. In this distributed database, the user can able to access the relevant task
without the help of other user. There is full replication which has whole database. And there are
partial replication that has fragment of database.
7