Data System and Integration: A Study on Data Cleaning, Merging, RESTful Web Services, and Mashups

DATA SYSTEM AND
INTEGRATION

Abstract
The main objective of this project is to provide the web page in the way of accepting the
user queries and the process will be done based on the queries. The user input is a kind of
service or postal code. From this code, our application will display cluster map of clinics to the
user. This project contains HTML, python, petl, parser, bottle and some other technologies.
They are required for the proper functioning of this application. The demonstration code
contains four data sources and also the sample data. The clinics.csv files contain the data about
required clinics. The XML file contains the location details about each clinic. The third CSV files
in the way of services.csv contain the details about several clinical services. The last CSV files
contain a list of clinics and the services. Data integration carried out by using the python scripts.
Usually, this script file performs the cleansing operation first and then the merging operation. In
merging operation, it merges the four data sources into one CSV file. The CSV file contains
several attributes in the way of service ID, service, Email, clinic ID, clinic, suburb, lat and so on.
This application also shows restful web service demo. Here also we use the python script. This
web service should accept clinic query from the user and provide appropriate service to the
user. Then we provide mashup demo that contains HTML and CSS files. It includes error
handling mechanism to handle any error when something went wrong in the process.

Table of Contents
1.0 Introduction...........................................................................................................................1
2.0 Key system concept............................................................................................................1
2.1 Data cleaning and merging............................................................................................1
2.2 RESTful web services.....................................................................................................2
2.3 Mashups.............................................................................................................................2
3.0 Demo Running Instruction:...............................................................................................3
4.0 Conclusion.............................................................................................................................6
References....................................................................................................................................7

Table of figures
Figure 1 Combine two files..............................................................................................................3
Figure 2 Find out the restful web services.......................................................................................4
Figure 3 To search the location.......................................................................................................5
Figure 4 Display the location using Map..........................................................................................5