1. IntroductionSystem and data integration is the process. It is the combination of both technical andbusiness process. The system and integration is used to perform some operations such asvalidation, mapping, transformation, and also consolidate the data. The data is from disparatesources into meaningful information. The integrated systems are easily identified. The fieldmapping operation and gap analysis is performed well. To achieve the effective result we need toensure the smooth data into the data ware house. We know the using system and data integrationperform validation, cleansing, and also transformation.RESTful servicesHTTP protocol performs the REST architecture style. In RESTful design is based on thefollowing concepts. Uniform resource identifiers are used. Basically it’s a hierarchal structure based. Eachand every resource must have at least one URI. To read and manipulate the resources using uniform interfacesThere are four basic HTTP operations are applicable. They are GET, POST, PUT, andDELETE.And also support other operations such as HEAD, OPTIONSUsing these operations the meat data is easily performed. The accepted messages are represented in different formats like HTML, JSON, or XML.So self descriptive messages are applicableIt’s also known as stateless interaction. The session date is does not maintain by thestateless interaction.That means all the information’s are meaningful including the HTTP messageFor instance resource name and messageMashups and toolsTwo or more existing components are integrated by the mashup application. The existingcomponents are available in the web. The components are in different form like data, logic, orapplication logic and user. Mashup components are also known as individual component.
The mashup mechanism is known as mashup logic. The mashup logic is used to tell abouthow the mashup operators are created and how the mashup components are created. They areused to specify some of operators between the different components. Control flow, data flow,and data mediation, are types of operations performed by mashup tools.There are different types of tools are used Node-RedGlue.thingsWoTKitT/WoT2. Data merging and cleaningMultiple database of information are merged is known as data merging. The informationabout common entities is frequently used in large commercial and government organizations.This problem is known as merge/purge problem. They have duplicate information about thetypical data. The data are very complex and also domain depend matching process. It achieves the data cleaning task. The customers are directly making the marketing typeapplication. Final result explains the statistical details about the data. The result finally generatethe statistical data it means the final result will be accurate and effective. Using transitive closure all individual results are combing. The independent resultgenerates and produces more accurate result, in lower cost. The rule programming module isprovided by the system. It is easy to find and locate the duplicate environment. Large amount ofdata is used in this application. The real world data base is done by data merging. The final resultgenerates the statistical data.PETL python packagePetl is a python package index. The following command is used to describe the pip$ pip install petl And to download manually, extract and run by following command
python setup.py installTo verify the installation following command is used$ pip install nose$ nosetests –v pet1We are using the python version 2.7 and 3.4. The UNIX and WINDOWS operatingsystem is used to perform python. ETL pipelinesUsing this package we can easily avoid the lazy evolution and iterations. The pipelinewill not execute accurately, until the data is required. For instance >>> example_data = """foo,bar,baz... a,1,3.4... b,2,7.4... c,6,2.2... d,9,8.1... """>>> with open('example.csv', 'w') as f:... f.write(example_data)...petl.util.vis.look() is a calling function. Using this function easily write the data and filesor database. Following codes are some examples petl. Io csv. tocsv()petl.io.db.todb()
End of preview
Want to access all the pages? Upload your documents or become a member.
Related Documents
Design of the System and Computing Systemlg...
|12
|1853
|215
Assignment on Web and Mobile Applicationslg...
|16
|3426
|14
Web and Mobile Applications Assignmentlg...
|7
|1539
|11
Data merging and Cleaning Assignment PDFlg...
|10
|2051
|29
ICT705 Data and System Integrationlg...
|17
|2694
|340
Information services and Computing Assignment PDFlg...