data and system integration assignment subjectreport and coding alsothankx
OfficeServiceID,OfficeID,ServiceID 1,1,1 2,1,2 3,2,1 4,2,2 5,2,3 6,2,4 7,2,5 8,3,1 9,3,2 10,4,1 11,4,4 12,4,5 13,5,2 14,6,3 15,7,1 16,7,2 17,7,5 18,8,1 19,8,2 20,8,3 21,9,1 22,9,4 23,10,1 24,10,2 25,10,3 26,10,4 27,10,5 28,11,2 29,12,3 30,13,1 31,13,4 32,14,1 33,14,5 34,15,1 35,16,1 36,16,2 37,17,1 38,17,2 39,17,3 40,17,4 41,17,5 42,18,3 43,19,1 44,19,2 45,19,3 46,19,4 47,19,5 48,20,4 49,21,1 50,21,5 51,22,1 52,22,4 53,22,5 54,23,1 55,23,4 56,24,2 57,25,5 58,26,1 59,26,2 60,26,3 61,27,1 62,27,2 63,27,3 64,27,4 65,27,5 66,28,1 67,28,3 68,28,5 69,29,1 70,29,2 71,29,3 72,29,4 73,29,5 Lat,Lon,officeID -33.975869,151.088939,1 -33.867139,151.207114,2 -33.849322,151.033421,3 -33.949859,151.052469,4 -32.748113,152.170141,5 -31.872153,152.689811,6 -34.853655,150.678507,7 -36.415074,148.618871,8 -32.413736,148.63938,9 -37.814563,144.970267,10 -37.738736,145.000515,11 -38.718949,143.725959,12 -37.842988,144.892631,13 -34.181714,142.163072,14 -37.203001,145.050171,15 -38.063056,145.40958,16 -37.733238,148.089423,17 -38.651487,146.675098,18 -27.46758,153.027892,19 -27.565733,153.057213,20 -27.767054,153.116881,21 -27.614604,152.760876,22 -27.6483,150.836678,23 -27.085007,152.951707,24 -26.498426,151.935421,25 -23.378941,150.512323,26 -19.267358,146.80654,27 -16.925397,145.775178,28 -34.92577,138.599732,29 ICT705 Data and System Integration Task 2 Semester 1, 2019 ICT705 Data and System Integration Assignment 2 Page 2 of 8 Assessment and Submission Details Marks: 40% of the Total Assessment for the Course Due Date: 11:59pm Friday, Week 12 Submit your assignment to Blackboard Task 2. Please follow the submission instructions in Blackboard. The assignment will be marked out of a total of 100 marks and forms 40% of the total assessment for the course. ALL assignments will be checked for plagiarism by SafeAssign system provided by Blackboard automatically. Refer to your Course Outline or the Course Web Site for a copy of the “Student Misconduct, Plagiarism and Collusion” guidelines. Late submission will be penalised according to the policy in the course outline. Please note Saturday and Sunday are included in the count of days late. Requests for an extension to an assignment MUST be made to the course coordinator prior to the date of submission and requests made on the day of submission or after the submission date will only be considered in exceptional circumstances. Assignment submission extensions will only be made using the official University guidelines. ICT705 Data and System Integration Assignment 2 Page 3 of 8 Background: E-Government Technology After evaluating various platforms, the government finally decided to adopt a Service Oriented Architecture (SOA) for its future IT infrastructure. They were impressed with your template-based Reference Architecture approach set out in your Task 1 Report and have accepted your recommendations regarding: • Computing and storage infrastructure design, • Application / service integration, and • Information integration. However, they would like to gain a deeper understanding of the technologies behind your recommendation and have asked for a small specific demonstration of these technologies along with a brief explanation of the concepts and principles of how it works. Assignment Task This assignment consists of two deliverables, being: • Demonstration code (50%). All code relating to this assignment should be contained within a folder named: Task 2 – Your Name – Student Number, the folder is then to be zipped and uploaded to blackboard. • A report (50%). The report must be uploaded separately. Part 1 - Demonstration Code (50%) Important Note: For ease of demonstration, your code must be self-contained. In addition to using Standards based HTML and Python, PETL, Bottle and Parser are the only additional frameworks you should need. If you use others they must be provided and not require installation. To demonstrate your code, you have been provided with four data sources compiled with fictitious sample data. These are: • “Offices.csv” contains the information about the government offices, • “Office_Locations.csv” contains the location coordinates for each office, • “Services.xml” contains a list of government office services, and • “Office_Services.csv” contains a list of offices and the services they offer. Task 1 - Data integration demo. You are to submit a python script named “data_integration.py” which first clean the data then merge it into one CSV output file named “office_service_locations.csv”. ICT705 Data and System Integration Assignment 2 Page 4 of 8 Task 1.1 Data Cleansing (10 marks) Clean the data in the phone number field in “Offices.csv” to ensure all phone numbers are in the same format: (+international_code) regional_code phone_number That is, all phone numbers should have the international code for Australia “(+61)”, followed by a space, followed by the regional code in two digits, followed by a space, followed by 8 digits of the local phone number. For example, the Brisbane office should be formatted to: (+61) 07 36728709 Whilst regional codes do not always adhere to state boundaries, you may apply the following regional codes for each state: NSW = 02 VIC = 03 QLD = 07 SA = 09 Task 1.2 Data Merge (10 marks) Merge the data from all four data sources, and generate output file “office_service_locations.csv” with the following fields (attributes): • OfficeServicesID – a unique field identifying each record from Office_Services • OfficeID – a foreign key linking to Services from Office_Services • Service – the ServiceName from Services • OfficeID – a foreign key linking to offices and locations • Office – the “Contact Name” from offices • Suburb – the “Suburb” from offices • Phone – the cleaned “Phone Number” data from offices • Email – the “Email” address from offices • Lat – from Office_Locations • Lon – from Office_Locations Task 2 – RESTful Web Service Demo You are to submit a python script named “office_locator.py”. For tasks 2.1 to 2.2, your script should build a RESTful web service that supports a ‘getoffices’ query from the client browser similar to “/getoffices?serviceid=x”. The server Web Service will return a JSON table with the following fields (attributes): Office, Suburb, Service, Phone, Email, Lat, Lon. Data is to come from the “office_service_locations.csv” you built in task 1.2. Task 2.1 Return offices for a service (5 marks) The server will return a table of records (tuples) of offices offering the service ID passed to it. ICT705 Data and System Integration Assignment 2 Page 5 of 8 Task 2.2 List of Services (5 marks) To populate your drop-down list in task 3.1, you will need to return a JSON table of all records from “services.csv” with the following fields (attributes): ServiceID, Service. The server should respond to a “getservices” request. Task 3 Mashup Demo You are to submit a HTML file “office_map.html” and optionally a CSS file named “office_map.css”. Task 3.1 Form Layout (5 marks) You are to create an input form that accepts user input for a particular service. The input for the service should be a drop-down list whose items should be created dynamically from a call to getservices from task 2.2. The drop-down list should be accompanied with descriptors and a “Locate Offices” button. Task 3.2 Google Map (10 marks) Clicking the “Locate Offices” button will trigger a “getoffices” web service to retrieve a table of offices matching the service with attributes described in task 2. From this data you are to display a Google cluster map marking the position of the returned offices. The map should be centred and zoomed to an appropriate level to show all offices in Australia. Task 3.3 Information Window Demographics (5 marks) Upon clicking a marker bubble on the map, the user will be displayed an information window containing: Contact Name, Suburb, Phone Number, and a clickable email address. ICT705 Data and System Integration Assignment 2 Page 6 of 8 Part 2 – Integration Report (50%) You are required to write a report explaining the theory underlining the key concepts around the design and implementation of your demonstration system. You are also required to explain how to run your code. Finally, you are to include all code submitted in the appendices to the report, note that the code will not count towards the word count. Your report should follow the following template: Table of Contents 1.0 Introduction 2.0 Key System Concepts 2.1 Data Matching and merging. Explain data matching and merging principles and how they were applied in your Demo. 2.2 RESTful Web Services. Explain RESTful Web services and how they were applied in your Demo. 2.3 Mashup. Explain Mashup principles and how it was applied in your Demo. 3.0 Demo Running Instructions 4