I have attached files.
ITECH 2201 Cloud Computing School of Science, Information Technology & Engineering Workbook for Week 6 (Big Data) Please note: All the efforts were taken to ensure the given web links are accessible. However, if they are broken – please use any appropriate video/article and refer them in your answer Part A (4 Marks) Exercise 1: Data Science (1 mark) Read the article at http://datascience.berkeley.edu/about/what-is-data-science/ and answer the following: What is Data Science? ____________________________________________________________________________ ____________________________________________________________________________ ____________________________________________________________________________ ____________________________________________________________________________ According to IBM estimation, what is the percent of the data in the world today that has been created in the past two years? ____________________________________________________________________________ What is the value of petabyte storage? _______________________________________________________________________ For each course, both foundation and advanced, you find at http://datascience.berkeley.edu/academics/curriculum/ briefly state (in 2 to 3 lines) what they offer? Based on the given course description as well as from the video. The purpose of this question is to understand the different streams available in Data Science. ____________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________ Exercise 2: Characteristics of Big Data (2 marks) Read the following research paper from IEEE Xplore Digital Library Ali-ud-din Khan, M.; Uddin, M.F.; Gupta, N., "Seven V's of Big Data understanding Big Data to extract value," American Society for Engineering Education (ASEE Zone 1), 2014 Zone 1 Conference of the , pp.1,5, 3-5 April 2014 and answer the following questions: Summarise the motivation of the author (in one paragraph) _______________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________ What are the 7 v’s mentioned in the paper? Briefly describe each V in one paragraph. __________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________ Explore the author’s future work by using the reference [4] in the research paper. Summarise your understanding how Big Data can improve the healthcare sector in 300 words. _______________________________________________________________________ _______________________________________________________________________ _______________________________________________________________________ _______________________________________________________________________ _______________________________________________________________________ _______________________________________________________________________ _______________________________________________________________________ _______________________________________________________________________ _______________________________________________________________________ _______________________________________________________________________ _______________________________________________________________________ _______________________________________________________________________ _______________________________________________________________________ Exercise 3: Big Data Platform (1 mark) In order to build a big data platform - one has to acquire, organize and analyse the big data. Go through the following links and answer the questions that follow the links: Check the videos and change the wordings · http://www.infochimps.com/infochimps-cloud/how-it-works/ · http://www.youtube.com/watch?v=TfuhuA_uaho · http://www.youtube.com/watch?v=IC6jVRO2Hq4 · http://www.youtube.com/watch?v=2yf_jrBhz5w Please note: You are encouraged to watch all the videos in the series from Oracle. How to acquire big data for enterprises and how it can be used? ___________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________ How to organize and handle the big data? ___________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________ What are the analyses that can be done using big data? ___________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________ Part B (4 Marks) Part B answers should be based on well cited article/videos – name the references used in your answer. For more information read the guidelines as given in Assignment 1. Exercise 4: Big Data Products (1 mark) Google is a master at creating data products. Below are few examples from Google. Describe the below products and explain how the large scale data is used effectively in these products. a. Google’s PageRank ___________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________ b. Google’s Spell Checker ___________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________ c. Google’s Flu Trends ___________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________ d. Google’s Trends ___________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________ Like Google – Facebook and LinkedIn also uses large scale data effectively. How? ___________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________ Exercise 5: Big Data Tools (2 marks) Briefly explain why a traditional relational database (RDBS) is not effectively used to store big data? _________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________ What is NoSQL Database? ________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________ Name and briefly describe at least 5 NoSQL Databases ________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________ What is MapReduce and how it works? ___________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________ Briefly describe some notable MapReduce products (at least 5) ___________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________ Amazon’s S3 service lets to store large chunks of data on an online service. List some 5 features for Amazon’s S3 service. _________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________ Getting the concise, valuable information from a sea of data can be challenging. We need statistical analysis tool to deal with Big Data. Name and describe some (at least 3) statistical analysis tools. _________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________ ___________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________ Exercise 6: Big Data Application (1 mark) Name 3 industries that should use Big Data – justify your claim in 250 words for each industry using proper references. ________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________ CRICOS Provider No. 00103D Insert file name here Page 1 of 9 CRICOS Provider No. 00103D Insert file name here Page 9 of 9 ITECH 2201 Cloud Computing School of Science, Information Technology & Engineering Workbook for Week 7 (Storage) Please note: All the efforts were taken to ensure the given web links are accessible. However, if they are broken – please use any appropriate video/article and refer them in your answer Part A (3 Marks) Exercise 1: Storage Methods (1 mark) From your lecture and also based on the below given video link: https://www.youtube.com/watch?v=_sXkTSiAe-A Write a paragraph about memory virtualization. ________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________ Watch the below mentioned YouTube link: https://www.youtube.com/watch?v=wTcxRObq738 Based on the video answer the following questions: What is RAID 0? ________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________ Describe Striping, Mirroring and Parity. _______________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________ Exercise 2: Storage Design (2 marks) Summarize storage repository design based on the following video link: https://www.youtube.com/watch?v=eVQH7C3nulY ________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________ Below YouTube link describes the Intelligent Storage System https://www.youtube.com/watch?v=raTIRsMi7zk Based on the watched video answer the following questions: What is ISS? ________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________ What are the 4 main components of the ISS? ________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________ How cache works in ISS? ________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________ Storage Area Network (SAN) and Network Attached Storage (NAS) are widely used concepts in data storage arena. The following YouTube video links gives detailed description of these concepts: · http://www.youtube.com/watch?v=csdJFazj3h0 · http://www.youtube.com/watch?v=vdf6CvGQZrk · https://www.youtube.com/watch?v=KxdfGcynfJ0 · https://www.youtube.com/watch?v=4RsLUTJ_Qtk Based on the watched videos answer the following questions: Describe NAS and SAN briefly using diagrams? ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ What are the advantages of SAN over NAS? ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ What are two common NAS file sharing protocols? How they are different from each other? ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ Part B (3 Marks) Exercise 3: Storage Design (1 Mark) Design Storage Solution for New Application Scenario An organization is deploying a new business application in their environment. The new application requires 1TB of storage space for business and application data. During peak workload, application is expected to generate 4900 IOPS (I/O per second) with typical I/O data block size of 4KB. The vendor available disk drive option is 15,000 rpm drive with 100 GB capacity. Other specifications of the drives are: Average Seek time = 5 millisecond and data transfer rate = 40 MB/sec. You are required to calculate the required number of disk drives that can meet both capacity and performance requirements of an application. Hint: In order to calculate the IOPS from average seek time, data transfer rate, disk rpm and data block size refer slide 28 in week 6 lecture slide. Once you have IOPS, refer slide 29 in week 6 to calculate the required number of disks. Exercise 4: Storage Evolution (2 Marks) Watch the following videos for Fiber Channel over Ethernet and answer the questions that follow: · http://www.youtube.com/watch?v=hSFyf-rmjA8 · http://www.youtube.com/watch?v=iCfJCzfNLrw What is FCoE and why we need FCoE? ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ In your opinion how FCoE is cost effective than traditional connection – give brief explanation. ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ You have read and answered about SAN in part A – based on your understanding and with some research effort answers the following questions: What is a Virtual SAN? ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ What is IP SAN protocols and FibreChannel over IP (FCIP)? ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ ________________________________________________________________ Watch the below video about Introduction to Object-based and Unified Storage and: https://www.youtube.com/watch?v=kl9X6mzEWO4 Choose the correct answer from the following questions: What is an advantage of a flat address space over a hierarchical address space? a. Highly scalable with minimal impact on performance b. Provides access to data, based on retention policies c. Provides access to block, file, and object with same interface d. Consumes less bandwidth on network while accessing data What is a role of metadata service in an OSD node? a. Responsible for storing data in the form of objects b. Stores unique IDs generated for objects c. Stores both objects and objects IDs d. Controls functioning of storage devices What is used to generate an object ID in a CAS system? a. File metadata b. Source and destination address c. Binary representation of data d. File system type and ownership What accurately describes block I/O access in a unified storage? a. I/O traverse NAS head and storage controller to disk b. I/O traverse OSD node and storage controller to disk c. I/O traverse storage controller to disk d. I/O is directly sent to the disk What accurately describes unified storage? a. Provides block, file, and object-based access within one platform b. Provides block and file storage access using objects c. Supports block and file access using flat address space d. Specialized storage device purposely built for archiving CRICOS Provider No. 00103D Insert file name here Page 1 of 9 CRICOS Provider No. 00103D Insert file name here Page 9 of 9 ITECH 2201 Cloud Computing School of Science, Information Technology & Engineering Workbook for Week 8 Please note: All the efforts were taken to ensure the given web links are accessible. However, if they are broken – please use any appropriate video/article and refer them in your answer Part A (3 Marks) Exercise 1: Green Computing (0.5 Marks) The questions in this exercise can be answered by doing internet search and/or from the YouTube videos. Answer to each question should be one paragraph in your own words. What is Greenhouse effect? ____________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________ We are legally, ethically, and socially required to green our IT products, applications, services, and practices – is this statement true? Why? ____________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________ What is Green IT and what are the benefits of greening IT? ________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________ ________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________ Exercise 2: Environmental Sustainability (0.5 Marks) Read the article in the below link and answer the questions that follow: http://www.computer.org/csdl/mags/it/2010/02/mit2010020004.html According to the article how do you build a greener environment? ____________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________ Summarize the article in 150 words ____________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________ Exercise 3: Environmentally Sound Practices (1 Mark) The questions in this exercise can be answered by doing internet search. Briefly explain the following terms – a paragraph for each term: · Power usage effectiveness (PUE) and its reciprocal ________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________ · Data center efficiency (DCE) ________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________ · Data center infrastructure efficiency (DCiE) ________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________ List 5 universities who offers Green Computing course. You should name the university, the course name and the brief description about the course. ________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________ Exercise 4: Major Cloud APIs (1 Mark) The following companies are the major cloud service provider: Amazon, GoGrid, Google, and Microsoft. List and briefly describe (3 lines for each company) the Cloud APIs