High Performance Computing Cloud Computing

High Performance Computing Cloud Computing Dr. Rami YARED

1

Outline High Performance Computing Parallel Computing

Cloud Computing Definitions Advantages and drawbacks

Cloud Computing vs Grid Computing 2

3

4

5

6

7

8

9

10

Outline High Performance Computing Parallel Computing

Cloud Computing Definitions Advantages and drawbacks

Cloud Computing vs Grid Computing 11

Cloud Computing New paradigm “Clouds will transform the information Technology (IT) industry… profoundly change the way people work and companies operate”  Provides massively scalable computing resources from anywhere.  Simplifies services delivery.  Enables rapid innovation of new business models.  Dynamic infrastructure for next generation data

12

The “Cloud” = 10X Improvements • • • •

Ease of Use Scalability Reliability Cost

13

Ease of Use • Deploy infrastructure with a mouse or API – No cabling – Middle of the night – Do it yourself remotely from anywhere anytime

14

Scalability Control your infrastructure with your app Nothing to purchase and take delivery on Instant

15

Reliability Based on enterprise grade hardware Design for failures: Automatically spin up replacements Use multiple clouds

Cost

“Turn off the lights” = turn off servers you aren’t using Ex: Turn off development and test environments Pay for only what you use No need to buy in advance Zero Capital Outlay No contracts 16

Cloud computing • Understanding how others view “Cloud Computing” • Multiple Definitions

17

Cloud Computing Definition by Forrester research “A pool of abstracted, highly scalable, and managed compute infrastructure capable of hosting end-customer applications and billed by consumption”

18

Cloud Computing Definition by Forrester research • Different than SaaS (Software as a Service) – – – – – – –

Prescript & Abstract Infrastructure Fully Virtualized Dynamic Infrastructure Software Pay by Consumption Free of Long-Term Contracts Application and OS Independent Free of Software or Hardware Installation

“Cloud computing has all the earmarks of being a potential innovation that all infrastructure and operations professionals should pay close attention.”

19

Other Definitions “Cloud computing is an emerging approach to shared infrastructure in which large pools of systems are linked together to provide IT services.” – IBM press release on “Blue Cloud”

“…a hosted infrastructure model that delivers abstracted IT resources over the Internet” – Thomas Weisel Partners LLC from “Into the Clouds: Leveraging Data Centers and the Road to Cloud Computing”

“Cloud computing describes a systems architecture. This particular architecture assumes nothing about the physical location, internal composition or ownership of its component parts.” – James Urquhart blog post

20

Cloud Computing definition • SaaS – Software as a Service – Storage as a Service

• PaaS – Platform as a Service • IaaS – Infrastructure as a Service

Hosting Industry Change Cloud Computing -“Enabling Technology” to move from Traditional Hosting to Cloud Hosting 21

The Cloud’s “Snowball Effect”

• Maturation of Virtualization Technology • Virtualization enables Compute Clouds • Compute Clouds create demand for Storage Clouds • Storage + Compute Clouds create Cloud Infrastructure • Cloud Infrastructure enables Cloud Platforms & Applications 22

Cloud Computing • Build upon a foundation • Building blocks: Infrastructure, Platforms, Applications Cloud Computing is…

… virtualized compute power and storage delivered via platform infrastructures of abstracted hardware and software accessed over the Internet. These shared, on-demand IT resources, are created and disposed of efficiently, are dynamically scalable through a variety of programmatic interfaces and are billed variably based on measurable

23

Cloud computing

• Develop in the cloud – Integrated, dynamically provisioned environment – Repository for source and reusable assets 24

Cloud computing • Deploy in the cloud – One click application provisioning – Deployment optimization – Collaboration platform for knowledge sharing

25

Cloud computing • Deliver services from the cloud – Seamless transition to production environment – Easily accessed from anywhere

26

Cloud computing • Overflow to another cloud – Hybrid cloud for dynamic Infrastructure – Leverage extra capacity from public clouds – Single systems management view across clouds

27

Cloud “Applications” • SaaS resides here • Most common Cloud / Many providers of different services • Examples: SalesForce, Gmail, Yahoo! Mail • Advantages: Free, Easy, Consumer Adoption • Disadvantages: Limited functionality, no control or access to underlying technology

28

Cloud “Platforms”

• “Containers” • “Closed” environments • Examples: Google App Engine, Joyent or Force.com (SalesForce Dev Platform) • Advantages: Good for developers, more control than “Application” Clouds, tightly configured • Disadvantages: Restricted to what is available 29

Traditional Hosting vs Cloud Hosting

• Static  Dynamic = Quick & Easy Scalability • Cost Prohibitive  Cost Effective = Cost Efficiencies based on usage, no contracts, no upfront costs • Predictable  Unpredictable = Innovations • Stagnant  Growth = Evolution Reference: Paul Lancaster, Business Development Manager, Traditional Hosting  Cloud Hosting = GoGrid http://www.GoGrid.com

FUTURE!

30

Cloud “Infrastructure” • Provide “Compute” and “Storage” clouds • Virtualization layers (hardware/software) • Examples: Amazon EC2, Amazon S3 • Advantages: Full control of environments and infrastructure • Disadvantages: premium price point, limited competition 31

32

Cloud Computing vs Grid computing • Cloud computing is a style of computing in which dynamically scalable and often virtualized resources are provided as a service over the Internet. Users need not have knowledge of, expertise in, or control over the technology infrastructure in the "cloud" that supports them. 33

Comparisons Cloud computing can be confused with: 1) grid computing: "a form of distributed computing whereby a super and virtual computer is composed of a cluster of networked, loosely-coupled computers, acting in concert to perform very large tasks". 2) utility computing: the "packaging of computing resources, such as computation and storage, as a metered service similar to a traditional public utility such as electricity“ 3) autonomic computing: "computer systems capable of self-management".

34

•

Cloud computing characteristics Cloud computing customers do not generally own the physical infrastructure serving as host to the software platform in question. Instead, they avoid capital expenses by renting usage from a third-party provider.

• They consume resources as a service and pay only for resources that they use. Many cloud-computing offerings employ the utility computing model, which is analogous to how traditional utility services (such as electricity) are consumed, while others bill on a subscription basis. • Computing power among multiple tenants can improve utilization rates, as servers are not unnecessarily left idle (which can reduce costs significantly while 35

History of Cloud Computing The Cloud is a term that borrowed from telephony. Up to the 1990s, data circuits (including those that carried Internet traffic) were hard-wired between destinations. Subsequently, long-haul telephone companies began offering Virtual Private Network (VPN) service for data communications. Telephone companies were able to offer VPN based services with the same guaranteed bandwidth as fixed circuits at a lower cost because they could switch traffic to balance utilization as they saw fit, thus utilizing their overall network bandwidth more effectively.

36

History of Cloud Computing • As a result of this arrangement, it was impossible to determine in advance precisely paths traffic would be routed over. The term "telecom cloud" was used to describe this type of networking, and cloud computing is conceptually somewhat similar. 37

Disadvantage of cloud Computing • Since cloud computing does not allow users to physically possess the storage of their data (the exception being the possibility that data can be backed up to a user-owned storage device, such as a USB flash drive or hard disk) it does leave responsibility of data storage and control in the hands of the provider. • Cloud computing has been criticized for limiting the freedom of users and making them dependent on the cloud computing provider, and some critics have alleged that is only possible to use applications or services that the provider is willing to offer. Thus, The London Times compares cloud computing to centralized systems of the 1950s and 60s, by which users connected through "dumb" terminals to mainframe computers. Typically, users had no freedom to install new applications and needed approval from administrators to achieve certain tasks.38 Overall, it limited both freedom and creativity. The

Disadvantage of cloud Computing • Similarly, Richard Stallman, founder of the Free Software Foundation, believes that cloud computing endangers liberties because users sacrifice their privacy and personal data to a third party. He stated that cloud computing is "simply a trap aimed at forcing more people to buy into locked, proprietary systems that would cost them more and more over

39

Outline High Performance Computing Parallel Computing

Cloud Computing Definitions Advantages and drawbacks

Cloud Computing vs Grid Computing 40

Cloud Computing • With cloud computing, companies can scale up to massive capacities in an instant without having to invest in new infrastructure, train new personnel, or license new software. • Cloud computing is of particular benefit to small and medium-sized businesses who wish to completely outsource their datacenter infrastructure, or large companies who wish to get peak load capacity without incurring the higher cost of building larger data centers internally. In both instances, service consumers use what they need on the Internet and pay only for what they use. 41

Cloud Computing • The service consumer no longer has to be at a PC, use an application from the PC, or purchase a specific version that's configured for smart phones, PDAs, and other devices. The consumer does not own the infrastructure, software, or platform in the cloud. • He has lower upfront costs, capital expenses, and operating expenses. He does not mind about how servers and networks are maintained in the cloud. • The consumer can access multiple servers anywhere on the globe without knowing which ones and where they are located.

42

Grid computing Cloud computing evolves from grid computing and provides ondemand resource provisioning. Grid computing may or may not be in the cloud depending on what type of users are using it. If the users are systems administrators and integrators, they care how things are maintained in the cloud. They upgrade, install, and virtualize servers and applications. If the users are consumers, they do not mind how things are run in the system. Grid computing requires the use of software that can divide and farm out pieces of a program as one large system image to several thousand computers. One concern about grid is that if one piece of the software on a node fails, other pieces of the software on other nodes may fail. This is alleviated if that component has a failover component on another node, but problems can still arise if components rely on other pieces of software to accomplish one or more grid computing tasks. Large system images and associated hardware to operate and maintain them can contribute to large 43 capital and operating expenses.

Grid vs Cloud: Similarities and differences • Cloud computing and grid computing are scalable. Scalability is accomplished through load balancing of application instances running separately on a variety of operating systems and connected through Web services. • CPU and network bandwidth is allocated and de-allocated on demand. The system's storage capacity goes up and down depending on the number of users, instances, and the amount of data transferred at a given time.

44

Grid vs Cloud Similarities and differences • Both computing types involve multitasking, meaning that many customers can perform different tasks, accessing a single or multiple application instances. Sharing resources among a large pool of users assists in reducing infrastructure costs and peak load capacity. • Cloud and grid computing provide service-level agreements (SLAs) for guaranteed uptime availability of, say, 99 percent. • If the service slides below the level of the guaranteed uptime service, the

45

Grid vs Cloud Computing • The Amazon S3 provides a Web services interface for the storage and retrieval of data in the cloud. Setting a maximum limits the number of objects one can store in S3. It can store an object as small as 1 byte and as large as 5 GB or even several terabytes. S3 uses the concept of buckets as containers for each storage location of your objects. The data is stored securely using the same data storage infrastructure that Amazon uses for its

46

Grid vs Cloud Computing • While the storage computing in the grid is well suited for data-intensive storage, it is not economically suited for storing objects as small as 1 byte. In a data grid, the amounts of distributed data must be large for maximum benefit. • A computational grid focuses on computationally intensive operations. Amazon Web Services in cloud computing offers two types of instances: standard and high-CPU.

47

Summary High Performance Computing Parallel Computing

Cloud Computing Definitions Advantages and drawbacks

Cloud Computing vs Grid Computing 48

Thank you