HPC in the Cloud


Dedicated to covering high-end cloud computing
in science, industry and the datacenter

Language Flags

VIRTUALIZATION, REGULATORY TRENDS WILL STIMULATE GRID


A. IEEE Globecom

One of two premier IEEE telecommunications conferences each year, IEEE Globecom was held in Dallas from Nov. 29 through Dec. 3. The conference featured keynote speeches from industry luminaries, a telecom business forum, design and developers forum, research-oriented papers and several tutorials -- including one on high-performance global Grid networks (download abstract from: www.globecom2004.org/workshop_w05.html).

B. Keynote Speech

In his conference opening keynote address, Hossein Eslambolchi (president of Global Networking Technology Services, CTO and CIO of AT&T) listed several networking and IT technology trends that augur well for Grid computing and the interconnection of multiple Grid sites. His talk, titled "Future Directions in Networks" emphasized AT&T's campaign to transform its multiple legacy networks to one global IP MPLS network. Eslambolchi stated that AT&T's packet network carries 4TB of traffic per day (it was not clear whether the "packet network" was AT&T's IP/Internet or their traffic engineered IP-MPLS network or the sum of traffic on both networks).

Eslambolchi identified the top 10 trends in both networking and IT.

The top 10 Networking trends:

1. "IP will eat everything": confirming that IP will be the single dominant networking technology and be pervasive throughout the enterprise and residential networks (Grid networks are based on IP for the Network layer).

2. Convergence of communications and applications will be a reality.

3. *Ethernet will be universally deployed, including in the WAN (optical Ethernet will provide bandwidth on demand as well as cost effective multi gigabit connectivity between Grid sites).

4. Wireless Internet will drive mobility.

5. *Sensor nets (e.g. RFID based) will be everywhere, but IPv6 will be required for the large address space needed (sensor networks will be part of many Grids and will stimulate the movement to IP v6, with its much larger address space then IPv4).

6. *Death of locality, since geography is not relevant in IP based networks (this should make it more cost effective to interconnect widely dispersed Grid sites -- including sites located in different countries).

7. Broadband access will be common (isn't it already?).

8. Wireless and wire line networks will converge, with wireless eventually subsuming wire line (editor does not agree with this).

9. *Information mining will transform the way we do business (information mining will be done on almost all Grids to classify and extract relevant information from the tremendous volume of scientific and financial data that seems to be doubling every year -- or less).

10. Home LANs will proliferate -- many alternative technologies now exist.

The top 10 IT trends:

1. *Data volume and storage explosion is moving faster then Moore's law (we'll need Grid-based storage servers to manage this proliferation of data -� see related networking trend No. 9 above).

2. *eCollaboration will dominate the workplace (this implies use of Web Services for eBusiness applications and for multi-site Grid management and control planes).

3. A universal communications device is emerging that will supply all video, audio and communications needs.

4. *Self-adapting networks will eliminate human intervention for network management (implies auto fault detection, self healing, and re-configuration of networks to meet new user requirements; this will be an inherent capability of Grid networks).

5. *Knowledge based mining will drive on line business processes and give rise to "just in time decision making" (this will push the need for more efficient use of compute resources and the movement toward Grids).

6. *Networks will appear as a computer utility -- the complexity of the applications will be masked (virtualization of networks and compute resources will be facilitated by Grids).

7. *IT Cybernation will drive operational costs much lower (part of IT Cybernation is the throughput monitoring, job scheduling, and load balancing which is inherent in Grid computing).

8. *Investment in IT security and its complexity will escalate. Perimeter security around the network will be essential (several levels of security will be required for Grids, including SSL, WS Security and authentication/authorization).

9. *Open source software will be everywhere. Eslambolchi claimed that 73 percent of Web Services software is already available as open source code (there are already several open source organizations committed to development of Grid middleware stacks, e.g. Globus Alliance).

10. PINs and passwords will be replaced by biometric ID's.

* These trends seem to be especially important for accelerating the adoption of Grid computing networks on a large scale. Please note parenthetical remarks form this editor.

In closing, Eslambolchi examined what AT&T has learned from current activities to automate its network wherever possible. He also talked about the technical developments necessary to achieve AT&T's desired goal of a "Cybernated Network" that will automatically configure itself to provide robust and secure new capabilities.

C. Global Market and Regulatory Trends

This pragmatic session featured panelists from Goldman Sachs and McKinsey (including Reed Hundt, former FCC chairman).

In his talk on Carrier Economics, C. Krishnamurthy of McKinsey identified three triggers for carrier migration to next generation networks (that would offer services such as managed interconnection of Grid computing sites):

  • Competitive Imperative -- defensive reaction to competitors before economics of the new services are proven.
  • Early replacement -- may be more cost effective where network operators face higher operations cost.
  • Regulatory incentives or disincentives along with capital markets willing to finance the new investments -- this will directly impact telco capex.

It was suggested that new services (e.g. video) would drive Fiber to the Premises (FTTP) and Fiber to the Node (FTTN) and this has now just started to happen on a worldwide scale. However, telco's need to consider how soon they would realize a payback from their investments before they could commence a major fiber build-out. The implication was that fiber is being driven closer to the subscriber, which would enable higher speed interconnection of Grid sites, as well as higher speed remote access to Grid based server clusters.

Chris Fine of Goldman Sachs provided a capital markets perspective of telecoms. He stated that last mile migration form copper/TDM to fiber/IP was moving slower then many expected. This was because the telco needed at least a 60 percent equipment price reduction to consider replacement of class 5 central office switches. Chris noted that without new revenue sources, the FTTN business case would be challenging. A telco moving to FTTN (or FTTP) was betting on new applications or competitive threats (from MSO's or wireless telcos). The key question was "how soon will the telco realize a payback from investment in new access infrastructure?"

Chris made several other key points regarding telco investments:

  • OPEX was more important then CAPEX to telco's, yet they had limited ability to reduce OPEX through automation. This calls for new ways to automate network operations (how about use of Web Services?).
  • The movement to IP is getting a growing part of the CAPEX budget.
  • Broadband rollout is likely to continue at a rapid pace (assume this refers to DSL based Internet access for residential and small business customers).
  • Movement to open standards will drive investment costs down and result in better ROI. This will stimulate more investment in new plant and equipment.
  • Telecom industry is evolving into a selective and cyclical business.
  • Success breeds success and vice-versa (assume to be failure breeds failure and eventually bankruptcy).

Hundt suggested that communications policy from regulators can "do more by doing less." That would imply less regulation of U.S. telcos, who have faced an uncertain regulatory environment up until now. That uncertainty (over sharing of facilities and network resources/ equipment with competitive carriers at below ROI prices) has been a deterrent to incumbent telco (ILEC) investment in new plant and equipment, as well as the introduction of new network services. Reed categorized the telco industry as being in "a frozen state." In addition to regulatory uncertainty over sharing of facilities, (local) telcos were faced with: uncertain take rates for new services (resulting in potential low ROI), high fixed costs (for new infrastructure builds), OPEX risks, loss of fixed line phone revenue (cash cow gone to pasture), threats from MSO's (Internet access and cable telephony).

Hundt believes that we now need a "new rule of law" for the broadband information sector of a national economy. The objective would be to stimulate broadband infrastructure creation and encourage innovative new services that could take advantage of such an infrastructure. He was encouraged by the recent FCC ruling that ILECs do not have to unbundle new fiber access systems (e.g. share them with competitive carriers at discount prices) and felt that would stimulate the telecom industry.

D. Fiber Access PONs As a Potential Private Network for Metro Grids?

In the session on Passive Optical Networks (PONs), panelists from Optical Solutions, Alcatel, Freescale, and FTTH Communications made a convincing case for the rollout of Broadband (B) PONs and the migration to Gigabit (G) PONs. They also noted that Ethernet (E) PON deployment had commenced in Japan and trials were being held in Asia. These PONs are intended to serve the small business and residential markets. Video services are seen as a key driver of PONs for the residential market.

This editor observed that for enterprise applications, the Optical Network Unit (ONU) could be placed in the building leased or owned by an enterprise.

  • If the ONU also had protocol conversion capability (it is then referred to as an ONT), it could embed the Ethernet LAN frames (from the subscriber equipment) within a PON frame (to the network -- OLT).
  • If the OLT had an embedded Ethernet VLAN switch (preferably one that used two sets of VLAN tags), that would facilitate inter-building communications.

Such a configuration could make the PON a cost effective private metro network for enterprise applications (including Grid site interconnect) -- one that might compete with a metro switched Ethernet, for example.

This topic will be discussed further in a forthcoming article.

E. Network Management and Operations

The basic premise of this session: telcos need to move beyond traditional Network Management and Operations Support Systems (OSS's) when they deploy next generation network services. The telco should provide a more integrated approach to management and operations on a service level (vs network technology) basis.

One presentation seemed to be particularly relevant to Grid networks. GMPLS-based control plane for IP/DWDM networks by Lou Berger of Movaz Networks. This is because it is quite likely that a GMPLS control plane will be used to set up dedicated, point to point optical channels �- either SONET/SDH or Ethernet framed -- that interconnect Grid sites.

Berger's premise was that a GMPLS control plane would greatly contribute to OSS simplification. Traditional OSS functions such as Planning and Traffic Engineering, Inventory Management, Service Activation, etc., could be moved from the backend OSS to the GMPLS based control plane (between EMS and NE's and between adjacent NE's within the network). The OSS based installation functions and parameters can be realized or determined by GMPLS based: auto discovery of topology and circuit end points, auto initialization, auto remote configuration (and path selection), auto power equalization (?). What's left for the OSS is: Facility inventory and assignment, detecting exception conditions, EMS interface (to NMS/OSS).

Likewise, the Customer Network Management (CNM) functionality can be reduced via a GMPLS based control plane. What's left is Customer Relationship Management and Application Server software.

Benefits to the telco providing dedicated optical channels via GMPLS CP include:

  • Simplified network inventory discovery (assumes that equipment and service inventory is distributed amongst all the NE's).
  • Simplified NE service activation.
  • NE Service awareness.
  • Service Level alarm correlation by NE's (assumes that NE faults, e.g. circuit pack, are propagated through the network via GMPLS CP and this enables "per service visibility of faults."
F. Tutorial on Global Grid Networks

Friday 3 December 2004 � 13:30 -- 17:00 � W05: High-Performance Global Grid Networks The workshop will focus on the use of novel optical networking concepts that support future global Grid computing applications.

It is now evident to the technical community that local computational resources cannot keep up with the demands generated by some users/applications. Therefore, distributed computing and the concept of a computational Grid are now emerging. Novel network concepts are needed to support such vision and high speed optical networking may be the required infrastructure that will enable global Grids. Optical networks have the potential to support a large portion of Grid networking infrastructures since they offer bandwidth manipulation at the wavelength (wavelength switching) and sub-wavelength level (optical packet and burst switching) supporting not only high service granularity but also the capability to accommodate a wide variety of traffic characteristics. Research on novel optical switching paradigms (such as Optical Burst Switching -- OBS) has recently emerged but the technology will not see any boost if there is no proper application space. We believe that the design of new optical network concepts (including OBS) should be linked to the demands of the real emerging applications.

The workshop will try to identify the features and properties of Grid networks and the characteristics of a suitable network infrastructure:

  • Photonic Grid network characteristics: functional requirements, network architecture, transport protocols, etc.
  • Standardization activities on Photonic Grids
  • Control, management & signaling for optical Grid networks.
  • Experimental showcases.
About Alan J. Weissberger

As the founder and Technical Director of Data Communications Technology (DCT), a technical consulting firm started in March 1983, Alan J. Weissberger specializes in telecommunications standards and their implementation. His clients have included network providers (AT&T, NTT, Pacific Bell, US West, Entel and CTC in Chile, Telkom South Africa, Moroccan PTT, others), equipment and semiconductor manufacturers, and large end users. In 1995 and 1996 Alan was the principal architect for the European Commission's multi-service, multi-country ATM network -- the largest private network in Europe (that network has now evolved into Gig Ethernet over CWDM). In 2000-01, he was Ciena's lead ITU-T delegate, contributing to the standardization of the optical control plane in SG13 and SG15. Alan now represents NEC Corp in several OASIS TCs dealing with Web Services, while also attending the Global Grid Forum and the Optical Internetworking Forum (OIF).

Weissberger can be reached via e-mail at aweissberger@sbcglobal.net or ajwdct@technologist.com. To read his entire biography, please visit www.gridtoday.com/04/1011/bio.html, or e-mail gridmore@gridtoday.com with "740119" in the subject line.

Most Read Blogs


Feature Articles

Avoiding Scientific Computing Bottlenecks in the Cloud

Frank Ding, engineering analysis & technical computing manager at Simpson Strong-Tie, discussed the advantages of utilizing the cloud for occasional scientific computing, identified the obstacles to doing so, and proposed workarounds to some of those obstacles.
Read more...

Overcoming the Cloud Security Barrier for Financial Services

The private industry least likely to adopt public cloud services for data storage are financial institutions. Holding the most sensitive and heavily-regulated of data types, personal financial information, banks and similar institutions are mostly moving towards private cloud services – and doing so at great cost.
Read more...

Research Roundup: Toward a More Efficient Cloud

In this week's hand-picked assortment, researchers explore the path to more energy-efficient cloud datacenters, investigate new frameworks and runtime environments that are compatible with Windows Azure, and design a unified programming model for diverse data-intensive cloud computing paradigms.
Read more...

Short Takes

Running Computational Fluid Dynamics in the Cloud

May 16, 2013 | When it comes to cloud, long distances mean unacceptably high latencies. Researchers from the University of Bonn in Germany examined those latency issues of doing CFD modeling in the cloud by utilizing a common CFD and its utilization in HPC instance types including both CPU and GPU cores of Amazon EC2.
Read more...

In Support of Cloud-based Rendering

May 10, 2013 | Australian visual effects company, Animal Logic, is considering a move to the public cloud.
Read more...

Internet2 Awards Program Seeks Innovative Applications

May 10, 2013 | Program provides cash awards up to $10,000 for the best open-source end-user applications deployed on 100G network.
Read more...

HPC and the True Cost of Cloud

May 08, 2013 | For engineers looking to leverage high-performance computing, the accessibility of a cloud-based approach is a powerful draw, but there are costs that may not be readily apparent.
Read more...

Sponsored Whitepapers

Best Practices in Big Data Storage

05/10/2013 | Cleversafe, Cray, DDN, NetApp, & Panasas | From Wall Street to Hollywood, drug discovery to homeland security, companies and organizations of all sizes and stripes are coming face to face with the challenges – and opportunities – afforded by Big Data. Before anyone can utilize these extraordinary data repositories, however, they must first harness and manage their data stores, and do so utilizing technologies that underscore affordability, security, and scalability.

Exploring the Potential of Heterogeneous Computing

04/02/2012 | AMD | Developers today are just beginning to explore the potential of heterogeneous computing, but the potential for this new paradigm is huge. This brief article reviews how the technology might impact a range of application development areas, including client experiences and cloud-based data management. As platforms like OpenCL continue to evolve, the benefits of heterogeneous computing will become even more accessible. Use this quick article to jump-start your own thinking on heterogeneous computing.

Sponsored Multimedias

Newsletters

Stay informed! Subscribe to HPC in the Cloud email Newsletters.

HPC in the Cloud Update
HPCwire Weekly Update
Digital Manufacturing Report
Datanami
HPCwire Conferences & Events
Job Bank
HPCwire Product Showcases


ISC

HPC Job Bank


Featured Events



  • June 16, 2013 - June 20, 2013
    ISC'13
    Leipzig,
    Germany

  • June 17, 2013 - June 18, 2013
    Forecast 2013
    San Francisco, CA
    United States




HPC in the Cloud Conferences & Events