Siemon 10G ip™ Data Center Solution

Executive Summary

The term data center conjures up different meanings to different people. Some would argue that the data center is the room where the servers are stored. Others visualize quite a different picture. It is true that at one time, the data center was little more than a secure server room. However with technological advances and data centric businesses of today the term could better be expressed as a "mission critical data center". Business models have gone through a complete cycle from centralized data centers to decentralized and now back to centralized. Businesses realize that data is their strongest asset and as such are making strides to assure its availability, security and redundancy.

The data center concept has also grown into its own business model. Companies that provide redundant and offsite storage for other companies are building state of the art facilities on a global scale. At the heart of these facilities is the IT infrastructure. This paper will address infrastructures and components of a data center. Whether a company implements all or part of these components, one core element will always remain, that is the cabling system infrastructure. This planning guide is designed to provide you with a basic roadmap for your data center.

Data Center Trends

According to Infonetics Research's latest North American data center market research study, the projected combined data center services and products are expected to grow 47% from $10.6 billion to $15.6 billion between 2003 and 2007. Data centers can represent 50% of an IT budget for an organization. These data centers house the data for ERP (Enterprise Resource Planning) applications, e-commerce applications, SCM (Supply Chain Management), CAD/CAM, rich media, video/voice/data convergence, B2B (Business to Business) applications along with the back-office applications on which companies run. The communications mechanisms for the applications very, but the critical elements of data uptime do not change. According to a study from Contingency Planning Research and "Internetweek" (4/3/2000) the hourly costs for downtime for various types of companies are listed below.

Brokerage Operations	$6,450,000
Credit Card Authorizations	$2,600,000
Amazon	$180,000
Package Shipping	$150,000
Home Shopping Channel	$113,000
Airline Reservations	$89,000
Cellular Service Activations	$41,000
ATM Service Fees	$14,000

It is not very difficult to see that downtime directly translates into dollars, and lots of them. Companies that provide data center components and equipment are sensitive to this and have made great strides in providing companies with viable, hearty solutions for their growing data stores and requirements.

Components of a Data Center

Data centers are comprised of a high speed, high demand networking communication systems capable of handing the traffic for SAN (Storage Area Networks), NAS (Network Attached Storage), file/application/web server farms, and other components located in the controlled environment. The control of the environment relates to humidity, flood, electrical, temperature, fire controls, and of course, physical access. Communication in and out of the data center is provided by WAN, CAN/MAN and LAN links in a variety of configurations depending upon the needs of the particular center.

A properly designed data center will provide availability, accessibility, scalability, and reliability 24 hours a day, 7 days a week, 365 days per year minus any scheduled downtime for maintenance. Telephone companies work for 99.999% uptime and the data center is no different. There are two basic types of data centers: corporate and institutional data centers (CDCs) and Internet Data Centers (IDCs). CDCs are maintained and operated from within the corporation, while IDCs are operated by Internet Service Providers (ISPs). The ISPs provide third party web sites, collocation facilities and other data services for companies such as outsourced email.

Critical data centers are monitored by a NOC (Network Operations Center) which may be in-house or outsourced to a third party. The NOC is the first place outages are realized and the starting point for corrective action. NOCs are generally staffed during the data center's hours of operations. In 24 x 7 data centers, the NOC is an around the clock department. Equipment monitoring devices will advise the NOC of problems such as overheating, equipment outages, and component failure via a set of triggers that can be configured on the equipment or via a third party monitoring software which can run over all of the equipment.

Data Center Planning and Design Guideline

Data center planning has become somewhat of a specialty in the architectural world. Most architectural firms either have an RCDD (Registered Communications Distribution Designer) on staff, or acting as a consultant to assist with the specialized equipment not addressed by their Electrical Engineers and Mechanical Engineers. The equipment housed within the center is complex each with specific requirements for heating, cooling, power budgets and spatial considerations. A typical data center contains the following components:

Computing and network infrastructure (cabling, fiber, and electronics)
NOC or NOC communications and monitoring
Power distribution, generation and conditioning systems - Uninterruptible Power Supplies, generators
Environmental control and HVAC systems
Fire Detection and Suppression systems (typically halon or other non-water suppression)
Physical security and access control prevention, allowance, and logging
Circuit breaker protection (lightning protection in some cases)
Proper lighting
Minimum of 8'5" ceiling height
Grounding
Racks and cabinets for equipment
Pathway: Raised access flooring and overhead cable tray
Carrier circuits and equipment
elecommunications equipment
Proper clearances around all equipment, termination panels and racks

Data centers must be carefully planned PRIOR to building to assure compliance with all applicable codes and standards. Design considerations include site and location selection, space, power and cooling capacity planning, floor loading, access and security, environmental cleanliness, hazard avoidance and growth. In order to calculate the above needs, the architect and RCDD must know the components that will be housed in the data center including all electronics, cabling, computers, racks, etc.

To provide this list it is important to predict the number of users, application types and platforms, rack units required for rack mount equipment and most importantly, expected or predicted growth. Anticipating growth and technological changes can be somewhat of a "crystal ball" prediction. With the possible combination of storage islands, application islands, server platforms and electronic components literally being factorial, planning is as important to a data center as the cabling is to a network. The data center will take on a life of its own and should be able to respond to growth and changes in equipment, standards and demands all while remaining manageable and of course, reliable. Larger data centers are designed in tiers with each tier performing different functions and generally with different security levels. Redundancy may be between different levels or different geographic locations depending on the needs of the users of the facility.

Equipment Improvements

In an effort to conserve space and lower costs within data centers, KVM switches have been on the market for quite sometime. KVM (Keyboard, Video and Mouse) switches allow a single keyboard, monitor and mouse to control multiple servers in a rack or the new blade servers that are entering the market. Newer versions of these switches allow this control to happen remotely as well as locally through the switch.

SAN (Storage Area Networks) and NAS (Network Attached Storage) devices have made sharing disk drives between servers or over the network a faster and easier alternative to the older server mirroring technologies. These devices can be attached via Fibre Channel, SCSI, or network cabling. IP based products are becoming prevalent that allow for the communications between the storage devices and network components to be either IP based or tunneled through IP. This makes these solutions far more scaleable and reliable than their predecessors. For more information on Storage Area Networks, view the white paper on these technologies.

Another plus in the data center world is that electronics are becoming smaller and more compact thereby conserving space on the data center floor. This can be seen in telecommunications switching equipment, servers, UPS solutions and various other components within the data center. Single chassis switches equipped with blades for various tasks replace the older versions where an entire switch unit was needed for each function. Servers and rack mounted appliance servers are also smaller than their counterparts of old.

Data Center Cabling System Considerations

The TIA TR-42.1.1 group is tasked with the development of the "Telecommunications Infrastructure Standard for Internet Data Centers." "The scope of the working group will include topologies and performance for copper and fiber cabling, and other aspects of the IT infrastructure that will enable these facilities to rapidly deploy new technologies, such as 10 Gb/s networks. The TIA/EIA has recently adopted TIA/EIA-942 'The Telecommunications Infrastructure Standard for Data Centers'. The requirements will consider the need for flexibility, scalability, reliability and space management." (Source-www.tiaonline.org). The National Electric Code (NEC) in Article 645 "Information Technology Equipment" and the National Fire Protection Association (NFPA) in NFPA-75 "The Standard for the Protection of Informantion Technology" have addressed these important factors. While these standards will provide guidelines, there are specific design elements that will vary with each data center and its housed equipment. General considerations that will apply to all data centers include:

Standards based open systems
High performance and high bandwidth with growth factors incorporated
Support for 10G or higher speed technologies
Support for storage devices (i.e. Fibre channel, SCSI or NAS)
Support for convergence with growth factors incorporated
High quality, reliability and scalability
Redundancy
High capacity and density
Flexibility and expandability with easy access for moves, adds and changes
BAS, voice, video, CCTV and other low voltage systems
Incorporation of Data Center security and monitoring systems

Cabling may be copper (UTP/ScTP) or fiber (SM/MM) which will depend on the interface of the equipment to which it is to connect. Typical practices allow for dark fiber (unused strands) to be run along with the active fiber. Equipment may be active or passive.

Cabling Pathways

Data centers contain highly consolidated networks and equipment. This high consolidation requires high density cabling systems. Cabling pathways in the data center generally consist of a combination of access under a raised flooring system and overhead cable tray. Raised floors provide the benefit of aesthetic pleasure along with heat management and easy access to the hidden cables. Cables under a raised floor should be run in raceways (cabling channels) to protect them from power cables, security devices and fire suppression systems which may be run in the same environment. Power cables can be run either in conduit or in power raceways and should respect the minimum distances outlined in industry standard specifications. Raceways aid in the distribution of cool air, facilitate future cablemoves, adds and changes and insure cable performance.

The fiber cabling pathway and management in the data center should be provided by a dedicated duct system. This provides a safe and protective method for routing and storing optical fiber patchcords, pigtails and riser cables among fiber distribution frames, panels, splice cabinets and termination equipment. Fiber carries different stress and bend radius requirements than copper due to the fact that it carries light rather than electrical signals. Planning is required to assure that proper space allowances are provided.

Enclosures and Racks

Equipment enclosures and rRack space should be a very early consideration in the entire design process. Identification of equipment and the number of rack units used will determine the number of racks needed for installation. Rack mounted equipment is expressed in xRU, with x representing the number of rack units (1-3/4" rack space). Some equipment also carries buffer or air requirements for separation from other equipment. Racks are standardized on a 19" width.

All racks should be properly labeled as should all equipment contained therein. Equipment enclosures and Rracks should contain the requiredand cabling and should utilize wire management. Equipment enclosures and rack Racks should be placed in locations allowing 4' from the center of the rack to the wall behind with a minimum clearance of 3' in front. Should equipment be contained in the rack, a 6' clearance should be allowed. ANSI TIA/EIA and the NEC codes should all be consulted for proper placement of all components within the data center. In raised floor environments equipment enclosures and rack placement should also consider floor tile layout in order to prevent "a land-locked" situation.

Cabling systems for the data center

10G ip™ is available and provides cabling solutions for data centers today.

The XGLO^® fiber-optic cabling solution, meets IEEE802.3ae standard. This laser-optimized fiber supports existing 10-Gigabit Ethernet equipment. The XGLO^® cabling system typically includes the following products:

Rack mounted optical fiber interconnect Center (RIC);
Rack Mounted Fiber Connect Panel (FCP3-DWR),
Wall Mount Interconnect Center (SWIC3);
Quick-Pack™ Adapter Panels,
CT^®, MAX^®, SM^® and FOB2 series work area adapters,
XGLO^®10 Gigabit Optical Fiber Jumpers & Pigtails,
XGLO^® qualified fiber cables.

These systems are backed by one of the best warranties on the market including not only parts and labor, but offer a performance warranty as well when installed by a certified installer.

For information on these and other systems from The Siemon Company, please consult one of our global team of certified installers, resellers or distributors.