MSG348MSG348Best Practices For Best Practices For Exchange Server Cluster Exchange Server Cluster Deployments Deployments Karl RobinsonKarl RobinsonSenior Systems EngineerSenior Systems EngineerISS Solutions EngineeringISS Solutions EngineeringHewlettHewlett--Packard CorporationPackard Corporation

AgendaAgendaWhy ClusterWhy ClusterWhat is a ClusterWhat is a ClusterWhat’s NewWhat’s NewPlanningPlanningAdministrative / Operational PracticesAdministrative / Operational Practices

Why ClusterWhy ClusterHigh AvailabilityHigh Availability

What is it?What is it?Availability versus ReliabilityAvailability versus Reliability

BenefitsBenefitsReduce single points of failureReduce single points of failureMaintenance and upgradeMaintenance and upgrade

Doesn’t protect againstDoesn’t protect againstShared storage failuresShared storage failuresNetwork failuresNetwork failuresOperational or procedural failuresOperational or procedural failures

What Is A Cluster?What Is A Cluster?Collection of physical servers that can Collection of physical servers that can act as a single logical serveract as a single logical serverRequirementsRequirements

Shared StorageShared StorageSame IP subnetSame IP subnet

What Is A Cluster?What Is A Cluster?Collection of ResourcesCollection of Resources

Physical DiskPhysical DiskIP AddressIP AddressNetwork NameNetwork Name

Exchange Specific ResourcesExchange Specific ResourcesSystem AttendantSystem AttendantInformation StoreInformation StoreSearchSearchHTTP, IMAP4, POP3, SMTP Virtual ServersHTTP, IMAP4, POP3, SMTP Virtual ServersRouting ServiceRouting ServiceMTA InstanceMTA Instance

Cluster ResourcesCluster ResourcesCluster Support for Exchange 2000 Cluster Support for Exchange 2000 ResourcesResources

Exchange 2000 ComponentExchange 2000 Component Cluster FunctionalityCluster Functionality CommentsComments

One instance per virtual serverOne instance per virtual serverActive/ActiveActive/ActiveMS Search ServerMS Search ServerNot Supported in a ClusterNot Supported in a ClusterActive/PassiveActive/PassiveKey Management, Video, Key Management, Video,

Chat, Conference, ADCChat, Conference, ADC

Not Supported in a ClusterNot Supported in a ClusterActive/PassiveActive/PassiveSite Replication ServiceSite Replication Service

Not Supported in a ClusterNot Supported in a ClusterActive/PassiveActive/PassiveConnectors: MSMail, CC Connectors: MSMail, CC Mail, Profs, etcMail, Profs, etc

Multiple virtual servers per nodeMultiple virtual servers per nodeActive/ActiveActive/ActivePOP3, IMAP, SMTP, HTTP POP3, IMAP, SMTP, HTTP DAV, NNTPDAV, NNTP

The MTA will be in only one The MTA will be in only one cluster group. One MTA instance cluster group. One MTA instance per clusterper cluster

Active/PassiveActive/PassiveMessage Transfer AgentMessage Transfer Agent

Each cluster node is limited to 4 Each cluster node is limited to 4 storage groupsstorage groups

Active/ActiveActive/ActiveInformation StoreInformation Store

Each Exchange Virtual Server is Each Exchange Virtual Server is created by the SA resource is created by the SA resource is configuredconfigured

Active/ActiveActive/ActiveSystem AttendantSystem Attendant

What Is A Cluster?What Is A Cluster?

What’s New ?What’s New ?Eight Node SupportEight Node Support

Windows Server 2003 Enterprise and Windows Server 2003 Enterprise and Datacenter EditionsDatacenter EditionsActive/Active only supported with 2 nodesActive/Active only supported with 2 nodesN Active Servers with Y passive Servers N Active Servers with Y passive Servers (N+1, etc.)(N+1, etc.)Better economicsBetter economics

1+1 1+1 –– 50% Standby50% Standby3+1 3+1 –– 25% Standby25% Standby7+1 7+1 –– 12.5% Standby12.5% Standby6+2 6+2 –– 25% Standby25% Standby

What’s New ?What’s New ?Cluster Service InstallationCluster Service Installation

Cluster Administrator installed by default Cluster Administrator installed by default in Admin Toolsin Admin ToolsNo need to install additional components No need to install additional components from disk for cluster servicefrom disk for cluster service

New Server Cluster WizardNew Server Cluster WizardSimplifies cluster installationSimplifies cluster installationAnalyses environment to determine Analyses environment to determine cluster feasibility cluster feasibility

New ServerNew ServerCluster WizardCluster Wizard

demodemo

What’s NewWhat’s NewSecuritySecurity

No longer need to make the cluster No longer need to make the cluster service account an Exchange full admin service account an Exchange full admin Support for KerberosSupport for KerberosSupport for IPSEC (FE Support for IPSEC (FE --> BE clustered > BE clustered ExchangeExchange server)server)Secure by default (POP and IMAP Secure by default (POP and IMAP resources will not longer be created resources will not longer be created by default) by default)

What’s New?What’s New?Faster FailoverFaster Failover

Flattened dependency treeFlattened dependency tree

Exchange 2000Exchange 2000 Exchange 2003Exchange 2003

What’s New?What’s New?Faster failoverFaster failover

AntiAnti--affinity APIaffinity APIStrong antiStrong anti--affinity means that groups will be affinity means that groups will be kept apart if possiblekept apart if possibleFind available nodes faster than inFind available nodes faster than inWindows 2000Windows 2000

Quorum typesQuorum typesLocalLocalMajority Node SetMajority Node SetDisk Resource (traditional)Disk Resource (traditional)

What’s New?What’s New?File System Mount PointsFile System Mount Points

Relief from drive letter limitationRelief from drive letter limitation

What’s New?What’s New?Volume Shadow Copy ServiceVolume Shadow Copy Service(VSS) support(VSS) support

Windows Server 2003Windows Server 2003Supported snap/clone ofSupported snap/clone ofExchange DatabasesExchange DatabasesSupported by storage vendorsSupported by storage vendors

Active/Active and N+IActive/Active and N+IActive / ActiveActive / Active

All nodes can have an active virtual serverAll nodes can have an active virtual serverA single node can have multiple active A single node can have multiple active

virtual servers at the same timevirtual servers at the same timeSupported up to 2 nodes onlySupported up to 2 nodes onlyA single node cluster is considered A/AA single node cluster is considered A/A

N+IN+IAt least 1 free node at any timeAt least 1 free node at any timeNo more than 1 active virtual server per No more than 1 active virtual server per

node (enforced with 3 or more nodes) node (enforced with 3 or more nodes)

Exchange Server Exchange Server 2003 Virtual2003 VirtualServer CreationServer Creation

demodemo

Planning ClustersPlanning ClustersCluster HardwareCluster HardwareStorage PlanningStorage PlanningWindows 2003 infrastructureWindows 2003 infrastructureNaming ConventionsNaming ConventionsService AccountService Account

Cluster HardwareCluster HardwareEnsure HCL complianceEnsure HCL compliance

Servers, Storage, Servers, Storage, HBAsHBAs, Drivers, DriversOther high availability componentsOther high availability components

Redundant power supplies, flash ROM, Redundant power supplies, flash ROM, hot plug fanshot plug fansHot Plug PCIHot Plug PCIRedundant Redundant HBAsHBAs, , NICsNICs, SCSI controllers, SCSI controllersAdvanced memory protectionAdvanced memory protection

Hot add RAMHot add RAMAdvanced ECCAdvanced ECCOnline Spare MemoryOnline Spare Memory

Cluster HardwareCluster HardwareChoose standard configurationsChoose standard configurationsKeep cluster nodes at same patch levelKeep cluster nodes at same patch level

Service PacksService PacksHot FixesHot FixesSecurity UpdatesSecurity UpdatesDriver versionsDriver versions

Redundancy, RedundancyRedundancy, RedundancyRedundancy at all levels Redundancy at all levels PowerPowerNetwork Network HardwareHardwareAD AD –– Multiple GCs/Multiple GCs/DCsDCsDNS DNS –– Multiple DNS serversMultiple DNS serversBridgehead serversBridgehead servers

Storage PlanningStorage PlanningEstimate storage requirementsEstimate storage requirements#users? #quota required?#users? #quota required?Use HP Storage Planning CalculatorUse HP Storage Planning CalculatorNot to be taken lightly, especiallyNot to be taken lightly, especiallyin a clusterin a clusterUse consistent naming for foldersUse consistent naming for foldersand databasesand databases

Storage PlanningStorage Planning

T:T:\\exchsrvrexchsrvr\\SG1_MBDDataSG1_MBDData\\SG1Mailstore2.edbSG1Mailstore2.edbT:T:\\exchsrvrexchsrvr\\SG1_MBDDataSG1_MBDData\\SG1Mailstore2.stmSG1Mailstore2.stm

SG1 Mailstore2SG1 Mailstore2

T:T:\\exchsrvrexchsrvr\\SG1_MBDDataSG1_MBDData\\SG1Mailstore1.edbSG1Mailstore1.edbT:T:\\exchsrvrexchsrvr\\SG1_MBDDataSG1_MBDData\\SG1Mailstore1.stmSG1Mailstore1.stm

SG1 Mailstore1SG1 Mailstore1

T:T:\\exchsrvrexchsrvr\\SG1_MBDDataSG1_MBDDataDatabase folderDatabase folderS:S:\\exchsrvrexchsrvr\\SG1_TransLogsSG1_TransLogsSG1 Transaction LogsSG1 Transaction LogsR:R:\\exchsrvrexchsrvr\\mailrootmailrootSMTP SMTP MailrootMailrootR:R:\\exchsrvrexchsrvr\\MTADATAMTADATAMTA Work DirectoryMTA Work DirectoryR:R:\\exchsrvrexchsrvr\\MTADATAMTADATAMessage Transfer AgentMessage Transfer AgentD:D:\\exchsrvrexchsrvr\\binbinExchange BinariesExchange BinariesFolder NameFolder NameComponentComponent

Storage PlanningStorage PlanningDistribute components!Distribute components!Use Q for quorum driveUse Q for quorum driveDo not use Drive M:Do not use Drive M:\\ (hidden in Ex2003)(hidden in Ex2003)Use RAID 0+1 for databasesUse RAID 0+1 for databasesUse RAID 1 for transaction logsUse RAID 1 for transaction logsUse RAID 1 for SMTP drop area, Use RAID 1 for SMTP drop area, Tracking Logs, and MTA Tracking Logs, and MTA

Storage PlanningStorage PlanningMake sure the Make sure the System System Attendant is Attendant is dependent on dependent on all disk all disk resources for resources for that virtual that virtual server.server.

Windows InfrastructureWindows InfrastructureInfrastructure must understand Infrastructure must understand existence of Virtual Serversexistence of Virtual ServersCritical to success of any clusterCritical to success of any clusterRedundancy, Redundancy Redundancy, Redundancy Implement multiple DC’s/GCs in same Implement multiple DC’s/GCs in same site as clustersite as clusterImplement multiple DNS serversImplement multiple DNS servers

Node ConfigurationNode ConfigurationDeploy latest SP on each nodeDeploy latest SP on each nodeCorrect network configuration on cluster Correct network configuration on cluster NIC’sNIC’s

2 2 NICsNICsOne set for Private, one set for Public and PrivateOne set for Private, one set for Public and PrivateName your network connections Name your network connections Do not configure a default gateway, DNS or WINS Do not configure a default gateway, DNS or WINS on private on private NICsNICsUse Static IP addressesUse Static IP addressesRemove “Client for Microsoft Networks” and Remove “Client for Microsoft Networks” and “File and Printer Sharing” from private “File and Printer Sharing” from private NICsNICs

Node ConfigurationNode ConfigurationNIC NIC autodetectautodetect KB KB 174812 174812

Do not use Do not use AutodetectAutodetect. Set media . Set media type, duplex, speed & type, duplex, speed & flow control manually.flow control manually.

Set/Verify binding Set/Verify binding order on order on NICsNICs

Node ConfigurationNode ConfigurationSet staggered boot delays onSet staggered boot delays oneach nodeeach node/3gb modification /3gb modification /3gb /USERVA = 3030 for Windows /3gb /USERVA = 3030 for Windows Server 2003Server 2003IP addresses IP addresses

2 for each node 2 for each node –– Public & Private Public & Private NICsNICs1 for the cluster network name1 for the cluster network name1 for each Exchange Virtual Server1 for each Exchange Virtual Server

Naming ConventionsNaming Conventions

Service AccountService AccountUsed by Windows Cluster ServiceUsed by Windows Cluster ServiceDo not logon with this account Do not logon with this account unnecessarily unnecessarily Use one service account per clusterUse one service account per clusterUse a consistent naming scheme Use a consistent naming scheme Delegate permissions to the cluster Delegate permissions to the cluster account prior to installation account prior to installation (Exchange 2000)(Exchange 2000)

Other PracticesOther PracticesTest, Test, TestTest, Test, TestDocumentDocumentTrainTrainMonitorMonitorThird Party Products Third Party Products –– ensure cluster ensure cluster compatibilitycompatibilityDisaster RecoveryDisaster Recovery

SummarySummaryClusters are not for everyone, but with new Clusters are not for everyone, but with new versions of Windows and Exchange, you versions of Windows and Exchange, you may want to remay want to re--evaluate their use in your evaluate their use in your organization.organization.The additional complexity mustThe additional complexity mustbe understoodbe understoodProvide flexibility in administration Provide flexibility in administration Contribute to HA if operated properlyContribute to HA if operated properlyhttp://www.hp.com/solutions/activeanswershttp://www.hp.com/solutions/activeanswershttp://h18004.www1.hp.com/solutions/enterphttp://h18004.www1.hp.com/solutions/enterprise/highavailability/index.htmlrise/highavailability/index.html

Exchange Community ResourcesExchange Community Resources

Exchange Community Web PageExchange Community Web Pagehttp://www.microsoft.com/exchange/communityhttp://www.microsoft.com/exchange/community

Exchange NewsgroupsExchange Newsgroupshttp://www.microsoft.com/exchange/community/newsgroupshttp://www.microsoft.com/exchange/community/newsgroups

Attend A Free Chat Or WebcastAttend A Free Chat Or Webcasthttp://www.microsoft.com/exchange/community/webcasts.asphttp://www.microsoft.com/exchange/community/webcasts.aspSome recent Exchange Some recent Exchange webcastswebcasts still available for viewingstill available for viewing

Exchange 2003 Overview: Exchange 2003 Overview: http://www.microsoft.com/usa/Webcasts/http://www.microsoft.com/usa/Webcasts/ondemand/1589.aspondemand/1589.aspDecide between Exchange 2000 & Exchange 2003: Decide between Exchange 2000 & Exchange 2003: http://searchwin2000.techtarget.com/content/0,290959,http://searchwin2000.techtarget.com/content/0,290959,sid1_gci875523,00.htmlsid1_gci875523,00.html

Locate A Local User GroupLocate A Local User Grouphttp://microsoft.com/communities/usergroups/default.mspxhttp://microsoft.com/communities/usergroups/default.mspx

Suggested Reading And ResourcesThe tools you need to put technology to work!The tools you need to put technology to work!

Microsoft Press books are Microsoft Press books are 20%20% off at the off at the TechEdTechEd Bookstore Bookstore and also at the Ask the Experts area in the Expo Halland also at the Ask the Experts area in the Expo HallVisit Visit Amazon.comAmazon.com today to receive today to receive 40%40% off selected titlesoff selected titles

TITLETITLE AvailableAvailable PricePrice

Microsoft® Exchange Server 2003 Microsoft® Exchange Server 2003 Administrator's Companion: 0Administrator's Companion: 0--73567356--19791979--44 $59.99$59.999/24/039/24/03

Active Directory® for Active Directory® for Microsoft® Windows® Server Microsoft® Windows® Server 2003 Technical Reference: 02003 Technical Reference: 0--73567356--15771577--22

TodayToday $49.99$49.99

©© 2003 Microsoft Corporation. All rights reserved.2003 Microsoft Corporation. All rights reserved.This presentation is for informational purposes only. MICROSOFT This presentation is for informational purposes only. MICROSOFT MAKES NO WARRANTIES, EXPRESS OR IMPLIED, IN THIS SUMMARY.MAKES NO WARRANTIES, EXPRESS OR IMPLIED, IN THIS SUMMARY.