Information Services

Request for Proposal for Data Center Virtualization
RFP#: KCIS 12-1

The purpose of this sealed Request for Proposal is to invite prospective vendors to submit a bid to supply a data center virtualization solution to Kittitas County, Washington. This RFP provides vendors with the relevant operational, performance, application, and architectural requirements for successful responses.

Request for Proposal for Data Center Virtualization, RFP#: KCIS 12-1

Key events and dates (RFP section 1.5)

  • Issuance of RFP 8 February 2012
  • Questions/inquiries/errors/omissions due 17 February 2012 5:00 pm
  • Questions/answers/addenda posted by 21 February 2012 Noon
  • RFP due 27 February 2012, 5:00 pm The due date has been extended to 5 March 2012, 5:00 pm
  • RFP opening 28 February 2012, 8:00 am The opening date has been extended to 6 March 2012, 8:00 am
  • RFP must be valid through 30 June 2012

Questions/answers/addenda (RFP section 1.6)

Inquiries, questions, and requests for clarification are to be directed via email to ISdatacenterRFP@co.kittitas.wa.us as described in RFP KCIS 12-1 Section 1.6 Communication.

Submitted questions are answered below:

1.8 Qualified Bidders
Q: Would Kittitas County consider selecting parts of solutions from different vendors, or must the entire solution come from one vendor?
A: Yes, KC will consider selecting parts of solutions from different vendors; however, we wish to maintain a single source of contact for support through the life of the project, so we ask that if different vendors are involved, a "consortium" be established with one vendor as "prime" - described in Section 1.8.

"Any single firm (sole proprietorship, partner, corporation, or other legal entity) is welcome to participate.

A consortium of companies duly backed up by an Agreement (to be submitted along with Qualification bid) is also eligible to participate subject to the following two conditions and satisfaction of the RFP Evaluation Committee during the evaluation of the RFP.

• The prime bidder (the member nominated as the prime bidder by the other consortium members) of this consortium shall be liable for adherence to all provisions of this Agreement.
• The Technical Bid shall include exact details as to how companies in the consortium will be used throughout the project.
"
4.1 Design

"We are currently using 35TB of data that will be migrated to the new SANs. This array will be in use for at least 7 years."

Q: Does "using" refer to consumed hard drive space or configured/partitioned space? If it is the latter, can you specify the total consumed space?
A: Consumed hard drive space. "Using" is measured by the figure "Used Space" in the "properties" of each disk drive. It includes operating systems, applications, data, and OS designated areas such as virtual memory / "page files".
Q: Is this requirement for raw or usable space?
A: Space currently in use, neither raw nor usable.
Q: If usable how does KC intend to configure volumes (RAID type)?
A: This is more an issue for the "data protection" portion of the solution. Existing DAS storage has been configured some as stand alone HDDs, some as RAIDs with various levels of RAID protection. The successful vendor will propose a virtualized storage solution and a data protection scheme that may take advantage of RAID protection, of snapshots, of backups - any or all. This will replace all of our current storage of whatever configuration.
Q: Of the 35TB listed above is there any storage that is allocated to backup as a backup-to-disk target perhaps?
A: The disk space used on our backup server Fangorn is NOT included in this 35TB figure.
4.1.1 Scope of design - compute
"The successful solution will virtualize the existing physical servers and move virtual machines to new hosts with the capacity to move virtual machines and associated storage from one location to another, due to performance, power, or maintenance needs, without client disruption, automatically or at administrative option. The design will be applied to the KC data center only and will not be applied outside that facility."
Q: Does the "outside facility" refer to the offsite backup location?
A: Yes.
Q: Does "associated storage" mean moving VMs from one data store to another data store within the same storage appliance?
A: Yes. If the successful solution specifies two or more storage appliances it may also mean relocation to another local storage appliance.
"Proposed solution should be capable of handling the failure of one physical server by moving all affected VMs to another physical server and all affected storage locations without interruption of existing applications and services."
Q: Does "handling failures" include failing over to a local secondary storage appliance?
A: If the successful solution specifies two or more storage appliances it may also mean relocation to another local storage appliance.
Q: Does "handling failures" include failing over to a secondary datacenter?
A: No. KC currently has an archive capacity housed in the county 911 data center located approximately 3 miles away from the county courthouse, attached to the county data center via a 1Gb/s fiber connection. The scope of this RFP includes only the data center within the county courthouse. If a vendor wishes to include the county 911 location within their solution, this may be proposed. There is very little available space in that remote location.
Q: Please confirm that the only two sites are the main data center and the DR location 3 miles away.
A: "The design will be applied to the KC data center (in the courthouse basement) only and will not be applied outside that facility."

"The proposed solution should possess sufficient reserve resources (processor, storage, and I/O) to handle current system demand, anticipated growth, and failover functions."

Q: What is the historic rate of growth for your server environment?
A: Over the past four years KC has added only two applications each requiring 2 servers. All other servers have been repurposed from surplus or virtual machines created for IS testing.

Application growth has been low by commercial standards but also non-linear and for many reasons we cannot accurately predict future resource requirements. While desiring some room for growth it is our intent to acquire resources to meet future demands as they occur.

Growth estimates for 7 years

Q: What are the expected growth rates for application and storage growth?
A: An estimated figure for application growth in recent years is 7%, for storage growth it is estimated at 10%. It is our belief that if we start with 35-40TB of storage capacity, the benefits of compression and de-duplication will handle anticipated storage growth in the first four years of this project. We estimate additional storage capacity will be added at the start of the fifth year. This expansion should be easy to accomplish but is otherwise not a part of this RFP.

Server environment capability

Q: What are anticipated growth rates for server usage?
A: KC will surplus most of its current physical servers as this virtualization project begins. We will retain three or four physical servers for testing, failover and unanticipated server growth.

Physical hosts in the successful solution should have the capacity to receive VMs from another failed physical host (N+1). This should be the case at the end of the five year project. Server capacity between the fifth and seventh year of use will have to be accommodated by capacity expansion funded in those years.

Active Directory domain controller

Q: Does KC expect server and software to be included in response?
A: When the P-to-V conversion is complete, we expect to have one physical domain controller and one virtual domain controller. One of our existing physical domain controllers will remain untouched, the other will be housed within a new physical host as a VM. Operating system lincenses and configurations from the P-to-V domain controller will transfer without additional requirements from the successful vendor.

Vendor to provide necessary software components

Q: Please provide a detailed list of KC's expectations in this area, both quantity and version. For example, VMware is required. Does KC have a preference on which version of VMware is provided? If Microsoft Windows Server licenses are required, how many server/instances are required and how many CALs.
A: It is our expectation that the successful vendor solution will propose necessary hardware and software as we respect your engineering capabilities and operational experience. We have specifically NOT stipulated a required hypervisor. If our objectives can be met using some other hypervisor than VMware, associated costs suggest you make that a part of your proposed solution. As each currently available hypervisor includes different native capabilities, each will require a different set of management, monitoring, reporting and configuration complements.

If VMware is a part of the proposed solution, we anticipate it will be ESXi 5.x. The level of VMware must be recommended by the vendor, although we have examined and like the Enterprise version very much. Hypervisor licensing should be a part of the successful solution.

We currently own six copies of Microsoft Windows Server 2008 R2 datacenter edition. Microsoft tells us these licenses will transfer to the new physical hosts and provide unlimited licensing for VMs in each physical host. We believe the same applies to other Microsoft licenses such as Exchange, SQL server and CALs. It is not expected that the successful vendor will have to supply server operating systems, applications licenses, or CALs.
4.1.2 Scope of design - storage (2.4 Storage; 8.5 Available equipment )

"Convert existing DAS (direct attached storage) and one IBM SAN to a single, tiered, virtualized storage system with hot? swap capacity to assure continual storage function in the event of the loss of two physical drives. The existing DS?3300 IBM SAN will not be a part of the virtualized environment."

"We have a mixture of DAS, an enterprise class IBM DS-3300, and two Cybernetic miSANs." "The existing DS-3300 IBM SAN will not be a part of the virtualized environment."

Q: What SANs will be available for repurposing? How much configurable space is available with each system?
A: Section 8.4 reads:
• "IBM DS-3300 iSCSI SAN with 2 controllers, 2 RAID 5 arrays and 4 logical drives (24 SAS drives and 2 hot spares) with a total capacity of 6.7 TB providing storage to six physical host servers housing 30 Virtual Machines under Hyper-V.
• Backup server (Fangorn) has 24 TB of attached RAID storage and a Cybernetics iSCSI miSAN with 16 TB (raw) / 9 TB configured as RAID 5.
• Video server (Denethor) has a Cybernetics iSCSI miSAN with 16 TB (raw) / 10 TB configured as RAID 5."


The IBM DS-3300 iSCSI SAN (6.8TB usable capacity - SAS 15k spindle speed - 1Gb/s controllers) provides storage for six Dell PE 2950 physical servers (hosting 30 VMs under Hyper-V). While this can be made available for repurposing, it is not required. The successful proposal will not be negatively viewed if this device is not included.

The county also currently uses two Cybernetics iSCSI miSANs each with 16TB of SAS drives (configured with 9TB usable - 1 Gb/s controllers). One of these (attached to Denethor) is not available for repurposing. The other (attached to Fangorn - our DtoD backup server) may be repurposed. It is our thought that current data protection/backup requires this capacity but vendors may propose another use while also proposing a sound backup solution.

Desire for 2 tiered solution for performance and capacity

Q: What are usable storage requirements for each tier?
A: We anticipate the successful vendor will engineer a solution that will adequately provide for the storage requirement of our existing servers/applications found in the RFP spreadsheet. As some tiered solutions are automated, some configured for demand-driven tiering, some based on access-dates, and others require manual data classification, we cannot specify requirements without unnecessarily restricting vendor recommendations.

We currently make use of MS SQL databases, ESRI-based GIS applications, and use MS Exchange 2007, each of which make significant demands upon any storage solution. We anticipate upgrading Exchange to 2010 either just before or soon after virtualization. These applications and associated data storage demands may be candidates for an upper tier of disk performance.

It appears to us now that 35-40TB of Tier 2 and 6-8TB of Tier 1 storage will be an acceptable place to start our conversation.

It has been suggested that the RFP spreadsheet does not make a good case for tiered storage. We will entertain a discussion of performance requirements based upon the VMware capacity planning application results listed there. We also ran Dell's Dpack traffic analysis which returned higher traffic numbers than VMware.
4.1.3 Scope of design - power
Q: What types of plugs are required for the PDUs?
A:The successful solution will utilize the existing (nearly 5 year old) APC 16kva UPS which has:
Symetra LX APC Model SYAF16KRMT
Communications Card Cabinet Model SYBFXR3RM
Extended Run Communications Card Cabinet SYAFSV16

The Symetra includes an integral power module; there are 4 additional power modules (XR frames) with batteries. Each has:
2 plugs model L520 (110/120v 20 amp)
1 plug model L1430 (120/208/240 v 30 amp)

We currently use 8 metered rack PDUs (using 110 volts).
4.1.4 Scope of design - data protection, backup and DR

"The successful design will provide for the automated movement of a failing server to another physical host, the capacity of the system to lose an entire physical host with the resulting load being picked up by associated physical servers without perceived loss of service to the end users, and the automated reduction of power or relocation of unused or underused servers."

Q: Can loss of physical hosts include a short time where the virtual machine is automatically restarted on another node which includes boot time for that restarted VM?
A: Yes.
Q: How many of the 64 servers need to be protected for automated site failover? Can KCIS please identify those servers from the Excel spreadsheet so that CPU, Memory and IO can be calculated?
A: In the sentence "This data must be replicated off-site every 24 hours; the local (array) copies must be kept for seven (7) days and the remote copies for thirty (30) days, before being archived to tape," please strike out the words off-site. Site failover is not a part of this RFP.
Q: What Symantec Backup Exec components/add-ons, does KC have? For example, NDMP, AD, Exchange & SQL agents? Please include all software component details.
A: Symantec Backup Exec 2010 current license expires 25 June 2012, all items quantity 1 except where noted:

SYMC BACKUP EXEC 2010 SERVER WIN PER
SERVER RENEWAL ESSENTIAL 12 MONTHS
GOV BAND S

SYMC BACKUP EXEC 2010 OPTION LIBRARY
EXPANSION WIN PER DEVICE RENEWAL
ESSENTIAL 12 MONTHS GOV BAND S

SYMC BACKUP EXEC 2010 OPTION
DEDUPLICATION WIN PER SERVER RENEWAL
ESSENTIAL 12 MONTHS GOV BAND S

SYMC BACKUP EXEC 2010 AGENT FOR
WINDOWS SYSTEMS WIN PER SERVER
RENEWAL ESSENTIAL 12 MONTHS GOV BAND
S - Quantity 23

SYMC BACKUP EXEC 2010 AGENT FOR
ORACLE WIN PER SERVER RENEWAL
ESSENTIAL 12 MONTHS GOV BAND S – Quantity 3

SYMC BACKUP EXEC 2010 AGENT FOR MSFT
ACTIVE DIRECTORY WIN PER DOMAIN
CONTROLLER RENEWAL ESSENTIAL 12
MONTHS GOV BAND S

SYMC BACKUP EXEC 2010 AGENT FOR MSFT
EXCHANGE WIN PER SERVER RENEWAL
ESSENTIAL 12 MONTHS GOV BAND S

SYMC BACKUP EXEC 2010 AGENT FOR MSFT
SQL WIN PER SERVER RENEWAL ESSENTIAL
12 MONTHS GOV BAND S
Q: Please explain how the Qwest and Barracuda datasets are currently protected (backup, archived) and their associated retention policy.
A: The Quest ArchiveManager application resides on our (VMs on Medwed) servers Cotton (app) and Galadriel (SQL). The Barracuda Message Archiver appliance is a recent purchase and is not yet installed in the network.

Quest ArchiveManager is backed up to disk by Fangorn via Symantec BackUp Exec. Presently the content of ArchiveManager is not set for deletion. Retention of backup copies on Fangorn follow county policy (mentioned in Section 3.3 of the RFP) of backups for:
• "Each of the most recent 5 business days,
• One day each week for the most recent calendar month,
• One day each month for the last 12 months"

Exchange server retention

Q: Is it required to keep 42 point-in-time recovery points of Exchange locally, .e.g. (4 hr * 6 per day) * 7 days?
A: No. We intend to keep point-in-time snapshots taken each four hours for the current and previous day (12 snapshots), other snapshots will follow county backup retention policy stated in the previous paragraph. It is our intent to protect email data in the same fashion as all other county data except for the four-hour-snapshots referenced here.
Q: Is it required to keep 180 point-in-time backups for the Exchange server remotely?
A: No. All backups will be accomplished locally on Fangorn. Archival copies may be kept on Isengard at the remote site - but those are not a part of this RFP. That location has a Dell PE 2850 server (Isengard) and two tape juke boxes. Neither the archival function nor the off-site 911 data center is a part of this RFP, although the equipment resources may be available for repurposing.

Data protection resources

Q: Would you confirm that the only existing hardware available for backup is a Dell R710 server, Fangorn, with 64GB of RAM, a Dell PowerVault 24TB RAID, and a Cybernetics iSCSI miSAN (16TB native, 9TB as configured) as a backup server, as well as the Tape library LTO4.
A: The tape library is controlled by a Dell PE 2850 (Isengard) with a Dell PV-132T tape device (23 slots) and an IBM 3573-TL tape device (43 slots). These use LTO Ultrium 4 tapes (800GB native/1600GB compressed). These (Fangorn, RAID, Cybernetics miSAN, Isengard, Dell tape device and IBM tape device) are the only existing data protection hardware resources we can make available.

SQL and Active Directory

Q: Is there a backup requirement for Active Directory System State backups for authoritative restores?
A: Although it is highly desirable, there is no requirement in this RFP for "Active Directory System State backups for authoritative restores".
Q: Is the native Windows Backup application sufficient to back up KC's AD system state for restore?
A: Yes, the native Windows Backup application is sufficient for AD system state restoration.
4.5 Support - warranties

Level of support

Q: a. 9x5 Next Business Day?
b. 24x7 Next Business Day?
c. 24x7, 4 hour?
A: Because of the location of the data center and its proximity to sources of support, we expect to reply upon telephone support from the vendor and manufacturers 24x7. 9x5 Next Business Day is acceptable for parts unless we are willing to send someone to a parts depot, dependent upon weather over Washington mountain passes.

The RFP states "Bidders will clearly indicate the level, time window, duration and support detail for hardware, software, and system management/configuration tools." We anticipate the successful solution will factor cost and geography into their proposals.

Performance

Q: Please clarify existing performance baseline?
A: No single baseline exists. We currently engage support at different levels depending upon the mission-critical status of the device/application.

 

4.8 Roles and responsibilities
Q: What are the roles that KC expects to take on? What are the roles that KC expect the vendor to take on?
A: We expect the vendor to engineer the successful proposal, negotiate product delivery and support, deliver the hardware/software/expertise, install the system, partner with KC in configuring the system to be functional, instruct the KCIS staff in the systems' specifications and operation, advise, consult and support the system during the life of the project (60 months).

We expect to select a proposal, negotiate expectations, cooperate in the delivery and installation of the system, provide configuration requirements, provide connectivity to user network, learn to manage the system, and take over day-to-day operational control.

Critical to our partnership KC will maintain a continual exchange of ideas and cooperate with the vendor in specifics to be negotiated as the basis of a contract. We expect the vendor to fully participate in the determination of those respective roles and responsibilities.
5. Budget and estimated pricing

"It is anticipated that some form of time payment or lease agreement will be negotiated totaling not more than $250,000 for the entire scope of the project."

Q: Is KC seeking a Leasing Company Solution as part of this project, or has the leasing provider already been identified?
A: No leasing arrangements have been made yet. It is anticipated that the successful vendor may wish to make these arrangement. If not, the county can use leasing sources available to state and county governments.
8.5 Available equipment

Cisco 3750 G core switch stack
• 1 fiber switch, 12 port
• 6 copper, 48 port

Q: How many ports are available from the 3750Gs in each switch for hypervisor, SAN and backup interconnectivity?
A: The existing Cisco 3750G switches are currently providing ports for 35 physical servers (most with multiple NICs) as well as ports for direct connection to many desktops in the county courthouse. It is our intent to rebuild that core switch stack prior to virtualization so that the desktops connect to a distribution or access switch layer rather than to the core switch stack. Since all existing physical servers (except 2) will be removed when the successful solution is implemented, there should be many more ports available than necessary to provide 1Gb/s connectivity to the new servers and SAN(s) if the successful vendors elects to use 1Gb/s connectivity.
8.6 Existing network

Network diagram

Q: Where is the other datacenter?
A: KC has a small amount of rack space in the county 911 center (KITTCOM), approximately 3 miles distant, for off-site backups.
Q: How many "U's" are available in cabinet/racks at the remote site?
A: We currently occupy 10 "Us". If we move Isengard and the two tape juke boxes back to the courthouse, that would free those up. The 911 datacenter is managed by a subsidiary of the county which is willing to cooperate with KCIS in additional space and power requirements.
Q: Is there power available for extra equipment, if so how many circuits/receptacles at the remote site?
A: Circuits and receptacles at the remote site are dependent upon reconfiguration of that data center. Absolute power availability unknown at this time.
Q: Is there 1Gb switch connectivity available at the remote site and how many ports are available?
A: Yes. 12 ports.

Names of bidders (RFP section 6.5.1)

The following is an alphabetical list of bidders who responded to the RFP due date:

General Microsystems
320 118th AVE SE
Bellevue WA 98005

IVOXY Consulting
5400 Carillon Point
Kirkland WA 98033

Strategic Hardware LLC
815 West 7th Avenue Suite 107
Spokane WA 99204