CPU and RAM recommendations for our data warehouse

Tags:
RAM
SAN
SSIS Package
We run a DWH with 3 databases. The first DB, called Staging, is the "input buffer", copies the operational data, seven source systems, 12 parallel Extraction Jobs running SSIS packages. Mostly full refresh 40 GB data every night. Second DB is called catalog. Data is transformed using about 1,500 views and tables, 120 GB. Third is the Datamart database. 80 Facts and 120 Dimensions in 70 datamarts. 60 GB. We read and write about 160 million rows each night and this takes about 5:15 hours at the moment. We use 4 CPU's and 8 GB RAM 32-bit enterprise edition. Looking forward we decided to upgrade to a 64 bit environment. A no optimized test showed us a runtime of 4:15 without optimization. Now my question: I am searching for CPU and RAM recommendations or facts on how I can find the right sizing for these two components. Measures? Network and SAN is fixed and fast enough.

Answer Wiki

Thanks. We'll let you know when a new response is added.

A 64bit upgrade will definitely help. Pretty much as much RAM as you can afford is a good thing. RAM up to about 64 Gigs is pretty inexpensive. After that the price starts to go up a lot. How many cores does each CPU have? You’ll want at least 4 cores per CPU.

Discuss This Question: 1  Reply

 
There was an error processing your information. Please try again later.
Thanks. We'll let you know when a new response is added.
Send me notifications when members answer or reply to this question.

REGISTER or login:

Forgot Password?
By submitting you agree to receive email from TechTarget and its partners. If you reside outside of the United States, you consent to having your personal data transferred to and processed in the United States. Privacy
  • Schste0
    Hi Mrdenny, thx for the answer and your great articles and posts i have already red. They made my live easier :-) At the moment we have 2 core CPU.
    10 pointsBadges:
    report

Forgot Password

No problem! Submit your e-mail address below. We'll send you an e-mail containing your password.

Your password has been sent to:

To follow this tag...

There was an error processing your information. Please try again later.

REGISTER or login:

Forgot Password?
By submitting you agree to receive email from TechTarget and its partners. If you reside outside of the United States, you consent to having your personal data transferred to and processed in the United States. Privacy

Thanks! We'll email you when relevant content is added and updated.

Following