As the first step in the decommissioning of sasCommunity.org the site has been converted to read-only mode.


Here are some tips for How to share your SAS knowledge with your professional network.


Blistering ETL performance using the Intelligent, Dynamic and Parallel Capabilities of SAS

From sasCommunity
Jump to: navigation, search
Paper 119-2010
Blistering ETL Performance using the Intelligent, Dynamic and Parallel Capabilities of SAS®
David Logan, PBT Group, Johannesburg, South Africa

Abstract

ETL from billion-record+ databases is a non-trivial task. By using the unique capabilities of SAS® to analyze the database in advance and then dynamically generating parallel SAS® jobs based on this interrogation, SAS® can effectively performance-tune itself each run for maximum benefit. Get in, get out, get the results. The net effect is to get the fastest possible results with the minimum window of ETL load on the source system. Scalable, efficient, and easy to develop. An added benefit is the data visualization possible post-analysis and pre-ETL to aid data quality checks.

Online Materials

View the pdf for File:Paper 119 2010 david logan.pdf

PowerPoint Presentation Pending

Contact Info

David Logan PBT Group