Wednesday, April 16, 2008

Build a Metadata-Driven ETL Platform by Extending Microsoft SQL Server Integration Services

SQL 2008 Metadata-Driven ETL Whitepaper.

Platform Architecture

The design goals of the platform include improving the productivity of developers, enforcing ETL standards, supporting a cost-effective way to deploy large data warehouses on commodity hardware, and providing a centralize metadata repository for lineage tracking. The solution architecture of the platform is shown in Figure 1. The intent of this paper is not to document all the implementation details. Rather, it describes the concepts and key components of the platform and how they are connected with SQL Server Integration Services. For a more detailed architecture diagram, see Figure 6 at the end of this paper.

ETLExtendSSISFig1.gif

Build a Metadata-Driven ETL Platform by Extending Microsoft SQL Server Integration Services

No comments: