A SQL Server Blog

SSIS Best Practices - Performance

We've been slowly creating a list of best practices. Simon asked me about these at the PDC a couple of weeks back. It's time to share them out not just to make folks aware of them but also to solicit other goodness you'd like us to include in the official list.

First off, Performance:  

  1. [Oledb Source, Lookup, Fuzzy Lookup]: Remove columns which’re not used downstream. 
  2. [Oledb Source, Lookup, Fuzzy Lookup]: Use a select statement when fetching data from a view instead of using the table drop down.
  3. [OLEDB Command Destination]: for large number of rows, this component might not scale because it sends one SQL statement per row. Persist data to a temporary table and use set based SQL.
  4. [SCD]: for large number of rows that will not exist in the dimension table, consider using a lookup before the SCD.
  5. [OLE DB Destination]: if the server is local, consider using SQL Server destination.
  6. [Flat file source]: turn on fast parse for columns that have types that fast parse understands. Look at BOL for more info on Fast Parse. 
  7. [Conditional Split]: For transforms that use conditions based on columns coming straight from OLEDB or ADO.Net sources, consider using the native filtering from the relational database to remove rows before they come in to the pipeline.
  8. [Flat file Source]: For transforms that have all columns with the default column type and size, consider using the ‘Suggest Type’ functionality.
  9. [OLEDB Destination]: Review the fast load settings on the destination adapter.
  10. [SQL Server]: for OLEDB Destinations/SQL Server Destinations that perform bulk insert into a database, verify that the logging mode is appropriate for performance. Refer to BOL for more info.

 

Published Tuesday, September 27, 2005 1:44 PM by ashvinis

Comments

 

ybhalerao said:

Hi Ashvini,

Did you get to build this SSIS Best Practices? If yes, where do I get it from

Thanks
Yogesh
September 5, 2006 11:34 AM
 

roy ashbrook said:

I’m wanting to compile a basic best practices list for SSIS. I don’t really need to get into

May 4, 2007 9:39 PM
 

Best practices | keyongtech said:

January 21, 2009 8:15 PM
 

drowned in code said:

Beberapa waktu yang lalu saya melakukan kesalahan besar dengan project SSIS yang saya kerjakan. Yang

March 19, 2009 12:22 AM
Anonymous comments are disabled

© 2009 Microsoft Corporation. All rights reserved. Terms of Use  |  Trademarks  |  Privacy Statement
Microsoft
Page view tracker