Welcome to MSDN Blogs Sign in | Join | Help

November 2008 - Posts

Tuesday, November 25, 2008 4:39 PM

Resources for Upgrading to SQL Server 2008

A new books online entry has been posted which contains links for various upgrade resources. They were posted to coincide with the release of the massive SQL Server 2008 Upgrade Technical Reference Guide white paper, which should contain everything you
Posted by mmasson | 0 Comments
Tuesday, November 25, 2008 9:41 AM

Processing late arriving facts in SSIS

This is just a place holder. Please see the post on different approaches of doing Range Lookups in SSIS .
Posted by mmasson | 1 Comments
Tuesday, November 25, 2008 9:30 AM

Lookup Pattern: Range Lookups

Performing range lookups (i.e. to find a key for a given range) is a common ETL operation in data warehousing scenarios. It's especially for historical loads and late arriving fact situations, where you're using type 2 dimensions and you need to locate
Posted by mmasson | 11 Comments
Filed under:
Sunday, November 23, 2008 12:16 PM

Lookup Pattern: Incremental persistent cache updates

The Cache Transform isn't currently able to update (i.e. append to) an existing persistent cache file. This pattern presents a way to incrementally build up your lookup cache if your data flow process is responsible for adding new rows to your reference
Posted by mmasson | 2 Comments
Filed under:
Sunday, November 23, 2008 9:53 AM

Lookup Pattern: Case Insensitive

The Lookup Transform does case sensitive string comparisons. This means that you need to a little bit of special handling to get it to work in a case insensitive way. In most cases (and especially if you're using a case sensitive collation on the database/table
Posted by mmasson | 2 Comments
Filed under:
Saturday, November 22, 2008 8:46 PM

Lookup Pattern: Cascading

The cascading lookup pattern uses two lookup transforms with different cache modes . A common use of this pattern is when your data flow is inserting new rows into your reference table. The first lookup in the chain is set to Full cache mode. Since it
Posted by mmasson | 2 Comments
Filed under:
Saturday, November 22, 2008 8:31 PM

Lookup Pattern: Upsert

This is a pretty basic pattern where we use a lookup to determine whether we need to update and existing row, or insert a new one. The lookup checks if a key or set of values exists. If the key isn't found, the row is sent to an OLEDB Destination for
Posted by mmasson | 2 Comments
Filed under:
Saturday, November 22, 2008 8:28 PM

Lookup Pattern: Key Generation

This pattern is used when you have transformation logic which relies on a key which might not already exist. If the lookup fails to find the key, a new key is generated with a script task so it can be used later on downstream. Optionally, the key could
Posted by mmasson | 4 Comments
Filed under:
Saturday, November 22, 2008 8:28 PM

Lookup Patterns

From the Lookup presentation I put together for the MS BI conference in October, here is a series of posts which describe different patterns for using the Lookup transform. Key Generation Upsert Cascading Case Insensitive Incremental Cache Update Range
Posted by mmasson | 1 Comments
Filed under:
Saturday, November 22, 2008 7:51 PM

Lookup - Using the cache connection manager

Using the Cache Connection Manager (CCM) is a new option for the Lookup transform in SSIS 2008. The CCM provides an alternative to doing lookups against a database table using an OLEDB connection. This post will suggest some best practices for using the
Posted by mmasson | 3 Comments
Filed under:
Wednesday, November 12, 2008 5:05 PM

Performance profiling your custom extensions

The Team Development Edition and Team Suite versions of Visual Studio 2008 comes with a performance profiling feature that can used to find bottlenecks in your custom extensions (tasks, data flow components, etc) for SSIS. Although having your extension
Posted by mmasson | 1 Comments
Filed under: ,
 
Page view tracker