SSIS Team Blog

Helpful information and examples on how to use SQL Server Integration Services.

Blog - About

About this blog

A blog about SQL Server Integration Services (SSIS) from a developer on the team.

  • SSIS Team Blog

    New connectivity white papers

    • 1 Comments
    Two new SSIS connectivity white papers have been published on MSDN. Connectivity Options for Microsoft SQL Server 2008 Integration Services by Martin Ellis This paper talks about the various connectivity options that SSIS supports, as well as the new...
  • SSIS Team Blog

    Resources for Upgrading to SQL Server 2008

    • 0 Comments
    A new books online entry has been posted which contains links for various upgrade resources. They were posted to coincide with the release of the massive SQL Server 2008 Upgrade Technical Reference Guide white paper, which should contain everything you...
  • SSIS Team Blog

    Processing late arriving facts in SSIS

    • 1 Comments
    This is just a place holder. Please see the post on different approaches of doing Range Lookups in SSIS .
  • SSIS Team Blog

    Lookup Pattern: Range Lookups

    • 31 Comments
    Performing range lookups (i.e. to find a key for a given range) is a common ETL operation in data warehousing scenarios. It's especially for historical loads and late arriving fact situations, where you're using type 2 dimensions and you need to locate...
  • SSIS Team Blog

    Lookup Pattern: Incremental persistent cache updates

    • 3 Comments
    The Cache Transform isn't currently able to update (i.e. append to) an existing persistent cache file. This pattern presents a way to incrementally build up your lookup cache if your data flow process is responsible for adding new rows to your reference...
  • SSIS Team Blog

    Lookup Pattern: Case Insensitive

    • 2 Comments
    The Lookup Transform does case sensitive string comparisons. This means that you need to a little bit of special handling to get it to work in a case insensitive way. In most cases (and especially if you're using a case sensitive collation on the database...
  • SSIS Team Blog

    Lookup Pattern: Cascading

    • 2 Comments
    The cascading lookup pattern uses two lookup transforms with different cache modes . A common use of this pattern is when your data flow is inserting new rows into your reference table. The first lookup in the chain is set to Full cache mode. Since it...
  • SSIS Team Blog

    Lookup Pattern: Upsert

    • 4 Comments
    This is a pretty basic pattern where we use a lookup to determine whether we need to update and existing row, or insert a new one. The lookup checks if a key or set of values exists. If the key isn't found, the row is sent to an OLEDB Destination for...
  • SSIS Team Blog

    Lookup Pattern: Key Generation

    • 4 Comments
    This pattern is used when you have transformation logic which relies on a key which might not already exist. If the lookup fails to find the key, a new key is generated with a script task so it can be used later on downstream. Optionally, the key could...
  • SSIS Team Blog

    Lookup Patterns

    • 1 Comments
    From the Lookup presentation I put together for the MS BI conference in October, here is a series of posts which describe different patterns for using the Lookup transform. Key Generation Upsert Cascading Case Insensitive Incremental Cache Update Range...
  • SSIS Team Blog

    Lookup - Using the cache connection manager

    • 3 Comments
    Using the Cache Connection Manager (CCM) is a new option for the Lookup transform in SSIS 2008. The CCM provides an alternative to doing lookups against a database table using an OLEDB connection. This post will suggest some best practices for using...
  • SSIS Team Blog

    Performance profiling your custom extensions

    • 1 Comments
    The Team Development Edition and Team Suite versions of Visual Studio 2008 comes with a performance profiling feature that can used to find bottlenecks in your custom extensions (tasks, data flow components, etc) for SSIS. Although having your extension...
  • SSIS Team Blog

    SSWUG.org Business Intelligence Virtual Conference

    • 0 Comments
    The SSWUG.org virtual conference is less than a week away. If you haven't already registered, you can use this VIP code to get an additional discount off the admission price. VIP CODE: MMASVIP Incase you missed it, a preview of my Lookup session (as well...
  • SSIS Team Blog

    SQL Server 2005 SP3 beta now available

    • 2 Comments
    The SQL Server 2005 SP3 beta is now available for download . The service pack doesn't contain any new features for SSIS, but it does contain a number of bug fixes - a roll up of all of the cumulative updates since SP2, as well as some fixes that were...
  • SSIS Team Blog

    Calculating the size of your Lookup cache

    • 2 Comments
    Good news - a couple of Information log events where added to the Lookup Transform in SQL 2008 to help you better understand your lookup cache. When you're running in Full Cache mode , the message will tell you the number of rows in the cache, its total...
  • SSIS Team Blog

    Lookup cache modes

    • 12 Comments
    Over the past couple of months I've been putting together a presentation on the Lookup Transform. I presented most of it as a Chalk Talk at the MS BI Conference last week, and from the evaluation scores, it seems like it was pretty well received. I'll...
  • SSIS Team Blog

    Presenting at PASS

    • 0 Comments
    I’ll be co-presenting a session at PASS this year entitled Incremental data warehouse loads with MERGE and Change Data Capture . This will be my first PASS conference, and I’m really looking forward to it. The conference is November 18-21 in Seattle....
  • SSIS Team Blog

    SSWUG virtual conference interview

    • 1 Comments
    Chris Shaw has posted my answers to some interview questions he sent out to all of the speakers at the upcoming SSWUG Virtual Conference . I hope I don't get into trouble for any of them. I've mentioned the conference before , and I thought I'd take...
  • SSIS Team Blog

    Attunity connectors for Oracle and Teradata are now available

    • 14 Comments
    The high speed connectors for Oracle and Teradata are now available for download .   Supported versions Platforms Oracle 9.2.0.4 or higher x86, x64, ia64 Teradata 2R6.0, 2R6.1, 2R6.2 and 12.0 x86, x64 Attunity has done a great job putting these together...
  • SSIS Team Blog

    Presenting at the Microsoft BI Conference

    • 3 Comments
    On Monday (October 6th) I’ll be doing a chalk talk presentation at the MS BI Conference . The topic is Advanced Scenarios with the Lookup Transform . Here is the abstract: Performing lookups is one of the most common operations in the ETL process, and...
  • SSIS Team Blog

    Enum value for Lookup’s NoMatchBehavior property

    • 0 Comments
    The lookup transform has a new property in SQL 2008 which controls how to handle rows with no matches – NoMatchBehavior. It has two values - “Treat rows with no matching entries as errors” and “Send rows with no matching entries to the no match output...
  • SSIS Team Blog

    Accessing OLEDB Connection Managers in a Script

    • 14 Comments
    Accessing ADO.Net Connection Managers from an SSIS script task / script component is pretty easy – you just need to cast the object returned from AcquireConnection() to the appropriate class (i.e. SqlConnection if you’re using SQL Native Client). SqlConnection...
  • SSIS Team Blog

    Competitive Comparison of SQL Server 2008 Integration Services

    • 2 Comments
    Did you know about this white paper comparing SSIS to IBM Information Server (DataStage), Informatica PowerCenter, Oracle Warehouse Builder, and Oracle Data Integrator? I had heard rumors of its existence, but I hadn’t actually seen the links for it until...
  • SSIS Team Blog

    New SSIS community samples

    • 2 Comments
    Some new samples have been added to the SSIS community samples project on codeplex . Delimited Flat File Reader This data flow source component is capable of parsing delimited flat files, including files with rows that are missing columns. Package Generation...
  • SSIS Team Blog

    SQL Server 2008 RTM is Live

    • 2 Comments
    The RTM version of SQL Server 2008 is now available for MSDN and Technet subscribers. Hurray!
Page 7 of 10 (242 items) «56789»