Blog - Title

  • SSIS Team Blog

    Lookup Pattern: Range Lookups

    • 27 Comments
    Performing range lookups (i.e. to find a key for a given range) is a common ETL operation in data warehousing scenarios. It's especially for historical loads and late arriving fact situations, where you're using type 2 dimensions and you need to locate...
  • SSIS Team Blog

    Lookup Pattern: Incremental persistent cache updates

    • 3 Comments
    The Cache Transform isn't currently able to update (i.e. append to) an existing persistent cache file. This pattern presents a way to incrementally build up your lookup cache if your data flow process is responsible for adding new rows to your reference...
  • SSIS Team Blog

    Lookup Pattern: Case Insensitive

    • 2 Comments
    The Lookup Transform does case sensitive string comparisons. This means that you need to a little bit of special handling to get it to work in a case insensitive way. In most cases (and especially if you're using a case sensitive collation on the database...
  • SSIS Team Blog

    Lookup Pattern: Cascading

    • 2 Comments
    The cascading lookup pattern uses two lookup transforms with different cache modes . A common use of this pattern is when your data flow is inserting new rows into your reference table. The first lookup in the chain is set to Full cache mode. Since it...
  • SSIS Team Blog

    Lookup Pattern: Upsert

    • 4 Comments
    This is a pretty basic pattern where we use a lookup to determine whether we need to update and existing row, or insert a new one. The lookup checks if a key or set of values exists. If the key isn't found, the row is sent to an OLEDB Destination for...
  • SSIS Team Blog

    Lookup Pattern: Key Generation

    • 4 Comments
    This pattern is used when you have transformation logic which relies on a key which might not already exist. If the lookup fails to find the key, a new key is generated with a script task so it can be used later on downstream. Optionally, the key could...
  • SSIS Team Blog

    Lookup Patterns

    • 1 Comments
    From the Lookup presentation I put together for the MS BI conference in October, here is a series of posts which describe different patterns for using the Lookup transform. Key Generation Upsert Cascading Case Insensitive Incremental Cache Update Range...
  • SSIS Team Blog

    Lookup - Using the cache connection manager

    • 3 Comments
    Using the Cache Connection Manager (CCM) is a new option for the Lookup transform in SSIS 2008. The CCM provides an alternative to doing lookups against a database table using an OLEDB connection. This post will suggest some best practices for using...
  • SSIS Team Blog

    Performance profiling your custom extensions

    • 1 Comments
    The Team Development Edition and Team Suite versions of Visual Studio 2008 comes with a performance profiling feature that can used to find bottlenecks in your custom extensions (tasks, data flow components, etc) for SSIS. Although having your extension...
  • SSIS Team Blog

    SSWUG.org Business Intelligence Virtual Conference

    • 0 Comments
    The SSWUG.org virtual conference is less than a week away. If you haven't already registered, you can use this VIP code to get an additional discount off the admission price. VIP CODE: MMASVIP Incase you missed it, a preview of my Lookup session (as well...
  • SSIS Team Blog

    SQL Server 2005 SP3 beta now available

    • 2 Comments
    The SQL Server 2005 SP3 beta is now available for download . The service pack doesn't contain any new features for SSIS, but it does contain a number of bug fixes - a roll up of all of the cumulative updates since SP2, as well as some fixes that were...
  • SSIS Team Blog

    Calculating the size of your Lookup cache

    • 2 Comments
    Good news - a couple of Information log events where added to the Lookup Transform in SQL 2008 to help you better understand your lookup cache. When you're running in Full Cache mode , the message will tell you the number of rows in the cache, its total...
  • SSIS Team Blog

    Lookup cache modes

    • 11 Comments
    Over the past couple of months I've been putting together a presentation on the Lookup Transform. I presented most of it as a Chalk Talk at the MS BI Conference last week, and from the evaluation scores, it seems like it was pretty well received. I'll...
  • SSIS Team Blog

    Presenting at PASS

    • 0 Comments
    I’ll be co-presenting a session at PASS this year entitled Incremental data warehouse loads with MERGE and Change Data Capture . This will be my first PASS conference, and I’m really looking forward to it. The conference is November 18-21 in Seattle....
  • SSIS Team Blog

    SSWUG virtual conference interview

    • 1 Comments
    Chris Shaw has posted my answers to some interview questions he sent out to all of the speakers at the upcoming SSWUG Virtual Conference . I hope I don't get into trouble for any of them. I've mentioned the conference before , and I thought I'd take...
  • SSIS Team Blog

    Attunity connectors for Oracle and Teradata are now available

    • 14 Comments
    The high speed connectors for Oracle and Teradata are now available for download .   Supported versions Platforms Oracle 9.2.0.4 or higher x86, x64, ia64 Teradata 2R6.0, 2R6.1, 2R6.2 and 12.0 x86, x64 Attunity has done a great job putting these together...
  • SSIS Team Blog

    Presenting at the Microsoft BI Conference

    • 3 Comments
    On Monday (October 6th) I’ll be doing a chalk talk presentation at the MS BI Conference . The topic is Advanced Scenarios with the Lookup Transform . Here is the abstract: Performing lookups is one of the most common operations in the ETL process, and...
  • SSIS Team Blog

    Enum value for Lookup’s NoMatchBehavior property

    • 0 Comments
    The lookup transform has a new property in SQL 2008 which controls how to handle rows with no matches – NoMatchBehavior. It has two values - “Treat rows with no matching entries as errors” and “Send rows with no matching entries to the no match output...
  • SSIS Team Blog

    Accessing OLEDB Connection Managers in a Script

    • 13 Comments
    Accessing ADO.Net Connection Managers from an SSIS script task / script component is pretty easy – you just need to cast the object returned from AcquireConnection() to the appropriate class (i.e. SqlConnection if you’re using SQL Native Client). SqlConnection...
  • SSIS Team Blog

    Competitive Comparison of SQL Server 2008 Integration Services

    • 2 Comments
    Did you know about this white paper comparing SSIS to IBM Information Server (DataStage), Informatica PowerCenter, Oracle Warehouse Builder, and Oracle Data Integrator? I had heard rumors of its existence, but I hadn’t actually seen the links for it until...
  • SSIS Team Blog

    New SSIS community samples

    • 2 Comments
    Some new samples have been added to the SSIS community samples project on codeplex . Delimited Flat File Reader This data flow source component is capable of parsing delimited flat files, including files with rows that are missing columns. Package Generation...
  • SSIS Team Blog

    SQL Server 2008 RTM is Live

    • 2 Comments
    The RTM version of SQL Server 2008 is now available for MSDN and Technet subscribers. Hurray!
  • SSIS Team Blog

    SSWUG Business Intelligence Virtual Conference

    • 1 Comments
    I’ve been invited to speak at the SSWUG BI Virtual Conference in September. Like John Welch mentioned in his blog, the current speaker lineup is very impressive. I’m honored (and a little intimidated) to be on the presenters list! I’ll be flying out to...
  • SSIS Team Blog

    Regular Expression Flat File Source

    • 5 Comments
    The RegEx flat file source is one of the new community samples for SQL Server 2008 we’ve published to Codeplex. It uses regular expressions to extract values from a text file. It works similar to the flat file source, except that it’s not limited to CSV...
  • SSIS Team Blog

    First two community samples for 2008 now on Codeplex

    • 1 Comments
    The Integration Services Community Samples project is now active on Codeplex. These samples are being created by the SSIS product team to supplement the content in books online, and the Product Samples for 2008 . They will (hopefully) provide useful functionality...
Page 7 of 10 (239 items) «56789»