Asmita's blog

Replication using custom mapping AND custom table create scripts for NON SQL subscriber - Applies to SQL server 2005 and 2008

2009-08-05T19:38:35Z

Replication using custom mapping AND custom table create scripts for NON SQL subscriber - Applies to SQL server 2005 and 2008

The purpose of this document is to demonstrate how SQL Server replication can be directed to use custom mapping while copying data to NON-SQL database.

This document requires the audience to know SQL server management. Replication and types of replication. It also requires you to SQL programming knowledge of DB2 database. That will be our example NON –SQL database.

Sample database:

In our example we will replicate two columns from Categories table of NorthWind database. Northwind database can be downloaded from http://www.microsoft.com/downloads/details.aspx?FamilyID=06616212-0356-46A0-8DA2-EEBC53A68034&displaylang=en

Original table definition for Categories table is like this:

Table create

USE [Northwind]

/****** Object: Table [dbo].[Categories] Script Date: 08/03/2009 11:05:36 ******/

SET ANSI_NULLS ON

SET QUOTED_IDENTIFIER ON

CREATE TABLE [dbo].[Categories](

[CategoryID] [int] IDENTITY(1,1) NOT FOR REPLICATION NOT NULL,

[CategoryName] [nvarchar](15) NOT NULL,

[Description] [ntext] NULL,

[Picture] [image] NULL,

CONSTRAINT [PK_Categories] PRIMARY KEY CLUSTERED

(

[CategoryID] ASC

)WITH (PAD_INDEX = OFF, STATISTICS_NORECOMPUTE = OFF, IGNORE_DUP_KEY = OFF, ALLOW_ROW_LOCKS = ON, ALLOW_PAGE_LOCKS = ON) ON [PRIMARY]

) ON [PRIMARY] TEXTIMAGE_ON [PRIMARY]

Create a Snapshot publication for Article Categories. Select only two columns from Categories as the columns to be replicated - those are CategoryID and Description. Create a NON-SQL subscriber using

Create a Snapshot publication and NON-SQL subscriber:

Following steps will guide you through creating simple snapshot publication. Note that the security method selected is not recommended one. Your organisation may need more strict security and please alter your publication accordingly.

Creating subscription:

DB2OLEDB provider connection string looks like this:

Provider=DB2OLEDB;User ID=XXXXXX;Password=******;Initial Catalog=YYYYYY;Network Transport Library=TCP;Host CCSID=37;PC Code Page=1252;Network Address=YYYYYY;Network Port=446;Package Collection=XXXXXX;Default Schema=XXXXXX;Process Binary as Character=True;Units of Work=RUW;DBMS Platform=DB2/AS400;Defer Prepare=False;Rowset Cache Size=0;Authentication=Server;Persist Security Info=True;Connection Pooling=True;Derive Parameters=False;

Determining supported mappings for your remote DBMS:

SQL server has a mappings table that keeps track of what all source data types can be mapped to what all destination data types on different DBMS platforms. For e.g. Following query retrieves all the mappings for DB2 as a destination dbms :

select * from msdb.dbo.sysdatatypemappings

where destination_dbms ='DB2'

And following query does find all the mappings for DB2 for source SQL data type = next:

select * from msdb.dbo.sysdatatypemappings

where source_type= 'ntext' AND destination_dbms ='DB2'

If desired custom mapping does not exist then use sp_adddatatypemapping to define one, something like in e.g. below:

--if above query does not return anything then add maping yourself using something like below

exec sp_adddatatypemapping

@source_dbms= 'MSSQLSERVER',

@destination_dbms='DB2', @source_type = 'ntext',

@destination_type='VARCHAR', @destination_length=32703

Setting the Article properties to use custom create TABLE script :

Once you verify or create required mapping, we need to tell replication as to how to use this mapping. SQL server allows this through stored procedure sp_changearticle.

More reference on sp_changearticle can be found at: http://msdn.microsoft.com/en-us/library/ms175980(SQL.90).aspx

--set the creation_script property of Article to point to custom Create Script

sp_changearticle @publication = SUBREPL,

@article = Categories,

@property = 'creation_script',

@value = "d:\TEMP\RFC4789\SUBREPL.sql",

@force_invalidate_snapshot = 1,

@force_reinit_subscription = 1

-- then change the Schema option.

DECLARE @option AS int;

SET @option = (SELECT CAST(0x00 AS int));

EXEC sp_changearticle @publication = SUBREPL,

@article = Categories,

@property = N'schema_option',

@value = @option,

@force_invalidate_snapshot = 1,

@force_reinit_subscription = 1

We have changed the Article properties by doing above two steps, now its time to discuss our e.g. Script SUBREPL.sql that creates the TABLE. Since we want this Article to be replicated on DB2, it is required to use DB2’s sql syntax.

e.g. our SUBREPL.sql contains following commands in it to create table and index on it. Note that this is DB2 syntax for OS/400. bypass_translation is required to be mentioned in the script so that publication will not translate the syntax of any queries that follows.

bypass_translation

DROP TABLE CATEGORIES

CREATE TABLE CATEGORIES (

CATEGORYID INT NOT NULL,

DESCRIPTION VARCHAR (32703))

CREATE UNIQUE INDEX PK_CATEGORIES ON CATEGORIES (CATEGORYID)

Match cases on object names:

Because DB2 is case sensitive we will make sure that Article property "Destination Object Name" is set to correct one . It has to be in the same case as it appears in the SUBREPL.sql Script

See the following screenshot:

That’s it you replication is set to go from ntext to VARCHAR using custom CREATE script.

How to get DB2 ServerClass and ServerVersion for your DB2 instance.

2009-07-09T02:08:00Z

here is code snippet using DataAccessLibrary that ships with :

1. Microsoft Host Integration Server AND

2. Microsoft Biztalk Adapters for Host Systems AND

3. Microsoft's DB2OLEDB (SQL server feature pack for DB2 ) .

if you have any of these , following code will help getting your DB2 server's version and class ( MVS or AS400 or NT etc.)

//referencesspan style="mso-spacerun:yes"> required to be added in your project - Microsoft.HostIntegration.DataAccessLibrary.dll

using System;

using Microsoft.HostIntegration.DataAccessLibrary;

using System.Diagnostics;

namespace ConsoleApplication1

{

class Program

{

static void Main(string[] args)

{

string serverClass = String.Empty;

string serverVersion = String.Empty;

try

{

DataAccessControl control = new DataAccessControl();

//DB2.UDL is the connection to DB2 server( Created with DAT- Data Access Tool)

IConnectionString cnstr = DB2OleDbConnectionString.ReadUDL(@"DB2.UDL");

DataAccessControl.TestConnection(cnstr, out serverClass, out serverVersion);

Console.WriteLine("serverClass" + serverClass);

Console.WriteLine("serverVersion" + serverVersion);

}

catch(Microsoft.HostIntegration.DataAccessLibrary.ConnectionException e)

{

Console.WriteLine("failed to connect " + e.ToString());

}

ADO.net provider for AS400/VSAM files in OFFLINE mode

2009-06-23T03:14:00Z

Just thought of writing a quick post on this new feature that ships with HIS 2009.

To give some introduction about this provider - HIS 2006 ships with first version of ADO.net provider for mainframe and AS400 files systems. At the time product required to have live connection to Host to read the data from VSAM files and AS400 files. Because of popular demand of supporting the SQL on predownloded binary files, HIS 2009 now supports this provider in OFFLINE mode.

1) ADVOFFLINE is a OFFLINE file ( VSAM or AS400 file that is FTP'd in BINARY format to a windows workstation ).

2) Lib_ADV.dll - Metadata assembly that defines record structure(s) that a ADVOFFLINE can have.

3) ADVCOPY - is a copybook for the original ONLINE VSAM file.

4) program.cs is a sample that does a SELECT ON a ADVOFFLINE.

program.cs code :

using System;

using System.Collections.Generic;

using System.Linq;

using System.Text;

using Microsoft.HostIntegration.MsHostFileClient;

using System.IO;

using System.Reflection;

using System.Data;

namespace OFFLINEUnions

{

class Program

{

static void Main(string[] args)

{

string cnstring = @"Local Folder=C:\HisTests\DataTests\OFFLINE;Metadata=C:\HISTests\DataTests\Binaries\HostFileProvider\Lib_ADV.DLL";

HostFileConnection cn = new HostFileConnection(cnstring);

try

{

Assembly HostFileMetadata = Assembly.LoadFile(@"c:\histests\DataTests\Binaries\HostFileProvider\Lib_ADV.DLL");

cn.Metadata = HostFileMetadata;

cn.Open();

HostFileCommand cm2 = new HostFileCommand(cn);

cm2.CommandText = "SELECT * from ADVOFFLINE as Lib_ADV.OUT_FILE_REC1";

HostFileRecordSet hfrs = cm2.ExecuteRecordSet();

StreamWriter ADVstream = new StreamWriter(@"c:\Histests\datatests\Scripts\SELECT_ADV.txt" );

while (hfrs.Read())

{

ADVstream.WriteLine(hfrs.GetString(0));

int lev88_colNumber = hfrs.GetOrdinal("OUT1_LEV88");

ADVstream.WriteLine(hfrs.GetInt16(lev88_colNumber));

if (hfrs.GetInt16(lev88_colNumber).Equals(1))

{

System.Console.WriteLine(hfrs.GetString(hfrs.GetOrdinal("UNION1")));

ADVstream.WriteLine(hfrs.GetString(hfrs.GetOrdinal("UNION1")));

}

if (hfrs.GetInt16(lev88_colNumber).Equals(2))

{

ADVstream.WriteLine(hfrs.GetDecimal(hfrs.GetOrdinal("UNION1")).ToString());

}

if (hfrs.GetInt16(lev88_colNumber).Equals(3))

{

HostFileRecordSet _unionshfrs = (HostFileRecordSet)hfrs.GetRecordSet(hfrs.GetOrdinal("UNION1"));

while (_unionshfrs.Read())

{

ADVstream.WriteLine(_unionshfrs.GetInt16(_unionshfrs.GetOrdinal("OUT1_SMALL1")).ToString());

ADVstream.WriteLine(_unionshfrs.GetString(_unionshfrs.GetOrdinal("OUT1_SMALL2")));

ADVstream.WriteLine(_unionshfrs.GetInt16(_unionshfrs.GetOrdinal("OUT1_SMALL3")).ToString());

}

_unionshfrs.Close();

}

HostFileRecordSet _unionsnumbershfrs = (HostFileRecordSet)hfrs.GetRecordSet(hfrs.GetOrdinal("OUT1_NUMBERS"));

while (_unionsnumbershfrs.Read())

{

string logvalue = _unionsnumbershfrs.GetInt32(_unionsnumbershfrs.GetOrdinal("OUT1_LEADING")).ToString();

ADVstream.WriteLine(logvalue);

logvalue = _unionsnumbershfrs.GetInt32(_unionsnumbershfrs.GetOrdinal("OUT1_TRAILING")).ToString();

ADVstream.WriteLine(logvalue);

logvalue = _unionsnumbershfrs.GetInt32(_unionsnumbershfrs.GetOrdinal("OUT1_SEPALEAD")).ToString();

ADVstream.WriteLine(logvalue);

logvalue = _unionsnumbershfrs.GetInt32(_unionsnumbershfrs.GetOrdinal("OUT1_SEPATRAI")).ToString();

ADVstream.WriteLine(logvalue);

}

hfrs.Close();

ADVstream.Close();

}

catch (Exception e)

{

Console.WriteLine(e.ToString());

}

finally

{

if (cn.State.Equals(ConnectionState.Open))

{

cn.Close();

}

WCF web Service - Hosting in IIS 6.0 with Windows Authentication and Web client impersonation

2009-06-15T08:44:00Z

As we all know, Hosting a WCF service and configuring authentication is not the same as we do for ASMX. There are many changes and the way we get credentials in service code and on server etc. I am not going to get deep into it, THIS LINK however here is another blog post which talks in great details about it hosting WCF service in IIS.

There is a small / Big (?) difference between ASMX and WCF with respect to hosting, and interestingly there is a compatibility mode for this same, THIS ARTICLE is great read on it.

Now, without wasting much of time, here is the problem in hand.

1. Need to create a WCF service which access Data Base

2. Then host it in IIS 6.0 (not IIS 7.0)

3. Make it Windows integrated Authentication

4. Build an ASP.NET client and consume service.

Simple enough? Interestingly there are some tweaks,

Here are the steps. (I am using windows 2003 server and Visual studio 2008 with Sp1 and .NET framework 3.5)

1. With Visual studio, Create a WCF web service.

2. In IIS 6.0 create a different app pool and use that App pool for this service, Turn on the Windows integrated Auth and uncheck the Anonymous auth (For all the documents and pages or whatever)

3. Then edit the endpoint configuration. You need to use basicHTTPBinding, Here is the code snippet inside the service model tag

<system.serviceModel>

<bindings>

<basicHttpBinding>

<binding name="BasicHttpEndPointBinding">

<security mode="TransportCredentialOnly">

<transport clientCredentialType="Windows"/>

</security>

</binding>

</basicHttpBinding>

</bindings>

4. Once this is done, try debugging the service by requesting the .SVC file. You should get a credential prompt. Everything work fine till here.

5. Create a ASP.NET web app, turn on windows Auth and turn off Anonymous auth. Create a service ref and write a code to access the service.

6. Now here is the interesting part. In most of the cases, you will have a service account which has given the access to DB, and you would like web service to run under that user account. To do this you would go and run the app pool created for WCF service under service account (This is the AD account). Once you do the the application pool will crash saying the user identity should be in SPN. (Need to make changes on Domain controller and all)

7. The above is not the part of solution, so here is what you do, Enable the IIS metabase edit enabled.

8. Open the IIS metadata file wich is in System32/inetsrv/metabase.xml and find IISWebServer tag in there corrosponding to you app pool name. Add this in there NTAuthenticationProviders="Negotiate,NTLM"

9. Close the IIS metabase xml file and restart the IIS. After doing this, Add this service account to IIS_WPG account. This is very important. Also you do not want <identity impersonate = "true"> for your service.

10. Now, on the client side (Your web app) if you are using the same app pool with Windows Auth, then it will work only on your local machine (Hop Problem), So for web application user the default app pool with network service as user.

You should be good now.

Mainframe - Printing the job(JCL) output to a file

2009-05-19T19:34:00Z

Sometimes we want to preserve the output of jobs ( JCL ) run sucessfully so that we can refer to them in future. The way I like to use these results is to convince my mainframe Admin that I am referring to the correct environment settings and the job log saved previously is the benchmark that we compare against.

The other way to make use of this log information is if your shop face the similar upgrade issues over and over you can refer to failed jobs for failure messages, return codes etc.

these are the steps that would work for most of the shops:

1) go to the SDSF panel

2) locate the job you want to copy

3) in the command line print XD

4) this will pull the SDSF open print dataset , which looks like :

                         SDSF Open Print Data Set
COMMAND INPUT ===>                                            SCROLL ===> CSR


Data set name ===> 'HQ.SPROC.OUT'
Member to use ===>
Disposition    ===> NEW        (OLD, NEW, SHR, MOD)

If the data set is to be created, specify the following.
Volume serial will be used to locate existing data sets if specified.

Management class     ===>           (Blank for default management class)
Storage class        ===>           (Blank for default storage class)
   Volume serial      ===>           (Blank for authorized default volume)
   Device type        ===>           (Generic unit or device address)
Data class           ===> DBCLASS   (Blank for default data class)
   Space units        ===> TRKS      (BLKS, TRKS, CYLS, BY, KB, or MB)
   Primary quantity   ===> 75        (In above units)
   Secondary quantity ===> 5         (In above units)
   Directory blocks   ===>           (Zero for sequential data set)
   Record format      ===> VBA
   Record length      ===> 240
   Block size         ===> 3120

5) hit enter, it will take you to the SDSF again. On the command line print "PRINT CLOSE" and hit enter.

6) Now you should be able to see the job log captured in dataset - 'HQ.SPROC.OUT'

thanks !

Validating Image File for Content Type with ASP.NET FileUpload web control.

2008-09-19T00:30:00Z

We use file upload web control in our sites, where we want only valid image types to be uploaded.

Without talking much -> here are 3 ways to do it.

1. Accept attribute of fileUpload control - Doesnt work with most of the browsers (Bad with IE itself)

2. Regular Expression validator for FileUpload

<asp:RegularExpressionValidator id="UpLoadValidator" runat="server" ErrorMessage="Upload Images only." ValidationExpression="^(([a-zA-Z]:)|(\\{2}\w+)\$?)(\\(\w[\w].*))(.jpg|.png|.bmp|.jpeg|.gif)$" ControlToValidate="FileUpload1"> </asp:RegularExpressionValidator>

This is Not very handy when using AJAX controls on page- Both javascripts dont like each other :)

3. Write a code behind function in a very simple way - Most robust way to use it. - Very Generic can be used for any file types.

private bool IsFileValid()

{

string [] allowedImageTyps = {"image/gif", "image/pjpeg", "image/bmp","image/x-png"};

StringCollection imageTypes = new StringCollection();

imageTypes.AddRange(allowedImageTyps);

if (imageTypes.Contains(FileUpload1.PostedFile.ContentType))

return true;

else

{

return false;

}

}

NOTE - use FileUpload1.PostedFile.ContentType and not the file name to check the Extension

Microsoft OLEDB provider for DB2 Service pack 2 Released

2008-09-03T03:41:00Z

I am excited to announce that SQL 2008 compatible version of DB2OLEDB provider is available for download at :

http://www.microsoft.com/downloads/details.aspx?FamilyID=c6c3e9ef-ba29-4a43-8d69-a2bed18fe73c&DisplayLang=en

This provider supports new datatypes added in SQL 2008 .More details information on how the new datatypes correspond to OLEDB data types is available here :

http://msdn.microsoft.com/en-us/library/ms175970.aspx

First Impressions on Google Chrome Web Browser

2008-09-03T00:36:00Z

Just thought to write about the Chrome web browser from Microsoft Developers perspective.

Browser can be downloaded from http://www.google.com/chrome

1. Silver light is not Supported (No Silverlight to start with)

2. Ajax toolkit project will not work as they work in IE. I have seen even IE8 breaks some functionality in AJAX enabled web pages.

3. You can debug/dump the JavaScript for a page as well as separate JavaScript console.

4. Basic problem from DEV perspective - Newlines are interpreted in much diff way in markup. Also Image (absolute) alignment are bit different.

Overall the browser is fast....feels much like Firefox.

Things that I liked

1. No Window header (The Title of the Browser) Tabs start from (0x0) - maximizing the browse area

2. Caching is nice.

3. Creates the list of frequently visited site instead of Showing "You have just opened a new Tab"

4. Search and address bar are the same and gets very handy in 2 minutes.......no learning curve there.

Sample : Executing i-series CL commands using Host file Provider - MSHostFileClient.dll

2008-08-28T21:42:00Z

Control language (CL) REFERENCES:

http://publib.boulder.ibm.com/infocenter/iseries/v5r4/index.jsp?topic=/rbam6/rbam6clmain.htm

C# sample :

using System;

using System.Collections.Generic;

using System.Text;

using Microsoft.HostIntegration.MsHostFileClient;

namespace ConsoleApplication1

{

class Program

{

static void Main(string[] args)

{

//connectionstring

string connectionstring = "Provider=SNAOLEDB;User ID=USERID;Password=PASSWORD;APPC Remote LU Alias=RUSDFM;APPC Local LU Alias=P31680;APPC Mode Name=PA62TKNU;Network Transport Library=TCP;Host CCSID=37;PC Code Page=1252;Network Address=HOST;Network Port=PORTNUMBER;Process Binary as Character=False;Persist Security Info=True;Cache Authentication=False;Cache Authentication=False;Encrypt Password=False;Impersonation Level=Impersonate;Location=HOST;Protection Level=Connect;Default Library=USERID;Repair Host Keys=False;Strict Validation=False;Mask Password=False;";

HostFileConnection cn = new HostFileConnection(connectionstring);

try

{

cn.Open();

HostFileCommand cmd = new HostFileCommand("EXEC 'SNDMSG MSG(HELLO) TOUSR(USERID)'", cn);

string RESULT = (string)cmd.ExecuteScalar();

// the result is dependednt upon the command getting executed.

// if command is wrong , it will give syntax error and will not execute at all.

if (RESULT.Equals(string.Empty))

{

// check for result to determine successfull execution of command.

}

}

catch (Exception e)

{

}

finally

{

cn.Close();

}

}

}

There is no inspiration like this

2008-08-05T03:25:00Z

In the month of June 2008 , I completed 2 years with "Microsoft Host Integration Server " team aka. HIS . I wrote very few blogs. I hope some of them helped some HIS community out there.

Whenever I write something on this medium of blog , I consider that there is no one reading my topic :) and that gives me a hint - how about after few years I myself return to visit this page ? Will it make sense to read what am I writing ?

And I did this exercise this time as I returned here after a long gap of 4 months.

To my surprise , I didnt enjoy it much untill when I realised that some other blogs and people have referred my articles in the past for their reference........And there is that inspiration that would keep my blog alive.

Thanks for reading !

SQL Linked server using DB2OLEDB provider

2008-03-27T07:49:00Z

As SQL Server describes linked server in BOL (Books Online):A linked server configuration enables SQL Server to execute commands against OLE DB data sources on remote servers. Linked servers offer the following advantages:

Remote server access.
The ability to issue distributed queries, updates, commands, and transactions on heterogeneous data sources across the enterprise.
The ability to address diverse data sources similarly.

A linked server definition specifies the following objects:

An OLE DB provider - in this case DB2OLEDB.DLL
An OLE DB data source - in case of db2oledb its database object on the db2 server.

Scenarios:

1) Remote server access: A typical organization has heterogeneous servers. some of the data might reside on SQL database whereas some other data on db2 servers .When in this case there is a need to perform operations on the data from DB2 server and all we have are the .Net developers and Microsoft SQL Server Programmer who has skills of SQL linked server. That programmer does not know how to get to DB2 database.

In this case the DB2 DBA will just provide the connection string to the SQL DBA. SQL DBA will install the db2oledb feature pack on the SQL server from http://www.microsoft.com/downloads/details.aspx?FamilyID=50b97994-8453-4998-8226-fa42ec403d17&displaylang=en

And on this SQL instance DBA will create the Linked server to the DB2 data source. That’s it. Now programmer can access data from db2 data source , perform all CRUD operations - execute procedures, create database objects like tables, views, stored procedures etc.

2)The ability to issue distributed queries, updates, commands, and transactions on heterogeneous data sources across the enterprise :

lets continue from the scenario above : Consider this is a Automobile manufacturer and there is a "Sales" table on DB2 database that stores the data for Motorcycle sale and there is "Sales" table on SQL server that stores all sales data for the sale of trucks. Now problem the problem developer has is to do JOIN on the tables and get combined sales information .

Yes , Linked server allows you to execute the Queries on the same SQL server instance but Query will actually pull data from heterogeneous data sources and join them. the query will look like :

SELECT ORDER_NO, ORDER_DATE, ... from SALES CROSS JOIN LINKEDSERVER.CATALOG.DATASOURCE.DB2SALES order by ORDER_NO ;

Where SALES is a SQL table for trucks orders whereas DB2SALES is a sales table for Motorcycle orders placed.

Open Containing Folder in Visual Studio Solution Explorer

2008-01-03T00:02:00Z

Hi All,

After so much relaxing vacation its fun to start work considering everything as new . Yes its new year and so I am starting everything as if I am doing it fresh , the first time. With thatmuch curiously and Interest.

So I started the work today and the focus is to learn new things from the same things that you are doing for long.

And here is what I found : In Visual Studio 2005 or Visual Studio 2008 , what is the option to locate the item in solution Explorer and then open its "containing folder ".

No Idea? Some people out there might have an idea but then there is few chance they will get directed to my blog. So I am sure you are the right people to know this Secret !

...

The shortcut is "CTRL+O"

Whats Oslo?

2007-12-28T02:42:00Z

Oslo is annouced to the technical community in SOA conference in OCT 2007 here in campus.

What is OSLO ?

People came from accross the world to Redmond, WA to attend the SOA Conference .I met someone from my home country in the conference and the person asked me if you have to explain whats OSLO in one line what would you say ?

Me : OSLO is major intiative of Microsoft and its a topic in itself . When we have the entire 5 days conference devoted to the same topic I dont think I can make you understand just in a sentence, you will see ...!!!

Really, Oslo is part of Microsoft's initiative to enable real world SOA ( Service Oriented Architecture ) through Microsoft Technologies. And its all about enabling to build Enterprise Business Applications in a SOA world.

Watch CVP, CSD(Connected Systems Division) - Robert Wahbe talking about Oslo here :

http://download.microsoft.com/download/8/4/6/846F8EE7-46BC-47A0-A38B-3ECD8DC7EB6E/VisionforOslo.wmv

Managed provider for Host files - programmer's guide

2007-11-02T01:07:00Z

New to Microsoft's Managed Provider for accessing VSAM files and AS400 file system ?

Here is a compile of material that can be helpful for the first time users :

Product documentation for programmers:

http://msdn2.microsoft.com/en-us/library/aa771659.aspx

http://msdn2.microsoft.com/en-us/library/microsoft.hostintegration.mshostfileclient.aspx

How to define the mapping for VSAM files and AS400 files ?

http://technet.microsoft.com/en-us/library/aa771286.aspx

If you are upgrading from existing HIS server to HIS 2006, Host file provider is one of the reasons.

http://www.microsoft.com/hiserver/evaluation/overview/topreasons.mspx

Here is the help for SQL Queries :

http://blogs.msdn.com/asmitaw/archive/2007/05/02/mshostfileclient-sql-syntax.aspx

SQL Server integration Services :

We can actually Import / export data from Host file provider and also Data flow packages can be created in programmatic to fetch data from the VSAM files and AS400 files .

link to SQL SSIS :

http://www.microsoft.com/sql/technologies/integration/default.mspx AND

I am looking forward to myself for adding a sample which will describe SSIS with MSHostfileClient.

creating HCD mapping for COBOL copybook

2007-10-25T21:01:00Z

cobol copybook :

       01 DTS-LAYOUT.
          05   OUT1-BOOL               PIC S9(3) COMP-3.
          05   OUT1-BYTE1              PIC S9(3) COMP-3.
          05   OUT1-DATE1              PIC X(10).
          05   OUT1-DECIMAL1        PIC S9(15)V9(03).
          05   OUT1-DECIMAL2        PIC S9(15)V9(03).
          05   OUT1-DOUBLE1         COMP-2.
          05   OUT1-DOUBLE2         PIC S9(09)V9(09).
          05   OUT1-INT1                  PIC S9(09) COMP.
          05   OUT1-INT2                  PIC S9(09) COMP-3.
          05   OUT1-INT3                  PIC S9(10) DISPLAY.
          05   OUT1-SHORT1            PIC S9(04) COMP.
          05   OUT1-SHORT2            PIC S9(04) COMP-3.
          05   OUT1-SINGLE1           COMP-1.
          05   OUT1-SINGLE2           PIC S9(05)V9(10).
          05   OUT1-STRING1           PIC X(4000).
          05   OUT1-TIME1               PIC X(08).
          05   OUT1-TSTAMP1         PIC X(26).

The corresponding HCD will be :

[Stats]
CreatedOn=06/29/06 15:18:50
[Files]
USERID.KSDS.BOOL=1
USERID.KSDS.BYTE=1
USERID.KSDS.DATE1=1
USERID.KSDS.DECIMAL2=1
USERID.KSDS.DECIMAL=1
USERID.KSDS.DOUBLE=1
USERID.KSDS.INT1=1
USERID.KSDS.INT2=1
USERID.KSDS.DOUBLE22=1
USERID.KSDS.INT3=1
USERID.KSDS.SHORT2=1
USERID.KSDS.SHORT=1
USERID.KSDS.SINGLE1=1
USERID.KSDS.SINGLE2=1
USERID.KSDS.STRING12=1
USERID.KSDS.TIME=1
USERID.KSDS.TSTAMP=1
[USERID.KSDS.DATE1]
UseForFileTransfer=0
DelimiterField=
DelimiterRecord=
TextQualifier=
FileCreationType=0
KeyPosition=0
KeyLength=0
KeySort=A
Col1=0;COL1;COL1;10;0;4;LONG;LONG;N;37; ;Y;
Col2=0;COL2;COL2;0;0;10;DATE;DATE;N;37; ;Y;
[USERID.KSDS.DOUBLE]
UseForFileTransfer=0
DelimiterField=
DelimiterRecord=
TextQualifier=
FileCreationType=0
KeyPosition=0
KeyLength=0
KeySort=A
Col1=0;COL1;COL1;10;0;4;LONG;LONG;N;37; ;N;
Col2=0;COL2;COL2;0;0;8;DOUBLE;DOUBLE;N;37; ;N;
[USERID.KSDS.DECIMAL2]
UseForFileTransfer=0
DelimiterField=
DelimiterRecord=
TextQualifier=
FileCreationType=0
KeyPosition=0
KeyLength=0
KeySort=A
Col1=0;COL1;COL1;10;0;4;LONG;LONG;N;37; ;N;
Col2=0;COL2;COL2;18;3;18;ZONED;NUMERIC;N;37; ;N;
[USERID.KSDS.INT1]
UseForFileTransfer=0
DelimiterField=
DelimiterRecord=
TextQualifier=
FileCreationType=0
KeyPosition=0
KeyLength=0
KeySort=A
Col1=0;COL1;COL1;10;0;4;LONG;LONG;N;37; ;N;
Col2=0;COL2;COL2;10;0;4;LONG;LONG;N;37; ;N;
[USERID.KSDS.INT2]
UseForFileTransfer=0
DelimiterField=
DelimiterRecord=
TextQualifier=
FileCreationType=0
KeyPosition=0
KeyLength=0
KeySort=A
Col1=0;COL1;COL1;10;0;4;LONG;LONG;N;37; ;N;
Col2=0;COL2;COL2;10;0;4;LONG;LONG;N;37; ;N;
[USERID.KSDS.DOUBLE22]
UseForFileTransfer=0
DelimiterField=
DelimiterRecord=
TextQualifier=
FileCreationType=0
KeyPosition=0
KeyLength=0
KeySort=A
Col1=0;COL1;COL1;10;0;4;LONG;LONG;N;37; ;N;
Col2=0;COL2;COL2;18;9;18;ZONED;DOUBLE;N;37; ;N;
[USERID.KSDS.SHORT2]
UseForFileTransfer=0
DelimiterField=
DelimiterRecord=
TextQualifier=
FileCreationType=0
KeyPosition=0
KeyLength=0
KeySort=A
Col1=0;COL1;COL1;10;0;4;LONG;LONG;N;37; ;N;
Col2=0;COL2;COL2;4;0;4;PACKED;DECIMAL;N;37; ;N;
[USERID.KSDS.SHORT]
UseForFileTransfer=0
DelimiterField=
DelimiterRecord=
TextQualifier=
FileCreationType=0
KeyPosition=0
KeyLength=0
KeySort=A
Col1=0;COL1;COL1;10;0;4;LONG;LONG;N;37; ;N;
Col2=0;COL2;COL2;4;0;4;SHORT;SHORT;N;37; ;N;
[USERID.KSDS.SINGLE1]
UseForFileTransfer=0
DelimiterField=
DelimiterRecord=
TextQualifier=
FileCreationType=0
KeyPosition=0
KeyLength=0
KeySort=A
Col1=0;COL1;COL1;10;0;4;LONG;LONG;N;37; ;N;
Col2=0;COL2;COL2;0;0;4;SINGLE;FLOAT;N;37; ;N;
[USERID.KSDS.SINGLE2]
UseForFileTransfer=0
DelimiterField=
DelimiterRecord=
TextQualifier=
FileCreationType=0
KeyPosition=0
KeyLength=0
KeySort=A
Col1=0;COL1;COL1;10;0;4;LONG;LONG;N;37; ;N;
Col2=0;COL2;COL2;15;10;15;ZONED;NUMERIC;N;37; ;N;
[USERID.KSDS.STRING12]
UseForFileTransfer=0
DelimiterField=
DelimiterRecord=
TextQualifier=
FileCreationType=0
KeyPosition=0
KeyLength=0
KeySort=A
Col1=0;COL1;COL1;0;0;4;SINGLE;FLOAT;N;37; ;N;
Col2=0;COL2;COL2;0;0;4000;CHAR;CHAR;N;37; ;N;
[USERID.KSDS.TIME]
UseForFileTransfer=0
DelimiterField=
DelimiterRecord=
TextQualifier=
FileCreationType=0
KeyPosition=0
KeyLength=0
KeySort=A
Col1=0;COL1;COL1;10;0;4;LONG;LONG;N;37; ;N;
Col2=0;COL2;COL2;0;0;8;TIME;TIME;N;37; ;N;
[USERID.KSDS.TSTAMP]
UseForFileTransfer=0
DelimiterField=
DelimiterRecord=
TextQualifier=
FileCreationType=0
KeyPosition=0
KeyLength=0
KeySort=A
Col1=0;COL1;COL1;10;0;4;LONG;LONG;N;37; ;N;
Col2=0;COL2;COL2;0;0;26;TIMESTAMP;TIME;N;37; ;N;
[USERID.KSDS.BOOL]
UseForFileTransfer=0
DelimiterField=
DelimiterRecord=
TextQualifier=
FileCreationType=0
KeyPosition=0
KeyLength=0
KeySort=A
Col1=0;COL1;COL1;10;0;4;LONG;LONG;N;37; ;N;
Col2=0;COL2;COL2;5;0;2;SHORT;SHORT;N;37; ;N;
[USERID.KSDS.BYTE]
UseForFileTransfer=0
DelimiterField=
DelimiterRecord=
TextQualifier=
FileCreationType=0
KeyPosition=0
KeyLength=0
KeySort=A
Col1=0;COL1;COL1;10;0;4;LONG;LONG;N;37; ;N;
Col2=0;COL2;COL2;0;0;8;BINARY;BINARY;N;37; ;N;
[USERID.KSDS.DECIMAL]
UseForFileTransfer=0
DelimiterField=
DelimiterRecord=
TextQualifier=
FileCreationType=0
KeyPosition=0
KeyLength=0
KeySort=A
Col1=0;COL1;COL1;10;0;4;LONG;LONG;N;37; ;N;
Col2=0;COL2;COL2;18;3;18;ZONED;DECIMAL;N;37; ;N;
[USERID.KSDS.INT3]
UseForFileTransfer=0
DelimiterField=
DelimiterRecord=
TextQualifier=
FileCreationType=0
KeyPosition=0
KeyLength=0
KeySort=A
Col1=0;COL1;COL1;10;0;4;LONG;LONG;N;37; ;N;
Col2=0;COL2;COL2;10;0;4;LONG;LONG;N;37; ;N;

Find more details of OLE DB data types that result from the mapping of the host data types by the Microsoft OLE DB Provider for AS/400 and VSAM :

http://msdn2.microsoft.com/en-us/library/ms967931.aspx