Simulating Sequence Objects in SQL Server

Many applications need sequentially incremental number as unique/primary key of records.  SQL Server 2005 today supports identity column as the primary mean to general sequence number, which generates the sequence number upon the execution of DML (insert) or bulk insert.  The value of the insertion is known (when using insertion DML), post the execution of the DML.  In some implementations, the sequence numbers (or next unique incremental number) need to be generated prior to the DML operation.  For example, if sequence number can be retrieved prior to the DML operation, it can be easily implemented in situations where multiple DML (inserts, or even updates) using the same sequence number can be performed, and data can be insert into different tables, for example, parent-child, or based on the sequence value, data can be insert into different tables.

SQL Server 2005 Migration Assistant (SSMA) provides a different mechanism for sequence number generation.  SSMA’s approach is to use a single table to hold all the sequence numbers.  Each sequence number object is represented by a single row of record, which holds the property of the sequence, e.g. sequence name, current value, increments…etc.  The generation of the next value is invoked by an extended stored procedure in order to minimize the impact on application concurrency – the execution of extended procedure is not within the transaction scope of the DML statement, and it holds very short duration locks on the row that represents the sequence number.

This BLOG describes two more methods of sequence number generation. 

Option 1

This option is easy to use and maintain, but it is suitable only with lower volume invocations.  It is also one of the widely used approaches, and often misused.  This method uses a single table to hold all the sequences needed for the application, and each sequence is represented by one single record, thus serializes operation requesting next value of the same sequence number. 

1.      Create the following objects

Table AllSequences holds the information of all the sequences.  As a simple example, the table and subsequent stored procedure is kept quite simple.  Further enhancement is certainly possible based on the needs – for example, additional information of sequence such as maximum range, minimum range, loopback(yes/no) can be added.

·         SeqName – name of the sequence

·         Seed – seed value of the sequence

·         Incr – incremental value of the sequence

·         Currval – current value of the sequence

Create table AllSequences (

      SeqName nvarchar(255) primary key, -- name of the sequence

      Seed int not null default(1), -- seed value

      Incr int not null default(1), -- incremental

      Currval int

)

Go

The following stored procedure is used to create a sequence.  The following input parameter is expected:

·         SeqName – name of the sequence

·         Seed – seed value of the sequence

·         Incr – incremental value of the sequence

create procedure usp_CreateNewSeq

      @SeqName nvarchar(255),

      @seed int = 0,

      @incr int = 1

as

begin

      declare @currval int

      if exists (

            select 1 from AllSequences

            where SeqName = @SeqName )

      begin

            print 'Sequence already exists.'

            return 1   

      end

      if @seed is null set @seed = 1

      if @incr is null set @incr = 1

      set @currval = @seed

      insert into AllSequences (SeqName, Seed, Incr, CurrVal)

      values (@SeqName, @Seed, @Incr, @CurrVal)

end

go

The following stored procedure is used to generate the next value of the specified sequence through input parameter SeqName.

create procedure usp_GetNewSeqVal

      @SeqName nvarchar(255)

as

begin

      declare @NewSeqVal int

      set NOCOUNT ON

      update AllSequences

      set @NewSeqVal = CurrVal = CurrVal+Incr

      where SeqName = @SeqName

      if @@rowcount = 0 begin

print 'Sequence does not exist'

            return

      end

      return @NewSeqVal

end

go

2.      To create the new sequence, for example:

usp_CreateNewSeq N'TestSeq'

3.      To retrieving the new sequence value, for example for sequence “TestSeq”

usp_GetNewSeqVal N'TestSeq'

One thing to be careful is to keep the execution of the stored procedure usp_CreateNewSeq outside the scope of subsequent transaction which uses the sequence number generated.  This can minimize impact of blocking.

Typical usage

Declare @NewSeqVal int

Execute @NewSeqVal=usp_GetNewSeqVal @seqname=N'TestSeq'

print @NewSeqVal

Option 2

This method is intended for higher-throughput environments – such as thousands of transactions per second.  A table with identity column is created for every sequence.  Since the generation of identity value is lightweight, and not within the transaction scope of subsequent DML, this method can significantly improve the concurrency over the first method.  In addition, it also consumes less resource than extended procedure. 

1.      Create one table with the following structure for each sequence, assuming seed 1, with increment of 1).

create table <tablename> (

      SeqID int identity(1,1) primary key,

      SeqVal varchar(1)

)

2.      Create the following stored procedure.  A delete operation is performed to remove the rows in the sequence table to reduce maintenance.  This obviously adds some load to the transaction however it should be quite minimal.  As an alternative, for higher throughput, the delete statement can be removed and a maintenance job can be scheduled during off-hour to purge the records in the table (truncate should not be used since it resets the identity value).

create procedure GetNewSeqVal_<tablename>

as

begin

      declare @NewSeqValue int

      set NOCOUNT ON

      insert into <tablename> (SeqVal) values ('a')

      set @NewSeqValue = scope_identity()

      delete from <tablename> WITH (READPAST)

return @NewSeqValue

end

3.      To retrieve the new value in a result set, simply execute the following:

GetNewSeqVal_<tablename>

Typical usage

            Declare @NewSeqVal int

            Exec @NewSeqVal =  GetNewSeqVal_<tablename>

Among the two options described above, Option 1 is widely used in different variations but prone to blocking/deadlocking.  Option 2 improves concurrency significantly with a simple approach.

Howard Yin