SQL Server Storage Engine

So much enthusiasm for SQL Server at TechEd!! (and a teaser for something I'm working on...)

TechEd in Barcelona is going really well. All the DAT sessions last week at the Developers conference were packed - I was particularly pleased that the chalk-talk I did on the internals of query execution in the Storage Engine was so popular that I had to repeat it. That's a great motivator for me to continue posting all these internal details here.

Now it's ITForum week - I'm sitting here in Kimberly's session on Upgrading to SQL 2005 and there's standing room only. From various polls in sessions this week and last, it seems about 10% of people are on SQL 2005 only, 10% on SQL 2000 only and the remainder on a mixture of the two. Some of the new features that people have enthused to me about:

  • database mirroring
  • partial database availability
  • instant file initialization
  • peer-to-peer replication
  • partitioning
  • piecemeal restore
  • page checksums
  • online operations
  • database snapshots
  • snapshot isolation

Wow - what a cool list of stuff.

And now the teaser. One interesting thing that I've been pondering this week - when you turn on page checksums, nothing happens to any pages until a page is read in, dirtied (written to), and then written out to disk again. There's also no tool to go through the database and 'touch' every page with a checksum, short of doing a bunch of index rebuilds or a no-op update of all rows. Well, while lying awake early Monday morning with jet-lag (still! after a week!) I think I figured out a way to produce a tool that does just that, without generating any log space and at media-speed. I'm currently doing a bunch of testing on my code and hope to have proven whether its safe or not within a week or so.

To finish off, as usual my favorite part of TechEds is meeting to people and answering questions. I just met one of the SQL MVPs I've been looking forward to meeting for a long time - Tony Rogerson. He has a great blog here. One of the most enthusiastic people we met was Jeff Wharton - below is a picture of us with him (in centre) from last week. The Storage Engine people here are me, Don Vilen, and Kimberly Tripp and we're all hanging out in each other's sessions - stop by and say hi!

 

Published Tuesday, November 14, 2006 4:49 PM by Paul Randal - MSFT

Comments

 

Jeff Wharton said:

Hi Paul,

Had an excellent time at Tech-Ed and it was great meeting you guy's in person; however still recovering from jet lag :-).

Cheers

Jeff

December 4, 2006 8:44 PM
Anonymous comments are disabled

About Paul Randal - MSFT

Paul started in the industry in 1994 working for DEC on the VMS file system and check/repair tools. In 1999 he moved to Microsoft to work on SQL Server, specifically on DBCC. For SQL Server 2000, he concentrated on index fragmentation (writing DBCC INDEXDEFRAG and DBCC SHOWCONTIG) plus various algorithms in DBCC CHECKDB. During SQL Server 2005 development Paul was the lead developer/manager of one the core dev teams in the Storage Engine, responsible for data access and storage (DBCC, allocation, indexes & heaps, pages/records, text/LOB storage, snapshot isolation, etc). He also spent several years rewriting DBCC CHECKDB and repair. For SQL Server 2008, Paul managed the Program Management team for the core Storage Engine to become more focused on customer/partner engagement and feature set definition. In 2007, after 8.5 years on the SQL Server team, Paul left Microsoft to join his wife, Kimberly Tripp, running SQLskills.com and pursuing his passion for presenting and consulting. Paul regularly presents at conferences and user groups around the world on high-availability, disaster recovery and Storage Engine internals. His popular blog is at http://www.sqlskills.com/blogs/paul/.

© 2009 Microsoft Corporation. All rights reserved. Terms of Use  |  Trademarks  |  Privacy Statement
Microsoft
Page view tracker