Rob Tiffany's Windows Mobile Accelerator : SQL Server

New Blog Site @ http://robtiffany.com

robtiffany — Wed, 23 Dec 2009 23:58:00 GMT

Hey everyone,

Just wanted to let you know that I'm continuing this blog over at robtiffany.com. I've finally decided to make better use of my personal Domain name and I'm switching to WordPress from the blog management system we use at MSDN. As a Mobility Architect at Microsoft, I will continue to give you my insights into the exciting world of Windows phones, wireless technologies, mobile hardware, the mobile web and Microsoft's mobile enterprise application platform (MEAP). Don't worry, you'll be getting my take on competing technologies as well. I enjoy seeing many of you both at Microsoft and at the events that I speak at all around the world. Now you have another place to hear from me. Come visit and subscribe to my RSS feed over at robtiffany.com. Happy Holidays everyone!

Best Regards,

Rob

What ever happened to RDA?

robtiffany — Wed, 23 Sep 2009 03:54:00 GMT

Who remembers using Remote Data Access to synchronize data between SQL Server and SQL Server Compact? I certainly do!

Before I dove head first into the world of Merge Replication, I always used RDA to get my customers up and running quickly. Mobilizing an organization’s workforce quickly and easily is what it’s all about so they can start reaping the benefits. In addition to a speedy time to market, there’s no faster or more scalable mobile sync technology on the market anywhere.

So why wouldn’t I always use RDA? Here’s a quick list:

You’re using Identity columns.
You want to replicate schema changes to the client.
You want change tracking on both the client and server to perform diffs of each of the tables during a sync instead of re-downloading the entire table.
You want to automatically resolve conflicts that arise when 2 people update the same data.
You want referential integrity constraints to be pushed down to the client database from SQL Server.
You don’t want to write code to perform synchronization or filter data.

If anything on the above list applied to you, you would shift to Merge Replication because it could manage ranges of Identity columns, push down schema changes, only sync data differences, resolve conflicts and push down a database’s referential integrity constraints. Merge requires almost no code to get started and tables and columns are filtered visually via a wizard.

So why might you choose to use RDA? Here’s another list:

Your Primary Keys use GUIDs instead of Identity columns.
Users don’t overwrite each other’s data so you don’t need conflict resolution. The rule of “Last in Wins” works for you.
While you want indexes to be pushed down, you don’t care if your local SSCE database has referential integrity constraints applied.
You want to wrap the changes you upload to SQL Server in a transaction so that all changes are applied or none of them are.
Change tracking on the client is good enough and re-downloading updated server tables doesn’t take too long.
You developers don’t mind writing some sync code.
Be able to execute SQL and Stored Procedures directly against SQL Server via IIS.

If your solution meets the criteria in the list above, you’re probably a good candidate for using RDA instead of Merge. Are there any other choices out there?

Back at MEDC 2007, we announced a new data replication technology for devices called Occasionally Connected Sync that would sit somewhere between RDA and Merge. OCS as it used to be called was renamed Sync Services for ADO.NET and then was eventually merged into the Sync Framework.

The Sync Framework is a developer-focused technology:

Supports conflict resolution.
Change tracking on the server as well as the client so that only data differences are exchanged.
Peer to Peer sync in the forthcoming v2 of Sync Framework.
Sync with databases other than SQL Server.
Best suited for SSCE running on a desktop or laptop.

The clearest differentiation that the Sync Framework has over Merge is its provider model which allows it to sync with other ADO.NET databases like Oracle or DB2. SQL Server supports built-in P2P Transactional replication and v2 of the Sync Framework will allow you to do this via WCF. If you development team doesn’t mind writing lots of sync code and needs to support scenarios like synchronizing with other databases from SSCE on the desktop, then the Sync Framework might be the way to go for you. I wouldn’t yet recommend the Sync Framework for device sync since its wire protocol is currently based on the DataSet which may cause out of memory errors on Windows phones with limited working sets.

So where does this leave RDA?

The reason I’m writing this blog post is because time and time again I run into customer sync scenarios that don’t always need the power of Merge or the extra flexibility of the Sync Framework. Most field service applications follow the same kind of pattern:

Lots of download-only lookup/reference tables that aren’t changed by the user.
Tables that are pushed down to the device that tell a user where to go and what to do.
Tables (sometimes empty) that are used to capture data from the user in the field that are upload-only.

These kinds of schemas don’t require conflict resolvers or server change tracking and are therefore well suited for RDA.

What’s the big benefit of using RDA if a sync scenario meets its criteria?

You won’t modify SQL Server’s schema with GUIDs and Triggers.
You won’t degrade the performance of SQL Server by having it track changes and maintain extra metadata.
You will have the fastest and most scalable sync solution with least amount of hardware.
Time to market is shorter.

The big takeaway here is that I want you to consider your sync solution carefully before choosing a technology. If your customer’s needs are met by RDA, then you should use it and reap the benefits of developing and deploying a simpler solution with fewer moving parts.

Remember Occam's Razor.

-Rob

Rise of the Psuedo Smartphones

robtiffany — Sat, 18 Jul 2009 03:50:00 GMT

What do the following feature phones have in common?

LG Dare
LG Voyager
LG Versa
LG enV Touch
LG Rumour 2
LG Lotus
LG Neon
LG Xenon
LG VU
Samsung Alias 2
Samsung Gravity
Samsung Behold
Samsung Highlight
Samsung Memoir
Samsung Propel
Samsung Rant
Samsung Exclaim
Samsung Instinct
Samsung Magnet
Samsung Eternity
Samsung Impression
Sanyo SCP-2700
AT&T Quickfire
Pantech Matrix
Motorola Karma

They include features like:

High-Megapixel Cameras w/Zoom
GPS
Touch Screen
QWERTY Keyboards
Play Music
Play Videos
Web Browser
Email
Games
Apps
Instant Messaging
3G
Stereo Bluetooth
Video Capture
SD Card Storage
Calendar
Contacts
Quad-Band GSM
Voice Dialing
Alarm
Calculator
Photo Album
SMS
MMS
Wi-Fi
Internet Tethering
Slide-out Keyboard
Turn-by-Turn Navigation
Push to Talk
Radio
Hi-res Graphics
Streaming XM/Sirius
Mobile TV
Java
Facebook
MySpace

We consider phones with advanced mobile operating systems like Windows Mobile, Blackberry, iPhone, Symbian, and WebOS to be Smartphones. When I look at the list of features above, I think most people in world would have a hard time distinguishing between what we call Smartphones and the rising tide of super-charged feature phones. At a 30,000 ft level, a published API and development tools that allow you to create rich applications to access databases and remote servers may be the only distinction. Of course that would be a slight againt Java ME that's found on over a billion feature phones. I would venture to guess that 99% of the buying public can't tell the difference and may not even care as long as the price is right.

The big takeaway is that the large chasm that used to exist between feature phones and Smartphones has diminished dramatically. In the coming years, Smartphone OS and hardware manufacturers have no choice but to innovate in a big way in order to put some distance between themselves and the clones attacking them from below or risk becoming commoditized and irrelevant.

- Rob

Mobile Architecture Pocket Guide v1.1

robtiffany — Sat, 17 Jan 2009 21:01:00 GMT

Just wanted to let everyone know that version 1.1 of the Mobile Architecture Pocket Guide is now available on CodePlex at http://www.codeplex.com/AppArch/Release/ProjectReleases.aspx?ReleaseId=19798. This is the first patterns & practices update to this guide since 2002 so it's a welcome sight to to have it out there for all our Windows Mobile developers.

I've spent the last couple of months working with J.D. Meier, Rabi Satter, Rob Boucher and the rest of the P&P team to tune, tweak and update the new Mobile Architecture Pocket Guide to ensure that it's as accurate and relevant to today's Windows Mobile platform and runtimes as possible. The guide's chapters include:

Ch 01 > Mobile Application Architecture
Ch 02 > Architecture and Design Guidelines
Ch 03 > Presentation Layer Guidelines
Ch 04 > Business Layer Guidelines
Ch 05 > Data Access Layer Guidelines
Ch 06 > Service Layer Guidelines
Ch 07 > Communication Guidelines
Ch 08 > Deployment Patterns

Our goal is to empower our Windows Mobile developer community as much as possible, and while this guide may seem like it's targeted exclusively to developers, I ensured that the IT Pro side of the house is accommodated as well. Mobile infrastructure elements of this guide include System Center Mobile Device Manager (Deployment), SQL Server (Sync Services + Merge), IIS (Web Services + Sync + WCF), Exchange (WCF Store and Forward) and Active Directory (Auth).

Download it, take if for a spin, and give us your feedback so we can keep improving it.

- Rob

See you in Barcelona for Tech Ed EMEA Dev

robtiffany — Fri, 07 Nov 2008 19:14:00 GMT

Looking forward to seeing lots of familiar faces and meeting new ones starting December 10th at Tech Ed EMEA! While I ran the Windows Mobile track for Tech Ed North America last June in Orlando, this time around I'll just be delivering a couple of presentations and spending most of my time helping empower delegates to create incredible mobile applications. I'll be delivering the following breakout sessions:


	MBL301	What's New in the Windows Mobile Line of Business Solution Accelerator 2008	November 10 16:00 - 17:15	Room 121
This session walks through the new features that we have added to the Windows Mobile Line of Business Accelerator 2008; features such as adapting your application to any device or screen size with a single binary, sync services, store and forward, and advanced data access objects with Microsoft .NET CF 3.5.


	MBL310	Mobilize your Enterprise and Achieve Global Scalability with Windows Mobile and SQL Server Compact	November 11 15:15 - 16:30	Room 121
With the world's largest organizations rolling out tens of thousands of Windows Mobile devices to empower their respective workforces, the ability to create mobile line-of-business solutions that can support large user populations is critical. Based on his third book on Windows Mobile development, Rob Tiffany shows you how to take the Microsoft SQL Server data you use to run your organization and make it available to all your mobile employees. Utilizing the performance, scale-out, and filtering capabilities of Merge Replication Republishing, Rob shows you how to build an n-tier mobile synchronization architecture designed to scale to hundreds of thousands of devices. Take the guesswork out of mobilizing your enterprise by tapping into the experience of one of the world's foremost authorities on Windows Mobile infrastructure and development.

See you there!

- Rob

Chapter 1 of my new Book is Ready!

robtiffany — Fri, 24 Oct 2008 04:12:00 GMT

Mobile Data Synchronization with Microsoft SQL Server 2005 and SQL Server Compact > Second Edition

Achieving Global Scalability via Merge Replication Republishing

Download and review the PDF from my Windows Live SkyDrive @

http://cid-8b9c82da88af61fc.skydrive.live.com/self.aspx/Sync/Ch%201.pdf

The new book shows you how to scale out your Merge Replication Architecture with Republishing. It's chock full of new insight to show you how to get the most performance and scalability out of your system. It also shows you how to make replication Subscriptions available to the Internet via ISA Server 2006 or System Center Mobile Device Manager.

Check it out and let me know what you think.

Best Regards,

Rob

Listen to Rob's Windows Mobile Interview on .NET Rocks!

robtiffany — Thu, 09 Oct 2008 23:07:00 GMT

I was recently interviewed by Carl Franklin and Richard Campbell who run one of the Internet's most popular developer sites, .NET Rocks! You can catch the interview at http://www.dotnetrocks.com/default.aspx?showNum=384 where you can either listen to it live via the website, or download it to your favorite device to listen later.

I cover the current state of Windows Mobile + the entire ecosystem including OEMs, Mobile Operators, developers and who does what within Microsoft's Mobile Commications Business in Redmond and the Mobile Development Center in Hyderabad. I take Carl and Richard on a deep dive of our latest mobile development technologies and techniques with the .NET Compact Framework, SQL Server Compact, and WCF Store and Forward just to name a few. I also cover all the features of System Center Mobile Device Manager including OTA software distribution, Group Policies, Mobile VPN security and Domain join.

Download it and give it a listen

- Rob

Sync Framework v1 and Sync Services for ADO.NET v2 are now Generally Available!

robtiffany — Thu, 07 Aug 2008 03:42:00 GMT

As of today you can download the Sync Framework SDK in 11 languages including Chinese (Hong Kong), Chinese (Simplified), English, German, French, Italian, Japanese, Korean, Portuguese, Russian and Spanish for AMD64, IA64 and x86 processors from the Sync Framework Download Center.

What is Sync Framework?

Imagine being able to build a solution that seamlessly exchanges contact information between Outlook, a database contact management application, your mobile device and your service based contact management system. Or how about a mobile device that connects with other devices to exchange pictures and videos. How about being able to take data from any of your enterprise databases, file or enterprise systems and make it available offline for users to modify and sync back up to the enterprise. All of these capabilities are possible with the Sync Framework and best of all, it is free on Windows platforms and licensable on non-Windows platforms!

Just a few examples of companies that are already using the Sync Framework include:

SmugMug who has added support for the Sync Framework to enable developers to build rich offline applications that can allow photos to be easily shared on friends and families local computers.
InterScape have embedded Sync Framework into their Customer Relationship & Management (CRM) solution to enable sales people to synchronize enterprise files and data for offline access.
Fujitsu Siemens will embed the SyncToy file synchronization solution (powered by Sync Framework) on their STORAGEBIRD external drives to enable seamless file synchronization between devices and computers.

Sync Framework Highlights

Some of the highlights of this release include:

Sync support to new and existing applications, services, and devices
Collaboration and offline capabilities for any application
Roam and share information from any data store, over any protocol, and over any network configuration
Leverage sync capabilities exposed in Microsoft technologies to create sync ecosystems
Extend the architecture to support custom data types including files

Sync Services for ADO.NET v2 Highlights

Sync Services for ADO.NET is a Microsoft Sync Framework powered solution for synchronizing ADO.NET enabled databases in offline and collaboration scenarios. Sync Services for ADO.NET allows developers who are familiar with the concepts of ADO.NET to apply that knowledge to data synchronization through a very similar set of APIs to that of ADO.NET. Sync Services for ADO.NET provides the flexibility of a programming model like offline datasets and a richer synchronization feature set like that found in Merge replication. Sync Services for ADO.NET also supports synchronization over services, such as Windows Communication Foundation (WCF).

Some of the Sync Services for ADO.NET highlights include:

Offline Database Synchronization: With Sync Services for ADO.NET you are able to build a solution where multiple remote clients connect and synchronize to a central ADO.NET database in a Hub-and-Spoke configuration. This enables occasionally connected devices to periodically connect and synchronize changes with a central ADO.NET database server. This topology is a common solution for remote workers such as sales reps or field service workers.
Collaboration Between Databases: Sync Services for ADO.NET also includes Peer-to-Peer capabilities. Through a custom Peer provider, collaboration between two or more SQL Server databases can occur (support is not available for SQL Server Compact). Unlike a Hub-and-Spoke architecture, this provider enables a SQL Server database to communicate and exchange information with any other SQL Server database. This type of scenario is useful in group scenarios where users (such as auditors) need to update information and then collaborate those changes with other group members.
SQL Server 2008 Integrated Change Tracking: If you are using SQL Server 2008, we recommend that you use the SQL Server change tracking feature. This feature addresses many of the issues of custom-tracking systems and provides a straightforward way to track changes. Change tracking is also supported by the Local Database Cache in Visual Studio 2008 SP1. Developers can now specify that the Configure Data Synchronization wizard should enable SQL Server change tracking on the server and generate the commands necessary to select and apply changes to the server database. Unlike custom change tracking systems, SQL Server change tracking does not require any schema changes in the server database. For more information, see the Visual Studio 2008 documentation.

Sync Framework Pricing

Sync Framework will be licensed free on Windows platforms. In addition, we are also licensing the specifications and a source code porting kit to developers who want to implement Microsoft Sync Framework solutions on non-Windows platforms.

To learn more, visit http://msdn.microsoft.com/sync

- Rob

Building Offline Enabled Applications

robtiffany — Mon, 23 Jun 2008 05:29:00 GMT

At Tech Ed Developers in Orlando this year, I had the pleasure of joining Ginny Caughey, Steve Lasker, Liam Cavanagh, and Rob Relyea for a Tech Ed Online discussion on building offline enabled applications.

In an online world, why are we building offline apps? Because networks are only occasionally available, or occasionally not available. However, building offline apps is a bit more complicated. Listen to our panel of speakers that works on enabling offline apps from the storage, sync, programming model, and UI stack.

View the low bandwidth version:

http://microsofttech.fr.edgesuite.net/TechEdOnline/Videos/08_NA_Dev_TEOPanel_14_low.wmv

View the high bandwidth version:

http://microsofttech.fr.edgesuite.net/TechEdOnline/Videos/08_NA_Dev_TEOPanel_14_high.wmv

View the MP4 version:

http://microsofttech.fr.edgesuite.net/TechEdOnline/Videos/08_NA_Dev_TEOPanel_14_high.mp4

- Rob

Mobile Scalability + Staggering Performance

robtiffany — Wed, 16 Jan 2008 08:08:00 GMT

As you know from my recent posts, I've been hanging out at 1,200 concurrent Subscribers trying to boost performance. When I first hit the 1,200 Subscriber mark, I was able to change and replicate ~13 million rows per hour. I was happy with the scalability, but the performance was no better than what I achieved with 600 concurrent Subscribers. Rather than push the scalability envelope out to 1,800 or 2,400 Subscribers, I decided to tweak, poke and prod my portable data center until I could get better performance at the 1,200 level. I succeeded with the architecture you see below:

Sometimes more is more. Sometimes less is more.

Knowing that the ISAPI DLL running on IIS is the biggest bottleneck in the system, I decided to scale out to 6 IIS servers in addition to my separate SQL Publisher and SQL Distributor servers. The 2 SQL Servers have 8 cores and 16 GB of RAM while the 6 IIS servers contain 2 cores and 2 GB of RAM. Each IIS server would accomodate 200 concurrent clients each. In the last week of December 2007, I throttled back the MAX_THREADS_PER_POOL registry setting on the IIS servers from the default of 20 to just 3 and ran my test harness. This resulted in the changing and replicating of ~15 millions rows per hour; a boost of 2 million rows per hour over my previous test. Using fewer threads on each IIS box meant lower memory and CPU utilization across the board. Instead of overwhelming SQL Server will lots of threads trying to perform work all at the same time, SQL Server got to chill out and thus processed each sync much faster. This was great news so I pushed the fewer threads experiment even further. I executed my test harness with 2 threads and then just 1 thread per IIS server. Using just 1 thread resulted in the changing and replicating of ~18 million rows per hour; a 3 million row per hour boost over using 3 threads per IIS server.

At ~21 million row changes per hour, 2 threads per IIS server is the sweet spot!

Rows changed: 5,826 per second | 349,600 per minute | 20,976,000 per hour | 503,424,000 per day
Bytes per row: 116
Data replicated: 2.3 GB per hour | 55 GB per day

The longest and average sync times dropped significantly over the first results I got with 1,200 concurrent Subscribers:

Longest sync time: 14 minutes
Shortest sync time: .6 seconds
Average sync time: 3 minutes, 38 seconds

The IIS didn't break a sweat:

IIS1: CPU: 11% | Mem: 172 MB | Network Utilization: 89%

Disk I/O: OS: .3%, ISAPI: 3.8%

IIS2: CPU: 8% | Mem: 167 MB | Network Utilization: .91%

Disk I/O: OS: .2%, ISAPI: 3%

IIS3: CPU: 6% | Mem: 171 MB | Network Utilization: .82%

Disk I/O: OS: .2%, ISAPI: 2.8%

IIS4: CPU: 7% | Mem: 171 MB | Network Utilization: .71%

Disk I/O: OS: .5%, ISAPI: 3.4%

IIS5: CPU: 6% | Mem: 152 MB | Network Utilization: .92%

Disk I/O: OS: .3%, ISAPI: 2.3%

IIS6: CPU: 8% | Mem: 151 MB | Network Utilization: 1%

Disk I/O: OS: .3%, ISAPI: 2.6%

The CPU was finally well-utilized (after dozens of tests that never went higher than 35%) on the SQL Publisher and the SQL Distributor's disk that held the transaction log was pegged (which means it could use some RAID 0 or 10 medicine).

SQL Distributor: CPU: 9% | Mem: 2.32 GB | Network Utilization: .64%

Disk I/O: OS: .7%, SQL: 1%, DB: 16.8%, LOG: 100%, Snapshot Share: 1%

SQL Publisher: CPU: 74% | Mem: 4.19 GB | Network Utilization: 4%

Disk I/O: OS: 1.1%, SQL: 13.7%, DB: 1%, LOG: 22.6%

I'm very pleased with these results as they represent the kind of scalability and performance that our clients are looking for when they're considering building and rolling out a mobile line of business application. As usual, the low memory and CPU utilizaiton on the IIS servers will lead architects to think that using 6 load-balanced boxes is wasteful and they deserve to be consolidated. I've been down that path and the place that I've arrived at today tells me that the ISAPI DLLs are exhausted long before you can detect any strain on the IIS server. That being said, the use of fewer threads means that I don't need the memory and CPU power I once thought I needed. Lower-end IIS servers could be purchased or perhaps consolidation could happen by deploying them as virtual images inside Hyper-V on Longhorn or Virtual Server on Windows Server 2003. Definitely something worth looking at.

In the near term, you should expect to see me push the scalability envelope to the 1,800 and/or 2,400 concurrent Subscriber level in an effort to see what it takes to saturate a single SQL Server box. Along the way, I will take a look at virtualization options to see how well they work out. Lastly, you'll see me persue "Republishing" architectures with SQL Server in an effort to make Mobile Merge Replication scalable enough to support hundreds of thousands or millions of Windows Mobile devices. Only then could you consider using this technology for large-scale consumer applications with a national or global reach. Remember, Windows Mobile 6 comes with a built-in content synchronization engine called SQL Server Compact 3.1. When you start thinking big, you realize that we could use this technology to push intelligent advertising to devices or build the next global social networking platform designed for people on the go.

See you at TechReady 6!

- Rob

My New Book is Now Available!

robtiffany — Tue, 08 Jan 2008 01:12:00 GMT

"Windows Mobile Data Synchronization with SQL Server 2005 and SQL Server Compact 3.1" is now available in print! Those of you in the continental U.S. can just buy it directly from the Hood Canal Press site at http://www.hoodcanalpress.com/catalog.htm and get free ground shipping. It's on Amazon in the U.S. so you can order it at http://www.amazon.com/Windows-Mobile-Synchronization-Server-Compact/dp/0979891205/ref=sr_1_13?ie=UTF8&s=books&qid=1199744085&sr=1-13 as well. At Amazon UK you can find it here http://www.amazon.co.uk/Windows-Mobile-Synchronization-Server-Compact/dp/0979891205/ref=sr_1_7?ie=UTF8&s=books&qid=1199744162&sr=1-7.

Go buy it and start building large-scale line of business and consumer applications for Windows Mobile!

-Rob

Windows Mobile Partner Summit Day 1

robtiffany — Wed, 12 Dec 2007 22:16:00 GMT

The Windows Mobile Partner Summit is going great and the event looks to be twice as big as last year. It's always nice to reconnect with our partner community. Steve Hegenderfer was kind enough to allow me to bring my rack of servers to his event. This time, I have a much lighter, 24U half rack which is much easier to move around. At the Dev Connections conference, I used a new stress test designed to push the number of row changes per sync. At that event, I used 300 concurrent Subscribers to perform 23,330 syncs per hour and make changes to 7,000,000 rows per hour. Each complete row change consisted of 116 bytes of data which meant I changed and replicated 812 MB of data per hour.

This time around I decided to double the number of concurrent Subscribers to 600. Keep in mind that each Subscriber is equivalant to a Windows Mobile device. I used 6 servers running 100 Subscribers each to create client load, 3 load-balanced IIS servers, and a separate SQL Server Distributor and Publisher. With 600 concurrent Subscribers contending for resources, I managed to perform 22,401 syncs per hour which is slightly fewer syncs than I saw when running only 300 Subscribers back in Vegas. The important story here is that I almost doubled the number of rows I changed and replicated per hour:

Rows changed: 13,440,600 per hour | 322,574,400 per day
Data replicated: 1.45 GB per hour | 34.8 GB per day

Just like in Vegas, the IIS and SQL Servers where just chilling out throughout this test:

IIS1: CPU: 7% | Mem: 188 MB | Network Utilization: .69%
IIS2: CPU: 8% | Mem: 187 MB | Network Utilization: .88%
IIS3: CPU: 5% | Mem: 185 MB | Network Utilization: .95%
SQL Distributor: CPU: 5% | Mem: 994 MB | Network Utilization: .77%
SQL Publisher: CPU: 36% | Mem: 4.11 GB | Network Utilization: 1%

This is truly incredible and further proves that SQL Server 2005 + SQL Server Compact 3.1 + Merge Replication is the most powerful data sync technology on the market today.

- Rob

New Mobile Merge Replication Benchmarks

robtiffany — Fri, 09 Nov 2007 21:02:00 GMT

I just finished up a week of teaching attendees at the Dev Connections conference how to setup and use mobile merge replication to sync data between their Windows Mobile devices and SQL Server 2005. As usual, I brought along my favorite teaching tool, my portable data center, to take attendees on deep dives of the 4 different tiers of my replication architecture. This time around, I changed the way my stress test harness works. In the past, my goal has always been to see how many Subscribers I could connect to the system at the same time. With the new test, I'm stressing the system to a much greater degree with my software to push the envelope in regards to how many table row changes I can make per hour.

With an eye towards the stress testing system that has helped give iAnywhere's ASA database and MobiLink replication server a dominant market position, I built a similar test where the amount of data in each row changed is exactly 116 bytes each time. I think the iAnywhere stress test used 92 byte rows. I used 3 servers to create client load, 3 load-balanced IIS servers, and a separate SQL Server Distributor and Publisher. The results I got from my test harness performing 23,330 syncs per hour are nothing short of spectacular:

Rows changed: 7,000,000 per hour | 168,000,000 per day
Data replicated: 812 MB per hour | 19.4 GB per day

Now check out how the IIS and SQL Servers where just chilling out throughout this test:

IIS1: CPU: 5% | Mem: 216 MB | Network Utilization: .44%
IIS2: CPU: 7% | Mem: 147 MB | Network Utilization: .13%
IIS3: CPU: 8% | Mem: 170 MB | Network Utilization: .42%
SQL Distributor: CPU: 5% | Mem: 2.15 GB | Network Utilization: .58%
SQL Publisher: CPU: 17% | Mem: 4.25 GB | Network Utilization: 1%

Not bad! Thanks to Loke Uei, we were also able to give away 300 copies of my new book that walks you through the construction of this scalable mobile merge replication system. Lots of Windows Mobile developers and IT Pros are now empowered to "mobilize" their organization's data out to mobile field personnel. Just as important, they can take the proof back to their respective organizations that this technology is build to perform and scale!

I'm just getting started with this new test harness. Come to the Windows Mobile Partner Summit in December to see me push this system even further and break new replication records!

- Rob

Chapter 1: Getting Started with Merge Replication

robtiffany — Mon, 10 Sep 2007 08:54:00 GMT

The non-linear fashion by which I've been writing this book reminds me of the way Pulp Fiction jumps around. Chapter 1 is ready to go so you can get started with Merge Replication for Windows Mobile devices. In addition to obvious technology walkthroughs, I also decided to add a bunch of scenarios that illustrate how mobile data synchronization can add tangible business value to existing endeavors.

The book is called "Windows Mobile Data Synchronization with SQL Server 2005 and SQL Server Compact 3.1" and it's being published by Hood Canal Press. Click on Chapter1.pdf below to download Chapter 1 on getting started with Merge Replication.

Chapter 3: Configuring the Publisher

robtiffany — Sat, 01 Sep 2007 08:14:00 GMT

The biggest and most comprehensive chapter of the new book is ready to preview! Chapter 3 is ready to go for some relaxing Labor Day weekend reading. It's the deepest coverage that I've seen on all the nuances of the SQL Server Publisher for mobile replication if I may say so myself.

The book is called "Windows Mobile Data Synchronization with SQL Server 2005 and SQL Server Compact 3.1" and it's being published by Hood Canal Press. Click on Chapter3.pdf below to download Chapter 3 on installing and configuring the SQL Server Publisher.