Over the past month I have been working on a framework to allow composition and submission of MapReduce jobs using .Net. I have put together two previous blog posts on this, so rather than put together a third on the latest change I thought I would create a final composite post. To understand why lets...

An updated version of this post can be found at: http://blogs.msdn.com/b/carlnol/archive/2012/04/29/generic-based-framework-for-net-hadoop-mapreduce-job-submission.aspx If you have been following my blog you will see that I have been putting together samples for writing .Net Hadoop MapReduce jobs;...

As mentioned in my previous post Hadoop Streaming not only supports text streaming, but it also supports Binary Streaming. As such I wanted to put together a sample that supports processing Office documents. As before the code can be downloaded from: http://code.msdn.microsoft.com/Hadoop-Streaming-and...

As you may know Microsoft has recently announced plans for a Hadoop adoption for both Windows Server and Windows Azure . You can find out more about Hadoop and Windows Azure at Apache Hadoop-based Services for Windows Azure and Availability of Community Technology Preview (CTP) of Hadoop based Service...

From the development perspective I often have to perform an analysis of a database application. More often than not this entails looking at a running system and ensuring that the application queries are behaving as expected. As such, I thought it would be worthwhile sharing some TSQL scripts that I have...

When you run the BAM data maintenance package (BAM_DM_ <activity name> ) BAM copies each partition in the BAM Primary Import database to a separate table in the BAM Archive database. You can create partitioned views in the BAM Archive database to facilitate locating the data. However one is left...

It seems that several times now I have had the requirement to create a comma separated string from column values. The latest reason for doing this was to build up a list of table column names such that a view could be generated for the table. This is surprisingly easy to do in TSQL. One merely has to...

FSharpChart now supports binding for Stacked Charts and for modifying the Marker associated with a series. As always one can download the latest release from: http://code.msdn.microsoft.com/FSharpChart-b59073f5   In previous versions of FSharpChart it was not very intuitive how a Stacked Chart could...

In a recent project I was using regular expressions a lot for validating string expressions such that statements like the following were true: Must be all characters Must be all alphanumeric’s and be of length 6 Must be all numeric digits (e.g. “3648”) Must be all upper case characters However in reflection...

If you have been using FSharpChart you will have seen some recent activities around documentation. I am happy to say that a new code drop has been made available. This release deals with some minor bug fixes and restructures the code download, hopefully making it easier to navigate, in addition to the...

If you are like me and often use console applications for a variety of purposes you would have found the F# template not much use (in fact a blank code file). As such I decided to put together a more complete Project Template that I could use. The template can be found on the Visual Studio Gallery: http...

In all the previous discussions around FSharpChart, samples have been shown within F# Interactive. I wanted to spend a few moments and demonstrate how FSharpChart can be consumed within a WinForms application, and how chart properties can be modified at runtime. Before getting started a quick word is...

With the addition of the SQL Server date and time types, I have often found myself needing to create a datetime (or datetime2) value based on the addition of a date and a time value. However, there is no built-in function for such an operation. There are a few solutions to this problem that encompass...

Recently I have been working a lot with the Task Parallel Libraries. In doing so, in F#,  you will quickly learn that one has to perform quite a bit of casting. As such I have found it useful to define some wrapper members that abstract these casting and calling schematics: type ParallelEx =   ...

In a previous post I talked about a mechanism for Parallel Process Execution with Conditional Completion . This code was a direct translation from a C# pattern. However it is worth noting that the Command pattern is not actually necessary in functional languages. To demonstrate this here is a version...

As I mentioned in my previous post, Array.Parallel sort functions demonstrating a Merge Sort using Barrier , I wanted to continue the parallel sort examples with a Quicksort using the Task Parallel Libraries. F#, as do all functional languages, lend themselves easily to Quicksort implementations. There...

If you have been using FSharpChart you will undoubtedly have read Keith Battocchi’s posting, on the F# team blog, covering Getting Started with FSharpChart . If not it is well worth a quick read. The FSharpChart library contains F#-friendly wrappers for the types in the System.Windows.Forms.DataVisualization...

If you follow the excellent Parallel Programing with .Net blog , you will have read a recent post by Emad Omara demonstrating a Parallel Merge Sort using Barrier . While there may be more efficient parallel sorting options, as this post notes, this is a good demonstration of the usage of a Barrier, and...

So, in my last post I said that the template would be the last for a while, but here is one more. This template creates a Windows Library with a simple class definition. The template can be found on the Visual Studio Gallery: http://visualstudiogallery.msdn.microsoft.com/a3f39bd9-9fd2-4465-a931...

So to round out the templates for a while, the final one I have created is an Item Template for creating an Assembly Information File: The template can be found on the Visual Studio Gallery at: http://visualstudiogallery.msdn.microsoft.com/06bc7a47-be14-42b9-a8cb-86031922ff83 The reason this...

Recently I created a posting outlining a project template for a WinForms application . This posting outlines a new project template that provides the elements for the creation windows service in F#. The template can be found on the Visual Studio Gallery: http://visualstudiogallery.msdn.microsoft.com...

Recently I have been doing some work with FSharp.Charting and found there was no simple template for an F# WinForms application. So to remedy this situation I have posted one on the Visual Studio Gallery: http://visualstudiogallery.msdn.microsoft.com/eba78049-a17e-4868-9ead-065da1421052 When the...

In a previous posting, available here , I discussed a pattern for running long running processes synchronously and in parallel, but terminating processing when a certain condition was met. As an F# exercise I decided to write a similar code pattern using PSeq, an F#-style API for parallel operations...

In a recent posting, available here , I tried to explain why the IEnumerable Distinct() method employs an IEqualityComparer implementation. In this posting I will provide a simple extension to IEnumerable for the Distinct() method that allows one to use a Func to determine a property on which the Distinct...

As you may know when working with LINQ there is a method that allows one to return distinct elements from a sequence. Two prototypes are supported: Distinct<TSource>(IEqualityComparer<TSource>) Distinct() Unlike most sequence operations that take some form of a Func parameter, the...