Blog - Title

  • Carl's Blog

    .Net Implementation of a Priority Queue (aka Heap)

    • 0 Comments
    I thought I would take a break for a while from Hadoop and put together an F# .Net implementation of a Priority Queue; implemented using a heap data structure. Conceptually we can think of a heap as a balanced binary tree. The tree will have a root, and...
  • Carl's Blog

    Generics based Framework for .Net Hadoop MapReduce Job Submission

    • 8 Comments
    Over the past month I have been working on a framework to allow composition and submission of MapReduce jobs using .Net. I have put together two previous blog posts on this, so rather than put together a third on the latest change I thought I would create...
  • Carl's Blog

    .Net Hadoop MapReduce Job Framework - Revisited (Archived)

    • 0 Comments
    An updated version of this post can be found at: http://blogs.msdn.com/b/carlnol/archive/2012/04/29/generic-based-framework-for-net-hadoop-mapreduce-job-submission.aspx If you have been using the Framework for Composing and Submitting .Net Hadoop...
  • Carl's Blog

    Framework for Composing and Submitting .Net Hadoop MapReduce Jobs (Archived)

    • 0 Comments
    An updated version of this post can be found at: http://blogs.msdn.com/b/carlnol/archive/2012/04/29/generic-based-framework-for-net-hadoop-mapreduce-job-submission.aspx If you have been following my blog you will see that I have been putting together...
  • Carl's Blog

    Hadoop .Net HDFS File Access (Archived)

    • 12 Comments
    Updated post can be found here: http://blogs.msdn.com/b/carlnol/archive/2013/02/08/hdinsight-net-hdfs-file-access.aspx If you grab the latest installment of Microsoft Distribution of Hadoop you will notice, in addition to the C library, a Managed C...
  • Carl's Blog

    Hadoop Streaming in F# and MapReduce (summary)

    • 0 Comments
    With all my recent posts around Hadoop Streaming I thought it would be useful to summarize them into a single post. The main objective of these posts was to put together a codebase to enable F# developers to write Map/Reduce libraries through a simple...
  • Carl's Blog

    FSharpChart for Valentines Day

    • 1 Comments
    As I have not posted anything about FSharpChart for a while I thought I would do a quick post, one that befits Valentines Day: Plotting the heart was surprisingly easy to do: [ for x in -1.1 .. 0.001 .. 1.0 do      let y1 = abs(x)+sqrt(1.0-x**2.0)   ...
  • Carl's Blog

    Hadoop XML Streaming and F# MapReduce

    • 0 Comments
    So, to round out the Hadoop Streaming samples I thought I would put together an XML Streaming sample. As always the code can be found here: http://code.msdn.microsoft.com/Hadoop-Streaming-and-F-f2e76850 XML Streaming Reader So how does one stream in XML...
  • Carl's Blog

    Hadoop Streaming and Windows Azure Blob Storage

    • 0 Comments
    One of the cool features of the Microsoft Distribution of Hadoop (MDH) is the native support for Windows Azure Blob Storage. When performing HDFS operations by default one can omit the scheme such that: hadoop fs -lsr /mobile Is equivalent to: hadoop...
  • Carl's Blog

    Hadoop Streaming and Reporting

    • 0 Comments
    If like me you are a .Net developer and have written some Streaming jobs it is not immediately obvious how one can do any reporting. However if you dig through the Streaming Documentation you will come across this in the FAQs: How do I update counters...
  • Carl's Blog

    A lazy evaluation of F# Seq.groupBy for sorted sequences

    • 0 Comments
    In doing some recent work with Hadoop I needed to process a sequence which was grouped by a projected key. Whereas the Seq.groupBy can perform this operation, the Seq.groupBy function makes no assumption on the ordering of the original sequence. As a...
  • Carl's Blog

    Hadoop Binary Streaming and PDF File Inclusion

    • 3 Comments
    In a previous post I talked about Hadoop Binary Streaming for the processing of Microsoft Office Word documents. However, due to there popularity, I thought inclusion for support of Adobe PDF documents would  be beneficial. To this end I have updated...
  • Carl's Blog

    Hadoop Binary Streaming and F# MapReduce

    • 0 Comments
    As mentioned in my previous post Hadoop Streaming not only supports text streaming, but it also supports Binary Streaming. As such I wanted to put together a sample that supports processing Office documents; more on support for PDF in a later post. As...
  • Carl's Blog

    MapReduce Tester: A Quick Word

    • 0 Comments
    In my previous post I talked a little about testing the Hadoop Streaming F# MapReduce code; but it is worth saying a few words about the tester application. The complete code for this blog post and the F# MapReduce code can be found at: http://code.msdn...
  • Carl's Blog

    Using Hadoop on Azure JS Console for Data Visualizations

    • 1 Comments
    In my last past I demonstrated a F# MapReduce program based on Hadoop Streaming. One thing that intrigued me was the possibility of using the JS Console for doing a quick visualization of the MapReduce output. So here is my first foray into the idea....
  • Carl's Blog

    Hadoop Streaming and F# MapReduce

    • 3 Comments
    And now for something completely different. As you may know Microsoft has recently announced plans for a Hadoop adoption for both Windows Server and Windows Azure . You can find out more about Hadoop and Windows Azure at Apache Hadoop-based Services...
  • Carl's Blog

    F# Project and Item Templates (revised)

    • 0 Comments
    Over the past few months I have posted up a few Project and Item Templates for F#. Here is a quick summary of those templates. The Project Templates include: WPF Project WinForms Application Console Application Windows Service F# Class Library These Project...
  • Carl's Blog

    F# WPF Project Template

    • 0 Comments
    This template is for a basic F# Windows Presentation Foundation (WPF) project. This template can be found on the Visual Studio Gallery: http://visualstudiogallery.msdn.microsoft.com/33dab4ce-62b8-419e-8072-92bc88556f78 When the template is installed...
  • Carl's Blog

    SQL Server Query Performance Analysis using DMVs

    • 4 Comments
    Continuing the TSQL theme I thought it would be worthwhile sharing some TSQL scripts that I have been using over the years for tuning SQL Server queries… From the development perspective I often have to perform an analysis of a database application. More...
  • Carl's Blog

    Adventures in TSQL: Using CTEs when performing DELETE/UPDATE operations

    • 0 Comments
    It seems in quite a few applications of late there has been the requirement to batch process, in a distinct order, a series of entries from a table; namely a processing queue. Without delving in broker services this is easily managed using standard TSQL...
  • Carl's Blog

    Adventures in TSQL: Adding date and time values

    • 2 Comments
    With the addition of the SQL Server date and time types, I have often found myself needing to create a datetime (or datetime2) value based on the addition of a date and a time value. However, there is no built-in function for such an operation. There...
  • Carl's Blog

    Adventures in TSQL: Comma separated string from column values

    • 2 Comments
    It seems that several times now I have had the requirement to create a comma separated string from column values. The latest reason for doing this was to build up a list of table column names such that a view could be generated for the table. This is...
  • Carl's Blog

    Creating a Partitioned View in the BAM Archiving Database

    • 0 Comments
    When you run the BAM data maintenance package (BAM_DM_ <activity name> ) BAM copies each partition in the BAM Primary Import database to a separate table in the BAM Archive database. You can create partitioned views in the BAM Archive database to...
  • Carl's Blog

    F# Dynamic Lookup Operator and Regex

    • 0 Comments
    In a recent post I talked about using String.forall for string matching over the use of Regex: http://blogs.msdn.com/b/carlnol/archive/2011/10/20/f-string-extension-methods-rather-than-using-regex.aspx I do however use Regex a lot for other types of processing...
  • Carl's Blog

    F# Parallel Execution and Future Tasks

    • 0 Comments
    In a previous post I talked about some options around performing parallel executions by providing some wrappers that allowed a collection of functions to be executed in parallel: http://blogs.msdn.com/b/carlnol/archive/2011/07/17/f-and-running-parallel...
Page 2 of 3 (71 items) 123