Blog - Title

  • Carl's Blog

    Hadoop .Net HDFS File Access (Revisited Archived)

    • 9 Comments
    Updated post can be found here: http://blogs.msdn.com/b/carlnol/archive/2013/02/08/hdinsight-net-hdfs-file-access.aspx Provided with the Microsoft Distribution of Hadoop, in addition to the C library, a Managed C++ solution for HDFS file access is...
  • Carl's Blog

    Hive and XML File Processing

    • 5 Comments
    When I put together the “ Generics based Framework for .Net Hadoop MapReduce Job Submission ” code one of the goals was to support XML file processing. This was achieved by the creation of a modified Mahout document reader where one can specify the XML...
  • Carl's Blog

    Implementing a MapReduce Join with Hadoop and the .Net Framework

    • 1 Comments
    I have often been asked how does one implement a Join whilst writing MapReduce code. As such, I thought it would be useful to add an additional sample demonstrating how this is achieved. There are multiple mechanisms one can employ to perform a Join operation...
  • Carl's Blog

    Hadoop Streaming and F# MapReduce

    • 3 Comments
    And now for something completely different. As you may know Microsoft has recently announced plans for a Hadoop adoption for both Windows Server and Windows Azure . You can find out more about Hadoop and Windows Azure at Apache Hadoop-based Services...
  • Carl's Blog

    SQL Server Query Performance Analysis using DMVs

    • 3 Comments
    Continuing the TSQL theme I thought it would be worthwhile sharing some TSQL scripts that I have been using over the years for tuning SQL Server queries… From the development perspective I often have to perform an analysis of a database application. More...
  • Carl's Blog

    Hadoop .Net HDFS File Access

    • 8 Comments
    Provided with the Microsoft Distribution of Hadoop, HDInsight, is a C library for HDFS file access. This code extends this library through a Managed C++ solution. This solution enables one to consume HDFS files from within a .Net environment. The purpose...
  • Carl's Blog

    Co-occurrence Approach to an Item Based Recommender

    • 0 Comments
    For a while I thought I would tackle the problem of creating an item-based recommender. Firstly I will start with a local variant before moving onto a MapReduce version. The current version of the code can be found at: http://code.msdn.microsoft.com/Co...
  • Carl's Blog

    C# MapReduce Based Co-occurrence Item Based Recommender

    • 0 Comments
    As promised, to conclude the Co-occurrence Approach to an Item Based Recommender posts I wanted to port the MapReduce code to C#; just for kicks and to prove the code is also easy to write in C#. For an explanation of the MapReduce post review the previous...
  • Carl's Blog

    MapReduce Based Co-occurrence Approach to an Item Based Recommender

    • 0 Comments
    In a previous post I covered the basics for a Co-occurrence Approach to an Item Based Recommender . As promised, here is the continuation of this work, an implementation of the same algorithm using MapReduce. Before reading this post it will be worth...
  • Carl's Blog

    Implementing Hadoop Rack Awareness with PowerShell

    • 0 Comments
    This post walks-through building a PowerShell script for enabling Rack Awareness in Hadoop. While several example scripts can be found online for Linux, samples building a script for Windows is less common. Hadoop divides the data into multiple file blocks...
  • Carl's Blog

    Framework for .Net Hadoop MapReduce Job Submission V1.0 Release

    • 0 Comments
    It has been a few months since I have made a change to the “ Generics based Framework for .Net Hadoop MapReduce Job Submission ” code. However I was going to put together a sample for a Reduce side join and came across a issue around the usage...
  • Carl's Blog

    WinForms HTML Editor

    • 12 Comments
    A few years ago I wrote a WinForms HTML Editor. As I have been working in WinForms again it seemed appropriate to post the code up to a new location: http://code.msdn.microsoft.com/WinForms-HTML-Editor-01dbce1a A document describing the control...
  • Carl's Blog

    Managing Your HDInsight Cluster with PowerShell

    • 0 Comments
    An updated version of this post can be found here . This blog post provides a mechanism for managing an HDInsight cluster using a local management console through the use of Windows PowerShell. The goal is to outline how to configure the local management...
  • Carl's Blog

    Framework for .Net Hadoop MapReduce Job Submission Json Serialization

    • 0 Comments
    A while back one of the changes made to the “ Generics based Framework for .Net Hadoop MapReduce Job Submission ” code was to support Binary Serialization from Mapper, in and out of Combiners, and out from the Reducer. Whereas this change...
  • Carl's Blog

    Execution Time Based Heuristic Custom Task Scheduler

    • 0 Comments
    If you follow the samples for Parallel Programming with the .Net Framework , you may have come across the ParallelExtensionsExtras and the Additional TaskSchedulers . Although these samples cover a broad set of requirements I recently came across another...
  • Carl's Blog

    Co-occurrence Approach to an Item Based Recommender Update

    • 0 Comments
    In a previous post I talked about a Co-occurrence Approach to an Item Based Recommender , that utilized the Math.Net Numerics library. Recently the Math.Net Numerics library was updated to version 2.3.0. With this version of the library I was able to...
  • Carl's Blog

    Generics based Framework for .Net Hadoop MapReduce Job Submission

    • 8 Comments
    Over the past month I have been working on a framework to allow composition and submission of MapReduce jobs using .Net. I have put together two previous blog posts on this, so rather than put together a third on the latest change I thought I would create...
  • Carl's Blog

    Framework for .Net Hadoop MapReduce Job Submission TextOutput Type

    • 0 Comments
    Some recent changes made to the “ Generics based Framework for .Net Hadoop MapReduce Job Submission ” code were to support Json and Binary Serialization from Mapper, in and out of Combiners, and out from the Reducer. However, this precluded one from controlling...
  • Carl's Blog

    Submitting Hadoop MapReduce Jobs using PowerShell

    • 0 Comments
    As always here is a link to the “ Generics based Framework for .Net Hadoop MapReduce Job Submission ” code. In all the samples I have shown so far I have always used the command-line consoles. However this does not need to be the case, PowerShell can...
  • Carl's Blog

    Framework for .Net Hadoop MapReduce Job Submission Binary Output

    • 0 Comments
    To end the week I decided to make a minor change to the “ Generics based Framework for .Net Hadoop MapReduce Job Submission ”. I have been doing some work on creating a co-occurrence matrix for item recommendations. I was going to map the...
  • Carl's Blog

    Framework for .Net Hadoop MapReduce Job Submission libjars update

    • 0 Comments
    If you have been using the “ Generics based Framework for .Net Hadoop MapReduce Job Submission ” you may want to download the latest version of the code. The previous version of the code, when processing XML and Binary files, was dependent...
  • Carl's Blog

    Framework for .Net Hadoop MapReduce Job Submission configuration update

    • 0 Comments
    To better support configuring the Stream environment whilst running .Net Streaming jobs I have made a change to the “ Generics based Framework for .Net Hadoop MapReduce Job Submission ” code. I have fixed a few bugs around setting job configuration...
  • Carl's Blog

    Managing Your HDInsight Cluster using PowerShell – Update

    • 0 Comments
    Since writing my last post Managing Your HDInsight Cluster and .Net Job Submissions using PowerShell , there have been some useful modifications to the Azure PowerShell Tools. The HDInsight cmdlets no longer exist as these have now been integrated into...
  • Carl's Blog

    Hadoop XML Streaming and F# MapReduce

    • 0 Comments
    So, to round out the Hadoop Streaming samples I thought I would put together an XML Streaming sample. As always the code can be found here: http://code.msdn.microsoft.com/Hadoop-Streaming-and-F-f2e76850 XML Streaming Reader So how does one stream in XML...
  • Carl's Blog

    Hadoop .Net HDFS File Access (Archived)

    • 12 Comments
    Updated post can be found here: http://blogs.msdn.com/b/carlnol/archive/2013/02/08/hdinsight-net-hdfs-file-access.aspx If you grab the latest installment of Microsoft Distribution of Hadoop you will notice, in addition to the C library, a Managed C...
Page 1 of 3 (71 items) 123