Sign in
MSDN Blogs
Microsoft Blog Images
More ...
Blog - Title
MSDN Blogs
>
Carl's Blog
Server & Tools Blogs
>
Business Intelligence Blogs
>
Carl Nolan's Blog
All About Business Intelligence
Microsoft Business Intelligence
Information Management
Master Data Services
SSIS
Data Quality Services
Jessica Meats’ Blog
Analysis Services
Analysis Services and PowerPivot
AS_EMEA
All MSDN Analysis Services Posts
PowerPivot
Analysis Services and PowerPivot
Data Explorer
All MSDN PowerPivot Postings
Big Data
SQL Server
Carl Nolan
Reporting Services
Reporting Services
Analysis Services and PowerPivot
SQL Server
All MSDN Reporting Services Posts
Data in the Cloud
Your Data in the Cloud
Windows Azure
SQL Server
Silver Lining
Carl Nolan’s Blog
Carl Nolan’s ramblings on development
Live Now on Server & Tools Blogs
Subscribe
Comments
Home
Menu
Subscribe via RSS
Blog Home
RSS for posts
Atom
RSS for comments
OK
Translate this page
Powered by
Microsoft® Translator
About Carl Nolan
I work for Microsoft Consulting Services in the UK. My primary focus is enterprise applications using C# and SQL Server. However I also have an interest in other programming paradigms, hence the interest in F#. A summary of my previous publications can be found
here
. A list of posted code can be found
here
.
Twitter Feed
Recent Posts
Hadoop .Net HDFS File Access
Posted
3 months ago
by
Carl Nolan
7
Comments
Submitting Hadoop MapReduce Jobs using PowerShell
Posted
3 months ago
by
Carl Nolan
0
Comments
Try F# 3.0 Released
Posted
3 months ago
by
Carl Nolan
0
Comments
Hive and XML File Processing
Posted
5 months ago
by
Carl Nolan
3
Comments
Tags
.Net
.Net Programming
Binary Streaming
C#
F#
FSharp
FSharpChart
Hadoop
Hadoop on Azure
Hadoop Streaming
Hadoop.Net
HDFS
IEnumerable
Machine Learning
MapReduce
Matrix
Parallel Processing
Recommendations
Sorting
SQL Server
Task Parallel Library
TSQL
Vector
WPF
XML Streaming
Archives
Archives
February 2013
(2)
January 2013
(1)
December 2012
(2)
November 2012
(1)
October 2012
(2)
July 2012
(4)
June 2012
(5)
May 2012
(1)
April 2012
(3)
February 2012
(3)
January 2012
(5)
December 2011
(6)
November 2011
(7)
October 2011
(8)
September 2011
(1)
August 2011
(1)
July 2011
(11)
More
▼
Less
▲
Subscribe via RSS
Sort by:
Most Recent
|
Most Views
|
Most Comments
Excerpt View
|
Full Post View
Carl's Blog
Hadoop .Net HDFS File Access
Posted
3 months ago
by
Carl Nolan
7
Comments
Provided with the Microsoft Distribution of Hadoop, HDInsight, is a C library for HDFS file access. This code extends this library through a Managed C++ solution. This solution enables one to consume HDFS files from within a .Net environment. The purpose...
Carl's Blog
Submitting Hadoop MapReduce Jobs using PowerShell
Posted
3 months ago
by
Carl Nolan
0
Comments
As always here is a link to the “ Generics based Framework for .Net Hadoop MapReduce Job Submission ” code. In all the samples I have shown so far I have always used the command-line consoles. However this does not need to be the case, PowerShell can...
Carl's Blog
Try F# 3.0 Released
Posted
3 months ago
by
Carl Nolan
0
Comments
From the F# Team Blog: If you're familiar with the site Try F#, which lets you run F# right in your browser, you'll be happy to hear that the Try F# team has launched Try F# 3.0 today! You will find updated content and tutorials, plus content that...
Carl's Blog
Hive and XML File Processing
Posted
5 months ago
by
Carl Nolan
3
Comments
When I put together the “ Generics based Framework for .Net Hadoop MapReduce Job Submission ” code one of the goals was to support XML file processing. This was achieved by the creation of a modified Mahout document reader where one can specify the XML...
Carl's Blog
Co-occurrence Approach to an Item Based Recommender Update
Posted
5 months ago
by
Carl Nolan
0
Comments
In a previous post I talked about a Co-occurrence Approach to an Item Based Recommender , that utilized the Math.Net Numerics library. Recently the Math.Net Numerics library was updated to version 2.3.0. With this version of the library I was able to...
Carl's Blog
Implementing a MapReduce Join with Hadoop and the .Net Framework
Posted
6 months ago
by
Carl Nolan
1
Comments
I have often been asked how does one implement a Join whilst writing MapReduce code. As such, I thought it would be useful to add an additional sample demonstrating how this is achieved. There are multiple mechanisms one can employ to perform a Join operation...
Carl's Blog
Framework for .Net Hadoop MapReduce Job Submission V1.0 Release
Posted
7 months ago
by
Carl Nolan
0
Comments
It has been a few months since I have made a change to the “ Generics based Framework for .Net Hadoop MapReduce Job Submission ” code. However I was going to put together a sample for a Reduce side join and came across a issue around the usage...
Carl's Blog
Execution Time Based Heuristic Custom Task Scheduler
Posted
7 months ago
by
Carl Nolan
0
Comments
If you follow the samples for Parallel Programming with the .Net Framework , you may have come across the ParallelExtensionsExtras and the Additional TaskSchedulers . Although these samples cover a broad set of requirements I recently came across another...
Carl's Blog
Framework for .Net Hadoop MapReduce Job Submission TextOutput Type
Posted
10 months ago
by
Carl Nolan
0
Comments
Some recent changes made to the “ Generics based Framework for .Net Hadoop MapReduce Job Submission ” code were to support Json and Binary Serialization from Mapper, in and out of Combiners, and out from the Reducer. However, this precluded one from controlling...
Carl's Blog
C# MapReduce Based Co-occurrence Item Based Recommender
Posted
10 months ago
by
Carl Nolan
0
Comments
As promised, to conclude the Co-occurrence Approach to an Item Based Recommender posts I wanted to port the MapReduce code to C#; just for kicks and to prove the code is also easy to write in C#. For an explanation of the MapReduce post review the previous...
Carl's Blog
MapReduce Based Co-occurrence Approach to an Item Based Recommender
Posted
10 months ago
by
Carl Nolan
0
Comments
In a previous post I covered the basics for a Co-occurrence Approach to an Item Based Recommender . As promised, here is the continuation of this work, an implementation of the same algorithm using MapReduce. Before reading this post it will be worth...
Carl's Blog
Framework for .Net Hadoop MapReduce Job Submission Json Serialization
Posted
10 months ago
by
Carl Nolan
0
Comments
A while back one of the changes made to the “ Generics based Framework for .Net Hadoop MapReduce Job Submission ” code was to support Binary Serialization from Mapper, in and out of Combiners, and out from the Reducer. Whereas this change...
Carl's Blog
Framework for .Net Hadoop MapReduce Job Submission configuration update
Posted
10 months ago
by
Carl Nolan
0
Comments
To better support configuring the Stream environment whilst running .Net Streaming jobs I have made a change to the “ Generics based Framework for .Net Hadoop MapReduce Job Submission ” code. I have fixed a few bugs around setting job configuration...
Carl's Blog
Co-occurrence Approach to an Item Based Recommender
Posted
10 months ago
by
Carl Nolan
0
Comments
For a while I thought I would tackle the problem of creating an item-based recommender. Firstly I will start with a local variant before moving onto a MapReduce version. The current version of the code can be found at: http://code.msdn.microsoft.com/Co...
Carl's Blog
Framework for .Net Hadoop MapReduce Job Submission Binary Output
Posted
11 months ago
by
Carl Nolan
0
Comments
To end the week I decided to make a minor change to the “ Generics based Framework for .Net Hadoop MapReduce Job Submission ”. I have been doing some work on creating a co-occurrence matrix for item recommendations. I was going to map the...
Carl's Blog
Framework for .Net Hadoop MapReduce Job Submission libjars update
Posted
11 months ago
by
Carl Nolan
0
Comments
If you have been using the “ Generics based Framework for .Net Hadoop MapReduce Job Submission ” you may want to download the latest version of the code. The previous version of the code, when processing XML and Binary files, was dependent...
Carl's Blog
Hadoop .Net HDFS File Access (Revisited Archived)
Posted
11 months ago
by
Carl Nolan
7
Comments
Updated post can be found here: http://blogs.msdn.com/b/carlnol/archive/2013/02/08/hdinsight-net-hdfs-file-access.aspx Provided with the Microsoft Distribution of Hadoop, in addition to the C library, a Managed C++ solution for HDFS file access is...
Carl's Blog
.Net Implementation of a Priority Queue (aka Heap)
Posted
over 1 year ago
by
Carl Nolan
0
Comments
I thought I would take a break for a while from Hadoop and put together an F# .Net implementation of a Priority Queue; implemented using a heap data structure. Conceptually we can think of a heap as a balanced binary tree. The tree will have a root, and...
Carl's Blog
Generics based Framework for .Net Hadoop MapReduce Job Submission
Posted
over 1 year ago
by
Carl Nolan
8
Comments
Over the past month I have been working on a framework to allow composition and submission of MapReduce jobs using .Net. I have put together two previous blog posts on this, so rather than put together a third on the latest change I thought I would create...
Carl's Blog
.Net Hadoop MapReduce Job Framework - Revisited (Archived)
Posted
over 1 year ago
by
Carl Nolan
0
Comments
An updated version of this post can be found at: http://blogs.msdn.com/b/carlnol/archive/2012/04/29/generic-based-framework-for-net-hadoop-mapreduce-job-submission.aspx If you have been using the Framework for Composing and Submitting .Net Hadoop...
Carl's Blog
Framework for Composing and Submitting .Net Hadoop MapReduce Jobs (Archived)
Posted
over 1 year ago
by
Carl Nolan
0
Comments
An updated version of this post can be found at: http://blogs.msdn.com/b/carlnol/archive/2012/04/29/generic-based-framework-for-net-hadoop-mapreduce-job-submission.aspx If you have been following my blog you will see that I have been putting together...
Carl's Blog
Hadoop .Net HDFS File Access (Archived)
Posted
over 1 year ago
by
Carl Nolan
11
Comments
Updated post can be found here: http://blogs.msdn.com/b/carlnol/archive/2013/02/08/hdinsight-net-hdfs-file-access.aspx If you grab the latest installment of Microsoft Distribution of Hadoop you will notice, in addition to the C library, a Managed C...
Carl's Blog
Hadoop Streaming in F# and MapReduce (summary)
Posted
over 1 year ago
by
Carl Nolan
0
Comments
With all my recent posts around Hadoop Streaming I thought it would be useful to summarize them into a single post. The main objective of these posts was to put together a codebase to enable F# developers to write Map/Reduce libraries through a simple...
Carl's Blog
FSharpChart for Valentines Day
Posted
over 1 year ago
by
Carl Nolan
1
Comments
As I have not posted anything about FSharpChart for a while I thought I would do a quick post, one that befits Valentines Day: Plotting the heart was surprisingly easy to do: [ for x in -1.1 .. 0.001 .. 1.0 do let y1 = abs(x)+sqrt(1.0-x**2.0) ...
Carl's Blog
Hadoop XML Streaming and F# MapReduce
Posted
over 1 year ago
by
Carl Nolan
0
Comments
So, to round out the Hadoop Streaming samples I thought I would put together an XML Streaming sample. As always the code can be found here: http://code.msdn.microsoft.com/Hadoop-Streaming-and-F-f2e76850 XML Streaming Reader So how does one stream in XML...
Page 1 of 3 (63 items)
1
2
3