The Windows Azure Azure CDN, like any other CDNs, attempts to be a transparent caching layer. The CDN doesn’t care who the referring site might be. Like any other CDN, Windows Azure CDN keep things transparent and have no concern of what the referring...

Apache Hadoop Primary Namenode and secondary Namenode architecture is designed as below: Namenode Master: The conf/masters file defines the master nodes of any single or multimode cluster. On master, conf/masters that it looks like this: ———————...

Apache Hadoop is designed to have Master Slave architecture. Master: Namenode, JobTracker Slave: {DataNode, TaskTraker}, ….. {DataNode, TaskTraker} HDFS is one primary components of Hadoop cluster and HDFS is designed to have Master...

ignoreRoleInstanceStatus is described in WebRole and WorkerRole Schema as below http://msdn.microsoft.com/en-us/library/windowsazure/gg557553.aspx Web Role: ignoreRoleInstanceStatus boolean Optional. When the...

Windows Azure Blob storage API provided following upload scenarios to upload a blob: Scenario [1]: You can upload a single blob in N parallel threads In your code if you set CloudBlobClient.ParallelOperationThreadCount = N; then N parallel threads...

Map Task (HDFS data localization): The unit of input for a map task is an HDFS data block of the input file. The map task functions most efficiently if the data block it has to process is available locally on the node on which the task is scheduled...

Recently I was working on an issue where the SSL certificate was expired and due to it, the user were warned to not to use site. The certificate expiration was visible as below: In this situation the following steps should be taken to get...

As you may have already know that Hadoop Cluster is network and disk, IO intensive. Recently I was trying to run a test scenario where I decided to change SATA hard disk to a high performance SSD Disk while keeping the cluster hardware the same. I was...

I was recently asked about if someone store their content at Windows Azure Storage, how secure is it and how many copies are there, so I decided to write this article. Technically there are 6 copies of your blob content , distributed in two separate...

I was recently asked to show that Pig scripts are actually MapReduce jobs so to explain it in very simple way I have created the following example: Read a text file using Pig Script Dump the content of the file As you can see below...

Technically they both will do the job, you are looking from "either hive or Pig" perspective, means you don't know what you are doing yet. However if you first define the data source, scope and the result representation and then look for which one to...