December, 2007

From the standpoint of Indic languages, Unicode has quite the struggle on its hands from the standpoint of acceptance by many native speakers.

I'm going to blather a bit about some of them here, and tell a fun story or two as well.

It does actually start with the ISCII (Indian Script Code for Information Interchange, which had a few "interesting" architectural features, including among other things:

• A single, consistent transliteration scheme into ASCII for the purposes of naming the various letters across all characters in the standard;
• An abugida based encoding model, presumably to save space in the code page by requiring fewer letters;

You might wonder why I put the word interesting in quotes.

Well, I did that because both of these "features" have specific problems with them that make the resulting encoding less intuitive....

First of all there is the transliteration scheme for the names, which is hardly universally accepted even with Hindi, let alone with the attempt to stick that same transliteration scheme on every other Indic script. Meaning that the way one would transliterate one's name into English may or may not match the scheme that is being used for the names.

And I have already talked lots (e.g. on this post and some of this one) about the abugida issue and the fact that not everyone would look at their language that way.

Unicode picked up most of these aspects of ISCII for the original Indic proposals.

Okay, now I am going to downshift this into something more about language and less about Unicode, and a fun little project that actually took months to accomplish on the calendar (though significantly less time in terms of hours actually spent -- this was an occasional thing).

It all started when I was meeting with Goldie Chaudhuri from over in SQL Server several months back (we were talking about some language issues vis-a-vis Unicode).

Goldie is of course not really any sort of "Indian" name I had ever heard before, but she apparently grew up in Florida so that seemed normal and certainly less odd than other names like Dweezil or Moon Unit; in any case it did not remind me of this transliteration issue or even a Unicode or a language one (beyond the vague sense of her having a Bengali last name, which I don't think I said anything about at the time).

It was in the afternoon and she had accidentally dropped her cardkey (I found it in her chair after she had gone). It actually had the the name Godhuli on it, not Goldie.

And then I vaguely recalled an article from a few months before entitled Words and Music that had the word godhuli in it. I tried to find the article online without luck (I later found it, right here from The Washington Post, the quote was Then think of the meaning of some of the words and phrases in these new languages. Think of the word for dusk in Hindi -- godhuli , which translates literally into "the dust kicked up by cows coming home from pasture.") 

but instead at the time found this random blog post that I kept the link for because of the story it told (the last name similarity with Goldie's was coincidence, I was on an article mission at that moment, looking for godhuli, not Godhuli!):

In A Strange and Sublime Address by Amit Chaudhuri, Sandeep, an only child living in a Bombay high-rise, spends a summer visiting his Uncle's house in Calcutta with his mother. On Sundays, his uncle sings aloud to himself during his leisurely preluncheon bath, the notes echoing in the enclosed space of the bathroom 'like rays of trapped light darting this way and that in a crystal'.

He usually sang old, half-remembered compositions that had been popular thirty of forty years ago in a Bengal where the radio and the windup gramophone were still new and incredible machines breaking the millennial silence of the towns and villages:

Godhulir chhaya pathe
Je gelo chini go tare.

Knocking on the bathroom door, Sandeep made a pest of himself by asking: " Chhotomama, what does godhuli mean?"

Lost in the general well-being of cleansing himself, his uncle replied patiently: "The word go means 'cow',and the word dhuli means 'dust'. In the villages, evening's the time the cowherds bring the cattle home. The herd returns, raising clouds from the road. Godhuli is that hour of cow dust. So it means 'dusk' or 'evening'."

As Chhotomama explained, his voice emerging from behind the steady sound of water, Sandeep saw it in his mind like a film being shown from a projector - the slow-moving, indolent cows, their nostrils and their shining eyes, the faint white outline of the cowherd, the sense of the expectant village (a group of scattered huts), and the dust, yes the dust, rising unwillingly from the cows' hooves and blurring everything. The mental picture was set in the greyish-red colour of twilight. It was strange how one word could contain a world within it.

Strange indeed! What is a word but a seemingly random arrangement of letters of the alphabet (which themselves are seemingly random shapes), or a seemingly random modulated sound? And yet, one single word can encompass whole Universes and more. The word godhuli does not just indicate a time of day, but conjures up a complete way of life.

Understanding words and phrases and the concepts they encapsulate brings us a long way toward understanding the people, and societies and cultures, who employ them. It's just amazing how, long after the dusk has given way to night, the dust from the cows' hooves has settled, and even the village itself has crumbled to dust, this word will remain, yielding its secrets to the deserving.

So in this weird and wacky language of mine (English) if I knew enough about etymology then I might have stories like that for words and names. And if I were a good enough writer, they would be very inspiring stories here.

But I don't, and so I don't, and I'm not, and so they're not.

Though I did order a copy of the book that was quoted!

Anyway, I started thinking about the fact that the name (Godhuli) was not really the name; it was instead a commonly accepted transliteration of a name, and of a word.

I decided I should see the name in Bengali.

Don't ask me why I decided this. I did the same thing with Tamil words almost two years ago trying to deal with the nearly insurmountable differences between  transliterations. I am just weird this way.

Of course at this point I had no idea if Goldie even knew the written Bengali language at all (she grew up in Florida, remember?), and I decided my weird funky language "projects" like this were unlikely to be too interesting, so I did not start by asking her.

The Tamil version of his project was quite unscoped beyond a vague desire to build up a good strong comparison/contrast of different transliteration schemes, and in the end not very much fun because it even led to arguments and the occasional threat of violence between various people. So the smaller scope of this Bengali project appealed to my peace-loving nature.... :-)

I took the Bengali Unicode chart and treated the transliteration precisely and literally as if it were some sort of secular version of Upanishadesque gospel and worked backwards into the Unicode characters.

Keep in mind I know almost no Bengali whatsoever here as I decide to do this.

The first cut (knowing I had at least one mistake in there, maybe more):

গোদ্হুলি (LETTER GA, VOWEL O, LETTER DA, HASANT, LETTER HA, VOWEL U, LETTER LA, VOWEL I)

Of course at this point I needed a native speaker to provide some corrective assistance; I could do no more just futzing with letters myself.

I sent it off to Goldie (explaining what I was trying to do in as few words as I could manage -- writing small is hard work!) for her opinion on this "guess".

I think she looked at what I was trying to do and decided it was perhaps a little weird, but it sounded like it would make a good blog post some day (and she likes the blog) so she decided to play along....

Her comment on the accuracy of the guess:

Wrong in three places. The first one you could probably figure out on your own, the second is because of the English transcription – you split one sound into two, and the third is a lack of emphasis. Though the third looks REALLY wrong, and I’d venture to guess that the last letter can’t actually be the last letter of a word. I don’t read enough to actually know.

After Goldie read this post, she realized that her computer she was looking at my guess on then did not have complex script support installed, so two of the three problems did not actually exist -- what she saw and what you might be seeing are not the same thing....

I guess she decided to go by the "teach a man to fish" philosophy, not giving away all the answers. That's cool, I can work with that. :-) 

Okay, the split was wrong -- I did the DA Hasant HA U instead of the DHA U. But I was basing it on my naive sense of the fact that the pronunciation separated the two letters into two separate syllables -- god-hu-li. So I did have a basis for my choice, even though it turned out to be dead wrong.

To learn something new, you have to be willing to be wrong, they say. Right?

I did have a bunch of work to do so my next guess was probably a week or three later (this sort of project by necessity runs in a low priority thread):

গোধুল্ঈ (LETTER GA, VOWEL O, LETTER DHA, VOWEL U LETTER LA, LETTER II)

And her response (there was a pause here too -- this was like a "Chess by mail" game almost!):

Closer – you figured out the first vowel this time, and the consonants are all correct (at least the base character). The last two characters are now TOTALLY off – you were much closer before. The vowels are tricky though, I imagine the Unicode approach to learning language doesn’t cover the nuances of when to use...don’t know the English words, but when to use modifying kars vs full characters.

She was talking about when to use VOWEL II vs. LETTER II -- the dependent vs. the independent form of the vowel.

I thought that might be wrong, but she had originally been saying the last letter couldn't be the last letter in a word. I was improvising....

My next guess was much closer, and I think I remarked that this was getting more like that game Mastermind (anyone else remember that game?) with me guessing and her giving oblique hints:

গোধুলী (LETTER GA, VOWEL O, LETTER DHA, VOWEL U, LETTER LA, VOWEL II)

She thought it was just about correct (just one vowel in the middle that was off), but wanted to consult with her parents, who had originally given her the name, based on a poem (or maybe a song?).

Her parents were initially interested in this strange game going on in the background of all of our lives but suddenly were more concerned about something that they realized while verifying their own opinions. 

They let her know that the way she had learned to spell her name all her life was wrong. Oops!

The real hazard of cultural assimilation. :-)

The details on the"mistake" in the name, as well as mistakes in my last name guess:

The first phoneme is the same sound as in the Chinese PM “Chou En-lai.” I don’t know how else it would be transcribed, but the BENGALI LETTER CHA is an aspirated sound – you want the non aspirated version. I could point you to the IPA if that would be easier?

Turns out I spelled my first name all wrong though. Got both vowels wrong (the tricky ones), and have been taught it wrong my entire life. Both the dictionary and Rabindranath Tagore agree on the spelling, though the root words that my name is derived from are spelled the way I thought my name was actually spelled. I led you astray, my apologies. You get a chance first to figure out where I was wrong, before I try and nudge you towards the right spelling.

Apparently colloquial Bengali doesn’t differentiate much between long vowels and short vowels either.

The final string that was intended for the first name:

গোধূলি (LETTER GA, VOWEL O, LETTER DHA, VOWEL UU, LETTER LA, VOWEL I) 

Now of course I never would have guessed the UU vs. U thing but since my first guess had used the II vs. I thing correctly I got some mileage out of her [unintentionally] leading me astray. She did have to deal with the fact that she had her name spelled wrong for decades, after all. So we were all learning. :-)

And of course she had not ever spelled her full name in English as Godhuuli, and she had actually been thinking it was Godhuulii which wasn't right at all and would have looked even worse using this transliteration scheme in Unicode.

Then the full name was easy, using the first name and the assonistic (her word, not mine) rhythmic/rhyming kind of thing that she thought the names shared, minus all of the parts that ended up being slightly different because the name had been spelled a little off all those years.

গোধূলি চৌধুরী (GA O DHA UU LA I   CA AU DHA U RA II)

Notice the lack of a CHA there. That transliteration thing again. What a native speaker thinks of as a CHA vs. CHAA was actually a CA and CHA thing.

As a side check, each of these words individually can find a bunch of web pages in Google whereas my earlier attempts cannot, which perhaps helps verify that they are right....

Now this same thing I then tried with the names of other folks.

Like former NLS Test/PM colleague Sushmita (means smiling, source Tamil).

Or NLS PM colleague Poornima (means full moon, source Sanskrit, I think?).

Though I won't publish my guesses on those two or others since without the feedback loop to make sure I am not unintentionally butchering their names, the fact that my first guesses are certain to be wrong keeps me from being comfortable posting them and you never know who would really enjoy this kind of thing (as I said I ran into problems in the past in this regard -- not everyone finds my little language fetishes to be normal!).

The problem here with Unicode? The names are not the letters they learned, it is not how a native speaker would think of the language.

I try to imagine if I was required to spell Kaplan with component pieces like o + preceding vertical line below instead of p or something. I would not think the scheme had much to do with the English language.

So acceptance of Unicode is facing an uphill battle with the native speaking target of some of the languages that use these scripts. And it is not hard to imagine why they would feel that we do not understand their language -- and where is the motivation for them to be interested in our implementation that so clearly fails to understand them?

It is obviously a bit too late to change things in this space (where a bit is defined as 3.1 versions in length -- much more time than 12 parsecs!), but even today people are still trying.

Example -- I have just been talking with someone in Malaysia telling me about another trip to Chennai happening early next year to discuss the latest "add the pure consonants for Tamil -- i.e. all of the consonants with the built in puLLi" proposal. I was asked if I would be attending -- I don't know for sure, though, to be honest.

Man, this was a long post. Hope somebody feels this glimpse into my "neither work nor play" life was entertaining.... :-)

This post brought to you by ঊ and ূ (U+098a and U+09c2, aka BENGALI LETTER UU and BENGALI VOWEL SIGN UU)

It has been years since I first posted What's up with handicapped parking in WA state? and the time since then has been interesting.

First of all there were the comments to the post itself, of course.

Then, a few months later, I had someone in my management chain suggest to me (off the record) that I should not be so disrespectful to agency temps as I was (excerpt below, with the text in question emphasized in red):

One of those two spaces where the two cars used to park still has a car in it every day. It seems to be one of those same two cars (I guess they are fighting for "their" space). Maybe I should start posting license plates and descriptions. Or maybe I should consider the handicap of their lack of decency as one that entitles them to park there? I hope they are contingent staff and their contracts don't get renewed. Most people at Microsoft are a lot nicer.

I admit to being shocked, as no disrespect to contingent staff was intended. Hell, I was a vendor to Microsoft for the first half of my "career" in Redmond, and I have a ton of respect for both the v- and a- folk here.

I do have a lot of disrespect for the sort of people who use handicapped parking spaces when they are not, in fact, handicapped. And since doing so is not a fire-able offense even if you do it on Microsoft grounds (thus making it quite unlikely to happen for people who do it across the street in their apartments!), I was just hoping that they would soon end up being done with the job they are in and that some sort of handicapped space karma would step in and see that the contract was not renewed. Because honestly if it could made a fire-able offense to do this sort of thing with the parking spaces then I would do my best to make sure it was enforced as often as appropriate, whether someone was full-time, part-time, flex-time, vendor, contractor, or whoever.

If anyone who was or is a contractor read that I felt any negative feelings toward contractors in general then please accept my apology for not being clearer, and my assurance that my feelings for contractors are in no way negative based on their "status" -- that kind of nonsense, I dealt with for years before I went full-time and is in fact a great way to know the best groups to work in -- how they treat their non-full-time staff!

Then in later months the handicapped parking thing would come up a few more times, like in What's up with handicapped parking everywhere?, That handicapped placard, and so on.

A few months ago another employee brought up a slightly different issue, one that I have often been troubled by myself:

There’s a dude who parks everyday in a handicapped spot. He only recently started parking there after I (and others) left him notes on his car to stop parking in the vanpool/carpool spots without a permit. For the first time, today, I saw him walking the halls with no outward disability. I am fully aware that a disabled permit isn’t only for conditions that are “out in the open,” so I’m not specifically questioning whether he “deserves” to park in the spot or not. He displays a handicapped permit but he conveniently slid it to the front of his dash. The expiration date is hidden from view, so only the handicapped icon on the permit is visible.

It would seem to me that he is, by a strictly view of the law, parked illegally since his expiration date is not visible.

Basically… have you got any advice/guidance on how to handle the situation? I do not think it’s proper to say to him “Hey, you don’t look disabled!” or something foolish like that. But I am admittedly not convinced he should be parking there after having seen him park in the carpool spots repeatedly without a permit.

I figure there’s not much I could do about it. I don’t require a disabled permit, so it’s not like he’s taking a spot away from me, and there are usually many open disabled parking spots in our garage, so it’s not like he’s taking a spot away from someone who really needs it. It’s simply the principle that ya just don’t do that. With this person’s track record of parking wherever is most convenient, I’m just not trusting of his necessity for a disabled spot, ya know?

The legality question is grey area, of course. Ususlly one would be ticketed but one could go to the heasring and show that one has a valid pass -- whether this is done would depend probably on the competition for spaces in a given lot. Some parts of Microsoft will tow fairly quickly (it happened to me once when the pass actually fell on the floor of the car and I was in a different building for a week for a class) so I know whereof I speak here....

As someone who for years had just minimal signs of disability (the cane) and who has had to deal with being questioned occasionally, I have to admit that I never found myself too troubled by the people who were simply asking the question and not being rude about it. Because then I would point out my reason and explain about how I only had a "Sabbath day's walk" within me.

But there is a reason why a cop will pull over the person with a busted tail light and run their plates -- because anyone who can let one issue go un-addressed can let another one. And it is easy to imagine someone who would park in carpool/vanpool spots without a permit choosing to borrow someone else's handicapped permit or using an expired one with the date hidden or get a sympathetic MD to sign the application the same way they could get an inappropriate Valium script out of one.

But now we get to the tough part -- though I don't expect that someone genuinely handicapped showing no visible signs would be too offended by a polite question in a bad parking situation, it is pretty obvious that someone parking their illegally would be quite likely to quickly get defensive and take offense (since as they say the best defense is a good offense!).

Which makes it hard to do much of anything here, beyond perhaps inquiring politely through someone who knows them or through their manager, just pointing out that the situation was creating some discomfort -- and that perhaps suggest to the colleague or manager that by generating a little awareness of their situation they could avoid causing other people to feel uncomfortable.

It reminds me of a reverse situation -- I have a friend I go lunch off-campus with sometimes, and when she drives there is almost never a good space left when we come back after lunch. She always refuses my offer to let me lend her my handicapped pass, even though she is driving me and getting me closer to the door, because she knows people know her car and she does not want people thinking she is taking advantage of a handicapped parking permit not her own.

So one has to wonder what sort of person would want people to think that of them, ever. My friend is perhap over-cautious, but her heart is at least in the right place.

Is there convincing proof that the under-cautious person has a heart? Wouldn't some kind of clarification be a good idea, and in their best interests, just to not create bad feelings with others in the group?

I actually got a similar mail from someone who works at Google asking almost the very same question of a co-worker of theirs who was doing the same kind of thing. Which honestly seems even weirder to me since I thought they had valet parking too? Would it be that worthwhile to park in the handicapped spaces?

And then even more recently there was someone with a totally different complaint:

I got a parking ticket for parking in the handicap parking in my apartment complex.

Guilty as charged. However, this was my first time I parked in the handicap parking and that too.. because all other parking spaces were full. The apartment does not provide assigned parking for the apartment, except for the carports.  I didn’t want to leave my car on the street and go to sleep. Knowing that no one in my building is handicap – I parked my car in the handicap parking spot --- only to get the parking ticket next day.

I am not sure whether it is a good idea to have mitigation hearing or pay the fine and sit quite. Any similar experience anybody?

Mitigation Hearing = I agree I have committed the infraction, but I want a hearing to explain the circumstances. Please send me a court date and I promise to appear on that date.

Now opinions on the question itself varied some, but the general trend warmed my heart a bit -- it was pay the damn ticket and just don't do it again (with some noting that handicapped people do go out in public and that they visit non-handicapped friends -- that is legal!).

Several people wondered how such a guest would feel, especially as "all other parking spaces were full".

Opinion was divided a bit on whether asking the question was relevant to a person's job, when one person suggested that they hoped the person's manager saw the question.

I tend to agree with the people who find it somewhat relevant under that same earlier theory about the cop pulling someone over even for minor infractions -- the whole where there's smoke, there's fire theory. One does have to wonder about

• the sense of entitlement
• the disregard for others less fortunate
• the willingness to take shortcuts when one find rules to be too inconvenient to follow

and whether such a tendency could spill over into one's decision making process at work.

Would they deserve for it come up in their review? Perhaps not. Though known cases os the spill-over into work SHOULD come up.

But either way, is it worth asking the question if one hppens to hear about it -- especially if the person asks the question rather widely at work?

Well, since I am record as saying that if I could I would fire the employees and end the contracts of the contractors who would abuse handicapped parking spaces on a regular basis, I think how I feel about the situation is clear -- pay the damn ticket and just don't do it again.

But I am not in charge of those kind of decisions, so in the end all I can say is that if you are doing that sort of thing then you know how I feel about you. And some others too, perhaps....

This post brought to you by ♿ (U+267f, a.k.a. WHEELCHAIR SYMBOL)

Over in the Suggestion Box, John Daintree asks:

Could you please follow up the missing functionality of LoadKeyboardLayout() on Windows Vista? I need to be able to load a specific layout for my application as the app starts.

The missing functionality in question is I believe what I described in Cutting the cord while someone else is shoring it up, which is the ability to load IMEs via a call to LoadKeyboardLayout, partially ameliorated by Office 2007 which adds three of them back: