Sorting it all Out

It's a Do-What-I-Mean feature and as such is pretty intractable - it will always do something wrong. Likewise AutoFormat.

Just recently I answered a question on the WiX mailing list in which I posted a command line. The Word email editor autocorrected my hyphens (to indicate a command line switch) to en-dashes. The original poster replied saying it wasn't working. Thankfully they posted the command-line output - where it was clear that the en-dashes had been replaced by question marks (and the error message was something like 'cannot find file ?ext').

You just have to remember to hit Undo if you spot Word making the change!

Another reason why text only emails are the best!

I finish this rather useless comment with a cheerful "Yay ASCII!" :)

The last time I checked (which has been a while ago), Word was not able to do autoconversion of ' to single quotes low-9 + high-6 (‚…‘, German etc.) correctly, because ' could also mean the apostroph ’. This does not matter in English, because apostroph and closing quotation mark are the same glyph.

Anyway, “smart quotes” were the wrong approach in the first place, one should have altered keyboard layouts instead (or at least additionally).

Great table!

But I think you have some typos at the end.

"U+301F" should probably be "U+301E".

And for some incomprehensible reason "U+301D" displays as something that is definitely not a quotation mark in my browser, although it should be. Perhaps my fonts are borked...

I never use Word as an editor because it is always messing with what I type. I HATE it when it tries to figure out what I mean instead of just doing what I actually told it.

Because of that, I’m constantly typing ALT-0146, ALT-0147, ALT-0148, etc. to get the right quote marks on everything—and the correct dashes!

What I want to know is, why doesn’t the command-line parser know how to handle surrounding quotation marks? I think COPY “FILENAME.TXT” should be a legal command.

In Office 2007 the ability to turn Word off as the email editor goes away.

Plain text emails are just as susceptible to AutoFormat as HTML email.

> why doesn’t the command-line parser know how to handle surrounding quotation marks?

Please, no... the solution to DWIM is not more DWIM.

Christoph Päper wrote:

> Anyway, “smart quotes” were the wrong approach in the first

> place, one should have altered keyboard layouts instead (or at

> least additionally).

+1.

Michael S. Kaplan wrote:

> Now if only Office 14/Word 14 can be made smart enough to

> detect the cases where the feature is not needed

Easy. Quotes must be left “as is” inside <code>, <kbd> and <samp> elements. And maybe also <pre>. In Word, this maps to predefined “HTML Code”, “HTML Keyboard”, “HTML Sample” and “HTML Preformatted” styles. Marking up samples and code as such is then responsibility of authors.

I think you've got Dutch mentioned a few times to many. That is, I've never seen ‛O’ U+201B + U+2019 or ‟O” U+201F + U+201D.

And I think ,O’ U+201A + U+2019 never existed either, since Dutch only recently started using single quotation marks under the influence of American typography (IIRC). So I believe this is a hypercorrect form of ‘O’ U+2018 + U+2019, under the influence of „O” U+201E + U+201D, which itself has become extinct under the weight of American typographical conventions (such as these „smart” quotes and IJ „autocorrecting” to Ij).

How about moving the "smart quote" feature to the rendering level?  Store quotes as " in the bit stream, and have Word display them as “ and ” at render time as it sees fit.

But when shoving to the clipboard, make a faithful copy of the bit stream.

It seems that the Romanian Academy decided that they have to mess-up with the quotes (and other things), so you will have to update the Romanian entries.

The new Romanian keyboards in Vista know about it (I did not, until I have filed a bug and was classified as "not a bug" :-)

So, you might also want to let the Office team know :-)

The external quotes are 99-down  99-up, and the internal ones are the French chevrons, but with not spaces:

http://www.secarica.ro/misc/InstitLingvTastatura-20031008.pdf

-- Original quote -----------------------------

1., 2. în limba română, semnele citării sau ghilimelele sunt, aşa cum se indică în unica lucrare

normativă actualmente în vigoare în acest domeniu (Academia Română, Institutul de Lingvistică „Iorgu

Iordan”, Îndreptar ortografic, ortoepic şi de punctuaţie, ediţia a V-a, Univers Enciclopedic, Bucureşti,

1995), „...” [deci 99 jos, 99 sus] ori «...» (p. 79), cu precizarea că ghilimelele «...» se aşază în interiorul

textului cuprins între ghilimelele „...” (p. 81);

== Translation (aprox, not pro :-) ======

1., 2. in the Romanian language the quotes are (as specified by the normative document

actually valid in the field, the Romanian Academy, the Institute of Linguistics „Iorgu

Iordan”, Guide of orthography, orthographic, and punctuation,  5th edition, published by Univers Enciclopedic, Bucharest,

1995), „...” [99 down, 99 up] or «...» (p. 79), with the specification that the quotes «...» are to be used inside

the text contained already between the quotes „...” (p. 81);

-------------------------------

It is reflected in the Romanian keyboard standard SR 13392:2004, and ISO/IEC 8859-16:2001

(both based on SR 13411:1999)

BTW "smart" quotes: MS Word, up to version 97 (I think) was doing something really-really dumb with the quotes.

When typing on a French system in a French document you got the chevrons (correct). But if the file was saved as RTF, and opened on an English system, the quotes where displayed as English quotes.

The dumb thing was not having a RTF tag for opening and closing quote, but the fact that Word used the user locale instead of the paragraph language to determine the look.

<<Quotes must be left “as is” inside <code>, <kbd> and <samp> elements. And maybe also <pre>. In Word, this maps to predefined “HTML Code”, “HTML Keyboard”, “HTML Sample” and “HTML Preformatted” styles. Marking up samples and code as such is then responsibility of authors.>>

Might be good, but not too useful.

Because tagging with styles is done after the text is done, but the quotes are converted when you type them.

Now imagine the functionality. You type, and type some quotes, they are converted to "smart" ones. Then you select the text area and mark it code. Now what? If you convert all the selected quotes to "dumb" quotes, I will again call fool! Because I can give a string example with smart quotes in code:

ids_Help "Click “Help” for more info"

So, this is not such a simple decision.

@Maurits: I think that's an even worse idea, seeing the current 'intelligence' Word seems to apply. I'm constantly fighting Word to get it to display 's, 't and 'n right (with a 9 rather than a 6; it always ends up as ‘S rather than ’s), and attr=”O” instead of attr=“O” or attr="O" looks really awful when you're using a font like Consolas, etc., etc. Now, you can still Ctrl+Z your way out.

The Romanian quotes in this table are not correct (any more).

This has changed about 8 years ago (the members of the Romanian Academy mush justify their salaries :-)

The new Romanian keyboards in Vista already provide these new quotes. It might be time for the Office team to update it's tables too.

===============================

Ok, the external quotes are 99-down  99-up, and the internal ones are the French chevrons, but with not spaces:

http://www.secarica.ro/misc/InstitLingvTastatura-20031008.pdf

-- Original quote from the PDF above ---------------------------

1., 2. în limba română, semnele citării sau ghilimelele sunt, aşa cum se indică în unica lucrare normativă actualmente în vigoare în acest domeniu (Academia Română, Institutul de Lingvistică „Iorgu Iordan”, Îndreptar ortografic, ortoepic şi de punctuaţie, ediţia a V-a, Univers Enciclopedic, Bucureşti, 1995), „...” [deci 99 jos, 99 sus] ori «...» (p. 79), cu precizarea că ghilimelele «...» se aşază în interiorul textului cuprins între ghilimelele „...” (p. 81);

== Translation (aprox, not pro :-) ======

1., 2. in the Romanian language the quotes are (as specified by the normative document actually valid in the field, the Romanian Academy, the Institute of Linguistics „Iorgu Iordan”, Guide of orthography, orthographic, and punctuation,  5th edition, published by Univers Enciclopedic, Bucharest, 1995), „...” [99 down, 99 up] or «...» (p. 79), with the specification that the quotes «...» are to be used inside the text contained already between the quotes „...” (p. 81);

---------------------------------------------------

It is reflected in the Romanian keyboard standard SR 13392:2004, and ISO/IEC 8859-16:2001

(both based on SR 13411:1999)

> I want something smarter than that, though -- because not

> everyone obsessively marks styles, especially in EMAIL

For plain text mail, just treat it as one big <pre>, no quote replacements. Yes, typographically correct quotes are important, but computers are not smart enough to detect where the conversion is or is not needed. I presume if people had “” on their keyboards they might actually learn to use them, but, unfortunately, most only have ' and ".

I have posted twice a message about the fact that the Romanian quotes are incorrect in the posted table.

It this censorship, or there is something wrong in my message?

:-)

Still about Romanian:

,O‘ is never used

„O“ is wrong, should be „O”

‹ O › is never used

« O » should be «O» (used when nested quotes are required, , i.e. „blah «blah» blah”)

I find strange the "some version of Office" statement, since AFAIK the autocorrect feature of MS Office always uses the correct official quotes (99 down / 99 up) since long time ago, even before the recent (2003) Romanian Academy clarification.

Some further references:

The shape (not the codes !) of the Romanian quotes have been clarified (not changed !) in 2003.

The official reference is this (scannd documents; intro + decision):

http://www.secarica.ro/misc/InstitLingvTastatura-20031008-1.tif (.tif, 1,81 MB)

http://www.secarica.ro/misc/InstitLingvTastatura-20031008-2.tif (.tif, 3,66 MB)

The physical written document is stored at the Institute for Cultural Memory ( http://www.cimec.ro/e_default.htm )

Additionally, some sort of tutorial on this subject can be found at the Romanain Academy's official site, on the very first page, under a link that says "Punctuaţia limbii române. I. Ghilimelele" (or direct link http://www.academiaromana.ro/com2006/doc/ghilimele.doc )

The Romanian translation for "quotes" is "ghilimele". They are described as 99 down (on opening) / 99 up (on closing). The Unicode correspondence for this description is U+201E / U+201D.

Cristi

<<They were auto-detected as spam, sorry....>>

So you decided to pass both, although they are almost identical :-)

<<That ALMOST bit is what did it, I did not want to have to choose....>>

Well, it was *almost* because I don't save the messages I submit.

So after submitting the first and did not make it, I had no way to resubmit, had to "recreate" it.

The differences where not relevant (in my mind at least :-)

Whatever, it does not matter.

Thanks.

In the spirit of dumb quotes ! A regular reader pointed me this one.... It would seem that Word' AutoCorrect

NOTE: In addition to the wonderful lesson in this post, please keep in mind the lesson from Dumb quotes...

Please read the disclaimer ; content of Michael Kaplan's blog not approved by Microsoft! The other day