Holy cow, I wrote a book!
The GetFileTime function will tell you when a file was last modified, but it won't tell you who did it. Neither will FindFirstFile, GetFileAttributes, or ReadDirectoryChangesW, or FileSystemWatcher.
GetFileTime
FindFirstFile
GetFileAttributes
ReadDirectoryChangesW
FileSystemWatcher
None of these the file system functions will tell you which user modified a file because the file system doesn't keep track of which user modified a file. But there is somebody who does keep track: The security event log.
To generate an event into the security event log when a file is modified, you first need to enable auditing on the system. In the Local Security Policy administrative tool, go to Local Policies, and then double-click Audit Policy. (These steps haven't changed since Windows 2000; the only thing is that the Administrative Tools folder moves around a bit.) Under Audit Object Access, say that you want an audit raised when access is successfully granted by checking Success (An audited security access attempt that succeeds).
Once auditing is enabled, you can then mark the files that you want to track modifications to. On the Security tab of each file you are interested in, go to the Auditing page, and select Add to add the user you want to audit. If you want to audit all accesses, then you can choose Everyone; if you are only interested in auditing a specific user or users in specific groups, you can enter the user or group.
After specifying whose access you want to monitor, you can select what actions should generate security events. In this case, you want to check the Successful box next to Create files / write data. This means "Generate a security event when the user requests and obtains permission to create a file (if this object is a directory) or write data (if this object is a file)."
If you want to monitor an entire directory, you can set the audit on the directory itself and specify that the audit should apply to objects within the directory as well.
After you've set up your audits, you can view the results in Event Viewer.
This technique of using auditing to track who is generating modifications also works for registry keys: Under the Edit menu, select Permissions.
Exercise: You're trying to debug a problem where a file gets deleted mysteriously, and you're not sure which program is doing it. How can you use this technique to log an event when that specific file gets deleted?
A customer asked the following question:
We've found that on Windows XP, when we call the XYZ function with the Awesome flag, the function fails for no apparent reason. However, it works correctly on Windows 7. Do you have any ideas about this?
So far, the customer has described what they have observed, but they haven't actually asked a question. It's just nostalgia, and nostalgia is not a question. (I'm rejecting "Do you have an ideas about this?" as a question because it too vague to be a meaningful question.)
Please be more specific about your question. Do you want to obtain Windows 7-style behavior on Windows XP? Do you want to obtain Windows XP-style behavior on Windows 7? Do you merely want to understand why the two behave differently?
The customer replied,
Why do they behave differently? Was it a new design for Windows 7? If so, how do the two implementations differ?
I fired up a handy copy of Windows XP in a virtual machine and started stepping through the code, and then I stopped and realized I was about to do a few hours' worth of investigation for no clear benefit. So I stopped and responded to their question with my own question.
Why do you want to know the reason for the change in behavior? How will the answer affect what you do next? Consider the following three answers: "The behavior was redesigned in Windows 7." "The Windows XP behavior was a bug that was fixed in Windows 7." "The behavior change was a side-effect of a Windows Update hotfix." What will you do differently if the answer is (1) rather than (2) or (3)?
Why do you want to know the reason for the change in behavior? How will the answer affect what you do next? Consider the following three answers:
What will you do differently if the answer is (1) rather than (2) or (3)?
The customer never responded. That saved me a few hours of my life.
If you don't know what you're going to do with the answer to a question, then there's not much point in others working hard to answer it. You're just creating work for others for no reason.
Okay, one more time about the Write-caching policy setting.
This dialog box takes various forms depending on what version of Windows you are using.
Windows XP:
Windows Server 2003:
Windows Vista:
Windows 7 and 8:
Notice that the warning text gets more and more scary each time it is updated. It starts out just by saying, "If you lose power, you might have data loss or corruption." Then it adds a recommendation, "Recommended only for disks with a backup power supply." And then it comes with a flat-out directive: "Do not select this check box unless the device has a separate power supply."
The scary warning is there for a reason: If you check the box when your hardware does not satisfy the criteria, you risk data corruption.
But it seems that even with the sternest warning available, people will still go in and check the box even though their device does not satisfy the criteria, and the dialog box says right there do not select this check box.
And then they complain, "I checked this box, and my hard drive was corrupted! You need to investigate the issue and release a fix for it."
Dangerous setting is dangerous.
At this point, I think the only valid "fix" for this feature would be to remove it entirely. This is why we can't have dangerous things.
I dreamed that a friend of mind said, "Between your tenant and your lover, you should get along with at least one of them."
Opportunistic locks allow you to be notified when somebody else tries to access a file you have open. This is usually done if you want to use a file provided nobody else wants it.
For example, you might be a search indexer that wants to extract information from a file, but if somebody opens the file for writing, you don't want them to get Sharing Violation. Instead, you want to stop indexing the file and let the other person get their write access.
Or you might be a file viewer application like ildasm, and you want to let the user update the file (in ildasm's case, rebuild the assembly) even though you're viewing it. (Otherwise, they will get an error from the compiler saying "Cannot open file for output.")
Or you might be Explorer, and you want to abandon generating the preview for a file if somebody tries to delete it.
(Rats I fell into the trap of trying to motivate a Little Program.)
Okay, enough motivation. Here's the program:
#include <windows.h> #include <winioctl.h> #include <stdio.h> OVERLAPPED g_o; REQUEST_OPLOCK_INPUT_BUFFER g_inputBuffer = { REQUEST_OPLOCK_CURRENT_VERSION, sizeof(g_inputBuffer), OPLOCK_LEVEL_CACHE_READ | OPLOCK_LEVEL_CACHE_HANDLE, REQUEST_OPLOCK_INPUT_FLAG_REQUEST, }; REQUEST_OPLOCK_OUTPUT_BUFFER g_outputBuffer = { REQUEST_OPLOCK_CURRENT_VERSION, sizeof(g_outputBuffer), }; int __cdecl wmain(int argc, wchar_t **argv) { g_o.hEvent = CreateEvent(nullptr, FALSE, FALSE, nullptr); HANDLE hFile = CreateFileW(argv[1], GENERIC_READ, FILE_SHARE_READ, nullptr, OPEN_EXISTING, FILE_FLAG_OVERLAPPED, nullptr); if (hFile == INVALID_HANDLE_VALUE) { return 0; } DeviceIoControl(hFile, FSCTL_REQUEST_OPLOCK, &g_inputBuffer, sizeof(g_inputBuffer), &g_outputBuffer, sizeof(g_outputBuffer), nullptr, &g_o); if (GetLastError() != ERROR_IO_PENDING) { // oplock failed return 0; } DWORD dwBytes; if (!GetOverlappedResult(hFile, &g_o, &dwBytes, TRUE)) { // oplock failed return 0; } printf("Cleaning up because somebody wants the file...\n"); Sleep(1000); // pretend this takes some time printf("Closing file handle\n"); CloseHandle(hFile); CloseHandle(g_o.hEvent); return 0; }
Run this program with the name of an existing file on the command line, say scratch x.txt. The program will wait.
scratch x.txt
In another command window, run the command type x.txt. The program keeps waiting.
type x.txt
Next, run the command echo hello > x.txt. Now things get interesting.
echo hello > x.txt
When the command prompt opens x.txt for writing, the DeviceIoControl call completes. At this point we print the Cleaning up... message.
x.txt
DeviceIoControl
To simulate the program taking a little while to clean up, we sleep for one second. Observe that the command prompt has not yet returned. Instead of immediately failing the request to open for writing with a sharing violation, the kernel puts the open request on hold to give our program time to clean up and close our handle.
Finally, our simulated clean-up is complete, and we close the handle. At this point, the kernel allows the command processor to proceed and open the file for writing so it can write hello into it.
That's the basics of opportunistic locks, but your program will almost certainly not be structured this way. You will probably not wait synchronously on the overlapped I/O but rather have the completion queued up to a completion function, an I/O completion port, or have a thread pool task listen on the event handle. When you do that, remember that you need to keep the OVERLAPPED structure as well as the REQUEST_OPLOCK_INPUT_BUFFER and REQUEST_OPLOCK_OUTUT_BUFFER structures valid until the I/O completes.
OVERLAPPED
REQUEST_OPLOCK_INPUT_BUFFER
REQUEST_OPLOCK_OUTUT_BUFFER
(You may find the CancelIo function handy to try to accelerate the clean-up of the file handle and any other actions that are dependent upon it.)
CancelIo
You can read more about opportunistic locks on MSDN. Note that there are limitations on explicitly-managed opportunistic locks; for example, they don't work across the network.
In London, some of the most expensive real estate is in neighborhoods where relatively few people actually live. According to one company's estimate, 37% of the the residences have been purchased by people who merely use them as vacation homes, visiting only for a week or two per year and leaving the building empty the remainder of the year. In other words, the people who can afford to live there choose not to.
This same phenomenon is reported in other cities. For example, only 10% of the condos in the Plaza Hotel are occupied full-time.
Another example of a house with nobody living inside is the case where the house is a façade for an industrial building, most commonly an electrical substation or a subway ventilation shaft.
I find both categories fascinating.
A customer liaison asked whether it was legal to use SetParent to create a parent/child relationship between windows which belong to different processes. "If I remember correctly, the documentation for SetParent used to contain a stern warning that it is not supported, but that remark does not appear to be present any more. I have a customer who is reparenting windows between processes, and their application is experiencing intermittent instability."
SetParent
Is it technically legal to have a parent/child or owner/owned relationship between windows from different processes?
Yes, it is technically legal.
It is also technically legal to juggle chainsaws.
Creating a cross-thread parent/child or owner/owned window relationship implicitly attaches the input queues of the threads which those windows belong to, and this attachment is transitive: If one of those queues is attached to a third queue, then all three queues are attached to each other. More generally, queues of all windows related by a chain of parent/child or owner/owned or shared-thread relationships are attached to each other.
Exercise: What are the equivalence classes generated by taking the transitive closure of parent/child windows, and what would be a natural choice of class representative? What about the equivalence classes generated by the transitive closure of parent/child and owner/owned windows?
This gets even more complicated when the parent/child or owner/owned relationship crosses processes, because cross-process coordination is even harder than cross-thread coordination. Sharing variables within a process is much easier than sharing variables across processes. On top of that, some window messages are blocked between processes.
So yes, it is technically legal, but if you create a cross-process parent/child or owner/owned relationship, the consequences can be very difficult to manage. And they become near-impossible to manage if one or both of the windows involved is unaware that it is participating in a cross-process window tree. (I often see this question in the context of somebody who wants to grab a window belonging to another process and forcibly graft it into their own process. That other process was totally unprepared for its window being manipulated in this way, and things may stop working. Indeed, things will definitely stop working if you change that other window from a top-level window to a child window.)
The existing text was probably removed when somebody pointed out that the action is technically legal (though not recommended for beginners), and instead of trying to come up with new text that describes the situation, merely removed the text that was incorrect. The problem with coming up with new text that describes the situation is that it only leads to more questions from people who want to do it in spite of the warnings. (It's one of those "if you don't already know what the consequences are, then you are not smart enough to do it correctly" things. You must first become the master of the rules before you can start breaking them.)
Microsofties love their acronyms, but you have to remember to send every potential name through a review panel of twelve-year-old boys to identify the lurking embarrassments.
When it came time in Windows 7 to come up with the names of the various subteams, two of the proposed names were Core OS eXperience and Find and Use eXperience, using the trendy letter X to abbreviate the trendy capitalization of the word eXperience.
The naming system was promptly reconsidered.
One of the subteams of Windows 8 is known as User-Centered Experience. The original name of the subteam was the You-Centered Experience (because it's all about you, the user), and they somewhat inadvisedly decided to adopt the nickname YOU, believing themselves to be sooooo clever.
What this actually did was create Abbot-and-Costello-level confusion.
"There's a work item assigned to YOU to handle this case."
— No, I don't have any such work item.
"No, not you. I mean the YOU team."
Some time after the standard acronyms and abbreviations for all the teams were settled upon, one of the reporting systems used to track the progress of the project was set up to allow reports to be generated not only for specific individuals or lists of individuals, but also for organizational units or feature teams. If you wanted to generate a report for Bob and everybody who reports through him, you could enter o_bob as the target of the report instead of having to type the name of every single person who worked for Bob. And if you wanted to generate a report for everybody who works on the XYZ feature team, you could enter f_xyz.
This meant that generating the reports for the YOU team required you to type f_you. The members of the YOU team were not pleased by this, and they prevailed upon the people who run the reporting system to change their notation. The request was granted, and the syntax for selecting an entire feature team was changed to ft_xyz instead of just f_xyz.
I would have argued that this was a problem of the YOU team's own creation. Next time, don't pick such a confusing name for your team.
Bonus chatter: During Windows XP development, we didn't use these fancy team acronyms. The teams were simply numbered. The kernel and drivers team was team 1. The terminal services team was team 4. The user interface was team 6. I forget most of the other numbers. But as I recall, there was no team 7, perhaps in tribute to Building 7.
I am a member of a peer-to-peer discussion group on an internal tool for programmers which we'll call Program Q. Every so often, somebody will get tripped up by smart quotes or en-dashes or ellipses, and they will get an error like
C:\> q select table –s “awesome table” Usage: q select table [-n] [-s] table Error: Must specify exactly one table.
After it is pointed out that they are a victim of Word's auto-conversion of straight quotes to slanted quotes, there will often be a suggestion, "You should treat en-dashes as plain dashes, smart quotes as straight quotes, and fancy-ellipses as three periods."
The people who support Program Q are members of this mailing list, and they explain that unfortunately for Program Q, those characters have been munged by internal processing to the point that when they reach the command line parser, they have been transformed into characters like ô and ö, so the parser doesn't even know that it's dealing with an en-dash or smart-quote or fancy-ellipsis.
Plus, this is a programming tool. Programmers presumably prefer consistent and strict behavior rather than auto-correcting guess-what-I-really-meant behavior. One of the former members of the Program Q support team recalled,
It might be possible to detect potential unintended goofiness and raise an error, but that creates the possibility of false positives, which in turn creates its own set of support issues that are more difficult to troubleshoot and resolve. Sometimes it's better to just let a failure fail at the point of failure rather than trying to be clever. There was a team that had a script that started up the Program Q server, and if there was a problem starting the server, it restored the databases from a backup. Automated failure recovery, what could possibly go wrong? Well, what happened is that the script decided to auto-restore from a week-old backup and thereby wiped out a week's worth of work. And it turns out that the failure in question was not caused by database corruption in the first place. Oops.
It might be possible to detect potential unintended goofiness and raise an error, but that creates the possibility of false positives, which in turn creates its own set of support issues that are more difficult to troubleshoot and resolve. Sometimes it's better to just let a failure fail at the point of failure rather than trying to be clever.
There was a team that had a script that started up the Program Q server, and if there was a problem starting the server, it restored the databases from a backup. Automated failure recovery, what could possibly go wrong? Well, what happened is that the script decided to auto-restore from a week-old backup and thereby wiped out a week's worth of work. And it turns out that the failure in question was not caused by database corruption in the first place. Oops.
"Well, if you're not going to do auto-correction, at least you should add this explanation to the documentation."
The people who support Program Q used to take these suggestions to heart, and when somebody said, "You should mention this in the documentation," they would more than not go ahead and add it to the documentation.
But that merely created a new phenomenon:
I can't get Program Q to create a table. I tried q create -template awesome_template awesome_table, but I keep getting the error "Template 'awesome_template' does not exist in the default namespace. Check that the template exists in the specified location. See 'q help create -template' for more information." What am I doing wrong?
q create -template awesome_template awesome_table
Um, did you check that the template exists in the specified location?
"No, I haven't. Should I?"
(Facepalm.)
After some troubleshooting, the people on the discussion group determine that the problem was that the template was created in a non-default namespace, so you had to use a full namespace qualifier to specify the template. (I'm totally making this up, I hope you realize. The actual Program Q doesn't have a template-create command. I'm just using this as a fake example for the purpose of storytelling.)
After this all gets straightened out, somebody will mention, "This is explained in the documentation for template creation. Did you read it?"
"I didn't read the documentation because it was too long."
If you follow one person's suggestion to add more discussion to the documentation, you end up creating problems for all the people who give up on the documentation because it's too long, regardless of how well-organized it is. In other words, sometimes adding documentation makes things worse. The challenge is to strike a decent balance.
Pre-emptive snarky comment: "TL;DR."
Shultzy's Sausage describes itself as "Seattle's Wurst Restaurant since 1989!" It's a local hangout for sausage, beer, chili, and advanced dishes like sausage with beer or sausage with chili.
In the early 1990's, Shultzy's expanded to a second location just a few blocks from Microsoft's main campus in Redmond, at a location known to my circle of friends as the location of death.
Many neighborhoods have a location of death: It's the location where there's a restaurant that can never manage to stay open. First it's a gyro restaurant. After a few months the gyro restaurant shuts down and a crêpe restaurant opens in its place. After another few months, the crêpe restaurant closes and a tea shop opens. You get the idea. It's not that we want the restaurants to fail. It's just that the location appears to be haunted.
Anyway, we wanted Shultzy's to succeed, so we made a point of going there semi-regularly. One evening, we went to the register and placed our orders, and the person behind the counter asked for a name to call when the order was ready.
Sometimes, when we went out to eat as a group and were feeling particularly whimsical, we'd all give the same name (Dave). Each time the name Dave was called, whoever felt lucky went to the counter to pick up the order. If the order was theirs, then they "won." It was cheap amusement, I admit.
Anyway, at this particular visit to Shultzy's, we did not play the Dave game. Each of us just gave our names. Except for Bob, who decided to be a bit of a smart aleck. When the person behind the counter asked, "What's your name?", Bob shot back, "What's your name?"
The person behind the counter calmly replied, "Shultzy."
Bob realized that he had just sassed the restaurant's owner and meekly replied, "My name's Bob."
Shultzy was gracious. "Thanks, Bob. I'll call you when your order's ready."
Even though Bob was only in his early 30's, he was a relative old-timer by Microsoft standards of the early 1990's. He perhaps should have recognized Shultzy, because Shultzy himself was featured in a full-page Microsoft advertisement a few years earlier touting how a small business uses Microsoft Excel to manage its day-to-day operations.
The location of death took another victim. The Shultzy's location near Microsoft main campus shut down after a few months. But the reason wasn't lack of business. Shultzy said that business at the new location was fine. Rather, he came to the conclusion that it was too much work to manage two locations, so he scaled his business back to its original size.
Today's article is in celebration of Seattle Restaurant Week.