ESENT (Extensible Storage Engine) API in the Windows SDK

infoblog » ESENT (Extensible Storage Engine) API in the Windows SDK

infoblog » ESENT (Extensible Storage Engine) API in the Windows SDK — Thu, 23 Oct 2008 05:33:50 GMT

PingBack from http://blog.a-foton.ru/index.php/2008/10/23/esent-extensible-storage-engine-api-in-the-windows-sdk/

infoblog » ESENT (Extensible Storage Engine) API in the Windows SDK

infoblog » ESENT (Extensible Storage Engine) API in the Windows SDK — Thu, 23 Oct 2008 05:34:06 GMT

PingBack from http://blog.a-foton.ru/index.php/2008/10/23/esent-extensible-storage-engine-api-in-the-windows-sdk/

My post on the Windows SDK blog

ESE/ESENT Database Stuff — Thu, 23 Oct 2008 07:50:06 GMT

Although the ESENT API has been available in the Windows SDK for several years, I don't think enough

ESENT tips and tricks

ascend slowly, breathing normally — Thu, 23 Oct 2008 09:06:32 GMT

ESENT is powerful embedded database engine that is part of Windows. It used by the Active Directory,

Visual Studio Links #81

Visual Studio Hacks — Fri, 24 Oct 2008 18:09:57 GMT

My latest in a series of the weekly, or more often, summary of interesting links I come across related to Visual Studio. Scott Guthrie posted the latest installment of links for ASP.NET, Visual Studio, WPF and Silverlight . Vance Morrison posted links

Un wrapper .NET pour les API ESENT (une des versions d’ESE, Extensible Storage Engine)

CoqBlog — Tue, 23 Dec 2008 18:10:07 GMT

Vous avez probablement déjà vu, au cours de vos recherches dans Process Explorer par exemple, que certains

re: ESENT (Extensible Storage Engine) API in the Windows SDK

flatfish — Wed, 24 Dec 2008 09:09:11 GMT

Any help here?

I want to create an instance of Database by ESE API, then attach an offline backuped Active Directory Database file "ntds.dit". It always report error "database page size mismatches engine size".

The offline Active Directory Database size is 8192. However, The ESE API on windows server 2003 always creates an instance with default database page size 4096.

I try to call JetSetSystemParameter function to set database page size to 8192, it always fails.

question:

How can I create an instance of Database with default page size 8192 on Windows Server 2003 by ESE API?

Any feedback will help. Thanks

re: ESENT (Extensible Storage Engine) API in the Windows SDK

laurionb — Wed, 24 Dec 2008 14:06:01 GMT

If setting the database page size is failing then esent is probably already initialized. Set the system parameter before calling JetInit.

re: ESENT (Extensible Storage Engine) API in the Windows SDK

flatfish — Wed, 31 Dec 2008 09:24:23 GMT

I ever tried the method of setting system parameter before calling JetInit, but it still failed.

Thanks

Changhua

re: ESENT (Extensible Storage Engine) API in the Windows SDK

flatfish — Wed, 31 Dec 2008 09:45:17 GMT

I ever tried like thus.

1.) set system parameter

2.) create instance

3.) call JetInit

Actually, it will fail in calling JetInit.

re: ESENT (Extensible Storage Engine) API in the Windows SDK

flatfish — Wed, 31 Dec 2008 09:46:35 GMT

I ever tried like thus.

1.) call setsystemparameter to set page size to 8192

2.) create instance

3.) call JetInit

Actually, it will fail in calling JetInit

re: ESENT (Extensible Storage Engine) API in the Windows SDK

laurionb — Fri, 02 Jan 2009 08:57:35 GMT

You are probably referencing the wrong logfiles then. Look for logfiles in the current directory and make sure you are setting the log path, basename and extension system parameters properly.

re: ESENT (Extensible Storage Engine) API in the Windows SDK

flatfish — Sun, 04 Jan 2009 04:26:11 GMT

Thank you very much! I will try.

re: ESENT (Extensible Storage Engine) API in the Windows SDK

flatfish — Sun, 04 Jan 2009 09:20:20 GMT

// Mount01.cpp : Defines the entry point for the console application.

#include "stdafx.h"

//#undef JET_VERSION

//#define JET_VERSION 0x0501

// #define _WIN32_WINNT 0X0501

#undef WINVER

#define WINVER 0x0502

#include <stdio.h>

#include <string.h>

#include <esent.h>

#include <string>

using namespace std;

typedef struct {

int errcode;

string msg ;

} errmap_t;

void PrintErrorMsg(JET_ERR retcode, char *name);

#define IMPLEMENT_MAP(code, msg) {code, #msg},

#define END_MAP() {0, ""}

errmap_t map[] = {

IMPLEMENT_MAP(JET_wrnRemainingVersions, The version store is still active. This error is returned by the directory manager.)

IMPLEMENT_MAP(JET_wrnNyi, The function is not yet implemented)

IMPLEMENT_MAP(JET_errRfsNotArmed, The Resource Failure Simulator has not been initialized.)

IMPLEMENT_MAP(JET_errInvalidParameter, An invalid API parameter is being used.)

IMPLEMENT_MAP(JET_errOutOfMemory, The system is out of memory.)

IMPLEMENT_MAP(JET_errInitInProgress, The database engine is being initialized.)

IMPLEMENT_MAP(JET_errLogFilePathInUse, The log file path is already being used by another database instance.)

IMPLEMENT_MAP(JET_errTempPathInUse, The path to the temporary database is already being used by another database instance.)

IMPLEMENT_MAP(JET_errDatabaseUnavailable, This database cannot be used because it encountered a fatal error.)

IMPLEMENT_MAP(JET_errNotInitialized, The database engine has not been initialized.)

IMPLEMENT_MAP(JET_errAlreadyInitialized, The database engine is already initialized.)

IMPLEMENT_MAP(JET_errDatabaseCorrupted, There is a non-database file or corrupt database.)

IMPLEMENT_MAP(JET_errInvalidDatabaseVersion, The database engine is incompatible with the database.)

IMPLEMENT_MAP(JET_errPageSizeMismatch, The database page size does not match the engine.)

IMPLEMENT_MAP(JET_errAttachedDatabaseMismatch, An outstanding database attachment has been detected at the start or end of the recovery but the database is missing or does not match attachment info.)

IMPLEMENT_MAP(JET_errCatalogCorrupted, Corruption was detected in the catalog.)

IMPLEMENT_MAP(JET_errPartiallyAttachedDB, The database is only partially attached and the attach operation cannot be completed.)

IMPLEMENT_MAP(JET_errInvalidSettings, The system parameters were set improperly.)

END_MAP()

};

int _tmain(int argc, _TCHAR* argv[])

{

JET_ERR errcode = 0;

JET_INSTANCE instance;

JET_SESID sesid;

JET_API_PTR value;

char szbuff[1024] = {0};

JET_DBID dbid;

// JET_PFNSTATUS status;

// Database Parameters

errcode = JetSetSystemParameter(&instance, JET_sesidNil, JET_paramDatabasePageSize, 8192, NULL);

PrintErrorMsg(errcode, "JetSetSystemParameter");

// create database instance;

errcode = JetCreateInstance(&instance, "JetDatabaseInstance");

PrintErrorMsg(errcode, "JetCreateInstance");

// Transaction Log Parameters

errcode = JetSetSystemParameter(&instance, JET_sesidNil, JET_paramLogFilePath, NULL, "D:\\ntdsbackup\\");

PrintErrorMsg(errcode, "JetSetSystemParameter");

// errcode = JetSetSystemParameter(&instance, JET_sesidNil, JET_paramBaseName, NULL, "edb");

errcode = JetSetSystemParameter(&instance, JET_sesidNil, JET_paramSystemPath, NULL, "D:\\ntdsbackup\\");

PrintErrorMsg(errcode, "JetSetSystemParameter");

// I/O Parameters

errcode = JetSetSystemParameter(&instance, JET_sesidNil, JET_paramAccessDeniedRetryPeriod, 1000, NULL);

PrintErrorMsg(errcode, "JetSetSystemParameter");

errcode = JetSetSystemParameter(&instance, JET_sesidNil, JET_paramCreatePathIfNotExist, 1, NULL);

PrintErrorMsg(errcode, "JetSetSystemParameter");

// Database Parameters

// errcode = JetSetSystemParameter(&instance, JET_sesidNil, JET_paramDbExtensionSize, 256, NULL);

// Database Cache Parameters

// errcode = JetSetSystemParameter(&instance, JET_sesidNil, JET_paramCacheSize, 10, NULL);

// Temporary Database Parameters

errcode = JetSetSystemParameter(&instance, JET_sesidNil, JET_paramTempPath, NULL, "C:\\WINDOWS\\Temp");

PrintErrorMsg(errcode, "JetSetSystemParameter");

errcode = JetGetSystemParameter(instance, JET_sesidNil, JET_paramDatabasePageSize, &value, szbuff, 1024);

PrintErrorMsg(errcode, "JetGetSystemParameter");

errcode = JetInit(&instance);

PrintErrorMsg(errcode, "JetInit");

errcode = JetBeginSession(instance, &sesid, 0, 0);

PrintErrorMsg(errcode, "JetBeginSession");

errcode = JetGetSystemParameter(instance, sesid, JET_paramDatabasePageSize, &value, szbuff, 1024);

PrintErrorMsg(errcode, "JetGetSystemParameter");

errcode = JetAttachDatabase(sesid, "D:\\ntdsbackup\\ntds.dit", 0);

PrintErrorMsg(errcode, "JetAttachDatabase");

errcode = JetOpenDatabase(sesid, "D:\\ntdsbackup\\ntds.dit", 0, &dbid, 0);

PrintErrorMsg(errcode, "JetOpenDatabase");

errcode = JetCloseDatabase(sesid, dbid, 0);

PrintErrorMsg(errcode, "JetCloseDatabase");

errcode = JetDetachDatabase(sesid, "D:\\ntdsbackup\\ntds.dit");

PrintErrorMsg(errcode, "JetDetachDatabase");

errcode = JetTerm(instance);

PrintErrorMsg(errcode, "JetTerm");

return 0;

}

void PrintErrorMsg(JET_ERR retcode, char *name)

{ if(retcode ==0) return;

for(int n = 0; n < sizeof(map) / sizeof(errmap_t); n++) {

if(map[n].errcode == 0) break;

if(retcode == map[n].errcode) {printf("%s : %d ----- %s\n", name, retcode, map[n].msg.c_str()); break;}

}

return;

}

I run above code, it still reports -1216 error.

"An outstanding database attachment has been detected at the start or end of the recovery, but the database is missing or does not match attachment info."

re: ESENT (Extensible Storage Engine) API in the Windows SDK

flatfish — Sun, 04 Jan 2009 09:21:14 GMT

The error is returned in calling JetInit.

re: ESENT (Extensible Storage Engine) API in the Windows SDK

flatfish — Sun, 04 Jan 2009 11:07:29 GMT

There are a few files in directory D:\\ntdsbackup\\

They are ntds.dit edb.chk edb.log edb00002.log.

re: ESENT (Extensible Storage Engine) API in the Windows SDK

flatfish — Mon, 05 Jan 2009 05:00:24 GMT

Hi laurionb:

I had backuped all Active Directory files, including ntds.dit edb.chk edb.log edbxxxxx.log, temp.edb, res1.log res2.log to the directory "d:\ntdsbackup". Then I run above program. It still returns error -1216.

Would you please give me extra help?

Thank you very much...

re: ESENT (Extensible Storage Engine) API in the Windows SDK

flatfish — Mon, 05 Jan 2009 10:00:03 GMT

It seems that it fails because of failing of soft recovery in calling JetInit.

re: ESENT (Extensible Storage Engine) API in the Windows SDK

flatfish — Tue, 06 Jan 2009 06:25:23 GMT

I Attached an Active Directory Database. But I didn't know that how many tables there are in it

and the table's name, id of each.

Question:

How did I get to the table's name, id for above case?

Thanks

re: ESENT (Extensible Storage Engine) API in the Windows SDK

flatfish — Tue, 06 Jan 2009 06:26:47 GMT

It seems that there isn't revelant ESE API to traverse the table's id and name etc.

re: ESENT (Extensible Storage Engine) API in the Windows SDK

flatfish — Tue, 06 Jan 2009 06:53:08 GMT

Are there ESE API to traverse all tables'name of Active Directory Database?

ESE, Microsoft's Embeddable Database

LonTonG — Wed, 07 Jan 2009 23:24:31 GMT

Mungkin ada benarnya juga kata pengantar di blog Windows SDK yang membahas tentang ESE , bahwa sedikit

re: ESENT (Extensible Storage Engine) API in the Windows SDK

KarinM — Thu, 08 Jan 2009 00:26:32 GMT

LonTonG, I’m not very fluent in Bhasa. Are you saying that a correction is needed in the preface of the ESE article?

--Karin

re: ESENT (Extensible Storage Engine) API in the Windows SDK

flatfish — Fri, 09 Jan 2009 13:54:50 GMT

It seemed that I found a workaround.

The concrete way is that we can get all tables'name by microsoft tool esentutl.exe, then I can access each table with the table's name just gotten.

re: ESENT (Extensible Storage Engine) API in the Windows SDK

flatfish — Mon, 12 Jan 2009 10:15:25 GMT

Why is there only few resource relevant to program with ESE API?

re: ESENT (Extensible Storage Engine) API in the Windows SDK

flatfish — Tue, 13 Jan 2009 12:09:27 GMT

I wanted to present Active Directory Objects logically from an offline Active Director Database. Currently, I can mount and open the offline Active Directory Database. But I didn't know any relation between their datas in the tables.

Question:

Can I present the Active Directory Objects with close logical relationship like the Active Directory Users and Computers console in Windows 2003 by ESE API?

Any feedback will help. Thank you in advance.

re: ESENT (Extensible Storage Engine) API in the Windows SDK

KarinM — Tue, 13 Jan 2009 20:03:34 GMT

Flatfish, you will have better luck getting your questions answered on the MSDN Developer Forum for General Windows Development Issues http://social.msdn.microsoft.com/Forums/en-US/windowsgeneraldevelopmentissues/threads/. The SDK team is only a ship vehicle for this technology and can’t answer your questions. Thousands of developers, including Microsoft MVP, technical support staff and Microsoft developers review and answer questions posted on the Developer Forums.

re: ESENT (Extensible Storage Engine) API in the Windows SDK

flatfish — Wed, 14 Jan 2009 07:03:47 GMT

Thanks, KarinM. I will try my luck in the Developer Forum.

In Windows Server 2003, there isn't ESE API used to get column's name of a table. How do I get the column name of a table in Windows Server 2003 by ESE API, or any workaround?

re: ESENT (Extensible Storage Engine) API in the Windows SDK

flatfish — Fri, 16 Jan 2009 03:58:08 GMT

Which is the schema table in Active Directory Database? What is the schema table's name?

Any help?

re: ESENT (Extensible Storage Engine) API in the Windows SDK

KarinM — Fri, 16 Jan 2009 04:04:24 GMT

Flatfish, please post your question on the MSDN Developer Forum for General Windows Development Issues http://social.msdn.microsoft.com/Forums/en-US/windowsgeneraldevelopmentissues/threads/. This is not the forum to ask development-related questions. Thanks!

Jet Blue is still alive or in the need of DBS

FrankFi's view of the world — Tue, 24 Mar 2009 19:43:32 GMT

Hi… most US citizens see in the term Jet Blue the airline. Some others (like me) remember there was something

re: ESENT (Extensible Storage Engine) API in the Windows SDK

jlu2000 — Sun, 29 Mar 2009 20:35:14 GMT

Here is the scenario I like to do with ESENT:

On a table, there is index on two colums:

PararnetId byte[8] nuallable

recId byte[8] unique

index on these two columns: idxParentToId

To query a list of records in a database which belongs to same parented, do you know how to achieve this :

JetSetCurrentIndex: idxParentToId

JetMakeKey -> key – {parentId} to search ?

JetSeek

JetSetIndexRange

Then using JetMove to read each record.

However, I am not able to do any seek on JetSeek, it always failed JET_wrnSeekNotEqual. Could anyone give me a sample how should I do this?

re: ESENT (Extensible Storage Engine) API in the Windows SDK

jlu2000 — Mon, 30 Mar 2009 05:53:55 GMT

JetOpenTable return with error = JET_errCallbackNotResolved, A callback function could not be found.

How could I register callback if I am not able to open table, since register would require table id?