Corruptions of the eXist database

classic Classic list List threaded Threaded
7 messages Options
Reply | Threaded
Open this post in threaded view
|

Corruptions of the eXist database

Eric van der Vlist
Hi,

My apiculteurs.info website (still powered by OPS 2.8) has rather
frequent eXist database corruptions.

I don't really know how to diagnose them, but I have noticed that the
last one has just occurred after a server stop/start and I am wondering
if the embedded database is properly shut by OPS down when a servlet is
stopped.

The eXist documentation
(http://exist.sourceforge.net/quickstart.html#N10375) says that "closing
the database explicitely is always a good idea" and more explicitly "It
is always recommended to cleanly shut down the database before killing
the server process. Otherwise, data files may get corrupted.".

Could that be the reason of these corruptions?

Thanks,

Eric
--
Weblog:
                 http://eric.van-der-vlist.com/blog?t=category&a=English
------------------------------------------------------------------------
Eric van der Vlist       http://xmlfr.org            http://dyomedea.com
(ISO) RELAX NG   ISBN:0-596-00421-4 http://oreilly.com/catalog/relax
(W3C) XML Schema ISBN:0-596-00252-1 http://oreilly.com/catalog/xmlschema
------------------------------------------------------------------------




--
You receive this message as a subscriber of the [hidden email] mailing list.
To unsubscribe: mailto:[hidden email]
For general help: mailto:[hidden email]?subject=help
ObjectWeb mailing lists service home page: http://www.objectweb.org/wws
Reply | Threaded
Open this post in threaded view
|

Re: Corruptions of the eXist database

Erik Bruchez
Administrator
Eric van der Vlist wrote:

> Hi,
>
> My apiculteurs.info website (still powered by OPS 2.8) has rather
> frequent eXist database corruptions.
>
> I don't really know how to diagnose them, but I have noticed that the
> last one has just occurred after a server stop/start and I am wondering
> if the embedded database is properly shut by OPS down when a servlet is
> stopped.
>
> The eXist documentation
> (http://exist.sourceforge.net/quickstart.html#N10375) says that "closing
> the database explicitely is always a good idea" and more explicitly "It
> is always recommended to cleanly shut down the database before killing
> the server process. Otherwise, data files may get corrupted.".
>
> Could that be the reason of these corruptions?
IIRC there is a difference between embedded use, where you have to be
explicit, and deploying eXist as a servlet, where, I assume,
Servlet.destroy() would take care of shutting down automatically.

Do you use the version of eXist bundled with OPS, or your own? Also, are
you using it as a servlet or in embedded mode? The embedded mode will be
triggered by a certain URL structure like:

   xmldb:exist:///

as opposed to something like:

   xmldb:exist://localhost:9999/exist/xmlrpc

In embedded mode, I don't think we do a nice shutdown of the database,
so this should be fixed. Added a bug to track this:

https://forge.objectweb.org/tracker/index.php?func=detail&aid=304104&group_id=168&atid=350207

At any rate it will be worth upgrading to a newer version of the version
of eXist currently embedded with OPS, as the current one is quite old.

-Erik



--
You receive this message as a subscriber of the [hidden email] mailing list.
To unsubscribe: mailto:[hidden email]
For general help: mailto:[hidden email]?subject=help
ObjectWeb mailing lists service home page: http://www.objectweb.org/wws
Reply | Threaded
Open this post in threaded view
|

Re: Corruptions of the eXist database

Eric van der Vlist
Hi Erik,

Le jeudi 22 septembre 2005 à 15:25 -0700, Erik Bruchez a écrit :

> Eric van der Vlist wrote:
> > Hi,
> >
> > My apiculteurs.info website (still powered by OPS 2.8) has rather
> > frequent eXist database corruptions.
> >
> > I don't really know how to diagnose them, but I have noticed that the
> > last one has just occurred after a server stop/start and I am wondering
> > if the embedded database is properly shut by OPS down when a servlet is
> > stopped.
> >
> > The eXist documentation
> > (http://exist.sourceforge.net/quickstart.html#N10375) says that "closing
> > the database explicitely is always a good idea" and more explicitly "It
> > is always recommended to cleanly shut down the database before killing
> > the server process. Otherwise, data files may get corrupted.".
> >
> > Could that be the reason of these corruptions?
>
> IIRC there is a difference between embedded use, where you have to be
> explicit, and deploying eXist as a servlet, where, I assume,
> Servlet.destroy() would take care of shutting down automatically.
>
> Do you use the version of eXist bundled with OPS, or your own?
I am using the version that is bundled with OPS.

> Also, are
> you using it as a servlet or in embedded mode?

I'd say I am using it in a mixed mode :-) ...

OPS applications access the database as an embedded one but I have added
an XML-RPC access in my web.xml so that I can also access the database
with the eXist client (that's very handy to administer the database).

A downside is that the DB needs to be started by OPS (I can't access the
database is OPS hasn't started it which is done after a first page
accessing the DB has been fetched).

> The embedded mode will be
> triggered by a certain URL structure like:
>
>    xmldb:exist:///
>
> as opposed to something like:
>
>    xmldb:exist://localhost:9999/exist/xmlrpc
>
> In embedded mode, I don't think we do a nice shutdown of the database,
> so this should be fixed. Added a bug to track this:
>
> https://forge.objectweb.org/tracker/index.php?func=detail&aid=304104&group_id=168&atid=350207
I have added en explicit shutdown of the database (through XML-RPC) in
my init.d script and I'll see if that helps.
>
> At any rate it will be worth upgrading to a newer version of the version
> of eXist currently embedded with OPS, as the current one is quite old.

OK, I'll try that too!

Thanks,

Eric

> -Erik

--
Le premier annuaire des apiculteurs 100% XML!
                                                http://apiculteurs.info/
------------------------------------------------------------------------
Eric van der Vlist       http://xmlfr.org            http://dyomedea.com
(ISO) RELAX NG   ISBN:0-596-00421-4 http://oreilly.com/catalog/relax
(W3C) XML Schema ISBN:0-596-00252-1 http://oreilly.com/catalog/xmlschema
------------------------------------------------------------------------




--
You receive this message as a subscriber of the [hidden email] mailing list.
To unsubscribe: mailto:[hidden email]
For general help: mailto:[hidden email]?subject=help
ObjectWeb mailing lists service home page: http://www.objectweb.org/wws
Reply | Threaded
Open this post in threaded view
|

Re: Corruptions of the eXist database

Erik Bruchez
Administrator
Eric van der Vlist wrote:

>> At any rate it will be worth upgrading to a newer version of the version
>> of eXist currently embedded with OPS, as the current one is quite old.
>
> OK, I'll try that too!

Note that the version eXist that ships with OPS right now has been
modified to use a re-rooted antlr library (man, is that one obnoxious by
not using Java packages and being built by custom scripts), because of a
conflict with Weblogic's bundled antlr. But you should be fine if you
don't use Weblogic!

-Erik




--
You receive this message as a subscriber of the [hidden email] mailing list.
To unsubscribe: mailto:[hidden email]
For general help: mailto:[hidden email]?subject=help
ObjectWeb mailing lists service home page: http://www.objectweb.org/wws
Reply | Threaded
Open this post in threaded view
|

Using OPS with a recent version of eXist (was: Corruptions of the eXist database)

Eric van der Vlist
Hi Erik,

Le vendredi 23 septembre 2005 à 16:43 -0700, Erik Bruchez a écrit :

> Eric van der Vlist wrote:
>
> >> At any rate it will be worth upgrading to a newer version of the version
> >> of eXist currently embedded with OPS, as the current one is quite old.
> >
> > OK, I'll try that too!
>
> Note that the version eXist that ships with OPS right now has been
> modified to use a re-rooted antlr library (man, is that one obnoxious by
> not using Java packages and being built by custom scripts), because of a
> conflict with Weblogic's bundled antlr. But you should be fine if you
> don't use Weblogic!
I can confirm that and have published some notes on how to do such a
migration:

http://eric.van-der-vlist.com/blog/1416_Using_Orbeon_PresentationServer_with_a_recent_version_of_eXist.item

I have migrated http://apiculteurs.info this night and I'll let you know
if I still have any corruption.

Thanks,

Eric

--
Freelance consulting and training.
                                            http://dyomedea.com/english/
------------------------------------------------------------------------
Eric van der Vlist       http://xmlfr.org            http://dyomedea.com
(ISO) RELAX NG   ISBN:0-596-00421-4 http://oreilly.com/catalog/relax
(W3C) XML Schema ISBN:0-596-00252-1 http://oreilly.com/catalog/xmlschema
------------------------------------------------------------------------




--
You receive this message as a subscriber of the [hidden email] mailing list.
To unsubscribe: mailto:[hidden email]
For general help: mailto:[hidden email]?subject=help
ObjectWeb mailing lists service home page: http://www.objectweb.org/wws
Reply | Threaded
Open this post in threaded view
|

Re: Using OPS with a recent version of eXist

Erik Bruchez
Administrator
Eric van der Vlist wrote:

> Hi Erik,
>
> Le vendredi 23 septembre 2005 ? 16:43 -0700, Erik Bruchez a ?crit :
>
>>Eric van der Vlist wrote:
>>
>>
>>>>At any rate it will be worth upgrading to a newer version of the version
>>>>of eXist currently embedded with OPS, as the current one is quite old.
>>>
>>>OK, I'll try that too!
>>
>>Note that the version eXist that ships with OPS right now has been
>>modified to use a re-rooted antlr library (man, is that one obnoxious by
>>not using Java packages and being built by custom scripts), because of a
>>conflict with Weblogic's bundled antlr. But you should be fine if you
>>don't use Weblogic!
>
>
> I can confirm that and have published some notes on how to do such a
> migration:
>
> http://eric.van-der-vlist.com/blog/1416_Using_Orbeon_PresentationServer_with_a_recent_version_of_eXist.item
>
> I have migrated http://apiculteurs.info this night and I'll let you know
> if I still have any corruption.
Great work. Thanks for the detailed migration information!

I was at first shocked reading that Java 5 was required. But I think we
can work around it by just providing the latest Xerces XML APIs.

-Erik



--
You receive this message as a subscriber of the [hidden email] mailing list.
To unsubscribe: mailto:[hidden email]
For general help: mailto:[hidden email]?subject=help
ObjectWeb mailing lists service home page: http://www.objectweb.org/wws
Reply | Threaded
Open this post in threaded view
|

Re: Using OPS with a recent version of eXist

Eric van der Vlist
Le vendredi 07 octobre 2005 à 10:28 +0200, Erik Bruchez a écrit :

> Eric van der Vlist wrote:
> > Hi Erik,
> >
> > Le vendredi 23 septembre 2005 à 16:43 -0700, Erik Bruchez a écrit :
> >
> >>Eric van der Vlist wrote:
> >>
> >>
> >>>>At any rate it will be worth upgrading to a newer version of the version
> >>>>of eXist currently embedded with OPS, as the current one is quite old.
> >>>
> >>>OK, I'll try that too!
> >>
> >>Note that the version eXist that ships with OPS right now has been
> >>modified to use a re-rooted antlr library (man, is that one obnoxious by
> >>not using Java packages and being built by custom scripts), because of a
> >>conflict with Weblogic's bundled antlr. But you should be fine if you
> >>don't use Weblogic!
> >
> >
> > I can confirm that and have published some notes on how to do such a
> > migration:
> >
> > http://eric.van-der-vlist.com/blog/1416_Using_Orbeon_PresentationServer_with_a_recent_version_of_eXist.item
> >
> > I have migrated http://apiculteurs.info this night and I'll let you know
> > if I still have any corruption.
>
> Great work. Thanks for the detailed migration information!
>
> I was at first shocked reading that Java 5 was required. But I think we
> can work around it by just providing the latest Xerces XML APIs.
Yes, probably. I have several versions of Java installed on my machines
anyway. That wasn't a big deal for me and I haven't investigated further
on...

If anyone finds out, please let me know either through this list or
leaving a comment on my blog and I'll update the blog item.

Thanks,

Eric

--
Don't you think all these XML schema languages should work together?
                                                         http://dsdl.org
------------------------------------------------------------------------
Eric van der Vlist       http://xmlfr.org            http://dyomedea.com
(ISO) RELAX NG   ISBN:0-596-00421-4 http://oreilly.com/catalog/relax
(W3C) XML Schema ISBN:0-596-00252-1 http://oreilly.com/catalog/xmlschema
------------------------------------------------------------------------




--
You receive this message as a subscriber of the [hidden email] mailing list.
To unsubscribe: mailto:[hidden email]
For general help: mailto:[hidden email]?subject=help
ObjectWeb mailing lists service home page: http://www.objectweb.org/wws