Orbeon Forms community mailing list

Orbeon Nightly regression: DTD entity imports no longer working

Classic

List

Threaded

17 messages Options

Ralf Jung

Orbeon Nightly regression: DTD entity imports no longer working

Hi,

I am using Orbeon to verify a document based on a DTD, and to resolve the
entities used by it. This includes both custom entities and those pre-defined
by XHTML, which are imported like this:

<!ENTITY % HTMLlat1 SYSTEM "xhtml-lat1.ent">
%HTMLlat1;
<!ENTITY % HTMLspecial SYSTEM "xhtml-special.ent">
%HTMLspecial;
<!ENTITY % HTMLsymbol SYSTEM "xhtml-symbol.ent">
%HTMLsymbol;

The documented is imported using the url-generator with validation enabled.
This works fine in Orbeon 3.8. However, while attempting to reproduce an issue
with the current nightly, I noticed a regression: Running the same pipeline
(through the command-line) results in tons of errors like this one:

2010-12-13 09:43:20,852 INFO org.orbeon.oxf.xml.XMLUtils - Error:
org.xml.sax.SAXParseException; systemId:
oxf:/var/lib/tomcat6/webapps/<path>/<file>.xml; lineNumber: 17626;
columnNumber: 41; The entity "nbsp" was referenced, but not declared.

However, the entities defined directly in the DTD are resolved fine. It seems
that for some reason, importing entities does not work anymore. Is there some
configuration option to control how and where Orbeon looks for DTDs and entity
files?

Kind regards,
Ralf Jung

--
You receive this message as a subscriber of the [hidden email] mailing list.
To unsubscribe: mailto:[hidden email]
For general help: mailto:[hidden email]?subject=help
OW2 mailing lists service home page: http://www.ow2.org/wws

Erik Bruchez

Re: Orbeon Nightly regression: DTD entity imports no longer working

Administrator

Ralf,

We just disabled loading of external entities for security reasons.

I guess that means we should provide an option to the URL generator
instead. The only problem is that the XML parser configuration is
really nasty (JAXP is a horrible thing).

Do you have a workaround for this?

-Erik

On Mon, Dec 13, 2010 at 1:09 AM, Ralf Jung <[hidden email]> wrote:

> Hi,
>
> I am using Orbeon to verify a document based on a DTD, and to resolve the
> entities used by it. This includes both custom entities and those pre-defined
> by XHTML, which are imported like this:
>
> <!ENTITY % HTMLlat1 SYSTEM "xhtml-lat1.ent">
> %HTMLlat1;
> <!ENTITY % HTMLspecial SYSTEM "xhtml-special.ent">
> %HTMLspecial;
> <!ENTITY % HTMLsymbol SYSTEM "xhtml-symbol.ent">
> %HTMLsymbol;
>
> The documented is imported using the url-generator with validation enabled.
> This works fine in Orbeon 3.8. However, while attempting to reproduce an issue
> with the current nightly, I noticed a regression: Running the same pipeline
> (through the command-line) results in tons of errors like this one:
>
> 2010-12-13 09:43:20,852 INFO org.orbeon.oxf.xml.XMLUtils - Error:
> org.xml.sax.SAXParseException; systemId:
> oxf:/var/lib/tomcat6/webapps/<path>/<file>.xml; lineNumber: 17626;
> columnNumber: 41; The entity "nbsp" was referenced, but not declared.
>
> However, the entities defined directly in the DTD are resolved fine. It seems
> that for some reason, importing entities does not work anymore. Is there some
> configuration option to control how and where Orbeon looks for DTDs and entity
> files?
>
> Kind regards,
> Ralf Jung
>
>
> --
> You receive this message as a subscriber of the [hidden email] mailing list.
> To unsubscribe: mailto:[hidden email]
> For general help: mailto:[hidden email]?subject=help
> OW2 mailing lists service home page: http://www.ow2.org/wws
>
>

--
You receive this message as a subscriber of the [hidden email] mailing list.
To unsubscribe: mailto:[hidden email]
For general help: mailto:[hidden email]?subject=help
OW2 mailing lists service home page: http://www.ow2.org/wws

Ralf Jung

Re: Re: Orbeon Nightly regression: DTD entity imports no longer working

Hi,

> We just disabled loading of external entities for security reasons.
Ouch :( Where is there a security issue here? The DTD itself is also loaded
from the file system, triggered by the XML file.

> I guess that means we should provide an option to the URL generator
> instead. The only problem is that the XML parser configuration is
> really nasty (JAXP is a horrible thing).
>
> Do you have a workaround for this?
Not really - this is already the workaround for eXist being unable to properly
deal with entities ;-)

Kind regards,
Ralf Jung

--
You receive this message as a subscriber of the [hidden email] mailing list.
To unsubscribe: mailto:[hidden email]
For general help: mailto:[hidden email]?subject=help
OW2 mailing lists service home page: http://www.ow2.org/wws

Erik Bruchez

Re: Re: Re: Orbeon Nightly regression: DTD entity imports no longer working

Administrator

>> We just disabled loading of external entities for security reasons.
> Ouch :( Where is there a security issue here? The DTD itself is also loaded
> from the file system, triggered by the XML file.

Security issues occur when malicious users post XML to Orbeon Forms.
In that case, for sure, external entities should be disabled.

So we took the rather drastic step to disable them for now.

>> I guess that means we should provide an option to the URL generator
>> instead. The only problem is that the XML parser configuration is
>> really nasty (JAXP is a horrible thing).
>>
>> Do you have a workaround for this?
> Not really - this is already the workaround for eXist being unable to properly
> deal with entities ;-)

Mmh, this means that we probably need to implement some configuration
mechanism. The issue is that it will be take a bit of time to do this.

Unless you could use something like XInclude?

-Erik

>
> Kind regards,
> Ralf Jung
>
>
> --
> You receive this message as a subscriber of the [hidden email] mailing list.
> To unsubscribe: mailto:[hidden email]
> For general help: mailto:[hidden email]?subject=help
> OW2 mailing lists service home page: http://www.ow2.org/wws
>
>

Ralf Jung

Re: Re: Re: Re: Orbeon Nightly regression: DTD entity imports no longer working

Hi Erik,

> Security issues occur when malicious users post XML to Orbeon Forms.
> In that case, for sure, external entities should be disabled.
Sorry if that is a stupid question, but I still do not get it... the only
difference between the entities that work and those that do not is that the
first are defined directly in the DTD, the other are "imported" (or however that
is called) through <!ENTITY % ... >. Since both files are controlled by the
system, and all the attacker can do is choose which DTD to use, it does not
occur to me why one file (the .dtd) is more trustworthy than the other (the
.ent).

> Mmh, this means that we probably need to implement some configuration
> mechanism. The issue is that it will be take a bit of time to do this.
>
> Unless you could use something like XInclude?
How could that help? Can a DTD XInclude other files? That would be a
possibility. I can not edit the files containing the data, as they are
regularly sent to me for import, with almost no possibility for me to change
the format (well, some more hacks and pre-processing them on a Shell should
work, but... the import is already complicated enough right now). But I can
tweak the DTD.

Kind regards,
Ralf Jung

--
You receive this message as a subscriber of the [hidden email] mailing list.
To unsubscribe: mailto:[hidden email]
For general help: mailto:[hidden email]?subject=help
OW2 mailing lists service home page: http://www.ow2.org/wws

Erik Bruchez

Re: Re: Re: Re: Re: Orbeon Nightly regression: DTD entity imports no longer working

Administrator

> Sorry if that is a stupid question, but I still do not get it... the only
> difference between the entities that work and those that do not is that the
> first are defined directly in the DTD, the other are "imported" (or however that
> is called) through <!ENTITY % ... >. Since both files are controlled by the
> system, and all the attacker can do is choose which DTD to use, it does not
> occur to me why one file (the .dtd) is more trustworthy than the other (the
> .ent).

Right, those are called external entities, and it's those that cause
security issues and which we disabled.

> How could that help? Can a DTD XInclude other files?

I fear not.

> That would be a
> possibility. I can not edit the files containing the data, as they are
> regularly sent to me for import, with almost no possibility for me to change
> the format (well, some more hacks and pre-processing them on a Shell should
> work, but... the import is already complicated enough right now). But I can
> tweak the DTD.

So can you tweak it not to use external entities?

-Erik

--
You receive this message as a subscriber of the [hidden email] mailing list.
To unsubscribe: mailto:[hidden email]
For general help: mailto:[hidden email]?subject=help
OW2 mailing lists service home page: http://www.ow2.org/wws

Ralf Jung

Re: Re: Re: Re: Re: Re: Orbeon Nightly regression: DTD entity imports no longer working

Hi,

> So can you tweak it not to use external entities?
Well, I guess I could paste the whole xhtml*.ent files into the DTDs. The next
work-around on my list, looks like XML programming is mainly consisting of
finding work-arounds ;-)
Anyway, it seems the import is working as expected now with the nightly.

Kind regards,
Ralf Jung

--
You receive this message as a subscriber of the [hidden email] mailing list.
To unsubscribe: mailto:[hidden email]
For general help: mailto:[hidden email]?subject=help
OW2 mailing lists service home page: http://www.ow2.org/wws

Erik Bruchez

Re: Re: Re: Re: Re: Re: Re: Orbeon Nightly regression: DTD entity imports no longer working

Administrator

>> So can you tweak it not to use external entities?
> Well, I guess I could paste the whole xhtml*.ent files into the DTDs. The next
> work-around on my list, looks like XML programming is mainly consisting of
> finding work-arounds ;-)

There has been a lot of debate about even the existence of DTDs in
XML. Now XML is stuck with them and lots of documents still use them.
But if you can avoid them, you probably should!

> Anyway, it seems the import is working as expected now with the nightly.

So you mean with the external entity, or with pasting your entities
into each document?

-Erik

--
You receive this message as a subscriber of the [hidden email] mailing list.
To unsubscribe: mailto:[hidden email]
For general help: mailto:[hidden email]?subject=help
OW2 mailing lists service home page: http://www.ow2.org/wws

Ralf Jung

Re: Re: Re: Re: Re: Re: Re: Re: Orbeon Nightly regression: DTD entity imports no longer working

Hi Erik,

> There has been a lot of debate about even the existence of DTDs in
> XML. Now XML is stuck with them and lots of documents still use them.
> But if you can avoid them, you probably should!
Unfortunately I can't. This is a very old XML format I am dealing with, with
lot of data being stored in that format, and I am happy to have any validation
available at all. I don't exactly feel like creating an XMLScheme for it. Not
to mention that, from all I understood, XMLSchemes can't handle entities - and
entities are a core part of the format, encoding much more than just
characters :(

> So you mean with the external entity, or with pasting your entities
> into each document?
I pasted most of the global .ent files into all of the DTDs, thanks for that
hint. It's working, but ugly, so I still hope for some configuration switch :)
. After all, I'm not going to productively use the new version before it had a
stable release.

Kind regards,
Ralf Jung

--
You receive this message as a subscriber of the [hidden email] mailing list.
To unsubscribe: mailto:[hidden email]
For general help: mailto:[hidden email]?subject=help
OW2 mailing lists service home page: http://www.ow2.org/wws

Erik Bruchez

Re: Re: Re: Re: Re: Re: Re: Re: Re: Orbeon Nightly regression: DTD entity imports no longer working

Administrator

Ralf,

For now I have entered an RFE to make this configurable:

http://forge.ow2.org/tracker/index.php?func=detail&aid=315707&group_id=168&atid=350207

-Erik

On Tue, Dec 21, 2010 at 2:46 AM, Ralf Jung <[hidden email]> wrote:

> Hi Erik,
>
>> There has been a lot of debate about even the existence of DTDs in
>> XML. Now XML is stuck with them and lots of documents still use them.
>> But if you can avoid them, you probably should!
> Unfortunately I can't. This is a very old XML format I am dealing with, with
> lot of data being stored in that format, and I am happy to have any validation
> available at all. I don't exactly feel like creating an XMLScheme for it. Not
> to mention that, from all I understood, XMLSchemes can't handle entities - and
> entities are a core part of the format, encoding much more than just
> characters :(
>
>> So you mean with the external entity, or with pasting your entities
>> into each document?
> I pasted most of the global .ent files into all of the DTDs, thanks for that
> hint. It's working, but ugly, so I still hope for some configuration switch :)
> . After all, I'm not going to productively use the new version before it had a
> stable release.
>
> Kind regards,
> Ralf Jung
>
>
> --
> You receive this message as a subscriber of the [hidden email] mailing list.
> To unsubscribe: mailto:[hidden email]
> For general help: mailto:[hidden email]?subject=help
> OW2 mailing lists service home page: http://www.ow2.org/wws
>
>

Erik Bruchez

Re: Re: Re: Re: Re: Re: Re: Re: Re: Orbeon Nightly regression: DTD entity imports no longer working

Administrator

Ralf,

Not sure if this is still relevant to you, but we have just implemented this:

http://forge.ow2.org/tracker/index.php?func=detail&aid=315707&group_id=168&atid=350207

See:

https://github.com/orbeon/orbeon-forms/commit/aad225857fbf1d01d6df5efc928fd6e720eee58e

Re: Orbeon Nightly regression: DTD entity imports no longer working

Hi Erik,

thanks a lot, it's indeed working :)

Kind regards,
Ralf

Am Freitag 11 März 2011, um 03:16:52 schrieb Erik Bruchez:

> Ralf,
>
> Not sure if this is still relevant to you, but we have just implemented
> this:
>
> http://forge.ow2.org/tracker/index.php?func=detail&aid=315707&group_id=168&
> atid=350207
>
> See:
>
> https://github.com/orbeon/orbeon-forms/commit/aad225857fbf1d01d6df5efc928fd
> 6e720eee58e
>
> See also:
>
> http://wiki.orbeon.com/forms/doc/developer-guide/processors-url-generator#T
> OC-XML-mode
> http://wiki.orbeon.com/forms/doc/developer-guide/processors-xinclude#TOC-X
> ML-external-entities
>
> -Erik
>
> On Tue, Dec 21, 2010 at 5:43 PM, Erik Bruchez <[hidden email]> wrote:
> > Ralf,
> >
> > For now I have entered an RFE to make this configurable:
> >
> >
> > http://forge.ow2.org/tracker/index.php?func=detail&aid=315707&group_id=16
> > 8&atid=350207
> >
> > -Erik
> >
> > On Tue, Dec 21, 2010 at 2:46 AM, Ralf Jung <[hidden email]> wrote:
> > > Hi Erik,
> > >
> > >> There has been a lot of debate about even the existence of DTDs in
> > >> XML. Now XML is stuck with them and lots of documents still use them.
> > >> But if you can avoid them, you probably should!
> > >
> > > Unfortunately I can't. This is a very old XML format I am dealing with,
> >
> > with
> >
> > > lot of data being stored in that format, and I am happy to have any
> >
> > validation
> >
> > > available at all. I don't exactly feel like creating an XMLScheme for
> > > it.
> >
> > Not
> >
> > > to mention that, from all I understood, XMLSchemes can't handle
> > > entities
> >
> > - and
> >
> > > entities are a core part of the format, encoding much more than just
> > > characters :(
> > >
> > >> So you mean with the external entity, or with pasting your entities
> > >> into each document?
> > >
> > > I pasted most of the global .ent files into all of the DTDs, thanks for
> >
> > that
> >
> > > hint. It's working, but ugly, so I still hope for some configuration
> >
> > switch :)
> >
> > > . After all, I'm not going to productively use the new version before
> > > it
> >
> > had a
> >
> > > stable release.
> > >
> > > Kind regards,
> > > Ralf Jung
> > >
> > >
> > > --
> > > You receive this message as a subscriber of the
> > > [hidden email] list. To unsubscribe:
> > > mailto:[hidden email]
> > > For general help: mailto:[hidden email]?subject=help
> > > OW2 mailing lists service home page: http://www.ow2.org/wws

Erik Bruchez

Re: Re: Orbeon Nightly regression: DTD entity imports no longer working

Administrator

Good to hear! -Erik

On Fri, Mar 11, 2011 at 6:34 AM, Ralf Jung <[hidden email]> wrote:

Hi Erik,

thanks a lot, it's indeed working :)

Kind regards,
Ralf

Am Freitag 11 März 2011, um 03:16:52 schrieb Erik Bruchez:

> Ralf,
>
> Not sure if this is still relevant to you, but we have just implemented
> this:
>
> http://forge.ow2.org/tracker/index.php?func=detail&aid=315707&group_id=168&
> atid=350207
>
> See:
>
> https://github.com/orbeon/orbeon-forms/commit/aad225857fbf1d01d6df5efc928fd
> 6e720eee58e
>
> See also:
>
> http://wiki.orbeon.com/forms/doc/developer-guide/processors-url-generator#T

> OC-XML-mode

> http://wiki.orbeon.com/forms/doc/developer-guide/processors-xinclude#TOC-X
> ML-external-entities
>
> -Erik
>
> On Tue, Dec 21, 2010 at 5:43 PM, Erik Bruchez <[hidden email]> wrote:
> > Ralf,
> >
> > For now I have entered an RFE to make this configurable:
> >
> >
> > http://forge.ow2.org/tracker/index.php?func=detail&aid=315707&group_id=16
> > 8&atid=350207
> >
> > -Erik
> >
> > On Tue, Dec 21, 2010 at 2:46 AM, Ralf Jung <[hidden email]> wrote:
> > > Hi Erik,
> > >
> > >> There has been a lot of debate about even the existence of DTDs in
> > >> XML. Now XML is stuck with them and lots of documents still use them.
> > >> But if you can avoid them, you probably should!
> > >
> > > Unfortunately I can't. This is a very old XML format I am dealing with,
> >
> > with
> >
> > > lot of data being stored in that format, and I am happy to have any
> >
> > validation
> >
> > > available at all. I don't exactly feel like creating an XMLScheme for
> > > it.
> >
> > Not
> >
> > > to mention that, from all I understood, XMLSchemes can't handle
> > > entities
> >
> > - and
> >
> > > entities are a core part of the format, encoding much more than just
> > > characters :(
> > >
> > >> So you mean with the external entity, or with pasting your entities
> > >> into each document?
> > >
> > > I pasted most of the global .ent files into all of the DTDs, thanks for
> >
> > that
> >
> > > hint. It's working, but ugly, so I still hope for some configuration
> >
> > switch :)
> >
> > > . After all, I'm not going to productively use the new version before
> > > it
> >
> > had a
> >
> > > stable release.
> > >
> > > Kind regards,
> > > Ralf Jung
> > >
> > >
> > > --
> > > You receive this message as a subscriber of the

> > > [hidden email] list. To unsubscribe:

> > > mailto:[hidden email]
> > > For general help: mailto:[hidden email]?subject=help
> > > OW2 mailing lists service home page: http://www.ow2.org/wws

--
You receive this message as a subscriber of the [hidden email] mailing list.
To unsubscribe: mailto:[hidden email]
For general help: mailto:[hidden email]?subject=help
OW2 mailing lists service home page: http://www.ow2.org/wws

Ralf Jung

Re: Re: Re: Orbeon Nightly regression: DTD entity imports no longer working

Hi,

did this regress again? I just tried the RC and see those errors again.

Kind regards,
Ralf

Am Samstag 12 März 2011, um 00:45:38 schrieb Erik Bruchez:

> Good to hear! -Erik
>
> On Fri, Mar 11, 2011 at 6:34 AM, Ralf Jung <[hidden email]> wrote:
> > Hi Erik,
> >
> > thanks a lot, it's indeed working :)
> >
> > Kind regards,
> > Ralf
> >
> > Am Freitag 11 März 2011, um 03:16:52 schrieb Erik Bruchez:
> > > Ralf,
> > >
> > > Not sure if this is still relevant to you, but we have just implemented
> >
> > > this:
> > http://forge.ow2.org/tracker/index.php?func=detail&aid=315707&group_id=16
> > 8&
> >
> > > atid=350207
> >
> > > See:
> > https://github.com/orbeon/orbeon-forms/commit/aad225857fbf1d01d6df5efc928
> > fd
> >
> > > 6e720eee58e
> >
> > > See also:
> > http://wiki.orbeon.com/forms/doc/developer-guide/processors-url-generator
> > #T
> >
> > > OC-XML-mode
> >
> > http://wiki.orbeon.com/forms/doc/developer-guide/processors-xinclude#TOC-
> > X
> >
> > > ML-external-entities
> > >
> > > -Erik
> > >
> > > On Tue, Dec 21, 2010 at 5:43 PM, Erik Bruchez <[hidden email]>
> >
> > wrote:
> > > > Ralf,
> >
> > > > For now I have entered an RFE to make this configurable:
> > http://forge.ow2.org/tracker/index.php?func=detail&aid=315707&group_id=16
> >
> > > > 8&atid=350207
> > > >
> > > > -Erik
> > > >
> > > > On Tue, Dec 21, 2010 at 2:46 AM, Ralf Jung <[hidden email]> wrote:
> > > > > Hi Erik,
> > > > >
> > > > >> There has been a lot of debate about even the existence of DTDs in
> > > > >> XML. Now XML is stuck with them and lots of documents still use
> >
> > them.
> >
> > > > >> But if you can avoid them, you probably should!
> > > > >
> > > > > Unfortunately I can't. This is a very old XML format I am dealing
> >
> > with,
> >
> > > > with
> > > >
> > > > > lot of data being stored in that format, and I am happy to have any
> > > >
> > > > validation
> > > >
> > > > > available at all. I don't exactly feel like creating an XMLScheme
> > > > > for it.
> > > >
> > > > Not
> > > >
> > > > > to mention that, from all I understood, XMLSchemes can't handle
> > > > > entities
> > > >
> > > > - and
> > > >
> > > > > entities are a core part of the format, encoding much more than
> > > > > just characters :(
> > > > >
> > > > >> So you mean with the external entity, or with pasting your
> > > > >> entities into each document?
> > > > >
> > > > > I pasted most of the global .ent files into all of the DTDs, thanks
> >
> > for
> >
> > > > that
> > > >
> > > > > hint. It's working, but ugly, so I still hope for some
> > > > > configuration
> > > >
> > > > switch :)
> > > >
> > > > > . After all, I'm not going to productively use the new version
> > > > > before it
> > > >
> > > > had a
> > > >
> > > > > stable release.
> > > > >
> > > > > Kind regards,
> > > > > Ralf Jung
> > > > >
> > > > >
> > > > > --
> > > > > You receive this message as a subscriber of the
> > > > > [hidden email] list. To unsubscribe:
> > > > > mailto:[hidden email]
> > > > > For general help: mailto:[hidden email]?subject=help
> > > > > OW2 mailing lists service home page: http://www.ow2.org/wws
> >
> > --
> > You receive this message as a subscriber of the [hidden email] mailing
> > list.
> > To unsubscribe: mailto:[hidden email]
> > For general help: mailto:[hidden email]?subject=help
> > OW2 mailing lists service home page: http://www.ow2.org/wws

Erik Bruchez

Re: Re: Re: Re: Orbeon Nightly regression: DTD entity imports no longer working

Administrator

Mmh, it shouldn't! The RC should have this change.

-Erik

On Wed, Mar 23, 2011 at 9:09 AM, Ralf Jung <[hidden email]> wrote:

> Hi,
>
> did this regress again? I just tried the RC and see those errors again.
>
> Kind regards,
> Ralf
>
> Am Samstag 12 März 2011, um 00:45:38 schrieb Erik Bruchez:
>> Good to hear! -Erik
>>
>> On Fri, Mar 11, 2011 at 6:34 AM, Ralf Jung <[hidden email]> wrote:
>> > Hi Erik,
>> >
>> > thanks a lot, it's indeed working :)
>> >
>> > Kind regards,
>> > Ralf
>> >
>> > Am Freitag 11 März 2011, um 03:16:52 schrieb Erik Bruchez:
>> > > Ralf,
>> > >
>> > > Not sure if this is still relevant to you, but we have just implemented
>> >
>> > > this:
>> > http://forge.ow2.org/tracker/index.php?func=detail&aid=315707&group_id=16
>> > 8&
>> >
>> > > atid=350207
>> >
>> > > See:
>> > https://github.com/orbeon/orbeon-forms/commit/aad225857fbf1d01d6df5efc928
>> > fd
>> >
>> > > 6e720eee58e
>> >
>> > > See also:
>> > http://wiki.orbeon.com/forms/doc/developer-guide/processors-url-generator
>> > #T
>> >
>> > > OC-XML-mode
>> >
>> > http://wiki.orbeon.com/forms/doc/developer-guide/processors-xinclude#TOC-
>> > X
>> >
>> > > ML-external-entities
>> > >
>> > > -Erik
>> > >
>> > > On Tue, Dec 21, 2010 at 5:43 PM, Erik Bruchez <[hidden email]>
>> >
>> > wrote:
>> > > > Ralf,
>> >
>> > > > For now I have entered an RFE to make this configurable:
>> > http://forge.ow2.org/tracker/index.php?func=detail&aid=315707&group_id=16
>> >
>> > > > 8&atid=350207
>> > > >
>> > > > -Erik
>> > > >
>> > > > On Tue, Dec 21, 2010 at 2:46 AM, Ralf Jung <[hidden email]> wrote:
>> > > > > Hi Erik,
>> > > > >
>> > > > >> There has been a lot of debate about even the existence of DTDs in
>> > > > >> XML. Now XML is stuck with them and lots of documents still use
>> >
>> > them.
>> >
>> > > > >> But if you can avoid them, you probably should!
>> > > > >
>> > > > > Unfortunately I can't. This is a very old XML format I am dealing
>> >
>> > with,
>> >
>> > > > with
>> > > >
>> > > > > lot of data being stored in that format, and I am happy to have any
>> > > >
>> > > > validation
>> > > >
>> > > > > available at all. I don't exactly feel like creating an XMLScheme
>> > > > > for it.
>> > > >
>> > > > Not
>> > > >
>> > > > > to mention that, from all I understood, XMLSchemes can't handle
>> > > > > entities
>> > > >
>> > > > - and
>> > > >
>> > > > > entities are a core part of the format, encoding much more than
>> > > > > just characters :(
>> > > > >
>> > > > >> So you mean with the external entity, or with pasting your
>> > > > >> entities into each document?
>> > > > >
>> > > > > I pasted most of the global .ent files into all of the DTDs, thanks
>> >
>> > for
>> >
>> > > > that
>> > > >
>> > > > > hint. It's working, but ugly, so I still hope for some
>> > > > > configuration
>> > > >
>> > > > switch :)
>> > > >
>> > > > > . After all, I'm not going to productively use the new version
>> > > > > before it
>> > > >
>> > > > had a
>> > > >
>> > > > > stable release.
>> > > > >
>> > > > > Kind regards,
>> > > > > Ralf Jung
>> > > > >
>> > > > >
>> > > > > --
>> > > > > You receive this message as a subscriber of the
>> > > > > [hidden email] list. To unsubscribe:
>> > > > > mailto:[hidden email]
>> > > > > For general help: mailto:[hidden email]?subject=help
>> > > > > OW2 mailing lists service home page: http://www.ow2.org/wws
>> >
>> > --
>> > You receive this message as a subscriber of the [hidden email] mailing
>> > list.
>> > To unsubscribe: mailto:[hidden email]
>> > For general help: mailto:[hidden email]?subject=help
>> > OW2 mailing lists service home page: http://www.ow2.org/wws
>
>
> --
> You receive this message as a subscriber of the [hidden email] mailing list.
> To unsubscribe: mailto:[hidden email]
> For general help: mailto:[hidden email]?subject=help
> OW2 mailing lists service home page: http://www.ow2.org/wws
>
>

Ralf Jung

Re: Orbeon Nightly regression: DTD entity imports no longer working

Hi Erik,

now that is weird: When I tested it with the nightly a few weeks ago, I did
not have to change anything in my import pipeline to get it working. Now I
read those docs you linked to again, added
<external-entities>true</external-entities>
and with that new option, it's working fine with the RC. Whatever^^

Kind regards,
Ralf

Am Donnerstag 24 März 2011, um 05:58:39 schrieb Erik Bruchez:

> Mmh, it shouldn't! The RC should have this change.
>
> -Erik
>
> On Wed, Mar 23, 2011 at 9:09 AM, Ralf Jung <[hidden email]> wrote:
> > Hi,
> >
> > did this regress again? I just tried the RC and see those errors again.
> >
> > Kind regards,
> > Ralf
> >
> > Am Samstag 12 März 2011, um 00:45:38 schrieb Erik Bruchez:
> >> Good to hear! -Erik
> >>
> >> On Fri, Mar 11, 2011 at 6:34 AM, Ralf Jung <[hidden email]> wrote:
> >> > Hi Erik,
> >> >
> >> > thanks a lot, it's indeed working :)
> >> >
> >> > Kind regards,
> >> > Ralf
> >> >
> >> > Am Freitag 11 März 2011, um 03:16:52 schrieb Erik Bruchez:
> >> > > Ralf,
> >> > >
> >> > > Not sure if this is still relevant to you, but we have just
> >> > > implemented
> >> >
> >> > > this:
> >> > http://forge.ow2.org/tracker/index.php?func=detail&aid=315707&group_id
> >> > =16 8&
> >> >
> >> > > atid=350207
> >> >
> >> > > See:
> >> > https://github.com/orbeon/orbeon-forms/commit/aad225857fbf1d01d6df5efc
> >> > 928 fd
> >> >
> >> > > 6e720eee58e
> >> >
> >> > > See also:
> >> > http://wiki.orbeon.com/forms/doc/developer-guide/processors-url-genera
> >> > tor #T
> >> >
> >> > > OC-XML-mode
> >> >
> >> > http://wiki.orbeon.com/forms/doc/developer-guide/processors-xinclude#T
> >> > OC- X
> >> >
> >> > > ML-external-entities
> >> > >
> >> > > -Erik
> >> > >
> >> > > On Tue, Dec 21, 2010 at 5:43 PM, Erik Bruchez <[hidden email]>
> >> >
> >> > wrote:
> >> > > > Ralf,
> >> >
> >> > > > For now I have entered an RFE to make this configurable:
> >> > http://forge.ow2.org/tracker/index.php?func=detail&aid=315707&group_id
> >> > =16
> >> >
> >> > > > 8&atid=350207
> >> > > >
> >> > > > -Erik
> >> > > >
> >> > > > On Tue, Dec 21, 2010 at 2:46 AM, Ralf Jung <[hidden email]>

wrote:

> >> > > > > Hi Erik,
> >> > > > >
> >> > > > >> There has been a lot of debate about even the existence of DTDs
> >> > > > >> in XML. Now XML is stuck with them and lots of documents still
> >> > > > >> use
> >> >
> >> > them.
> >> >
> >> > > > >> But if you can avoid them, you probably should!
> >> > > > >
> >> > > > > Unfortunately I can't. This is a very old XML format I am
> >> > > > > dealing
> >> >
> >> > with,
> >> >
> >> > > > with
> >> > > >
> >> > > > > lot of data being stored in that format, and I am happy to have
> >> > > > > any
> >> > > >
> >> > > > validation
> >> > > >
> >> > > > > available at all. I don't exactly feel like creating an
> >> > > > > XMLScheme for it.
> >> > > >
> >> > > > Not
> >> > > >
> >> > > > > to mention that, from all I understood, XMLSchemes can't handle
> >> > > > > entities
> >> > > >
> >> > > > - and
> >> > > >
> >> > > > > entities are a core part of the format, encoding much more than
> >> > > > > just characters :(
> >> > > > >
> >> > > > >> So you mean with the external entity, or with pasting your
> >> > > > >> entities into each document?
> >> > > > >
> >> > > > > I pasted most of the global .ent files into all of the DTDs,
> >> > > > > thanks
> >> >
> >> > for
> >> >
> >> > > > that
> >> > > >
> >> > > > > hint. It's working, but ugly, so I still hope for some
> >> > > > > configuration
> >> > > >
> >> > > > switch :)
> >> > > >
> >> > > > > . After all, I'm not going to productively use the new version
> >> > > > > before it
> >> > > >
> >> > > > had a
> >> > > >
> >> > > > > stable release.
> >> > > > >
> >> > > > > Kind regards,
> >> > > > > Ralf Jung
> >> > > > >
> >> > > > >
> >> > > > > --
> >> > > > > You receive this message as a subscriber of the
> >> > > > > [hidden email] list. To unsubscribe:
> >> > > > > mailto:[hidden email]
> >> > > > > For general help: mailto:[hidden email]?subject=help
> >> > > > > OW2 mailing lists service home page: http://www.ow2.org/wws
> >> >
> >> > --
> >> > You receive this message as a subscriber of the [hidden email]
> >> > mailing list.
> >> > To unsubscribe: mailto:[hidden email]
> >> > For general help: mailto:[hidden email]?subject=help
> >> > OW2 mailing lists service home page: http://www.ow2.org/wws
> >
> > --
> > You receive this message as a subscriber of the [hidden email] mailing
> > list. To unsubscribe: mailto:[hidden email]
> > For general help: mailto:[hidden email]?subject=help
> > OW2 mailing lists service home page: http://www.ow2.org/wws

Erik Bruchez

Re: Re: Orbeon Nightly regression: DTD entity imports no longer working

Administrator

Ralf,

That happens ;)

-Erik

On Thu, Mar 24, 2011 at 2:55 AM, Ralf Jung <[hidden email]> wrote:

> Hi Erik,
>
> now that is weird: When I tested it with the nightly a few weeks ago, I did
> not have to change anything in my import pipeline to get it working. Now I
> read those docs you linked to again, added
> <external-entities>true</external-entities>
> and with that new option, it's working fine with the RC. Whatever^^
>
> Kind regards,
> Ralf
>
> Am Donnerstag 24 März 2011, um 05:58:39 schrieb Erik Bruchez:
>> Mmh, it shouldn't! The RC should have this change.
>>
>> -Erik
>>
>> On Wed, Mar 23, 2011 at 9:09 AM, Ralf Jung <[hidden email]> wrote:
>> > Hi,
>> >
>> > did this regress again? I just tried the RC and see those errors again.
>> >
>> > Kind regards,
>> > Ralf
>> >
>> > Am Samstag 12 März 2011, um 00:45:38 schrieb Erik Bruchez:
>> >> Good to hear! -Erik
>> >>
>> >> On Fri, Mar 11, 2011 at 6:34 AM, Ralf Jung <[hidden email]> wrote:
>> >> > Hi Erik,
>> >> >
>> >> > thanks a lot, it's indeed working :)
>> >> >
>> >> > Kind regards,
>> >> > Ralf
>> >> >
>> >> > Am Freitag 11 März 2011, um 03:16:52 schrieb Erik Bruchez:
>> >> > > Ralf,
>> >> > >
>> >> > > Not sure if this is still relevant to you, but we have just
>> >> > > implemented
>> >> >
>> >> > > this:
>> >> > http://forge.ow2.org/tracker/index.php?func=detail&aid=315707&group_id
>> >> > =16 8&
>> >> >
>> >> > > atid=350207
>> >> >
>> >> > > See:
>> >> > https://github.com/orbeon/orbeon-forms/commit/aad225857fbf1d01d6df5efc
>> >> > 928 fd
>> >> >
>> >> > > 6e720eee58e
>> >> >
>> >> > > See also:
>> >> > http://wiki.orbeon.com/forms/doc/developer-guide/processors-url-genera
>> >> > tor #T
>> >> >
>> >> > > OC-XML-mode
>> >> >
>> >> > http://wiki.orbeon.com/forms/doc/developer-guide/processors-xinclude#T
>> >> > OC- X
>> >> >
>> >> > > ML-external-entities
>> >> > >
>> >> > > -Erik
>> >> > >
>> >> > > On Tue, Dec 21, 2010 at 5:43 PM, Erik Bruchez <[hidden email]>
>> >> >
>> >> > wrote:
>> >> > > > Ralf,
>> >> >
>> >> > > > For now I have entered an RFE to make this configurable:
>> >> > http://forge.ow2.org/tracker/index.php?func=detail&aid=315707&group_id
>> >> > =16
>> >> >
>> >> > > > 8&atid=350207
>> >> > > >
>> >> > > > -Erik
>> >> > > >
>> >> > > > On Tue, Dec 21, 2010 at 2:46 AM, Ralf Jung <[hidden email]>
> wrote:
>> >> > > > > Hi Erik,
>> >> > > > >
>> >> > > > >> There has been a lot of debate about even the existence of DTDs
>> >> > > > >> in XML. Now XML is stuck with them and lots of documents still
>> >> > > > >> use
>> >> >
>> >> > them.
>> >> >
>> >> > > > >> But if you can avoid them, you probably should!
>> >> > > > >
>> >> > > > > Unfortunately I can't. This is a very old XML format I am
>> >> > > > > dealing
>> >> >
>> >> > with,
>> >> >
>> >> > > > with
>> >> > > >
>> >> > > > > lot of data being stored in that format, and I am happy to have
>> >> > > > > any
>> >> > > >
>> >> > > > validation
>> >> > > >
>> >> > > > > available at all. I don't exactly feel like creating an
>> >> > > > > XMLScheme for it.
>> >> > > >
>> >> > > > Not
>> >> > > >
>> >> > > > > to mention that, from all I understood, XMLSchemes can't handle
>> >> > > > > entities
>> >> > > >
>> >> > > > - and
>> >> > > >
>> >> > > > > entities are a core part of the format, encoding much more than
>> >> > > > > just characters :(
>> >> > > > >
>> >> > > > >> So you mean with the external entity, or with pasting your
>> >> > > > >> entities into each document?
>> >> > > > >
>> >> > > > > I pasted most of the global .ent files into all of the DTDs,
>> >> > > > > thanks
>> >> >
>> >> > for
>> >> >
>> >> > > > that
>> >> > > >
>> >> > > > > hint. It's working, but ugly, so I still hope for some
>> >> > > > > configuration
>> >> > > >
>> >> > > > switch :)
>> >> > > >
>> >> > > > > . After all, I'm not going to productively use the new version
>> >> > > > > before it
>> >> > > >
>> >> > > > had a
>> >> > > >
>> >> > > > > stable release.
>> >> > > > >
>> >> > > > > Kind regards,
>> >> > > > > Ralf Jung
>> >> > > > >
>> >> > > > >
>> >> > > > > --
>> >> > > > > You receive this message as a subscriber of the
>> >> > > > > [hidden email] list. To unsubscribe:
>> >> > > > > mailto:[hidden email]
>> >> > > > > For general help: mailto:[hidden email]?subject=help
>> >> > > > > OW2 mailing lists service home page: http://www.ow2.org/wws
>> >> >
>> >> > --
>> >> > You receive this message as a subscriber of the [hidden email]
>> >> > mailing list.
>> >> > To unsubscribe: mailto:[hidden email]
>> >> > For general help: mailto:[hidden email]?subject=help
>> >> > OW2 mailing lists service home page: http://www.ow2.org/wws
>> >
>> > --
>> > You receive this message as a subscriber of the [hidden email] mailing
>> > list. To unsubscribe: mailto:[hidden email]
>> > For general help: mailto:[hidden email]?subject=help
>> > OW2 mailing lists service home page: http://www.ow2.org/wws
>
>
> --
> You receive this message as a subscriber of the [hidden email] mailing list.
> To unsubscribe: mailto:[hidden email]
> For general help: mailto:[hidden email]?subject=help
> OW2 mailing lists service home page: http://www.ow2.org/wws
>
>