Login  Register

Re: Re: Re: Re: RE: Re: Slow page load

Posted by Erik Bruchez on Dec 16, 2010; 5:45am
URL: https://discuss.orbeon.com/Slow-page-load-tp2768407p3090330.html

I would expect a 45 MB file to take at least 10x in RAM, so 450 MB. If
that is just copied once or twice, that would explain why you run out
of memory.

Now that doesn't mean things can't be improved.

Both the URL generator and the HTTP serializer have configurations to
disable caching:

* http://wiki.orbeon.com/forms/doc/developer-guide/processors-url-generator#TOC-Cache-control
* http://www.orbeon.com/orbeon/doc/processors-serializers-http#d6e26

I would try to load and serialize large documents by setting
use-local-cache to false in both cases.

-Erik

On Tue, Dec 14, 2010 at 1:45 AM, Ralf Jung <[hidden email]> wrote:

> Hi,
>
> not sure if this is related, but I am also under the impression that there is
> some memory issue somewhere: I am using an XPL pipe to load a document, using
> XSLT to split the nodes from the root into segments of max. 500 nodes, and
> then sending each of those segments to the DB. The XML file in 45MiB in size
> (>9k children of the root, i.e. 19 segments), and if I give less than 1200MiB
> RAM to Orbeon, it crashes with "GC overhead limit exceeded" around the 10th
> segment. It feels like it's keeping much more data during that loop than it
> needs.
> (I previously had it send the whole file to the DB in a batch, which would
> behave even worse).
> This is with Orbeon 3.8 CE.
>
> Kind regards,
> Ralf Jung
>
> Am Dienstag 14 Dezember 2010, um 10:03:25 schrieb ncrofts:
>> Hi Erik,
>>
>> The tests were done with the official 3.8 CE release,
>> orbeon-3.8.0.rc1.201005041622-CE.
>>
>> I've not tried with a recent nightly build, but with respect all previous
>> builds I've tried have been similarly memory intensive. I'm not sure yet
>> what the specific bottleneck(s) are and there is obviously quite a lot of
>> processing going on just to read from a db and process XML, but it is
>> curious that an XPL based application (that also processes db/XML) seems
>> lighter on the memory footprint. It does feel rather a disproportionate
>> overhead just to generate a few K's worth of HTML and I can't help but feel
>> something is not quite right.
>>
>> Regards,
>> Neil
>
>
> --
> You receive this message as a subscriber of the [hidden email] mailing list.
> To unsubscribe: mailto:[hidden email]
> For general help: mailto:[hidden email]?subject=help
> OW2 mailing lists service home page: http://www.ow2.org/wws
>
>


--
You receive this message as a subscriber of the [hidden email] mailing list.
To unsubscribe: mailto:[hidden email]
For general help: mailto:[hidden email]?subject=help
OW2 mailing lists service home page: http://www.ow2.org/wws