Scheduler problem

classic Classic list List threaded Threaded
24 messages Options
12
Reply | Threaded
Open this post in threaded view
|

Re: Re: Scheduler problem

Mats Eklund-2
Ok, will try.
 
In the meantime I have encountered another problem arising in my scheduled task: "OutOfMemory ... Perm Gen"...
 
As mentioned, the scheduled task is simply copying a fairly large xml file from one location to another via two REST GET and PUT requests.
It seems the problem starts when the file reaches over 100Kb.
 
Is this a known issue? Can it be fixed?
 


From: Erik Bruchez <[hidden email]>
To: [hidden email]
Sent: Monday, August 31, 2009 4:43:13 AM
Subject: [ops-users] Re: Re: Re: Re: Re: Re: Re: Re: Re: Re: Scheduler problem


I put in a patch to prevent the NPE:

http://github.com/orbeon/orbeon-forms/commit/6decbde60511940abc79d39fa9d45f9d0f9ac803

Hopefully that will fix your problem.

-Erik


Mats Eklund-2 wrote:

>
> Alex,
>
> I have resolved the problem. I noticed that on line 402 in Connection.java
> / org.orbeon.oxf.util.Connection.connect() (code from last Friday), the
> variable headersMap is null if not run in request context and if no
> xforms:submission/xforms:header has been defined by the author. For the
> moment I can therefore workaround the problem by adding a custom dummy
> xforms:header! (yes!!!)
>
> The reason this was so hard to debug for me was that when lowering the
> debug level in log4j.xml from "info" to "debug", a lot of _other_ bugs in
> the orbeon submission code are showing up (most of these seem to be due to
> an assumption that the code is run in request context)!!
>
> Thanks for your help anyway, and hope you will fix these problems in the
> next release!
>
> Cheers,
> Mats
>
>
>
>
> ________________________________
> From: Alessandro Vernet <[hidden email]>
> To: [hidden email]
> Sent: Friday, August 28, 2009 9:21:46 PM
> Subject: [ops-users] Re: Re: Re: Re: Re: Re: Re: Re: Re: Scheduler problem
>
>
> Mats,
>
>
> Mats Eklund-2 wrote:
>>
>> Yes, I do get an exception (see below). I have verified that the XPL
>> works
>> when called in normal servlet context... All help apprectiated!
>>
>
> OK. That code has changed significantly since the version you are using.
> So
> I can't tell if this is something that we could quickly fix or not.
>
> So you don't have to upgrade and wait for a fix, I recommend you follow
> the
> method I was describing earlier
> (http://www.nabble.com/Scheduler-problem-tp25098228p25124539.html) so the
> XForms submission processor runs in the servlet context and not a
> "scheduler" context.
>
> Alex
>
> -----
> Orbeon Forms - Web 2.0 Forms, open-source, for the Enterprise
> Orbeon's Blog: http://www.orbeon.com/blog/
> Personal Blog: http://avernet.blogspot.com/
> Twitter - http://twitter.com/avernet
> --
> View this message in context:
> http://www.nabble.com/Scheduler-problem-tp25098228p25195523.html
> Sent from the ObjectWeb OPS - Users mailing list archive at Nabble.com.
>
>
>     
>
> --
> You receive this message as a subscriber of the [hidden email] mailing
> list.
> To unsubscribe: mailto:[hidden email]
> For general help: mailto:[hidden email]?subject=help
> OW2 mailing lists service home page: http://www.ow2.org/wws
>
>

--
View this message in context: http://www.nabble.com/Scheduler-problem-tp25098228p25217704.html
Sent from the ObjectWeb OPS - Users mailing list archive at Nabble.com.




--
You receive this message as a subscriber of the [hidden email] mailing list.
To unsubscribe: mailto:[hidden email]
For general help: mailto:[hidden email]?subject=help
OW2 mailing lists service home page: http://www.ow2.org/wws
Reply | Threaded
Open this post in threaded view
|

Re: Re: Scheduler problem

Erik Bruchez
Administrator
Try increasing permgen, see e.g.:

http://www.nabble.com/Problem-with-submission-td24721357.html#a24745497

-Erik

Mats Eklund-2 wrote
Ok, will try.

In the meantime I have encountered another problem arising in my scheduled task: "OutOfMemory ... Perm Gen"...

As mentioned, the scheduled task is simply copying a fairly large xml file from one location to another via two REST GET and PUT requests.

It seems the problem starts when the file reaches over 100Kb.

Is this a known issue? Can it be fixed?




________________________________
From: Erik Bruchez <ebruchez@orbeon.com>
To: ops-users@ow2.org
Sent: Monday, August 31, 2009 4:43:13 AM
Subject: [ops-users] Re: Re: Re: Re: Re: Re: Re: Re: Re: Re: Scheduler problem


I put in a patch to prevent the NPE:

http://github.com/orbeon/orbeon-forms/commit/6decbde60511940abc79d39fa9d45f9d0f9ac803

Hopefully that will fix your problem.

-Erik


Mats Eklund-2 wrote:
>
> Alex,
>
> I have resolved the problem. I noticed that on line 402 in Connection.java
> / org.orbeon.oxf.util.Connection.connect() (code from last Friday), the
> variable headersMap is null if not run in request context and if no
> xforms:submission/xforms:header has been defined by the author. For the
> moment I can therefore workaround the problem by adding a custom dummy
> xforms:header! (yes!!!)
>
> The reason this was so hard to debug for me was that when lowering the
> debug level in log4j.xml from "info" to "debug", a lot of _other_ bugs in
> the orbeon submission code are showing up (most of these seem to be due to
> an assumption that the code is run in request context)!!
>
> Thanks for your help anyway, and hope you will fix these problems in the
> next release!
>
> Cheers,
> Mats
>
>
>
>
> ________________________________
> From: Alessandro Vernet <avernet@orbeon.com>
> To: ops-users@ow2.org
> Sent: Friday, August 28, 2009 9:21:46 PM
> Subject: [ops-users] Re: Re: Re: Re: Re: Re: Re: Re: Re: Scheduler problem
>
>
> Mats,
>
>
> Mats Eklund-2 wrote:
>>
>> Yes, I do get an exception (see below). I have verified that the XPL
>> works
>> when called in normal servlet context... All help apprectiated!
>>
>
> OK. That code has changed significantly since the version you are using.
> So
> I can't tell if this is something that we could quickly fix or not.
>
> So you don't have to upgrade and wait for a fix, I recommend you follow
> the
> method I was describing earlier
> (http://www.nabble.com/Scheduler-problem-tp25098228p25124539.html) so the
> XForms submission processor runs in the servlet context and not a
> "scheduler" context.
>
> Alex
>
> -----
> Orbeon Forms - Web 2.0 Forms, open-source, for the Enterprise
> Orbeon's Blog: http://www.orbeon.com/blog/
> Personal Blog: http://avernet.blogspot.com/
> Twitter - http://twitter.com/avernet
> --
> View this message in context:
> http://www.nabble.com/Scheduler-problem-tp25098228p25195523.html
> Sent from the ObjectWeb OPS - Users mailing list archive at Nabble.com.
>
>
>     
>
> --
> You receive this message as a subscriber of the ops-users@ow2.org mailing
> list.
> To unsubscribe: mailto:ops-users-unsubscribe@ow2.org
> For general help: mailto:sympa@ow2.org?subject=help
> OW2 mailing lists service home page: http://www.ow2.org/wws
>
>

--
View this message in context: http://www.nabble.com/Scheduler-problem-tp25098228p25217704.html
Sent from the ObjectWeb OPS - Users mailing list archive at Nabble.com.


     

--
You receive this message as a subscriber of the ops-users@ow2.org mailing list.
To unsubscribe: mailto:ops-users-unsubscribe@ow2.org
For general help: mailto:sympa@ow2.org?subject=help
OW2 mailing lists service home page: http://www.ow2.org/wws
Reply | Threaded
Open this post in threaded view
|

Re: Re: Re: Scheduler problem

Mats Eklund-2
Thanks Erik,

Where can I change that setting?


From: Erik Bruchez <[hidden email]>
To: [hidden email]
Sent: Tuesday, September 1, 2009 7:23:48 AM
Subject: [ops-users] Re: Re: Scheduler problem


Try increasing permgen, see e.g.:

http://www.nabble.com/Problem-with-submission-td24721357.html#a24745497

-Erik


Mats Eklund-2 wrote:

>
> Ok, will try.
>
> In the meantime I have encountered another problem arising in my scheduled
> task: "OutOfMemory ... Perm Gen"...
>
> As mentioned, the scheduled task is simply copying a fairly large xml file
> from one location to another via two REST GET and PUT requests.
>
> It seems the problem starts when the file reaches over 100Kb.
>
> Is this a known issue? Can it be fixed?
>
>
>
>
> ________________________________
> From: Erik Bruchez <[hidden email]>
> To: [hidden email]
> Sent: Monday, August 31, 2009 4:43:13 AM
> Subject: [ops-users] Re: Re: Re: Re: Re: Re: Re: Re: Re: Re: Scheduler
> problem
>
>
> I put in a patch to prevent the NPE:
>
> http://github.com/orbeon/orbeon-forms/commit/6decbde60511940abc79d39fa9d45f9d0f9ac803

>
> Hopefully that will fix your problem.
>
> -Erik
>
>
> Mats Eklund-2 wrote:
>>
>> Alex,
>>
>> I have resolved the problem. I noticed that on line 402 in
>> Connection.java
>> / org.orbeon.oxf.util.Connection.connect() (code from last Friday), the
>> variable headersMap is null if not run in request context and if no
>> xforms:submission/xforms:header has been defined by the author. For the
>> moment I can therefore workaround the problem by adding a custom dummy
>> xforms:header! (yes!!!)
>>
>> The reason this was so hard to debug for me was that when lowering the
>> debug level in log4j.xml from "info" to "debug", a lot of _other_ bugs in
>> the orbeon submission code are showing up (most of these seem to be due
>> to
>> an assumption that the code is run in request context)!!
>>
>> Thanks for your help anyway, and hope you will fix these problems in the
>> next release!
>>
>> Cheers,
>> Mats
>>
>>
>>
>>
>> ________________________________
>> From: Alessandro Vernet <[hidden email]>
>> To: [hidden email]
>> Sent: Friday, August 28, 2009 9:21:46 PM
>> Subject: [ops-users] Re: Re: Re: Re: Re: Re: Re: Re: Re: Scheduler
>> problem
>>
>>
>> Mats,
>>
>>
>> Mats Eklund-2 wrote:
>>>
>>> Yes, I do get an exception (see below). I have verified that the XPL
>>> works
>>> when called in normal servlet context... All help apprectiated!
>>>
>>
>> OK. That code has changed significantly since the version you are using.
>> So
>> I can't tell if this is something that we could quickly fix or not.
>>
>> So you don't have to upgrade and wait for a fix, I recommend you follow
>> the
>> method I was describing earlier
>> (http://www.nabble.com/Scheduler-problem-tp25098228p25124539.html) so the
>> XForms submission processor runs in the servlet context and not a
>> "scheduler" context.
>>
>> Alex
>>
>> -----
>> Orbeon Forms - Web 2.0 Forms, open-source, for the Enterprise
>> Orbeon's Blog: http://www.orbeon.com/blog/
>> Personal Blog: http://avernet.blogspot.com/
>> Twitter - http://twitter.com/avernet
>> --
>> View this message in context:
>> http://www.nabble.com/Scheduler-problem-tp25098228p25195523.html

>> Sent from the ObjectWeb OPS - Users mailing list archive at Nabble.com.
>>
>>
>>     
>>
>> --
>> You receive this message as a subscriber of the [hidden email] mailing
>> list.
>> To unsubscribe: mailto:[hidden email]
>> For general help: mailto:[hidden email]?subject=help
>> OW2 mailing lists service home page: http://www.ow2.org/wws
>>
>>
>
> --
> View this message in context:
> http://www.nabble.com/Scheduler-problem-tp25098228p25217704.html

> Sent from the ObjectWeb OPS - Users mailing list archive at Nabble.com.
>
>
>     
>
> --
> You receive this message as a subscriber of the [hidden email] mailing
> list.
> To unsubscribe: mailto:[hidden email]
> For general help: mailto:[hidden email]?subject=help
> OW2 mailing lists service home page: http://www.ow2.org/wws
>
>

--
View this message in context: http://www.nabble.com/Scheduler-problem-tp25098228p25234475.html
Sent from the ObjectWeb OPS - Users mailing list archive at Nabble.com.




--
You receive this message as a subscriber of the [hidden email] mailing list.
To unsubscribe: mailto:[hidden email]
For general help: mailto:[hidden email]?subject=help
OW2 mailing lists service home page: http://www.ow2.org/wws
Reply | Threaded
Open this post in threaded view
|

Re: Re: Re: Scheduler problem

Erik Bruchez
Administrator
It's a JVM option, you must add it to wherever you usually put your memory settings for your servlet container. Options include environment variables, catalina.sh, etc.

-Erik

Mats Eklund-2 wrote
Thanks Erik,

Where can I change that setting?




________________________________
From: Erik Bruchez <ebruchez@orbeon.com>
To: ops-users@ow2.org
Sent: Tuesday, September 1, 2009 7:23:48 AM
Subject: [ops-users] Re: Re: Scheduler problem


Try increasing permgen, see e.g.:

http://www.nabble.com/Problem-with-submission-td24721357.html#a24745497

-Erik


Mats Eklund-2 wrote:
>
> Ok, will try.
>
> In the meantime I have encountered another problem arising in my scheduled
> task: "OutOfMemory ... Perm Gen"...
>
> As mentioned, the scheduled task is simply copying a fairly large xml file
> from one location to another via two REST GET and PUT requests.
>
> It seems the problem starts when the file reaches over 100Kb.
>
> Is this a known issue? Can it be fixed?
>
>
>
>
> ________________________________
> From: Erik Bruchez <ebruchez@orbeon.com>
> To: ops-users@ow2.org
> Sent: Monday, August 31, 2009 4:43:13 AM
> Subject: [ops-users] Re: Re: Re: Re: Re: Re: Re: Re: Re: Re: Scheduler
> problem
>
>
> I put in a patch to prevent the NPE:
>
> http://github.com/orbeon/orbeon-forms/commit/6decbde60511940abc79d39fa9d45f9d0f9ac803
>
> Hopefully that will fix your problem.
>
> -Erik
>
>
> Mats Eklund-2 wrote:
>>
>> Alex,
>>
>> I have resolved the problem. I noticed that on line 402 in
>> Connection.java
>> / org.orbeon.oxf.util.Connection.connect() (code from last Friday), the
>> variable headersMap is null if not run in request context and if no
>> xforms:submission/xforms:header has been defined by the author. For the
>> moment I can therefore workaround the problem by adding a custom dummy
>> xforms:header! (yes!!!)
>>
>> The reason this was so hard to debug for me was that when lowering the
>> debug level in log4j.xml from "info" to "debug", a lot of _other_ bugs in
>> the orbeon submission code are showing up (most of these seem to be due
>> to
>> an assumption that the code is run in request context)!!
>>
>> Thanks for your help anyway, and hope you will fix these problems in the
>> next release!
>>
>> Cheers,
>> Mats
>>
>>
>>
>>
>> ________________________________
>> From: Alessandro Vernet <avernet@orbeon.com>
>> To: ops-users@ow2.org
>> Sent: Friday, August 28, 2009 9:21:46 PM
>> Subject: [ops-users] Re: Re: Re: Re: Re: Re: Re: Re: Re: Scheduler
>> problem
>>
>>
>> Mats,
>>
>>
>> Mats Eklund-2 wrote:
>>>
>>> Yes, I do get an exception (see below). I have verified that the XPL
>>> works
>>> when called in normal servlet context... All help apprectiated!
>>>
>>
>> OK. That code has changed significantly since the version you are using.
>> So
>> I can't tell if this is something that we could quickly fix or not.
>>
>> So you don't have to upgrade and wait for a fix, I recommend you follow
>> the
>> method I was describing earlier
>> (http://www.nabble.com/Scheduler-problem-tp25098228p25124539.html) so the
>> XForms submission processor runs in the servlet context and not a
>> "scheduler" context.
>>
>> Alex
>>
>> -----
>> Orbeon Forms - Web 2.0 Forms, open-source, for the Enterprise
>> Orbeon's Blog: http://www.orbeon.com/blog/
>> Personal Blog: http://avernet.blogspot.com/
>> Twitter - http://twitter.com/avernet
>> --
>> View this message in context:
>> http://www.nabble.com/Scheduler-problem-tp25098228p25195523.html
>> Sent from the ObjectWeb OPS - Users mailing list archive at Nabble.com.
>>
>>
>>      
>>
>> --
>> You receive this message as a subscriber of the ops-users@ow2.org mailing
>> list.
>> To unsubscribe: mailto:ops-users-unsubscribe@ow2.org
>> For general help: mailto:sympa@ow2.org?subject=help
>> OW2 mailing lists service home page: http://www.ow2.org/wws
>>
>>
>
> --
> View this message in context:
> http://www.nabble.com/Scheduler-problem-tp25098228p25217704.html
> Sent from the ObjectWeb OPS - Users mailing list archive at Nabble.com.
>
>
>      
>
> --
> You receive this message as a subscriber of the ops-users@ow2.org mailing
> list.
> To unsubscribe: mailto:ops-users-unsubscribe@ow2.org
> For general help: mailto:sympa@ow2.org?subject=help
> OW2 mailing lists service home page: http://www.ow2.org/wws
>
>

--
View this message in context: http://www.nabble.com/Scheduler-problem-tp25098228p25234475.html
Sent from the ObjectWeb OPS - Users mailing list archive at Nabble.com.


     

--
You receive this message as a subscriber of the ops-users@ow2.org mailing list.
To unsubscribe: mailto:ops-users-unsubscribe@ow2.org
For general help: mailto:sympa@ow2.org?subject=help
OW2 mailing lists service home page: http://www.ow2.org/wws
12