scheduler adds an extra processing loop?

> I have an xpl doc (attached) called by a scheduler. The pipeline
> contains several processors within a loop. The processors retrieve a
> particular record from the database, convert it to a text file, save
> the text file and update the database record to mark it as processed.
> If I provide an XML on the input with N "iteration" nodes, the number
> of performed iterations is actually N+1 where the first "iteration"
> node is executed one more time, thus producing a duplicate text file.
>
> A typical loop-controlling XML looks like this:
>
> <conf>
>      <output-directory>
>          <path>/my/convert/path</path>
>      </output-directory>
>      <transactions>
>          <transaction>
>              <tranaction_number>14442</tranaction_number>
>              <transaction_id>810</transaction_id>
>          </transaction>
>          <transaction>
>              <tranaction_number>20397</tranaction_number>
>              <transaction_id>810</transaction_id>
>          </transaction>
>          <transaction>
>              <tranaction_number>27106</tranaction_number>
>              <transaction_id>810</transaction_id>
>          </transaction>
>      </transactions>
> </conf>
>
>
> Alex.
>
>
>
>
> --
> You receive this message as a subscriber of the [hidden email] mailing list.
> To unsubscribe: mailto:[hidden email]
> For general help: mailto:[hidden email]?subject=help
> ObjectWeb mailing lists service home page: http://www.objectweb.org/wws
>
>
>
>

> Alex,
>
> I got your XPL file but can't run it locally as it uses your database.
> Do you see this "N+1" problem only when running the XPL file from the
> scheduler, or can you reproduce it even running the XPL from the page
> flow? Would you be able to create an example that we can run locally
> and that reproduces this problem?
>
> Alex
>
> On 3/3/06, Alexander Zatko <[hidden email]> wrote:
>> I have an xpl doc (attached) called by a scheduler. The pipeline
>> contains several processors within a loop. The processors retrieve a
>> particular record from the database, convert it to a text file, save
>> the text file and update the database record to mark it as processed.
>> If I provide an XML on the input with N "iteration" nodes, the number
>> of performed iterations is actually N+1 where the first "iteration"
>> node is executed one more time, thus producing a duplicate text file.
>>
>> A typical loop-controlling XML looks like this:
>>
>> <conf>
>>      <output-directory>
>>          <path>/my/convert/path</path>
>>      </output-directory>
>>      <transactions>
>>          <transaction>
>>              <tranaction_number>14442</tranaction_number>
>>              <transaction_id>810</transaction_id>
>>          </transaction>
>>          <transaction>
>>              <tranaction_number>20397</tranaction_number>
>>              <transaction_id>810</transaction_id>
>>          </transaction>
>>          <transaction>
>>              <tranaction_number>27106</tranaction_number>
>>              <transaction_id>810</transaction_id>
>>          </transaction>
>>      </transactions>
>> </conf>
>>
>>
>> Alex.
>>
>>
>>
>>
>> --
>> You receive this message as a subscriber of the
>> [hidden email] mailing list.
>> To unsubscribe: mailto:[hidden email]
>> For general help: mailto:[hidden email]?subject=help
>> ObjectWeb mailing lists service home page:
>> http://www.objectweb.org/wws
>>
>>
>>
>>
>
> --
> Blog (XML, Web apps, Open Source):
> http://www.orbeon.com/blog/
>
>
> --
> You receive this message as a subscriber of the
> [hidden email] mailing list.
> To unsubscribe: mailto:[hidden email]
> For general help: mailto:[hidden email]?subject=help
> ObjectWeb mailing lists service home page: http://www.objectweb.org/wws

> The problem occurs only if the file is run by scheduler (I have also a  
> manual conversion mode in which this issue does not exist). I actually  
> tested with the database processors removed and I think the culprit  
> seemed to be the file serializer. I will try to remove dependencies on  
> my environment and send you a new xpl file later.
>
> A.
>
> On Mar 3, 2006, at 3:10 PM, Alessandro Vernet wrote:
>
>> Alex,
>>
>> I got your XPL file but can't run it locally as it uses your database.
>> Do you see this "N+1" problem only when running the XPL file from the
>> scheduler, or can you reproduce it even running the XPL from the page
>> flow? Would you be able to create an example that we can run locally
>> and that reproduces this problem?
>>
>> Alex
>>
>> On 3/3/06, Alexander Zatko <[hidden email]> wrote:
>>> I have an xpl doc (attached) called by a scheduler. The pipeline
>>> contains several processors within a loop. The processors retrieve a
>>> particular record from the database, convert it to a text file, save
>>> the text file and update the database record to mark it as processed.
>>> If I provide an XML on the input with N "iteration" nodes, the number
>>> of performed iterations is actually N+1 where the first "iteration"
>>> node is executed one more time, thus producing a duplicate text file.
>>>
>>> A typical loop-controlling XML looks like this:
>>>
>>> <conf>
>>>      <output-directory>
>>>          <path>/my/convert/path</path>
>>>      </output-directory>
>>>      <transactions>
>>>          <transaction>
>>>              <tranaction_number>14442</tranaction_number>
>>>              <transaction_id>810</transaction_id>
>>>          </transaction>
>>>          <transaction>
>>>              <tranaction_number>20397</tranaction_number>
>>>              <transaction_id>810</transaction_id>
>>>          </transaction>
>>>          <transaction>
>>>              <tranaction_number>27106</tranaction_number>
>>>              <transaction_id>810</transaction_id>
>>>          </transaction>
>>>      </transactions>
>>> </conf>
>>>
>>>
>>> Alex.
>>>
>>>
>>>
>>>
>>> --
>>> You receive this message as a subscriber of the  
>>> [hidden email] mailing list.
>>> To unsubscribe: mailto:[hidden email]
>>> For general help: mailto:[hidden email]?subject=help
>>> ObjectWeb mailing lists service home page:  
>>> http://www.objectweb.org/wws
>>>
>>>
>>>
>>>
>>
>> --
>> Blog (XML, Web apps, Open Source):
>> http://www.orbeon.com/blog/
>>
>>
>> --
>> You receive this message as a subscriber of the  
>> [hidden email] mailing list.
>> To unsubscribe: mailto:[hidden email]
>> For general help: mailto:[hidden email]?subject=help
>> ObjectWeb mailing lists service home page:  
>> http://www.objectweb.org/wws
> --
> You receive this message as a subscriber of the  
> [hidden email] mailing list.
> To unsubscribe: mailto:[hidden email]
> For general help: mailto:[hidden email]?subject=help
> ObjectWeb mailing lists service home page: http://www.objectweb.org/wws

> Alex,
>
> I modified/simplified the xpl file - see attached. You will want to  
> change the path in the input XML if you want the files to be saved.
>
> Below is the debug info I am seeing when I feed this XML into the  
> input:
>
> <conf>
>     <output-directory>
>          
> <path>/Applications/jakarta-tomcat-5.0.28/webapps/ops/WEB-INF/
> resources/convert/btf</path>
>     </output-directory>
>     <transactions>
>         <transaction>
>             <tranaction_number>27354</tranaction_number>
>             <transaction_id>810</transaction_id>
>         </transaction>
>         <transaction>
>             <tranaction_number>33740</tranaction_number>
>             <transaction_id>810</transaction_id>
>         </transaction>
>     </transactions>
> </conf>
>
> ___________ the debug info: _________________
>
> 2006-03-03 20:47:52,655 INFO  org.orbeon.oxf.processor.DebugProcessor  
> null - current:
> oxf:/convert/invpull/process-records.xpl, line 17, column 65
>
> <transaction>
>     <tranaction_number>27354</tranaction_number>
>     <transaction_id>810</transaction_id>
> </transaction>
> 2006-03-03 20:47:52,743 INFO  org.orbeon.oxf.processor.DebugProcessor  
> null - current:
> oxf:/convert/invpull/process-records.xpl, line 17, column 65
>
> <transaction>
>     <tranaction_number>33740</tranaction_number>
>     <transaction_id>810</transaction_id>
> </transaction>
> 2006-03-03 20:47:52,783 INFO  org.orbeon.oxf.processor.DebugProcessor  
> null - current:
> oxf:/convert/invpull/process-records.xpl, line 17, column 65
>
> <transaction>
>     <tranaction_number>27354</tranaction_number>
>     <transaction_id>810</transaction_id>
> </transaction>
>
> On Mar 3, 2006, at 3:16 PM, Alexander Zatko wrote:
>
>> The problem occurs only if the file is run by scheduler (I have also  
>> a manual conversion mode in which this issue does not exist). I  
>> actually tested with the database processors removed and I think the  
>> culprit seemed to be the file serializer. I will try to remove  
>> dependencies on my environment and send you a new xpl file later.
>>
>> A.
>>
>> On Mar 3, 2006, at 3:10 PM, Alessandro Vernet wrote:
>>
>>> Alex,
>>>
>>> I got your XPL file but can't run it locally as it uses your  
>>> database.
>>> Do you see this "N+1" problem only when running the XPL file from the
>>> scheduler, or can you reproduce it even running the XPL from the page
>>> flow? Would you be able to create an example that we can run locally
>>> and that reproduces this problem?
>>>
>>> Alex
>>>
>>> On 3/3/06, Alexander Zatko <[hidden email]> wrote:
>>>> I have an xpl doc (attached) called by a scheduler. The pipeline
>>>> contains several processors within a loop. The processors retrieve a
>>>> particular record from the database, convert it to a text file, save
>>>> the text file and update the database record to mark it as  
>>>> processed.
>>>> If I provide an XML on the input with N "iteration" nodes, the  
>>>> number
>>>> of performed iterations is actually N+1 where the first "iteration"
>>>> node is executed one more time, thus producing a duplicate text  
>>>> file.
>>>>
>>>> A typical loop-controlling XML looks like this:
>>>>
>>>> <conf>
>>>>      <output-directory>
>>>>          <path>/my/convert/path</path>
>>>>      </output-directory>
>>>>      <transactions>
>>>>          <transaction>
>>>>              <tranaction_number>14442</tranaction_number>
>>>>              <transaction_id>810</transaction_id>
>>>>          </transaction>
>>>>          <transaction>
>>>>              <tranaction_number>20397</tranaction_number>
>>>>              <transaction_id>810</transaction_id>
>>>>          </transaction>
>>>>          <transaction>
>>>>              <tranaction_number>27106</tranaction_number>
>>>>              <transaction_id>810</transaction_id>
>>>>          </transaction>
>>>>      </transactions>
>>>> </conf>
>>>>
>>>>
>>>> Alex.
>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> You receive this message as a subscriber of the  
>>>> [hidden email] mailing list.
>>>> To unsubscribe: mailto:[hidden email]
>>>> For general help: mailto:[hidden email]?subject=help
>>>> ObjectWeb mailing lists service home page:  
>>>> http://www.objectweb.org/wws
>>>>
>>>>
>>>>
>>>>
>>>
>>> --
>>> Blog (XML, Web apps, Open Source):
>>> http://www.orbeon.com/blog/
>>>
>>>
>>> --
>>> You receive this message as a subscriber of the  
>>> [hidden email] mailing list.
>>> To unsubscribe: mailto:[hidden email]
>>> For general help: mailto:[hidden email]?subject=help
>>> ObjectWeb mailing lists service home page:  
>>> http://www.objectweb.org/wws
>> --
>> You receive this message as a subscriber of the  
>> [hidden email] mailing list.
>> To unsubscribe: mailto:[hidden email]
>> For general help: mailto:[hidden email]?subject=help
>> ObjectWeb mailing lists service home page:  
>> http://www.objectweb.org/wws
> --
> You receive this message as a subscriber of the  
> [hidden email] mailing list.
> To unsubscribe: mailto:[hidden email]
> For general help: mailto:[hidden email]?subject=help
> ObjectWeb mailing lists service home page: http://www.objectweb.org/wws

> and now I am also attaching the file :-)
>
> <convertor.xpl>
>
> On Mar 3, 2006, at 8:55 PM, Alexander Zatko wrote:
>
>> Alex,
>>
>> I modified/simplified the xpl file - see attached. You will want to  
>> change the path in the input XML if you want the files to be saved.
>>
>> Below is the debug info I am seeing when I feed this XML into the  
>> input:
>>
>> <conf>
>>     <output-directory>
>>          
>> <path>/Applications/jakarta-tomcat-5.0.28/webapps/ops/WEB-INF/
>> resources/convert/btf</path>
>>     </output-directory>
>>     <transactions>
>>         <transaction>
>>             <tranaction_number>27354</tranaction_number>
>>             <transaction_id>810</transaction_id>
>>         </transaction>
>>         <transaction>
>>             <tranaction_number>33740</tranaction_number>
>>             <transaction_id>810</transaction_id>
>>         </transaction>
>>     </transactions>
>> </conf>
>>
>> ___________ the debug info: _________________
>>
>> 2006-03-03 20:47:52,655 INFO  org.orbeon.oxf.processor.DebugProcessor  
>> null - current:
>> oxf:/convert/invpull/process-records.xpl, line 17, column 65
>>
>> <transaction>
>>     <tranaction_number>27354</tranaction_number>
>>     <transaction_id>810</transaction_id>
>> </transaction>
>> 2006-03-03 20:47:52,743 INFO  org.orbeon.oxf.processor.DebugProcessor  
>> null - current:
>> oxf:/convert/invpull/process-records.xpl, line 17, column 65
>>
>> <transaction>
>>     <tranaction_number>33740</tranaction_number>
>>     <transaction_id>810</transaction_id>
>> </transaction>
>> 2006-03-03 20:47:52,783 INFO  org.orbeon.oxf.processor.DebugProcessor  
>> null - current:
>> oxf:/convert/invpull/process-records.xpl, line 17, column 65
>>
>> <transaction>
>>     <tranaction_number>27354</tranaction_number>
>>     <transaction_id>810</transaction_id>
>> </transaction>
>>
>> On Mar 3, 2006, at 3:16 PM, Alexander Zatko wrote:
>>
>>> The problem occurs only if the file is run by scheduler (I have also  
>>> a manual conversion mode in which this issue does not exist). I  
>>> actually tested with the database processors removed and I think the  
>>> culprit seemed to be the file serializer. I will try to remove  
>>> dependencies on my environment and send you a new xpl file later.
>>>
>>> A.
>>>
>>> On Mar 3, 2006, at 3:10 PM, Alessandro Vernet wrote:
>>>
>>>> Alex,
>>>>
>>>> I got your XPL file but can't run it locally as it uses your  
>>>> database.
>>>> Do you see this "N+1" problem only when running the XPL file from  
>>>> the
>>>> scheduler, or can you reproduce it even running the XPL from the  
>>>> page
>>>> flow? Would you be able to create an example that we can run locally
>>>> and that reproduces this problem?
>>>>
>>>> Alex
>>>>
>>>> On 3/3/06, Alexander Zatko <[hidden email]> wrote:
>>>>> I have an xpl doc (attached) called by a scheduler. The pipeline
>>>>> contains several processors within a loop. The processors retrieve  
>>>>> a
>>>>> particular record from the database, convert it to a text file,  
>>>>> save
>>>>> the text file and update the database record to mark it as  
>>>>> processed.
>>>>> If I provide an XML on the input with N "iteration" nodes, the  
>>>>> number
>>>>> of performed iterations is actually N+1 where the first "iteration"
>>>>> node is executed one more time, thus producing a duplicate text  
>>>>> file.
>>>>>
>>>>> A typical loop-controlling XML looks like this:
>>>>>
>>>>> <conf>
>>>>>      <output-directory>
>>>>>          <path>/my/convert/path</path>
>>>>>      </output-directory>
>>>>>      <transactions>
>>>>>          <transaction>
>>>>>              <tranaction_number>14442</tranaction_number>
>>>>>              <transaction_id>810</transaction_id>
>>>>>          </transaction>
>>>>>          <transaction>
>>>>>              <tranaction_number>20397</tranaction_number>
>>>>>              <transaction_id>810</transaction_id>
>>>>>          </transaction>
>>>>>          <transaction>
>>>>>              <tranaction_number>27106</tranaction_number>
>>>>>              <transaction_id>810</transaction_id>
>>>>>          </transaction>
>>>>>      </transactions>
>>>>> </conf>
>>>>>
>>>>>
>>>>> Alex.
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> You receive this message as a subscriber of the  
>>>>> [hidden email] mailing list.
>>>>> To unsubscribe: mailto:[hidden email]
>>>>> For general help: mailto:[hidden email]?subject=help
>>>>> ObjectWeb mailing lists service home page:  
>>>>> http://www.objectweb.org/wws
>>>>>
>>>>>
>>>>>
>>>>>
>>>>
>>>> --
>>>> Blog (XML, Web apps, Open Source):
>>>> http://www.orbeon.com/blog/
>>>>
>>>>
>>>> --
>>>> You receive this message as a subscriber of the  
>>>> [hidden email] mailing list.
>>>> To unsubscribe: mailto:[hidden email]
>>>> For general help: mailto:[hidden email]?subject=help
>>>> ObjectWeb mailing lists service home page:  
>>>> http://www.objectweb.org/wws
>>> --
>>> You receive this message as a subscriber of the  
>>> [hidden email] mailing list.
>>> To unsubscribe: mailto:[hidden email]
>>> For general help: mailto:[hidden email]?subject=help
>>> ObjectWeb mailing lists service home page:  
>>> http://www.objectweb.org/wws
>> --
>> You receive this message as a subscriber of the  
>> [hidden email] mailing list.
>> To unsubscribe: mailto:[hidden email]
>> For general help: mailto:[hidden email]?subject=help
>> ObjectWeb mailing lists service home page:  
>> http://www.objectweb.org/wws

>> and now I am also attaching the file :-)
>>
>> <convertor.xpl>
>>
>> On Mar 3, 2006, at 8:55 PM, Alexander Zatko wrote:
>>
>>> Alex,
>>>
>>> I modified/simplified the xpl file - see attached. You will want to
>>> change the path in the input XML if you want the files to be saved.
>>>
>>> Below is the debug info I am seeing when I feed this XML into the
>>> input:
>>>
>>> <conf>
>>>     <output-directory>
>>>        
>>> <path>/Applications/jakarta-tomcat-5.0.28/webapps/ops/WEB-INF/resources/convert/btf</path>
>>>
>>>     </output-directory>
>>>     <transactions>
>>>         <transaction>
>>>             <tranaction_number>27354</tranaction_number>
>>>             <transaction_id>810</transaction_id>
>>>         </transaction>
>>>         <transaction>
>>>             <tranaction_number>33740</tranaction_number>
>>>             <transaction_id>810</transaction_id>
>>>         </transaction>
>>>     </transactions>
>>> </conf>
>>>
>>> ___________ the debug info: _________________
>>>
>>> 2006-03-03 20:47:52,655 INFO  
>>> org.orbeon.oxf.processor.DebugProcessor null - current:
>>> oxf:/convert/invpull/process-records.xpl, line 17, column 65
>>>
>>> <transaction>
>>>     <tranaction_number>27354</tranaction_number>
>>>     <transaction_id>810</transaction_id>
>>> </transaction>
>>> 2006-03-03 20:47:52,743 INFO  
>>> org.orbeon.oxf.processor.DebugProcessor null - current:
>>> oxf:/convert/invpull/process-records.xpl, line 17, column 65
>>>
>>> <transaction>
>>>     <tranaction_number>33740</tranaction_number>
>>>     <transaction_id>810</transaction_id>
>>> </transaction>
>>> 2006-03-03 20:47:52,783 INFO  
>>> org.orbeon.oxf.processor.DebugProcessor null - current:
>>> oxf:/convert/invpull/process-records.xpl, line 17, column 65
>>>
>>> <transaction>
>>>     <tranaction_number>27354</tranaction_number>
>>>     <transaction_id>810</transaction_id>
>>> </transaction>
>>>
>>> On Mar 3, 2006, at 3:16 PM, Alexander Zatko wrote:
>>>
>>>> The problem occurs only if the file is run by scheduler (I have
>>>> also a manual conversion mode in which this issue does not exist).
>>>> I actually tested with the database processors removed and I think
>>>> the culprit seemed to be the file serializer. I will try to remove
>>>> dependencies on my environment and send you a new xpl file later.
>>>>
>>>> A.
>>>>
>>>> On Mar 3, 2006, at 3:10 PM, Alessandro Vernet wrote:
>>>>
>>>>> Alex,
>>>>>
>>>>> I got your XPL file but can't run it locally as it uses your
>>>>> database.
>>>>> Do you see this "N+1" problem only when running the XPL file from the
>>>>> scheduler, or can you reproduce it even running the XPL from the page
>>>>> flow? Would you be able to create an example that we can run locally
>>>>> and that reproduces this problem?
>>>>>
>>>>> Alex
>>>>>
>>>>> On 3/3/06, Alexander Zatko <[hidden email]> wrote:
>>>>>> I have an xpl doc (attached) called by a scheduler. The pipeline
>>>>>> contains several processors within a loop. The processors retrieve a
>>>>>> particular record from the database, convert it to a text file, save
>>>>>> the text file and update the database record to mark it as
>>>>>> processed.
>>>>>> If I provide an XML on the input with N "iteration" nodes, the
>>>>>> number
>>>>>> of performed iterations is actually N+1 where the first "iteration"
>>>>>> node is executed one more time, thus producing a duplicate text
>>>>>> file.
>>>>>>
>>>>>> A typical loop-controlling XML looks like this:
>>>>>>
>>>>>> <conf>
>>>>>>      <output-directory>
>>>>>>          <path>/my/convert/path</path>
>>>>>>      </output-directory>
>>>>>>      <transactions>
>>>>>>          <transaction>
>>>>>>              <tranaction_number>14442</tranaction_number>
>>>>>>              <transaction_id>810</transaction_id>
>>>>>>          </transaction>
>>>>>>          <transaction>
>>>>>>              <tranaction_number>20397</tranaction_number>
>>>>>>              <transaction_id>810</transaction_id>
>>>>>>          </transaction>
>>>>>>          <transaction>
>>>>>>              <tranaction_number>27106</tranaction_number>
>>>>>>              <transaction_id>810</transaction_id>
>>>>>>          </transaction>
>>>>>>      </transactions>
>>>>>> </conf>
>>>>>>
>>>>>>
>>>>>> Alex.
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> You receive this message as a subscriber of the
>>>>>> [hidden email] mailing list.
>>>>>> To unsubscribe: mailto:[hidden email]
>>>>>> For general help: mailto:[hidden email]?subject=help
>>>>>> ObjectWeb mailing lists service home page:
>>>>>> http://www.objectweb.org/wws
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>> --
>>>>> Blog (XML, Web apps, Open Source):
>>>>> http://www.orbeon.com/blog/
>>>>>
>>>>>
>>>>> --
>>>>> You receive this message as a subscriber of the
>>>>> [hidden email] mailing list.
>>>>> To unsubscribe: mailto:[hidden email]
>>>>> For general help: mailto:[hidden email]?subject=help
>>>>> ObjectWeb mailing lists service home page:
>>>>> http://www.objectweb.org/wws
>>>> --
>>>> You receive this message as a subscriber of the
>>>> [hidden email] mailing list.
>>>> To unsubscribe: mailto:[hidden email]
>>>> For general help: mailto:[hidden email]?subject=help
>>>> ObjectWeb mailing lists service home page:
>>>> http://www.objectweb.org/wws
>>> --
>>> You receive this message as a subscriber of the
>>> [hidden email] mailing list.
>>> To unsubscribe: mailto:[hidden email]
>>> For general help: mailto:[hidden email]?subject=help
>>> ObjectWeb mailing lists service home page: http://www.objectweb.org/wws
>
>
> ------------------------------------------------------------------------
>
>
> --
> You receive this message as a subscriber of the [hidden email] mailing list.
> To unsubscribe: mailto:[hidden email]
> For general help: mailto:[hidden email]?subject=help
> ObjectWeb mailing lists service home page: http://www.objectweb.org/wws
>  

>
>
> Alexander Zatko wrote:
>> ...one correction - this issue does not seem to be tied to the  
>> scheduler as I see it also when I run the xpl manually.
>>
>> A.
>> On Mar 3, 2006, at 9:18 PM, Alexander Zatko wrote:
>>
>
> Hi,
>
> I think I have seen the same problem today.  Strangely, a debug added  
> to the processor that consumes the output of the for-each seems to  
> stop it happening in my case.   Also, in my case it was actually doing  
> each item in the for each 3 times ... I can post my pipeline if you  
> think this might help find what the problem is.   I have tried to  
> simplify it but cannot reproduce it in the simplified form...
>
> Dave
>
>>> and now I am also attaching the file :-)
>>>
>>> <convertor.xpl>
>>>
>>> On Mar 3, 2006, at 8:55 PM, Alexander Zatko wrote:
>>>
>>>> Alex,
>>>>
>>>> I modified/simplified the xpl file - see attached. You will want to  
>>>> change the path in the input XML if you want the files to be saved.
>>>>
>>>> Below is the debug info I am seeing when I feed this XML into the  
>>>> input:
>>>>
>>>> <conf>
>>>>     <output-directory>
>>>>          
>>>> <path>/Applications/jakarta-tomcat-5.0.28/webapps/ops/WEB-INF/
>>>> resources/convert/btf</path>
>>>>     </output-directory>
>>>>     <transactions>
>>>>         <transaction>
>>>>             <tranaction_number>27354</tranaction_number>
>>>>             <transaction_id>810</transaction_id>
>>>>         </transaction>
>>>>         <transaction>
>>>>             <tranaction_number>33740</tranaction_number>
>>>>             <transaction_id>810</transaction_id>
>>>>         </transaction>
>>>>     </transactions>
>>>> </conf>
>>>>
>>>> ___________ the debug info: _________________
>>>>
>>>> 2006-03-03 20:47:52,655 INFO  
>>>> org.orbeon.oxf.processor.DebugProcessor null - current:
>>>> oxf:/convert/invpull/process-records.xpl, line 17, column 65
>>>>
>>>> <transaction>
>>>>     <tranaction_number>27354</tranaction_number>
>>>>     <transaction_id>810</transaction_id>
>>>> </transaction>
>>>> 2006-03-03 20:47:52,743 INFO  
>>>> org.orbeon.oxf.processor.DebugProcessor null - current:
>>>> oxf:/convert/invpull/process-records.xpl, line 17, column 65
>>>>
>>>> <transaction>
>>>>     <tranaction_number>33740</tranaction_number>
>>>>     <transaction_id>810</transaction_id>
>>>> </transaction>
>>>> 2006-03-03 20:47:52,783 INFO  
>>>> org.orbeon.oxf.processor.DebugProcessor null - current:
>>>> oxf:/convert/invpull/process-records.xpl, line 17, column 65
>>>>
>>>> <transaction>
>>>>     <tranaction_number>27354</tranaction_number>
>>>>     <transaction_id>810</transaction_id>
>>>> </transaction>
>>>>
>>>> On Mar 3, 2006, at 3:16 PM, Alexander Zatko wrote:
>>>>
>>>>> The problem occurs only if the file is run by scheduler (I have  
>>>>> also a manual conversion mode in which this issue does not exist).  
>>>>> I actually tested with the database processors removed and I think  
>>>>> the culprit seemed to be the file serializer. I will try to remove  
>>>>> dependencies on my environment and send you a new xpl file later.
>>>>>
>>>>> A.
>>>>>
>>>>> On Mar 3, 2006, at 3:10 PM, Alessandro Vernet wrote:
>>>>>
>>>>>> Alex,
>>>>>>
>>>>>> I got your XPL file but can't run it locally as it uses your  
>>>>>> database.
>>>>>> Do you see this "N+1" problem only when running the XPL file from  
>>>>>> the
>>>>>> scheduler, or can you reproduce it even running the XPL from the  
>>>>>> page
>>>>>> flow? Would you be able to create an example that we can run  
>>>>>> locally
>>>>>> and that reproduces this problem?
>>>>>>
>>>>>> Alex
>>>>>>
>>>>>> On 3/3/06, Alexander Zatko <[hidden email]> wrote:
>>>>>>> I have an xpl doc (attached) called by a scheduler. The pipeline
>>>>>>> contains several processors within a loop. The processors  
>>>>>>> retrieve a
>>>>>>> particular record from the database, convert it to a text file,  
>>>>>>> save
>>>>>>> the text file and update the database record to mark it as  
>>>>>>> processed.
>>>>>>> If I provide an XML on the input with N "iteration" nodes, the  
>>>>>>> number
>>>>>>> of performed iterations is actually N+1 where the first  
>>>>>>> "iteration"
>>>>>>> node is executed one more time, thus producing a duplicate text  
>>>>>>> file.
>>>>>>>
>>>>>>> A typical loop-controlling XML looks like this:
>>>>>>>
>>>>>>> <conf>
>>>>>>>      <output-directory>
>>>>>>>          <path>/my/convert/path</path>
>>>>>>>      </output-directory>
>>>>>>>      <transactions>
>>>>>>>          <transaction>
>>>>>>>              <tranaction_number>14442</tranaction_number>
>>>>>>>              <transaction_id>810</transaction_id>
>>>>>>>          </transaction>
>>>>>>>          <transaction>
>>>>>>>              <tranaction_number>20397</tranaction_number>
>>>>>>>              <transaction_id>810</transaction_id>
>>>>>>>          </transaction>
>>>>>>>          <transaction>
>>>>>>>              <tranaction_number>27106</tranaction_number>
>>>>>>>              <transaction_id>810</transaction_id>
>>>>>>>          </transaction>
>>>>>>>      </transactions>
>>>>>>> </conf>
>>>>>>>
>>>>>>>
>>>>>>> Alex.
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> You receive this message as a subscriber of the  
>>>>>>> [hidden email] mailing list.
>>>>>>> To unsubscribe: mailto:[hidden email]
>>>>>>> For general help: mailto:[hidden email]?subject=help
>>>>>>> ObjectWeb mailing lists service home page:  
>>>>>>> http://www.objectweb.org/wws
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>
>>>>>> --
>>>>>> Blog (XML, Web apps, Open Source):
>>>>>> http://www.orbeon.com/blog/
>>>>>>
>>>>>>
>>>>>> --
>>>>>> You receive this message as a subscriber of the  
>>>>>> [hidden email] mailing list.
>>>>>> To unsubscribe: mailto:[hidden email]
>>>>>> For general help: mailto:[hidden email]?subject=help
>>>>>> ObjectWeb mailing lists service home page:  
>>>>>> http://www.objectweb.org/wws
>>>>> --
>>>>> You receive this message as a subscriber of the  
>>>>> [hidden email] mailing list.
>>>>> To unsubscribe: mailto:[hidden email]
>>>>> For general help: mailto:[hidden email]?subject=help
>>>>> ObjectWeb mailing lists service home page:  
>>>>> http://www.objectweb.org/wws
>>>> --
>>>> You receive this message as a subscriber of the  
>>>> [hidden email] mailing list.
>>>> To unsubscribe: mailto:[hidden email]
>>>> For general help: mailto:[hidden email]?subject=help
>>>> ObjectWeb mailing lists service home page:  
>>>> http://www.objectweb.org/wws
>>
>>
>> ----------------------------------------------------------------------
>> --
>>
>>
>> --
>> You receive this message as a subscriber of the  
>> [hidden email] mailing list.
>> To unsubscribe: mailto:[hidden email]
>> For general help: mailto:[hidden email]?subject=help
>> ObjectWeb mailing lists service home page:  
>> http://www.objectweb.org/wws
>>
>
>
> --
> You receive this message as a subscriber of the  
> [hidden email] mailing list.
> To unsubscribe: mailto:[hidden email]
> For general help: mailto:[hidden email]?subject=help
> ObjectWeb mailing lists service home page: http://www.objectweb.org/wws

> and now I am also attaching the file :-)
>
>
>
>
>
> On Mar 3, 2006, at 8:55 PM, Alexander Zatko wrote:
>
> > Alex,
> >
> > I modified/simplified the xpl file - see attached. You will want to
> > change the path in the input XML if you want the files to be saved.
> >
> > Below is the debug info I am seeing when I feed this XML into the
> > input:
> >
> > <conf>
> >     <output-directory>
> >
> > <path>/Applications/jakarta-tomcat-5.0.28/webapps/ops/WEB-INF/
> > resources/convert/btf</path>
> >     </output-directory>
> >     <transactions>
> >         <transaction>
> >             <tranaction_number>27354</tranaction_number>
> >             <transaction_id>810</transaction_id>
> >         </transaction>
> >         <transaction>
> >             <tranaction_number>33740</tranaction_number>
> >             <transaction_id>810</transaction_id>
> >         </transaction>
> >     </transactions>
> > </conf>
> >
> > ___________ the debug info: _________________
> >
> > 2006-03-03 20:47:52,655 INFO  org.orbeon.oxf.processor.DebugProcessor
> > null - current:
> > oxf:/convert/invpull/process-records.xpl, line 17, column 65
> >
> > <transaction>
> >     <tranaction_number>27354</tranaction_number>
> >     <transaction_id>810</transaction_id>
> > </transaction>
> > 2006-03-03 20:47:52,743 INFO  org.orbeon.oxf.processor.DebugProcessor
> > null - current:
> > oxf:/convert/invpull/process-records.xpl, line 17, column 65
> >
> > <transaction>
> >     <tranaction_number>33740</tranaction_number>
> >     <transaction_id>810</transaction_id>
> > </transaction>
> > 2006-03-03 20:47:52,783 INFO  org.orbeon.oxf.processor.DebugProcessor
> > null - current:
> > oxf:/convert/invpull/process-records.xpl, line 17, column 65
> >
> > <transaction>
> >     <tranaction_number>27354</tranaction_number>
> >     <transaction_id>810</transaction_id>
> > </transaction>
> >
> > On Mar 3, 2006, at 3:16 PM, Alexander Zatko wrote:
> >
> >> The problem occurs only if the file is run by scheduler (I have also
> >> a manual conversion mode in which this issue does not exist). I
> >> actually tested with the database processors removed and I think the
> >> culprit seemed to be the file serializer. I will try to remove
> >> dependencies on my environment and send you a new xpl file later.
> >>
> >> A.
> >>
> >> On Mar 3, 2006, at 3:10 PM, Alessandro Vernet wrote:
> >>
> >>> Alex,
> >>>
> >>> I got your XPL file but can't run it locally as it uses your
> >>> database.
> >>> Do you see this "N+1" problem only when running the XPL file from the
> >>> scheduler, or can you reproduce it even running the XPL from the page
> >>> flow? Would you be able to create an example that we can run locally
> >>> and that reproduces this problem?
> >>>
> >>> Alex
> >>>
> >>> On 3/3/06, Alexander Zatko <[hidden email]> wrote:
> >>>> I have an xpl doc (attached) called by a scheduler. The pipeline
> >>>> contains several processors within a loop. The processors retrieve a
> >>>> particular record from the database, convert it to a text file, save
> >>>> the text file and update the database record to mark it as
> >>>> processed.
> >>>> If I provide an XML on the input with N "iteration" nodes, the
> >>>> number
> >>>> of performed iterations is actually N+1 where the first "iteration"
> >>>> node is executed one more time, thus producing a duplicate text
> >>>> file.
> >>>>
> >>>> A typical loop-controlling XML looks like this:
> >>>>
> >>>> <conf>
> >>>>      <output-directory>
> >>>>          <path>/my/convert/path</path>
> >>>>      </output-directory>
> >>>>      <transactions>
> >>>>          <transaction>
> >>>>              <tranaction_number>14442</tranaction_number>
> >>>>              <transaction_id>810</transaction_id>
> >>>>          </transaction>
> >>>>          <transaction>
> >>>>              <tranaction_number>20397</tranaction_number>
> >>>>              <transaction_id>810</transaction_id>
> >>>>          </transaction>
> >>>>          <transaction>
> >>>>              <tranaction_number>27106</tranaction_number>
> >>>>              <transaction_id>810</transaction_id>
> >>>>          </transaction>
> >>>>      </transactions>
> >>>> </conf>
> >>>>
> >>>>
> >>>> Alex.
> >>>>
> >>>>
> >>>>
> >>>>
> >>>> --
> >>>> You receive this message as a subscriber of the
> >>>> [hidden email] mailing list.
> >>>> To unsubscribe: mailto:[hidden email]
> >>>> For general help: mailto:[hidden email]?subject=help
> >>>> ObjectWeb mailing lists service home page:
> >>>> http://www.objectweb.org/wws
> >>>>
> >>>>
> >>>>
> >>>>
> >>>
> >>> --
> >>> Blog (XML, Web apps, Open Source):
> >>> http://www.orbeon.com/blog/
> >>>
> >>>
> >>> --
> >>> You receive this message as a subscriber of the
> >>> [hidden email] mailing list.
> >>> To unsubscribe: mailto:[hidden email]
> >>> For general help: mailto:[hidden email]?subject=help
> >>> ObjectWeb mailing lists service home page:
> >>> http://www.objectweb.org/wws
> >> --
> >> You receive this message as a subscriber of the
> >> [hidden email] mailing list.
> >> To unsubscribe: mailto:[hidden email]
> >> For general help: mailto:[hidden email]?subject=help
> >> ObjectWeb mailing lists service home page:
> >> http://www.objectweb.org/wws
> > --
> > You receive this message as a subscriber of the
> > [hidden email] mailing list.
> > To unsubscribe: mailto:[hidden email]
> > For general help: mailto:[hidden email]?subject=help
> > ObjectWeb mailing lists service home page: http://www.objectweb.org/wws
>
>
>
> --
> You receive this message as a subscriber of the [hidden email] mailing list.
> To unsubscribe: mailto:[hidden email]
> For general help: mailto:[hidden email]?subject=help
> ObjectWeb mailing lists service home page: http://www.objectweb.org/wws
>
>
>
>

> Alex,
>
> I was able to reproduce the problem. I simplified even further your
> test case and attached it to this bug entry in the tracker:
>
> http://forge.objectweb.org/tracker/index.php?
> func=detail&aid=304762&group_id=168&atid=350207
>
> Alex
>
> On 3/3/06, Alexander Zatko <[hidden email]> wrote:
>> and now I am also attaching the file :-)
>>
>>
>>
>>
>>
>> On Mar 3, 2006, at 8:55 PM, Alexander Zatko wrote:
>>
>>> Alex,
>>>
>>> I modified/simplified the xpl file - see attached. You will want to
>>> change the path in the input XML if you want the files to be saved.
>>>
>>> Below is the debug info I am seeing when I feed this XML into the
>>> input:
>>>
>>> <conf>
>>>     <output-directory>
>>>
>>> <path>/Applications/jakarta-tomcat-5.0.28/webapps/ops/WEB-INF/
>>> resources/convert/btf</path>
>>>     </output-directory>
>>>     <transactions>
>>>         <transaction>
>>>             <tranaction_number>27354</tranaction_number>
>>>             <transaction_id>810</transaction_id>
>>>         </transaction>
>>>         <transaction>
>>>             <tranaction_number>33740</tranaction_number>
>>>             <transaction_id>810</transaction_id>
>>>         </transaction>
>>>     </transactions>
>>> </conf>
>>>
>>> ___________ the debug info: _________________
>>>
>>> 2006-03-03 20:47:52,655 INFO  org.orbeon.oxf.processor.DebugProcessor
>>> null - current:
>>> oxf:/convert/invpull/process-records.xpl, line 17, column 65
>>>
>>> <transaction>
>>>     <tranaction_number>27354</tranaction_number>
>>>     <transaction_id>810</transaction_id>
>>> </transaction>
>>> 2006-03-03 20:47:52,743 INFO  org.orbeon.oxf.processor.DebugProcessor
>>> null - current:
>>> oxf:/convert/invpull/process-records.xpl, line 17, column 65
>>>
>>> <transaction>
>>>     <tranaction_number>33740</tranaction_number>
>>>     <transaction_id>810</transaction_id>
>>> </transaction>
>>> 2006-03-03 20:47:52,783 INFO  org.orbeon.oxf.processor.DebugProcessor
>>> null - current:
>>> oxf:/convert/invpull/process-records.xpl, line 17, column 65
>>>
>>> <transaction>
>>>     <tranaction_number>27354</tranaction_number>
>>>     <transaction_id>810</transaction_id>
>>> </transaction>
>>>
>>> On Mar 3, 2006, at 3:16 PM, Alexander Zatko wrote:
>>>
>>>> The problem occurs only if the file is run by scheduler (I have also
>>>> a manual conversion mode in which this issue does not exist). I
>>>> actually tested with the database processors removed and I think the
>>>> culprit seemed to be the file serializer. I will try to remove
>>>> dependencies on my environment and send you a new xpl file later.
>>>>
>>>> A.
>>>>
>>>> On Mar 3, 2006, at 3:10 PM, Alessandro Vernet wrote:
>>>>
>>>>> Alex,
>>>>>
>>>>> I got your XPL file but can't run it locally as it uses your
>>>>> database.
>>>>> Do you see this "N+1" problem only when running the XPL file from  
>>>>> the
>>>>> scheduler, or can you reproduce it even running the XPL from the  
>>>>> page
>>>>> flow? Would you be able to create an example that we can run  
>>>>> locally
>>>>> and that reproduces this problem?
>>>>>
>>>>> Alex
>>>>>
>>>>> On 3/3/06, Alexander Zatko <[hidden email]> wrote:
>>>>>> I have an xpl doc (attached) called by a scheduler. The pipeline
>>>>>> contains several processors within a loop. The processors  
>>>>>> retrieve a
>>>>>> particular record from the database, convert it to a text file,  
>>>>>> save
>>>>>> the text file and update the database record to mark it as
>>>>>> processed.
>>>>>> If I provide an XML on the input with N "iteration" nodes, the
>>>>>> number
>>>>>> of performed iterations is actually N+1 where the first  
>>>>>> "iteration"
>>>>>> node is executed one more time, thus producing a duplicate text
>>>>>> file.
>>>>>>
>>>>>> A typical loop-controlling XML looks like this:
>>>>>>
>>>>>> <conf>
>>>>>>      <output-directory>
>>>>>>          <path>/my/convert/path</path>
>>>>>>      </output-directory>
>>>>>>      <transactions>
>>>>>>          <transaction>
>>>>>>              <tranaction_number>14442</tranaction_number>
>>>>>>              <transaction_id>810</transaction_id>
>>>>>>          </transaction>
>>>>>>          <transaction>
>>>>>>              <tranaction_number>20397</tranaction_number>
>>>>>>              <transaction_id>810</transaction_id>
>>>>>>          </transaction>
>>>>>>          <transaction>
>>>>>>              <tranaction_number>27106</tranaction_number>
>>>>>>              <transaction_id>810</transaction_id>
>>>>>>          </transaction>
>>>>>>      </transactions>
>>>>>> </conf>
>>>>>>
>>>>>>
>>>>>> Alex.
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> You receive this message as a subscriber of the
>>>>>> [hidden email] mailing list.
>>>>>> To unsubscribe: mailto:[hidden email]
>>>>>> For general help: mailto:[hidden email]?subject=help
>>>>>> ObjectWeb mailing lists service home page:
>>>>>> http://www.objectweb.org/wws
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>> --
>>>>> Blog (XML, Web apps, Open Source):
>>>>> http://www.orbeon.com/blog/
>>>>>
>>>>>
>>>>> --
>>>>> You receive this message as a subscriber of the
>>>>> [hidden email] mailing list.
>>>>> To unsubscribe: mailto:[hidden email]
>>>>> For general help: mailto:[hidden email]?subject=help
>>>>> ObjectWeb mailing lists service home page:
>>>>> http://www.objectweb.org/wws
>>>> --
>>>> You receive this message as a subscriber of the
>>>> [hidden email] mailing list.
>>>> To unsubscribe: mailto:[hidden email]
>>>> For general help: mailto:[hidden email]?subject=help
>>>> ObjectWeb mailing lists service home page:
>>>> http://www.objectweb.org/wws
>>> --
>>> You receive this message as a subscriber of the
>>> [hidden email] mailing list.
>>> To unsubscribe: mailto:[hidden email]
>>> For general help: mailto:[hidden email]?subject=help
>>> ObjectWeb mailing lists service home page:  
>>> http://www.objectweb.org/wws
>>
>>
>>
>> --
>> You receive this message as a subscriber of the  
>> [hidden email] mailing list.
>> To unsubscribe: mailto:[hidden email]
>> For general help: mailto:[hidden email]?subject=help
>> ObjectWeb mailing lists service home page:  
>> http://www.objectweb.org/wws
>>
>>
>>
>>
>
> --
> Blog (XML, Web apps, Open Source):
> http://www.orbeon.com/blog/
>
>
> --
> You receive this message as a subscriber of the  
> [hidden email] mailing list.
> To unsubscribe: mailto:[hidden email]
> For general help: mailto:[hidden email]?subject=help
> ObjectWeb mailing lists service home page: http://www.objectweb.org/wws

> Alex,
>
> I was able to reproduce the problem. I simplified even further your
> test case and attached it to this bug entry in the tracker:
>
> http://forge.objectweb.org/tracker/index.php?func=detail&aid=304762&group_id=168&atid=350207
>
> Alex
>
> On 3/3/06, Alexander Zatko <[hidden email]> wrote:
> > and now I am also attaching the file :-)
> >
> >
> >
> >
> >
> > On Mar 3, 2006, at 8:55 PM, Alexander Zatko wrote:
> >
> > > Alex,
> > >
> > > I modified/simplified the xpl file - see attached. You will want to
> > > change the path in the input XML if you want the files to be saved.
> > >
> > > Below is the debug info I am seeing when I feed this XML into the
> > > input:
> > >
> > > <conf>
> > >     <output-directory>
> > >
> > > <path>/Applications/jakarta-tomcat-5.0.28/webapps/ops/WEB-INF/
> > > resources/convert/btf</path>
> > >     </output-directory>
> > >     <transactions>
> > >         <transaction>
> > >             <tranaction_number>27354</tranaction_number>
> > >             <transaction_id>810</transaction_id>
> > >         </transaction>
> > >         <transaction>
> > >             <tranaction_number>33740</tranaction_number>
> > >             <transaction_id>810</transaction_id>
> > >         </transaction>
> > >     </transactions>
> > > </conf>
> > >
> > > ___________ the debug info: _________________
> > >
> > > 2006-03-03 20:47:52,655 INFO  org.orbeon.oxf.processor.DebugProcessor
> > > null - current:
> > > oxf:/convert/invpull/process-records.xpl, line 17, column 65
> > >
> > > <transaction>
> > >     <tranaction_number>27354</tranaction_number>
> > >     <transaction_id>810</transaction_id>
> > > </transaction>
> > > 2006-03-03 20:47:52,743 INFO  org.orbeon.oxf.processor.DebugProcessor
> > > null - current:
> > > oxf:/convert/invpull/process-records.xpl, line 17, column 65
> > >
> > > <transaction>
> > >     <tranaction_number>33740</tranaction_number>
> > >     <transaction_id>810</transaction_id>
> > > </transaction>
> > > 2006-03-03 20:47:52,783 INFO  org.orbeon.oxf.processor.DebugProcessor
> > > null - current:
> > > oxf:/convert/invpull/process-records.xpl, line 17, column 65
> > >
> > > <transaction>
> > >     <tranaction_number>27354</tranaction_number>
> > >     <transaction_id>810</transaction_id>
> > > </transaction>
> > >
> > > On Mar 3, 2006, at 3:16 PM, Alexander Zatko wrote:
> > >
> > >> The problem occurs only if the file is run by scheduler (I have also
> > >> a manual conversion mode in which this issue does not exist). I
> > >> actually tested with the database processors removed and I think the
> > >> culprit seemed to be the file serializer. I will try to remove
> > >> dependencies on my environment and send you a new xpl file later.
> > >>
> > >> A.
> > >>
> > >> On Mar 3, 2006, at 3:10 PM, Alessandro Vernet wrote:
> > >>
> > >>> Alex,
> > >>>
> > >>> I got your XPL file but can't run it locally as it uses your
> > >>> database.
> > >>> Do you see this "N+1" problem only when running the XPL file from the
> > >>> scheduler, or can you reproduce it even running the XPL from the page
> > >>> flow? Would you be able to create an example that we can run locally
> > >>> and that reproduces this problem?
> > >>>
> > >>> Alex
> > >>>
> > >>> On 3/3/06, Alexander Zatko <[hidden email]> wrote:
> > >>>> I have an xpl doc (attached) called by a scheduler. The pipeline
> > >>>> contains several processors within a loop. The processors retrieve a
> > >>>> particular record from the database, convert it to a text file, save
> > >>>> the text file and update the database record to mark it as
> > >>>> processed.
> > >>>> If I provide an XML on the input with N "iteration" nodes, the
> > >>>> number
> > >>>> of performed iterations is actually N+1 where the first "iteration"
> > >>>> node is executed one more time, thus producing a duplicate text
> > >>>> file.
> > >>>>
> > >>>> A typical loop-controlling XML looks like this:
> > >>>>
> > >>>> <conf>
> > >>>>      <output-directory>
> > >>>>          <path>/my/convert/path</path>
> > >>>>      </output-directory>
> > >>>>      <transactions>
> > >>>>          <transaction>
> > >>>>              <tranaction_number>14442</tranaction_number>
> > >>>>              <transaction_id>810</transaction_id>
> > >>>>          </transaction>
> > >>>>          <transaction>
> > >>>>              <tranaction_number>20397</tranaction_number>
> > >>>>              <transaction_id>810</transaction_id>
> > >>>>          </transaction>
> > >>>>          <transaction>
> > >>>>              <tranaction_number>27106</tranaction_number>
> > >>>>              <transaction_id>810</transaction_id>
> > >>>>          </transaction>
> > >>>>      </transactions>
> > >>>> </conf>
> > >>>>
> > >>>>
> > >>>> Alex.
> > >>>>
> > >>>>
> > >>>>
> > >>>>
> > >>>> --
> > >>>> You receive this message as a subscriber of the
> > >>>> [hidden email] mailing list.
> > >>>> To unsubscribe: mailto:[hidden email]
> > >>>> For general help: mailto:[hidden email]?subject=help
> > >>>> ObjectWeb mailing lists service home page:
> > >>>> http://www.objectweb.org/wws
> > >>>>
> > >>>>
> > >>>>
> > >>>>
> > >>>
> > >>> --
> > >>> Blog (XML, Web apps, Open Source):
> > >>> http://www.orbeon.com/blog/
> > >>>
> > >>>
> > >>> --
> > >>> You receive this message as a subscriber of the
> > >>> [hidden email] mailing list.
> > >>> To unsubscribe: mailto:[hidden email]
> > >>> For general help: mailto:[hidden email]?subject=help
> > >>> ObjectWeb mailing lists service home page:
> > >>> http://www.objectweb.org/wws
> > >> --
> > >> You receive this message as a subscriber of the
> > >> [hidden email] mailing list.
> > >> To unsubscribe: mailto:[hidden email]
> > >> For general help: mailto:[hidden email]?subject=help
> > >> ObjectWeb mailing lists service home page:
> > >> http://www.objectweb.org/wws
> > > --
> > > You receive this message as a subscriber of the
> > > [hidden email] mailing list.
> > > To unsubscribe: mailto:[hidden email]
> > > For general help: mailto:[hidden email]?subject=help
> > > ObjectWeb mailing lists service home page: http://www.objectweb.org/wws
> >
> >
> >
> > --
> > You receive this message as a subscriber of the [hidden email] mailing list.
> > To unsubscribe: mailto:[hidden email]
> > For general help: mailto:[hidden email]?subject=help
> > ObjectWeb mailing lists service home page: http://www.objectweb.org/wws
> >
> >
> >
> >
>
>
> --
> Blog (XML, Web apps, Open Source):
> http://www.orbeon.com/blog/
>

> This is a tricky one! Just to update you on the status of the issue, I
> have spent a few hours tonight on the problem and added some comments
> to the bug entry, but I don't have a resolution yet.
>
> Alex
>
> On 3/9/06, Alessandro Vernet <[hidden email]> wrote:
> > Alex,
> >
> > I was able to reproduce the problem. I simplified even further your
> > test case and attached it to this bug entry in the tracker:
> >
> > http://forge.objectweb.org/tracker/index.php?func=detail&aid=304762&group_id=168&atid=350207
> >
> > Alex
> >
> > On 3/3/06, Alexander Zatko <[hidden email]> wrote:
> > > and now I am also attaching the file :-)
> > >
> > >
> > >
> > >
> > >
> > > On Mar 3, 2006, at 8:55 PM, Alexander Zatko wrote:
> > >
> > > > Alex,
> > > >
> > > > I modified/simplified the xpl file - see attached. You will want to
> > > > change the path in the input XML if you want the files to be saved.
> > > >
> > > > Below is the debug info I am seeing when I feed this XML into the
> > > > input:
> > > >
> > > > <conf>
> > > >     <output-directory>
> > > >
> > > > <path>/Applications/jakarta-tomcat-5.0.28/webapps/ops/WEB-INF/
> > > > resources/convert/btf</path>
> > > >     </output-directory>
> > > >     <transactions>
> > > >         <transaction>
> > > >             <tranaction_number>27354</tranaction_number>
> > > >             <transaction_id>810</transaction_id>
> > > >         </transaction>
> > > >         <transaction>
> > > >             <tranaction_number>33740</tranaction_number>
> > > >             <transaction_id>810</transaction_id>
> > > >         </transaction>
> > > >     </transactions>
> > > > </conf>
> > > >
> > > > ___________ the debug info: _________________
> > > >
> > > > 2006-03-03 20:47:52,655 INFO  org.orbeon.oxf.processor.DebugProcessor
> > > > null - current:
> > > > oxf:/convert/invpull/process-records.xpl, line 17, column 65
> > > >
> > > > <transaction>
> > > >     <tranaction_number>27354</tranaction_number>
> > > >     <transaction_id>810</transaction_id>
> > > > </transaction>
> > > > 2006-03-03 20:47:52,743 INFO  org.orbeon.oxf.processor.DebugProcessor
> > > > null - current:
> > > > oxf:/convert/invpull/process-records.xpl, line 17, column 65
> > > >
> > > > <transaction>
> > > >     <tranaction_number>33740</tranaction_number>
> > > >     <transaction_id>810</transaction_id>
> > > > </transaction>
> > > > 2006-03-03 20:47:52,783 INFO  org.orbeon.oxf.processor.DebugProcessor
> > > > null - current:
> > > > oxf:/convert/invpull/process-records.xpl, line 17, column 65
> > > >
> > > > <transaction>
> > > >     <tranaction_number>27354</tranaction_number>
> > > >     <transaction_id>810</transaction_id>
> > > > </transaction>
> > > >
> > > > On Mar 3, 2006, at 3:16 PM, Alexander Zatko wrote:
> > > >
> > > >> The problem occurs only if the file is run by scheduler (I have also
> > > >> a manual conversion mode in which this issue does not exist). I
> > > >> actually tested with the database processors removed and I think the
> > > >> culprit seemed to be the file serializer. I will try to remove
> > > >> dependencies on my environment and send you a new xpl file later.
> > > >>
> > > >> A.
> > > >>
> > > >> On Mar 3, 2006, at 3:10 PM, Alessandro Vernet wrote:
> > > >>
> > > >>> Alex,
> > > >>>
> > > >>> I got your XPL file but can't run it locally as it uses your
> > > >>> database.
> > > >>> Do you see this "N+1" problem only when running the XPL file from the
> > > >>> scheduler, or can you reproduce it even running the XPL from the page
> > > >>> flow? Would you be able to create an example that we can run locally
> > > >>> and that reproduces this problem?
> > > >>>
> > > >>> Alex
> > > >>>
> > > >>> On 3/3/06, Alexander Zatko <[hidden email]> wrote:
> > > >>>> I have an xpl doc (attached) called by a scheduler. The pipeline
> > > >>>> contains several processors within a loop. The processors retrieve a
> > > >>>> particular record from the database, convert it to a text file, save
> > > >>>> the text file and update the database record to mark it as
> > > >>>> processed.
> > > >>>> If I provide an XML on the input with N "iteration" nodes, the
> > > >>>> number
> > > >>>> of performed iterations is actually N+1 where the first "iteration"
> > > >>>> node is executed one more time, thus producing a duplicate text
> > > >>>> file.
> > > >>>>
> > > >>>> A typical loop-controlling XML looks like this:
> > > >>>>
> > > >>>> <conf>
> > > >>>>      <output-directory>
> > > >>>>          <path>/my/convert/path</path>
> > > >>>>      </output-directory>
> > > >>>>      <transactions>
> > > >>>>          <transaction>
> > > >>>>              <tranaction_number>14442</tranaction_number>
> > > >>>>              <transaction_id>810</transaction_id>
> > > >>>>          </transaction>
> > > >>>>          <transaction>
> > > >>>>              <tranaction_number>20397</tranaction_number>
> > > >>>>              <transaction_id>810</transaction_id>
> > > >>>>          </transaction>
> > > >>>>          <transaction>
> > > >>>>              <tranaction_number>27106</tranaction_number>
> > > >>>>              <transaction_id>810</transaction_id>
> > > >>>>          </transaction>
> > > >>>>      </transactions>
> > > >>>> </conf>
> > > >>>>
> > > >>>>
> > > >>>> Alex.
> > > >>>>
> > > >>>>
> > > >>>>
> > > >>>>
> > > >>>> --
> > > >>>> You receive this message as a subscriber of the
> > > >>>> [hidden email] mailing list.
> > > >>>> To unsubscribe: mailto:[hidden email]
> > > >>>> For general help: mailto:[hidden email]?subject=help
> > > >>>> ObjectWeb mailing lists service home page:
> > > >>>> http://www.objectweb.org/wws
> > > >>>>
> > > >>>>
> > > >>>>
> > > >>>>
> > > >>>
> > > >>> --
> > > >>> Blog (XML, Web apps, Open Source):
> > > >>> http://www.orbeon.com/blog/
> > > >>>
> > > >>>
> > > >>> --
> > > >>> You receive this message as a subscriber of the
> > > >>> [hidden email] mailing list.
> > > >>> To unsubscribe: mailto:[hidden email]
> > > >>> For general help: mailto:[hidden email]?subject=help
> > > >>> ObjectWeb mailing lists service home page:
> > > >>> http://www.objectweb.org/wws
> > > >> --
> > > >> You receive this message as a subscriber of the
> > > >> [hidden email] mailing list.
> > > >> To unsubscribe: mailto:[hidden email]
> > > >> For general help: mailto:[hidden email]?subject=help
> > > >> ObjectWeb mailing lists service home page:
> > > >> http://www.objectweb.org/wws
> > > > --
> > > > You receive this message as a subscriber of the
> > > > [hidden email] mailing list.
> > > > To unsubscribe: mailto:[hidden email]
> > > > For general help: mailto:[hidden email]?subject=help
> > > > ObjectWeb mailing lists service home page: http://www.objectweb.org/wws
> > >
> > >
> > >
> > > --
> > > You receive this message as a subscriber of the [hidden email] mailing list.
> > > To unsubscribe: mailto:[hidden email]
> > > For general help: mailto:[hidden email]?subject=help
> > > ObjectWeb mailing lists service home page: http://www.objectweb.org/wws
> > >
> > >
> > >
> > >
> >
> >
> > --
> > Blog (XML, Web apps, Open Source):
> > http://www.orbeon.com/blog/
> >
>
>
> --
> Blog (XML, Web apps, Open Source):
> http://www.orbeon.com/blog/
>