strategy for searching and navigations with HUGE reference book (xml file)
Locked
 
|
I have a HUGE reference book, which it is impossible divide in a part. Prompt as the best strategy for realization of searching and navigations on this reference book.
Presently I do this by means of xpl-file in 4 stages: 1. reading the file with reference book data and transformation in instance 2. filtering/searching (xsl:copy-of) 3. sorting on necessary field (xsl:sort) 4. selection of the current range, example 20-30 (<xsl:copy-of select="REF/ITEM[position() > $srow and position() < $erow]"/>) This operations on reference book with 19 thousand items (the size of the file is 13 mb) are executed beside 30 seconds. Its slooooowly :( |
Re: strategy for searching and navigations with HUGE reference book (xml file)
|
Administrator
|
Maybe storing the data in eXist and querying information using XQuery
is the way to go? -Erik On Oct 6, 2008, at 10:52 PM, ????? wrote: > > I have a HUGE reference book, which it is impossible divide in a > part. Prompt > as the best strategy for realization of searching and navigations on > this > reference book. > Presently I do this by means of xpl-file in 4 stages: > 1. reading the file with reference book data and transformation in > instance > 2. filtering/searching (xsl:copy-of) > 3. sorting on necessary field (xsl:sort) > 4. selection of the current range, example 20-30 (<xsl:copy-of > select="REF/ITEM[position() > $srow and position() < $erow]"/>) > > This operations on reference book with 19 thousand items (the size > of the > file is 13 mb) are executed beside 30 seconds. Its slooooowly :( > -- > View this message in context: http://www.nabble.com/strategy-for-searching-and-navigations-with-HUGE-reference-book-%28xml-file%29-tp19851508p19851508.html > Sent from the ObjectWeb OPS - Users mailing list archive at > Nabble.com. > > > -- > You receive this message as a subscriber of the [hidden email] > mailing list. > To unsubscribe: mailto:[hidden email] > For general help: mailto:[hidden email]?subject=help > OW2 mailing lists service home page: http://www.ow2.org/wws Orbeon Forms - Web Forms for the Enterprise Done the Right Way http://www.orbeon.com/ -- You receive this message as a subscriber of the [hidden email] mailing list. To unsubscribe: mailto:[hidden email] For general help: mailto:[hidden email]?subject=help OW2 mailing lists service home page: http://www.ow2.org/wws |
|
|
Ok, I`ll try eXist. Please, prompt the way, as possible store the reference book in eXist at applications start?
|
Re: Re: strategy for searching and navigations with HUGE reference book (xml file)
|
Administrator
|
Do you mean when the whole web app starts, or when a given page is
loaded? -Erik On Oct 8, 2008, at 1:15 AM, ????? wrote: > > Ok, I`ll try eXist. Please, prompt the way, as possible store the > reference > book in eXist at applications start? > > > > Erik Bruchez wrote: >> >> Maybe storing the data in eXist and querying information using XQuery >> is the way to go? >> >> -Erik >> >> On Oct 6, 2008, at 10:52 PM, ????? wrote: >> >>> >>> I have a HUGE reference book, which it is impossible divide in a >>> part. Prompt >>> as the best strategy for realization of searching and navigations on >>> this >>> reference book. >>> Presently I do this by means of xpl-file in 4 stages: >>> 1. reading the file with reference book data and transformation in >>> instance >>> 2. filtering/searching (xsl:copy-of) >>> 3. sorting on necessary field (xsl:sort) >>> 4. selection of the current range, example 20-30 (<xsl:copy-of >>> select="REF/ITEM[position() > $srow and position() < $erow]"/ >>> >) >>> >>> This operations on reference book with 19 thousand items (the size >>> of the >>> file is 13 mb) are executed beside 30 seconds. Its slooooowly :( >>> -- >>> View this message in context: >>> http://www.nabble.com/strategy-for-searching-and-navigations-with-HUGE-reference-book-%28xml-file%29-tp19851508p19851508.html >>> Sent from the ObjectWeb OPS - Users mailing list archive at >>> Nabble.com. >>> >>> >>> -- >>> You receive this message as a subscriber of the [hidden email] >>> mailing list. >>> To unsubscribe: mailto:[hidden email] >>> For general help: mailto:[hidden email]?subject=help >>> OW2 mailing lists service home page: http://www.ow2.org/wws >> >> -- >> Orbeon Forms - Web Forms for the Enterprise Done the Right Way >> http://www.orbeon.com/ >> >> >> >> -- >> You receive this message as a subscriber of the [hidden email] >> mailing >> list. >> To unsubscribe: mailto:[hidden email] >> For general help: mailto:[hidden email]?subject=help >> OW2 mailing lists service home page: http://www.ow2.org/wws >> >> > > -- > View this message in context: http://www.nabble.com/strategy-for-searching-and-navigations-with-HUGE-reference-book-%28xml-file%29-tp19851508p19874362.html > Sent from the ObjectWeb OPS - Users mailing list archive at > Nabble.com. > > > -- > You receive this message as a subscriber of the [hidden email] > mailing list. > To unsubscribe: mailto:[hidden email] > For general help: mailto:[hidden email]?subject=help > OW2 mailing lists service home page: http://www.ow2.org/wws Orbeon Forms - Web Forms for the Enterprise Done the Right Way http://www.orbeon.com/ -- You receive this message as a subscriber of the [hidden email] mailing list. To unsubscribe: mailto:[hidden email] For general help: mailto:[hidden email]?subject=help OW2 mailing lists service home page: http://www.ow2.org/wws |
|
|
when the whole web app starts, once for all users and forms(pages).
store reference book in DB every time at opening of the form(page) - senselessly (i think :)).
|
Re: Re: Re: strategy for searching and navigations with HUGE reference book (xml file)
|
Administrator
|
You can run pipelines upon application initialization. Check:
RESOURCES/apps/context/context-initialized.xpl You could from there run the oxf:xforms-submission processor to load data into eXist. -Erik On Oct 9, 2008, at 11:33 PM, МОНАХ wrote: > > when the whole web app starts, once for all users and forms(pages). > store reference book in DB every time at opening of the form(page) - > senselessly (i think :)). > > > Erik Bruchez wrote: >> >> Do you mean when the whole web app starts, or when a given page is >> loaded? >> >> -Erik >> >> On Oct 8, 2008, at 1:15 AM, ????? wrote: >> >>> >>> Ok, I`ll try eXist. Please, prompt the way, as possible store the >>> reference >>> book in eXist at applications start? >>> >>> >>> >>> Erik Bruchez wrote: >>>> >>>> Maybe storing the data in eXist and querying information using >>>> XQuery >>>> is the way to go? >>>> >>>> -Erik >>>> >>>> On Oct 6, 2008, at 10:52 PM, ????? wrote: >>>> >>>>> >>>>> I have a HUGE reference book, which it is impossible divide in a >>>>> part. Prompt >>>>> as the best strategy for realization of searching and >>>>> navigations on >>>>> this >>>>> reference book. >>>>> Presently I do this by means of xpl-file in 4 stages: >>>>> 1. reading the file with reference book data and transformation in >>>>> instance >>>>> 2. filtering/searching (xsl:copy-of) >>>>> 3. sorting on necessary field (xsl:sort) >>>>> 4. selection of the current range, example 20-30 (<xsl:copy-of >>>>> select="REF/ITEM[position() > $srow and position() < >>>>> $erow]"/ >>>>>> ) >>>>> >>>>> This operations on reference book with 19 thousand items (the size >>>>> of the >>>>> file is 13 mb) are executed beside 30 seconds. Its slooooowly :( >>>>> -- >>>>> View this message in context: >>>>> http://www.nabble.com/strategy-for-searching-and-navigations-with-HUGE-reference-book-%28xml-file%29-tp19851508p19851508.html >>>>> Sent from the ObjectWeb OPS - Users mailing list archive at >>>>> Nabble.com. >>>>> >>>>> >>>>> -- >>>>> You receive this message as a subscriber of the [hidden email] >>>>> mailing list. >>>>> To unsubscribe: mailto:[hidden email] >>>>> For general help: mailto:[hidden email]?subject=help >>>>> OW2 mailing lists service home page: http://www.ow2.org/wws >>>> >>>> -- >>>> Orbeon Forms - Web Forms for the Enterprise Done the Right Way >>>> http://www.orbeon.com/ >>>> >>>> >>>> >>>> -- >>>> You receive this message as a subscriber of the [hidden email] >>>> mailing >>>> list. >>>> To unsubscribe: mailto:[hidden email] >>>> For general help: mailto:[hidden email]?subject=help >>>> OW2 mailing lists service home page: http://www.ow2.org/wws >>>> >>>> >>> >>> -- >>> View this message in context: >>> http://www.nabble.com/strategy-for-searching-and-navigations-with-HUGE-reference-book-%28xml-file%29-tp19851508p19874362.html >>> Sent from the ObjectWeb OPS - Users mailing list archive at >>> Nabble.com. >>> >>> >>> -- >>> You receive this message as a subscriber of the [hidden email] >>> mailing list. >>> To unsubscribe: mailto:[hidden email] >>> For general help: mailto:[hidden email]?subject=help >>> OW2 mailing lists service home page: http://www.ow2.org/wws >> >> -- >> Orbeon Forms - Web Forms for the Enterprise Done the Right Way >> http://www.orbeon.com/ >> >> >> >> -- >> You receive this message as a subscriber of the [hidden email] >> mailing >> list. >> To unsubscribe: mailto:[hidden email] >> For general help: mailto:[hidden email]?subject=help >> OW2 mailing lists service home page: http://www.ow2.org/wws >> >> > > -- > View this message in context: http://www.nabble.com/strategy-for-searching-and-navigations-with-HUGE-reference-book-%28xml-file%29-tp19851508p19912754.html > Sent from the ObjectWeb OPS - Users mailing list archive at > Nabble.com. > > > -- > You receive this message as a subscriber of the [hidden email] > mailing list. > To unsubscribe: mailto:[hidden email] > For general help: mailto:[hidden email]?subject=help > OW2 mailing lists service home page: http://www.ow2.org/wws Orbeon Forms - Web Forms for the Enterprise Done the Right Way http://www.orbeon.com/ -- You receive this message as a subscriber of the [hidden email] mailing list. To unsubscribe: mailto:[hidden email] For general help: mailto:[hidden email]?subject=help OW2 mailing lists service home page: http://www.ow2.org/wws |
|
|
Thank you for advice.
The Summary account on use eXist DB for reference book with 182 thousand rows (items) running time to operations of searching for of the substring, sorting and choice of the necessary range occupies about 4-5 seconds (P4 3.2GHz, 3 mb ram)
|
«
Return to Orbeon Forms community mailing list
|
1 view|%1 views
| Free forum by Nabble | Edit this page |