Re: [WebDNA] Acceleratin Search / Index Performance in a Formum Service
This WebDNA talk-list message is from 2013
It keeps the original formatting.
numero = 110762
interpreted = N
texte = --Apple-Mail=_4ACAD495-920E-4F35-B45F-ECA8086C67D5 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=windows-1252 No, HDD /Palle On 02/10/2013, at 10.25, Lawrence Banahan
wrote: > SSD? >=20 > Le 2 oct. 2013 10:02, "Palle Bo Nielsen" a = =E9crit : > Hi Lawrence, >=20 > HDD with 8GB RAM >=20 > /Palle >=20 >=20 > On 02/10/2013, at 09.50, Lawrence Banahan wrote: >=20 >> Hi >> Do you have SSD drives on your server with plenty of ram? >> Lawrence >>=20 >> Le 2 oct. 2013 09:41, "Palle Bo Nielsen" a = =E9crit : >> Hi all, >>=20 >> Looking for advise to optimise a webpage using WebDNA and large DB's. >>=20 >> I have built a forum entirely in WebDNA and the DB's are getting big. = The main DB has the following characteristics=85 >>=20 >> - Columns: 11 >> - Rows: 847.121 >> - Size: 264 MB >>=20 >> If I display the different generic topics within the Forum and the = most recent Post within each category etc. then the code is executing = quite fast (acceptable performance). >>=20 >> But if I want to add the value of posts within each category or = within each thread then the performance is slowing the too much. >>=20 >> I have a category DB which eventually show 25 topics on the main page = of the forum, then I do a search into the main DB and search for all = posts with this categories ID and show the numFound. This is repeated = for every unique Topic. >>=20 >>=20 >>=20 >> << Searching for the Topics >> >> [search = db=3D/forum/db/db1.db&eqdb1_publishdata=3D1&asdb1_prioritysort=3D1&db1_pri= oritytype=3Dnum&AllReqd=3DT][founditems] >>=20 >> << Searching for the numFound Value - This One is Pulling a Lot of = Performance even though it's simple, but there is a lot of data to = search through >> >> [search = db=3D/forum/db/db4.db&eqdb4_publishdata=3D1&eqdb4_db1data=3D[db1_sku]&AllR= eqd=3DT][numFound][founditems][/founditems][/search] >>=20 >>=20 >>=20 >> I would appreciate any good advise or ideas on how to accelerate the = performance. Some kind of indexing to avoid live searching would be = great, but how? >>=20 >> /Palle >>=20 >> --------------------------------------------------------- >> This message is sent to you because you are subscribed to >> the mailing list . >> To unsubscribe, E-mail to: >> archives: http://mail.webdna.us/list/talk@webdna.us >> Bug Reporting: support@webdna.us >> --------------------------------------------------------- This = message is sent to you because you are subscribed to the mailing list . = To unsubscribe, E-mail to: archives: = http://mail.webdna.us/list/talk@webdna.us Bug Reporting: = support@webdna.us >=20 > --------------------------------------------------------- This message = is sent to you because you are subscribed to the mailing list . To = unsubscribe, E-mail to: archives: = http://mail.webdna.us/list/talk@webdna.us Bug Reporting: = support@webdna.us > --------------------------------------------------------- This message = is sent to you because you are subscribed to the mailing list . To = unsubscribe, E-mail to: archives: = http://mail.webdna.us/list/talk@webdna.us Bug Reporting: = support@webdna.us --Apple-Mail=_4ACAD495-920E-4F35-B45F-ECA8086C67D5 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=windows-1252 No, = HDD
/Palle
=
SSD?
Le 2 oct. 2013 10:02, "Palle Bo Nielsen" = <
powerpalle@powerpalle.dk> = a =E9crit :
Hi = Lawrence,
HDD with 8GB = RAM
/Palle
Hi
Do you have SSD drives on your server with plenty of ram?
Lawrence
Le 2 oct. 2013 09:41, "Palle Bo Nielsen" = <
powerpalle@powerpalle.dk> a =E9crit :
Hi all,
Looking for advise to optimise a webpage using WebDNA and large = DB's.
I have built a forum entirely in WebDNA and the DB's are getting big. = The main DB has the following characteristics=85
- Columns: 11
- Rows: 847.121
- Size: 264 MB
If I display the different generic topics within the Forum and the most = recent Post within each category etc. then the code is executing quite = fast (acceptable performance).
But if I want to add the value of posts within each category or within = each thread then the performance is slowing the too much.
I have a category DB which eventually show 25 topics on the main page of = the forum, then I do a search into the main DB and search for all posts = with this categories ID and show the numFound. This is repeated for = every unique Topic.
<< Searching for the Topics >>
[search = db=3D/forum/db/db1.db&eqdb1_publishdata=3D1&asdb1_prioritysort=3D1= &db1_prioritytype=3Dnum&AllReqd=3DT][founditems]
<< Searching for the numFound Value - This One is Pulling a Lot of = Performance even though it's simple, but there is a lot of data to = search through >>
[search = db=3D/forum/db/db4.db&eqdb4_publishdata=3D1&eqdb4_db1data=3D[db1_s= ku]&AllReqd=3DT][numFound][founditems][/founditems][/search]
I would appreciate any good advise or ideas on how to accelerate the = performance. Some kind of indexing to avoid live searching would be = great, but how?
/Palle
---------------------------------------------------------
This message is sent to you because you are subscribed to
the mailing list <talk@webdna.us>.
To unsubscribe, E-mail to: <talk-leave@webdna.us>
archives: http://mail.webdna.us/list/talk@webdna.us
Bug Reporting: support@webdna.us
--Apple-Mail=_4ACAD495-920E-4F35-B45F-ECA8086C67D5 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=windows-1252 No, HDD /Palle On 02/10/2013, at 10.25, Lawrence Banahan wrote: > SSD? >=20 > Le 2 oct. 2013 10:02, "Palle Bo Nielsen" a = =E9crit : > Hi Lawrence, >=20 > HDD with 8GB RAM >=20 > /Palle >=20 >=20 > On 02/10/2013, at 09.50, Lawrence Banahan wrote: >=20 >> Hi >> Do you have SSD drives on your server with plenty of ram? >> Lawrence >>=20 >> Le 2 oct. 2013 09:41, "Palle Bo Nielsen" a = =E9crit : >> Hi all, >>=20 >> Looking for advise to optimise a webpage using WebDNA and large DB's. >>=20 >> I have built a forum entirely in WebDNA and the DB's are getting big. = The main DB has the following characteristics=85 >>=20 >> - Columns: 11 >> - Rows: 847.121 >> - Size: 264 MB >>=20 >> If I display the different generic topics within the Forum and the = most recent Post within each category etc. then the code is executing = quite fast (acceptable performance). >>=20 >> But if I want to add the value of posts within each category or = within each thread then the performance is slowing the too much. >>=20 >> I have a category DB which eventually show 25 topics on the main page = of the forum, then I do a search into the main DB and search for all = posts with this categories ID and show the numFound. This is repeated = for every unique Topic. >>=20 >>=20 >>=20 >> << Searching for the Topics >> >> [search = db=3D/forum/db/db1.db&eqdb1_publishdata=3D1&asdb1_prioritysort=3D1&db1_pri= oritytype=3Dnum&AllReqd=3DT][founditems] >>=20 >> << Searching for the numFound Value - This One is Pulling a Lot of = Performance even though it's simple, but there is a lot of data to = search through >> >> [search = db=3D/forum/db/db4.db&eqdb4_publishdata=3D1&eqdb4_db1data=3D[db1_sku]&AllR= eqd=3DT][numFound][founditems][/founditems][/search] >>=20 >>=20 >>=20 >> I would appreciate any good advise or ideas on how to accelerate the = performance. Some kind of indexing to avoid live searching would be = great, but how? >>=20 >> /Palle >>=20 >> --------------------------------------------------------- >> This message is sent to you because you are subscribed to >> the mailing list . >> To unsubscribe, E-mail to: >> archives: http://mail.webdna.us/list/talk@webdna.us >> Bug Reporting: support@webdna.us >> --------------------------------------------------------- This = message is sent to you because you are subscribed to the mailing list . = To unsubscribe, E-mail to: archives: = http://mail.webdna.us/list/talk@webdna.us Bug Reporting: = support@webdna.us >=20 > --------------------------------------------------------- This message = is sent to you because you are subscribed to the mailing list . To = unsubscribe, E-mail to: archives: = http://mail.webdna.us/list/talk@webdna.us Bug Reporting: = support@webdna.us > --------------------------------------------------------- This message = is sent to you because you are subscribed to the mailing list . To = unsubscribe, E-mail to: archives: = http://mail.webdna.us/list/talk@webdna.us Bug Reporting: = support@webdna.us --Apple-Mail=_4ACAD495-920E-4F35-B45F-ECA8086C67D5 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=windows-1252 No, = HDD
/Palle
=
SSD?
Le 2 oct. 2013 10:02, "Palle Bo Nielsen" = <
powerpalle@powerpalle.dk> = a =E9crit :
Hi = Lawrence,
HDD with 8GB = RAM
/Palle
Hi
Do you have SSD drives on your server with plenty of ram?
Lawrence
Le 2 oct. 2013 09:41, "Palle Bo Nielsen" = <
powerpalle@powerpalle.dk> a =E9crit :
Hi all,
Looking for advise to optimise a webpage using WebDNA and large = DB's.
I have built a forum entirely in WebDNA and the DB's are getting big. = The main DB has the following characteristics=85
- Columns: 11
- Rows: 847.121
- Size: 264 MB
If I display the different generic topics within the Forum and the most = recent Post within each category etc. then the code is executing quite = fast (acceptable performance).
But if I want to add the value of posts within each category or within = each thread then the performance is slowing the too much.
I have a category DB which eventually show 25 topics on the main page of = the forum, then I do a search into the main DB and search for all posts = with this categories ID and show the numFound. This is repeated for = every unique Topic.
<< Searching for the Topics >>
[search = db=3D/forum/db/db1.db&eqdb1_publishdata=3D1&asdb1_prioritysort=3D1= &db1_prioritytype=3Dnum&AllReqd=3DT][founditems]
<< Searching for the numFound Value - This One is Pulling a Lot of = Performance even though it's simple, but there is a lot of data to = search through >>
[search = db=3D/forum/db/db4.db&eqdb4_publishdata=3D1&eqdb4_db1data=3D[db1_s= ku]&AllReqd=3DT][numFound][founditems][/founditems][/search]
I would appreciate any good advise or ideas on how to accelerate the = performance. Some kind of indexing to avoid live searching would be = great, but how?
/Palle
---------------------------------------------------------
This message is sent to you because you are subscribed to
the mailing list <talk@webdna.us>.
To unsubscribe, E-mail to: <talk-leave@webdna.us>
archives: http://mail.webdna.us/list/talk@webdna.us
Bug Reporting: support@webdna.us
DOWNLOAD WEBDNA NOW!
Top Articles:
Talk List
The WebDNA community talk-list is the best place to get some help: several hundred extremely proficient programmers with an excellent knowledge of WebDNA and an excellent spirit will deliver all the tips and tricks you can imagine...
Related Readings:
Weird bug, or is there something amiss? (1997)
[input] context (1999)
Word wrapping (1997)
SQL Changes in 3.0.7? (2000)
PCS Frames (1997)
WCS Newbie question (1997)
[Sum] function? (1997)
Re[2]: New syntax feedback for 4.0 (2000)
page redirect in webDNA (1997)
rn doesn't work on date fields (1998)
[LOOKUP] (1997)
Emailer (1998)
Pass Thru Page? (1998)
[GROUPS] followup (1997)
formatting dates from a field ... (1997)
Frames and cart values (1998)
Feature Request: ! character bug correct in [showif[variable]=] (2000)
Grep to convert characters to html entities (2006)
using showpage and showcart commands (1996)
Practice runs ? (1997)