Re: Table code broken?
This WebDNA talk-list message is from 2004
It keeps the original formatting.
numero = 60399
interpreted = N
texte = Thanks :)On 09/12/2004, at 10:34 AM, Scott Anderson wrote:> No, that value sets the maximum number of databases files that can be > cached> at any given moment.>> -----Original Message-----> From: WebDNA Talk [mailto:WebDNA-Talk@talk.smithmicro.com]On Behalf Of> Stuart Tremain> Sent: Wednesday, December 08, 2004 02:36 PM> To: WebDNA Talk> Subject: Re: Table code broken?>>> Scott>> Is that 100 = 100mb ?>>>> On 09/12/2004, at 8:15 AM, Scott Anderson wrote:>>> Just FYI...>>>> In the case where you find yourself needing to generating several>> temporary>> databases, you may want to take a look at your WebDNA 'CacheSizePrefs'>> file>> (introduced in WebDNA 4.5.1). WebDNA uses the settings in this file>> to set>> the size of the database and template caches, when starting up. The>> 'stock'>> settings are:>>>> DatabasesCacheSize100>> TemplatesCacheSize100>>>> This file is located in the WebCatalogEngine folder. The WebDNA>> process>> must be restarted for the changes to take effect.>>>> Given the increasing amounts of RAM installed on servers these days,>> you can>> probably bump up the DatabasesCacheSize setting. This should reduce>> the>> amount of db swapping that WebDNA will be doing if the number of open>> databases frequently reaches the cache size limit. Be careful when>> increasing these values, as WebDNA does not currently handle the case>> where>> the increased number of databases does not fit in available RAM.>> Perhaps>> start at 150, then 175, and so on. If you find several error log>> entries>> where WebDNA failed to open a db due to lack of available RAM, then>> back>> down the cache size.>>>> -----Original Message----->> From: WebDNA Talk [mailto:WebDNA-Talk@talk.smithmicro.com]On Behalf Of>> devaulw@onebox.com>> Sent: Wednesday, December 08, 2004 12:41 PM>> To: WebDNA Talk>> Subject: Re: Table code broken?>>>>>> Thanks for looking into this - I was pulling my hair out at 3am on>> this one.>> I was looking for a workaround to a temp database. I wanted to avoid>> disk>> writes and the possiblity of two people creating the same temp>> database as>> the same time.>>>> Perhaps I will keep tables for working sets of search results and>> rename the>> temp database to a cart name. There still is possibility of many db's>> open>> at the same time.>>>> Eventually I will move data to a permanent database, but WebDNA is so>> fast>> at creating these db's on the fly...>>>> Bill>>>>>> -----Original Message----->> From: Scott Anderson
>> Sent: Wed, 8 Dec 2004 12:17:37 -0800>> To: "WebDNA Talk" >> Subject: Re: Table code broken?>>>> There is no intentional limitation on table size. Available memory>> should>> be the only factor in limiting a table size. I'll take a closer look>> at the>> code to see if any other conditions exists that may limit the number >> of>> records a table can hold.>>>> On a side note: The table context was created as a convenient way of>> storing and manipulating smaller sets of data. Although storing>> thousands>> of records in a table should not be a problem, this can become quite>> taxing>> on your system resources if several request threads are creating>> multiple>> instances of large tables. In addition to all the WebDNA databases>> that are>> already cached in RAM, each WebDNA request thread maintains its own>> list of>> table objects. There currently is no way to 'share' a table resource>> between threads.>>>> -----Original Message----->> From: WebDNA Talk [mailto:WebDNA-Talk@talk.smithmicro.com]On Behalf Of>> devaulw@onebox.com>> Sent: Wednesday, December 08, 2004 11:30 AM>> To: WebDNA Talk>> Subject: Re: Table code broken?>>>>>> OK, these are identical in structure except for the directory or the>> number>> of dates. I assure you that there is a /Orders/ path on this server>> (with>> fewer than 10k order files in it). If I limit the number of entries>> to the>> table by restricting the date (SET 2 below), the problem disappears>> for the>> /Orders/ folder. See the three sets of code below for what works/what>> doesn't.>>>> Is there a limit to either the number of entries in a table or the>> size of a>> table? There's no limit mentioned in the docs and there should be>> plenty of>> room to handle this on the server.>>>> Thanks,>> Bill>>>> SET 1 THIS WORKS:>> [table name=tab&fields=ONO,DACR][/table]>> [listfiles path=/]>> [append>> table=tab]ONO=[url][filename][/url]&DACR=[url][moddate][/url][/append]>> [/listfiles]>> [search table=tab&neDACRdatarq=[blank]]>> [founditems][ONO] [DACR]
[/founditems]>> [/search]>>>> SET 2 THIS DATE RESTRICTED VERSION WORKS:>> [table name=tab&fields=ONO,DACR][/table]>> [listfiles path=/Orders]>> [showif [math]{[moddate]}[/math]>[math]{[date]}-30[/math]]>> [append>> table=tab]ONO=[url][filename][/url]&DACR=[url][moddate][/url][/append]>> [/showif]>> [/listfiles]>>>> SET 3 THIS UNRESTRICTED VERSION SHOWS NOTHING!>> [table name=tab&fields=ONO,DACR][/table]>> [listfiles path=/Orders/]>> [append>> table=tab]ONO=[url][filename][/url]&DACR=[url][moddate][/url][/append]>> [/listfiles]>>>>>>>> ------------------------------------------------------------->> This message is sent to you because you are subscribed to>> the mailing list .>> To unsubscribe, E-mail to: >> To switch to the DIGEST mode, E-mail to>> >> Web Archive of this list is at: http://webdna.smithmicro.com/>>>>>> ------------------------------------------------------------->> This message is sent to you because you are subscribed to>> the mailing list .>> To unsubscribe, E-mail to: >> To switch to the DIGEST mode, E-mail to>> >> Web Archive of this list is at: http://webdna.smithmicro.com/>>>>>>>> ------------------------------------------------------------->> This message is sent to you because you are subscribed to>> the mailing list .>> To unsubscribe, E-mail to: >> To switch to the DIGEST mode, E-mail to>> >> Web Archive of this list is at: http://webdna.smithmicro.com/>>>>>> ------------------------------------------------------------->> This message is sent to you because you are subscribed to>> the mailing list .>> To unsubscribe, E-mail to: >> To switch to the DIGEST mode, E-mail to>> >> Web Archive of this list is at: http://webdna.smithmicro.com/>>>>> Regards>> Stuart Tremain> idfk web developments> 114a/40 yeo street neutral bay 2089 australia> t +612 9908 2134> f +612 9908 4837>>> -------------------------------------------------------------> This message is sent to you because you are subscribed to> the mailing list .> To unsubscribe, E-mail to: > To switch to the DIGEST mode, E-mail to> > Web Archive of this list is at: http://webdna.smithmicro.com/>>> -------------------------------------------------------------> This message is sent to you because you are subscribed to> the mailing list .> To unsubscribe, E-mail to: > To switch to the DIGEST mode, E-mail to > > Web Archive of this list is at: http://webdna.smithmicro.com/>>RegardsStuart Tremainidfk web developments114a/40 yeo street neutral bay 2089 australiat +612 9908 2134f +612 9908 4837-------------------------------------------------------------This message is sent to you because you are subscribed to the mailing list .To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to Web Archive of this list is at: http://webdna.smithmicro.com/
Associated Messages, from the most recent to the oldest:
Thanks :)On 09/12/2004, at 10:34 AM, Scott Anderson wrote:> No, that value sets the maximum number of databases files that can be > cached> at any given moment.>> -----Original Message-----> From: WebDNA Talk [mailto:WebDNA-Talk@talk.smithmicro.com]On Behalf Of> Stuart Tremain> Sent: Wednesday, December 08, 2004 02:36 PM> To: WebDNA Talk> Subject: Re: Table code broken?>>> Scott>> Is that 100 = 100mb ?>>>> On 09/12/2004, at 8:15 AM, Scott Anderson wrote:>>> Just FYI...>>>> In the case where you find yourself needing to generating several>> temporary>> databases, you may want to take a look at your WebDNA 'CacheSizePrefs'>> file>> (introduced in WebDNA 4.5.1). WebDNA uses the settings in this file>> to set>> the size of the database and template caches, when starting up. The>> 'stock'>> settings are:>>>> DatabasesCacheSize100>> TemplatesCacheSize100>>>> This file is located in the WebCatalogEngine folder. The WebDNA>> process>> must be restarted for the changes to take effect.>>>> Given the increasing amounts of RAM installed on servers these days,>> you can>> probably bump up the DatabasesCacheSize setting. This should reduce>> the>> amount of db swapping that WebDNA will be doing if the number of open>> databases frequently reaches the cache size limit. Be careful when>> increasing these values, as WebDNA does not currently handle the case>> where>> the increased number of databases does not fit in available RAM.>> Perhaps>> start at 150, then 175, and so on. If you find several error log>> entries>> where WebDNA failed to open a db due to lack of available RAM, then>> back>> down the cache size.>>>> -----Original Message----->> From: WebDNA Talk [mailto:WebDNA-Talk@talk.smithmicro.com]On Behalf Of>> devaulw@onebox.com>> Sent: Wednesday, December 08, 2004 12:41 PM>> To: WebDNA Talk>> Subject: Re: Table code broken?>>>>>> Thanks for looking into this - I was pulling my hair out at 3am on>> this one.>> I was looking for a workaround to a temp database. I wanted to avoid>> disk>> writes and the possiblity of two people creating the same temp>> database as>> the same time.>>>> Perhaps I will keep tables for working sets of search results and>> rename the>> temp database to a cart name. There still is possibility of many db's>> open>> at the same time.>>>> Eventually I will move data to a permanent database, but WebDNA is so>> fast>> at creating these db's on the fly...>>>> Bill>>>>>> -----Original Message----->> From: Scott Anderson >> Sent: Wed, 8 Dec 2004 12:17:37 -0800>> To: "WebDNA Talk" >> Subject: Re: Table code broken?>>>> There is no intentional limitation on table size. Available memory>> should>> be the only factor in limiting a table size. I'll take a closer look>> at the>> code to see if any other conditions exists that may limit the number >> of>> records a table can hold.>>>> On a side note: The table context was created as a convenient way of>> storing and manipulating smaller sets of data. Although storing>> thousands>> of records in a table should not be a problem, this can become quite>> taxing>> on your system resources if several request threads are creating>> multiple>> instances of large tables. In addition to all the WebDNA databases>> that are>> already cached in RAM, each WebDNA request thread maintains its own>> list of>> table objects. There currently is no way to 'share' a table resource>> between threads.>>>> -----Original Message----->> From: WebDNA Talk [mailto:WebDNA-Talk@talk.smithmicro.com]On Behalf Of>> devaulw@onebox.com>> Sent: Wednesday, December 08, 2004 11:30 AM>> To: WebDNA Talk>> Subject: Re: Table code broken?>>>>>> OK, these are identical in structure except for the directory or the>> number>> of dates. I assure you that there is a /Orders/ path on this server>> (with>> fewer than 10k order files in it). If I limit the number of entries>> to the>> table by restricting the date (SET 2 below), the problem disappears>> for the>> /Orders/ folder. See the three sets of code below for what works/what>> doesn't.>>>> Is there a limit to either the number of entries in a table or the>> size of a>> table? There's no limit mentioned in the docs and there should be>> plenty of>> room to handle this on the server.>>>> Thanks,>> Bill>>>> SET 1 THIS WORKS:>> [table name=tab&fields=ONO,DACR][/table]>> [listfiles path=/]>> [append>> table=tab]ONO=[url][filename][/url]&DACR=[url][moddate][/url][/append]>> [/listfiles]>> [search table=tab&neDACRdatarq=[blank]]>> [founditems][ONO] [DACR]
[/founditems]>> [/search]>>>> SET 2 THIS DATE RESTRICTED VERSION WORKS:>> [table name=tab&fields=ONO,DACR][/table]>> [listfiles path=/Orders]>> [showif [math]{[moddate]}[/math]>[math]{[date]}-30[/math]]>> [append>> table=tab]ONO=[url][filename][/url]&DACR=[url][moddate][/url][/append]>> [/showif]>> [/listfiles]>>>> SET 3 THIS UNRESTRICTED VERSION SHOWS NOTHING!>> [table name=tab&fields=ONO,DACR][/table]>> [listfiles path=/Orders/]>> [append>> table=tab]ONO=[url][filename][/url]&DACR=[url][moddate][/url][/append]>> [/listfiles]>>>>>>>> ------------------------------------------------------------->> This message is sent to you because you are subscribed to>> the mailing list .>> To unsubscribe, E-mail to: >> To switch to the DIGEST mode, E-mail to>> >> Web Archive of this list is at: http://webdna.smithmicro.com/>>>>>> ------------------------------------------------------------->> This message is sent to you because you are subscribed to>> the mailing list .>> To unsubscribe, E-mail to: >> To switch to the DIGEST mode, E-mail to>> >> Web Archive of this list is at: http://webdna.smithmicro.com/>>>>>>>> ------------------------------------------------------------->> This message is sent to you because you are subscribed to>> the mailing list .>> To unsubscribe, E-mail to: >> To switch to the DIGEST mode, E-mail to>> >> Web Archive of this list is at: http://webdna.smithmicro.com/>>>>>> ------------------------------------------------------------->> This message is sent to you because you are subscribed to>> the mailing list .>> To unsubscribe, E-mail to: >> To switch to the DIGEST mode, E-mail to>> >> Web Archive of this list is at: http://webdna.smithmicro.com/>>>>> Regards>> Stuart Tremain> idfk web developments> 114a/40 yeo street neutral bay 2089 australia> t +612 9908 2134> f +612 9908 4837>>> -------------------------------------------------------------> This message is sent to you because you are subscribed to> the mailing list .> To unsubscribe, E-mail to: > To switch to the DIGEST mode, E-mail to> > Web Archive of this list is at: http://webdna.smithmicro.com/>>> -------------------------------------------------------------> This message is sent to you because you are subscribed to> the mailing list .> To unsubscribe, E-mail to: > To switch to the DIGEST mode, E-mail to > > Web Archive of this list is at: http://webdna.smithmicro.com/>>RegardsStuart Tremainidfk web developments114a/40 yeo street neutral bay 2089 australiat +612 9908 2134f +612 9908 4837-------------------------------------------------------------This message is sent to you because you are subscribed to the mailing list .To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to Web Archive of this list is at: http://webdna.smithmicro.com/
Stuart Tremain
DOWNLOAD WEBDNA NOW!
Top Articles:
Talk List
The WebDNA community talk-list is the best place to get some help: several hundred extremely proficient programmers with an excellent knowledge of WebDNA and an excellent spirit will deliver all the tips and tricks you can imagine...
Related Readings:
Viewing old carts (was FEW QUESTIONS) (1997)
http or https (2005)
getchars broken? (1997)
# fields limited? (1997)
bug in [SendMail] (1997)
Exclude by date - multiple (1997)
A multi-processor savvy WebCatalog? (1997)
webcat- multiple selection in input field (1997)
OT - Javascript anyone? (2004)
problems with 2 tags shakur (1997)
Generating Searches on the fly? (1999)
Keep away (1997)
Cookies and webcat (1997)
ups quickcost [repost] (1999)
A Function question... about remembering (2004)
WebMerchant problem (1998)
Showing unopened cart (1997)
FIXED: Showing Results Alphabetically in Columns (top tobottom) (2002)
Using [purchase] (1998)
Sendmail doesn't (was Queertrons?) (1997)