Re: [WebDNA] A new popuated field to a DB with 700.000 records
This WebDNA talk-list message is from 2009
It keeps the original formatting.
numero = 104105
interpreted = N
texte = I am not sure about it. You can unckeck the "Automatically commit = databases to disk after modification", use the "Activity Monitor" to = visualize the disk activity and prefer [replacefounditems] (without the = "[founditems]" context) which is much faster than [replace] Something like [search db=3Dl4.db&nel4_statusdata=3Ddummy&asl4_serialsort=3D1] [replacefounditems]l4_index=3D[index][/replacefounditems] [/search] (http://www.webdna.us/page.dna?numero=3D211) Please tell us what results you get. thanks! - chris On Dec 3, 2009, at 17:31, Palle Bo Nielsen wrote: > Hi Chris, >=20 > DB size is 96 MB and the Automatically Commit to Databases to Disk = after Modification is enabled and in works fine under normal operations = but I can see where you are getting if you need to write to 700.000 = records in one process. Actually, will it write once or 700.000 times in = such a process? >=20 > Mac OS X Server 10.5.8 > 8 GB RAM > 2x2.8 GHz Quad Core Intel Xeon >=20 > Palle >=20 >=20 > On 03/12/2009, at 14.07, christophe.billiottet@webdna.us wrote: >=20 >> Palle, just curiosity: what size (MB) is your 700,000 records = database? is the "Automatically commit databases to disk after = modification" checked in your preferences? what version of WebDNA are = you running and what is the hardware (CPU/RAM) ? >>=20 >> thank you! >> - chris >>=20 >>=20 >> On Dec 2, 2009, at 18:27, Palle Bo Nielsen wrote: >>=20 >>> Hi all, >>>=20 >>> I got a DB which has 11 fields and more that 700.000 lines of data. >>>=20 >>> Now I need to add a new field and I need to populate this field with = an index from the number 1 to the most recent number which for example = is 700.000. >>>=20 >>> The number 1 is the first lines of data within this BD and the = 700.000 is the most recent added line of data. >>>=20 >>> If have done some test and sand-boxing and every time WebDNA goes = into it's knees. >>>=20 >>> I need some good advise from you all to figure out the best = solution. >>>=20 >>> I look forward to your suggestions. >>>=20 >>> **** this one is rough and breaks WebDNA **** >>> [search = db=3Dl4.db&nel4_statusdata=3Ddummy&asl4_serialsort=3D1][numFound][foundIte= ms] >>> [replace db=3Dl4.db&eql4_skudata=3D[l4_sku]]l4_index=3D[index][/replac= e] >>> [/foundItems][/search] >>> **** snip **** >>>=20 >>>=20 >>> Palle--------------------------------------------------------- >>> This message is sent to you because you are subscribed to >>> the mailing list
. >>> To unsubscribe, E-mail to: >>> archives: http://mail.webdna.us/list/talk@webdna.us >>> old archives: http://dev.webdna.us/TalkListArchive/ >>> Bug Reporting: = http://forum.webdna.us/eucabb.html?page=3Dtopics&category=3D288 >>=20 >> --------------------------------------------------------- >> This message is sent to you because you are subscribed to >> the mailing list . >> To unsubscribe, E-mail to: >> archives: http://mail.webdna.us/list/talk@webdna.us >> old archives: http://dev.webdna.us/TalkListArchive/ >> Bug Reporting: = http://forum.webdna.us/eucabb.html?page=3Dtopics&category=3D288 >>=20 >=20 > --------------------------------------------------------- > This message is sent to you because you are subscribed to > the mailing list . > To unsubscribe, E-mail to: > archives: http://mail.webdna.us/list/talk@webdna.us > old archives: http://dev.webdna.us/TalkListArchive/ > Bug Reporting: = http://forum.webdna.us/eucabb.html?page=3Dtopics&category=3D288
Associated Messages, from the most recent to the oldest:
I am not sure about it. You can unckeck the "Automatically commit = databases to disk after modification", use the "Activity Monitor" to = visualize the disk activity and prefer [replacefounditems] (without the = "[founditems]" context) which is much faster than [replace] Something like [search db=3Dl4.db&nel4_statusdata=3Ddummy&asl4_serialsort=3D1] [replacefounditems]l4_index=3D[index][/replacefounditems] [/search] (http://www.webdna.us/page.dna?numero=3D211) Please tell us what results you get. thanks! - chris On Dec 3, 2009, at 17:31, Palle Bo Nielsen wrote: > Hi Chris, >=20 > DB size is 96 MB and the Automatically Commit to Databases to Disk = after Modification is enabled and in works fine under normal operations = but I can see where you are getting if you need to write to 700.000 = records in one process. Actually, will it write once or 700.000 times in = such a process? >=20 > Mac OS X Server 10.5.8 > 8 GB RAM > 2x2.8 GHz Quad Core Intel Xeon >=20 > Palle >=20 >=20 > On 03/12/2009, at 14.07, christophe.billiottet@webdna.us wrote: >=20 >> Palle, just curiosity: what size (MB) is your 700,000 records = database? is the "Automatically commit databases to disk after = modification" checked in your preferences? what version of WebDNA are = you running and what is the hardware (CPU/RAM) ? >>=20 >> thank you! >> - chris >>=20 >>=20 >> On Dec 2, 2009, at 18:27, Palle Bo Nielsen wrote: >>=20 >>> Hi all, >>>=20 >>> I got a DB which has 11 fields and more that 700.000 lines of data. >>>=20 >>> Now I need to add a new field and I need to populate this field with = an index from the number 1 to the most recent number which for example = is 700.000. >>>=20 >>> The number 1 is the first lines of data within this BD and the = 700.000 is the most recent added line of data. >>>=20 >>> If have done some test and sand-boxing and every time WebDNA goes = into it's knees. >>>=20 >>> I need some good advise from you all to figure out the best = solution. >>>=20 >>> I look forward to your suggestions. >>>=20 >>> **** this one is rough and breaks WebDNA **** >>> [search = db=3Dl4.db&nel4_statusdata=3Ddummy&asl4_serialsort=3D1][numFound][foundIte= ms] >>> [replace db=3Dl4.db&eql4_skudata=3D[l4_sku]]l4_index=3D[index][/replac= e] >>> [/foundItems][/search] >>> **** snip **** >>>=20 >>>=20 >>> Palle--------------------------------------------------------- >>> This message is sent to you because you are subscribed to >>> the mailing list . >>> To unsubscribe, E-mail to: >>> archives: http://mail.webdna.us/list/talk@webdna.us >>> old archives: http://dev.webdna.us/TalkListArchive/ >>> Bug Reporting: = http://forum.webdna.us/eucabb.html?page=3Dtopics&category=3D288 >>=20 >> --------------------------------------------------------- >> This message is sent to you because you are subscribed to >> the mailing list . >> To unsubscribe, E-mail to: >> archives: http://mail.webdna.us/list/talk@webdna.us >> old archives: http://dev.webdna.us/TalkListArchive/ >> Bug Reporting: = http://forum.webdna.us/eucabb.html?page=3Dtopics&category=3D288 >>=20 >=20 > --------------------------------------------------------- > This message is sent to you because you are subscribed to > the mailing list . > To unsubscribe, E-mail to: > archives: http://mail.webdna.us/list/talk@webdna.us > old archives: http://dev.webdna.us/TalkListArchive/ > Bug Reporting: = http://forum.webdna.us/eucabb.html?page=3Dtopics&category=3D288
christophe.billiottet@webdna.us
DOWNLOAD WEBDNA NOW!
Top Articles:
Talk List
The WebDNA community talk-list is the best place to get some help: several hundred extremely proficient programmers with an excellent knowledge of WebDNA and an excellent spirit will deliver all the tips and tricks you can imagine...
Related Readings:
[/application] error? (1997)
Server Freeze (1998)
[WebDNA] Convertchars Weirdness (2014)
easy numfound search? (2001)
WebCat editing, SiteGuard & SiteEdit (1997)
a new bug? (1999)
Help! WebCat2 bug (1997)
ConvertWords (2002)
Feature Request: [moverecord] (2003)
[WebDNA] Need Rosetta to install on OS X? (2010)
[writefile] (1997)
WebCat2 several catalogs? (1997)
Frames and WebCat (1997)
multipart (2004)
Need relative path explanation (1997)
WebCat2b13MacPlugIn - [shownext method=post] ??? (1997)
Hosts who have upgraded to v5.0? (2003)
PowerKey and PageSentry not playing nice (2000)
Search returns all, not 20 (1997)
Nesting WebDNA in JavaScript (2003)