Re: [WebDNA] A new popuated field to a DB with 700.000 records
This WebDNA talk-list message is from 2009
It keeps the original formatting.
numero = 104106
interpreted = N
texte = Hi Chris, This one did the trick in a jimmy. Almost no waitingtime (less than 15 = seconds). No change to the commit to disk or anything... So, thanks a lot. --- snip --- [search db=3Dl4.db&nel4_statusdata=3Ddummy&asl4_serialsort=3D1] [replacefounditems]l4_index=3D[index][/replacefounditems] [/search] --- snip --- On 03/12/2009, at 20.52, christophe.billiottet@webdna.us wrote: > I am not sure about it. You can unckeck the "Automatically commit = databases to disk after modification", use the "Activity Monitor" to = visualize the disk activity and prefer [replacefounditems] (without the = "[founditems]" context) which is much faster than [replace] > Something like >=20 > [search db=3Dl4.db&nel4_statusdata=3Ddummy&asl4_serialsort=3D1] > [replacefounditems]l4_index=3D[index][/replacefounditems] > [/search] >=20 > (http://www.webdna.us/page.dna?numero=3D211) >=20 > Please tell us what results you get. >=20 > thanks! > - chris >=20 >=20 >=20 > On Dec 3, 2009, at 17:31, Palle Bo Nielsen wrote: >=20 >> Hi Chris, >>=20 >> DB size is 96 MB and the Automatically Commit to Databases to Disk = after Modification is enabled and in works fine under normal operations = but I can see where you are getting if you need to write to 700.000 = records in one process. Actually, will it write once or 700.000 times in = such a process? >>=20 >> Mac OS X Server 10.5.8 >> 8 GB RAM >> 2x2.8 GHz Quad Core Intel Xeon >>=20 >> Palle >>=20 >>=20 >> On 03/12/2009, at 14.07, christophe.billiottet@webdna.us wrote: >>=20 >>> Palle, just curiosity: what size (MB) is your 700,000 records = database? is the "Automatically commit databases to disk after = modification" checked in your preferences? what version of WebDNA are = you running and what is the hardware (CPU/RAM) ? >>>=20 >>> thank you! >>> - chris >>>=20 >>>=20 >>> On Dec 2, 2009, at 18:27, Palle Bo Nielsen wrote: >>>=20 >>>> Hi all, >>>>=20 >>>> I got a DB which has 11 fields and more that 700.000 lines of data. >>>>=20 >>>> Now I need to add a new field and I need to populate this field = with an index from the number 1 to the most recent number which for = example is 700.000. >>>>=20 >>>> The number 1 is the first lines of data within this BD and the = 700.000 is the most recent added line of data. >>>>=20 >>>> If have done some test and sand-boxing and every time WebDNA goes = into it's knees. >>>>=20 >>>> I need some good advise from you all to figure out the best = solution. >>>>=20 >>>> I look forward to your suggestions. >>>>=20 >>>> **** this one is rough and breaks WebDNA **** >>>> [search = db=3Dl4.db&nel4_statusdata=3Ddummy&asl4_serialsort=3D1][numFound][foundIte= ms] >>>> [replace db=3Dl4.db&eql4_skudata=3D[l4_sku]]l4_index=3D[index][/repla= ce] >>>> [/foundItems][/search] >>>> **** snip **** >>>>=20 >>>>=20 >>>> Palle--------------------------------------------------------- >>>> This message is sent to you because you are subscribed to >>>> the mailing list
. >>>> To unsubscribe, E-mail to: >>>> archives: http://mail.webdna.us/list/talk@webdna.us >>>> old archives: http://dev.webdna.us/TalkListArchive/ >>>> Bug Reporting: = http://forum.webdna.us/eucabb.html?page=3Dtopics&category=3D288 >>>=20 >>> --------------------------------------------------------- >>> This message is sent to you because you are subscribed to >>> the mailing list . >>> To unsubscribe, E-mail to: >>> archives: http://mail.webdna.us/list/talk@webdna.us >>> old archives: http://dev.webdna.us/TalkListArchive/ >>> Bug Reporting: = http://forum.webdna.us/eucabb.html?page=3Dtopics&category=3D288 >>>=20 >>=20 >> --------------------------------------------------------- >> This message is sent to you because you are subscribed to >> the mailing list . >> To unsubscribe, E-mail to: >> archives: http://mail.webdna.us/list/talk@webdna.us >> old archives: http://dev.webdna.us/TalkListArchive/ >> Bug Reporting: = http://forum.webdna.us/eucabb.html?page=3Dtopics&category=3D288 >=20 > --------------------------------------------------------- > This message is sent to you because you are subscribed to > the mailing list . > To unsubscribe, E-mail to: > archives: http://mail.webdna.us/list/talk@webdna.us > old archives: http://dev.webdna.us/TalkListArchive/ > Bug Reporting: = http://forum.webdna.us/eucabb.html?page=3Dtopics&category=3D288 >=20
Associated Messages, from the most recent to the oldest:
Hi Chris, This one did the trick in a jimmy. Almost no waitingtime (less than 15 = seconds). No change to the commit to disk or anything... So, thanks a lot. --- snip --- [search db=3Dl4.db&nel4_statusdata=3Ddummy&asl4_serialsort=3D1] [replacefounditems]l4_index=3D[index][/replacefounditems] [/search] --- snip --- On 03/12/2009, at 20.52, christophe.billiottet@webdna.us wrote: > I am not sure about it. You can unckeck the "Automatically commit = databases to disk after modification", use the "Activity Monitor" to = visualize the disk activity and prefer [replacefounditems] (without the = "[founditems]" context) which is much faster than [replace] > Something like >=20 > [search db=3Dl4.db&nel4_statusdata=3Ddummy&asl4_serialsort=3D1] > [replacefounditems]l4_index=3D[index][/replacefounditems] > [/search] >=20 > (http://www.webdna.us/page.dna?numero=3D211) >=20 > Please tell us what results you get. >=20 > thanks! > - chris >=20 >=20 >=20 > On Dec 3, 2009, at 17:31, Palle Bo Nielsen wrote: >=20 >> Hi Chris, >>=20 >> DB size is 96 MB and the Automatically Commit to Databases to Disk = after Modification is enabled and in works fine under normal operations = but I can see where you are getting if you need to write to 700.000 = records in one process. Actually, will it write once or 700.000 times in = such a process? >>=20 >> Mac OS X Server 10.5.8 >> 8 GB RAM >> 2x2.8 GHz Quad Core Intel Xeon >>=20 >> Palle >>=20 >>=20 >> On 03/12/2009, at 14.07, christophe.billiottet@webdna.us wrote: >>=20 >>> Palle, just curiosity: what size (MB) is your 700,000 records = database? is the "Automatically commit databases to disk after = modification" checked in your preferences? what version of WebDNA are = you running and what is the hardware (CPU/RAM) ? >>>=20 >>> thank you! >>> - chris >>>=20 >>>=20 >>> On Dec 2, 2009, at 18:27, Palle Bo Nielsen wrote: >>>=20 >>>> Hi all, >>>>=20 >>>> I got a DB which has 11 fields and more that 700.000 lines of data. >>>>=20 >>>> Now I need to add a new field and I need to populate this field = with an index from the number 1 to the most recent number which for = example is 700.000. >>>>=20 >>>> The number 1 is the first lines of data within this BD and the = 700.000 is the most recent added line of data. >>>>=20 >>>> If have done some test and sand-boxing and every time WebDNA goes = into it's knees. >>>>=20 >>>> I need some good advise from you all to figure out the best = solution. >>>>=20 >>>> I look forward to your suggestions. >>>>=20 >>>> **** this one is rough and breaks WebDNA **** >>>> [search = db=3Dl4.db&nel4_statusdata=3Ddummy&asl4_serialsort=3D1][numFound][foundIte= ms] >>>> [replace db=3Dl4.db&eql4_skudata=3D[l4_sku]]l4_index=3D[index][/repla= ce] >>>> [/foundItems][/search] >>>> **** snip **** >>>>=20 >>>>=20 >>>> Palle--------------------------------------------------------- >>>> This message is sent to you because you are subscribed to >>>> the mailing list . >>>> To unsubscribe, E-mail to: >>>> archives: http://mail.webdna.us/list/talk@webdna.us >>>> old archives: http://dev.webdna.us/TalkListArchive/ >>>> Bug Reporting: = http://forum.webdna.us/eucabb.html?page=3Dtopics&category=3D288 >>>=20 >>> --------------------------------------------------------- >>> This message is sent to you because you are subscribed to >>> the mailing list . >>> To unsubscribe, E-mail to: >>> archives: http://mail.webdna.us/list/talk@webdna.us >>> old archives: http://dev.webdna.us/TalkListArchive/ >>> Bug Reporting: = http://forum.webdna.us/eucabb.html?page=3Dtopics&category=3D288 >>>=20 >>=20 >> --------------------------------------------------------- >> This message is sent to you because you are subscribed to >> the mailing list . >> To unsubscribe, E-mail to: >> archives: http://mail.webdna.us/list/talk@webdna.us >> old archives: http://dev.webdna.us/TalkListArchive/ >> Bug Reporting: = http://forum.webdna.us/eucabb.html?page=3Dtopics&category=3D288 >=20 > --------------------------------------------------------- > This message is sent to you because you are subscribed to > the mailing list . > To unsubscribe, E-mail to: > archives: http://mail.webdna.us/list/talk@webdna.us > old archives: http://dev.webdna.us/TalkListArchive/ > Bug Reporting: = http://forum.webdna.us/eucabb.html?page=3Dtopics&category=3D288 >=20
Palle Bo Nielsen
DOWNLOAD WEBDNA NOW!
Top Articles:
Talk List
The WebDNA community talk-list is the best place to get some help: several hundred extremely proficient programmers with an excellent knowledge of WebDNA and an excellent spirit will deliver all the tips and tricks you can imagine...
Related Readings:
cart converting to scientific notation format (2001)
Trouble with carts (2000)
Credit Card Verification.... (1998)
WebCat2: Items xx to xx shown, etc. (1997)
'RequiredField' Question (1998)
WCf2 and nested tags (1997)
unsubscribe (1997)
b12 cannot limit records returned and more. (1997)
verify online (1997)
New Weird Behavior (bug report) (2000)
Firesite cache vs webcat cache (1997)
Problems with [Search] param - Mac Plugin b15 (1997)
WebCat consulting $ (1998)
re: Default contains WEBDNA (1998)
Giving out error pages (1997)
denied access (1997)
WebCat2final1 crashes (1997)
For those of you not on the WebCatalog Beta... (1997)
Database Posting (2000)
New commands in Final candidate (1997)