Re: database with 10,000+ web pages stored in it?

This WebDNA talk-list message is from

2000


It keeps the original formatting.
numero = 26576
interpreted = N
texte = on 1/25/00 8:06 PM, Kenneth Grome at ken@simplewebstores.com wrote:>> A client is going to have a site with 10,000 pages drawn from a >> database. These are not pointers to a database, these are actual >> pages, in a web based administration system. Can web catalog handle >> this kind of volume? > > webCtaalog can handle hundreds of thousands of records. Tens of thousands is > trivial ... > >> The database size would be around 600 megs or >> more. Certainly you wouldn't keep this in RAM. > > why not? > > ================================ > Kenneth Grome, WebDNA Consultant10,000 pages = 600megs of information? that is a lot of HTML/Text which is the only thing you are actually storing in the tab delimited text files (ie: WebCatalog .db files) Images would just be URL's or partial URL's stored in the database, the images would be in a directory on the HD and would not affect Webcatalog nor use Ram within Webcatalog. Thing is if you are using Webcatalog as a Web Administration tool to publish web pages, you are still A) dynamically searching and displaying the pages from the database or B) writing static HTML page OUT of the Webcatalog database after someone creates the entries within the web administration (and yes there are times when this is a better way to go then true dynamic pages if your site/data will work in this fashion (ie: product information pages, research studies, any information which you need updated via a web interface but would in no way benefit from being constantly dynamically generated.I would break up say different product types, or different departments, or some how break up pages into meaningful groups so if you do indeed end up with 600megs of data, say maybe 10 databases of 60megs each or 100 databases of 6megs each... remember webcatalog will load/unload databases that are needed/less accessed to fit into ram, and yes you can only have 100 databases open at one time, but normally will never run into this happening (if you do, it will load and unload databases, which is rather quick :)When you can buy a Gig of ram for less then you use to spend for a gig of hard drive space, keeping 600megs in a ram based database is very likely, and affordable.------------------------------------------------------------- Brought to you by CommuniGate Pro - The Buzz Word Compliant Messaging Server. To end your Mail problems go to .This message is sent to you because you are subscribed to the mailing list . To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to Associated Messages, from the most recent to the oldest:

    
on 1/25/00 8:06 PM, Kenneth Grome at ken@simplewebstores.com wrote:>> A client is going to have a site with 10,000 pages drawn from a >> database. These are not pointers to a database, these are actual >> pages, in a web based administration system. Can web catalog handle >> this kind of volume? > > webCtaalog can handle hundreds of thousands of records. Tens of thousands is > trivial ... > >> The database size would be around 600 megs or >> more. Certainly you wouldn't keep this in RAM. > > why not? > > ================================ > Kenneth Grome, WebDNA Consultant10,000 pages = 600megs of information? that is a lot of HTML/Text which is the only thing you are actually storing in the tab delimited text files (ie: WebCatalog .db files) Images would just be URL's or partial URL's stored in the database, the images would be in a directory on the HD and would not affect Webcatalog nor use Ram within Webcatalog. Thing is if you are using Webcatalog as a Web Administration tool to publish web pages, you are still A) dynamically searching and displaying the pages from the database or B) writing static HTML page OUT of the Webcatalog database after someone creates the entries within the web administration (and yes there are times when this is a better way to go then true dynamic pages if your site/data will work in this fashion (ie: product information pages, research studies, any information which you need updated via a web interface but would in no way benefit from being constantly dynamically generated.I would break up say different product types, or different departments, or some how break up pages into meaningful groups so if you do indeed end up with 600megs of data, say maybe 10 databases of 60megs each or 100 databases of 6megs each... remember webcatalog will load/unload databases that are needed/less accessed to fit into ram, and yes you can only have 100 databases open at one time, but normally will never run into this happening (if you do, it will load and unload databases, which is rather quick :)When you can buy a Gig of ram for less then you use to spend for a gig of hard drive space, keeping 600megs in a ram based database is very likely, and affordable.------------------------------------------------------------- Brought to you by CommuniGate Pro - The Buzz Word Compliant Messaging Server. To end your Mail problems go to .This message is sent to you because you are subscribed to the mailing list . To unsubscribe, E-mail to: To switch to the DIGEST mode, E-mail to J Lane

DOWNLOAD WEBDNA NOW!

Top Articles:

Talk List

The WebDNA community talk-list is the best place to get some help: several hundred extremely proficient programmers with an excellent knowledge of WebDNA and an excellent spirit will deliver all the tips and tricks you can imagine...

Related Readings:

[WebDNA] [WebDNA] WebDNA: Could not establish connection with the module (2012) [listfields] context (2005) Add a field to the error log? (1997) Server crash (1997) PCS Emailer's role ? (1997) Free pack for the New UPS ratings and services tool (2000) Projects & Contractors (1997) [movefile] (1999) [ShowIf] and empty fields (1997) Problems with [Search] param - Mac Plugin b15 (1997) delete and return to founditems (2002) Cold Fusion Buster (1997) WC2 or 3: Displaying Search Result Relevance (1998) 5.0 Pricing (2003) Where's Cart Created ? (1997) Help: sorting in found set. (2001) WCS Newbie question (1997) [OT] 'Email this story to a friend' (2003) message forum question (2005) quick GREP question (2001)