RE: Full text search

This WebDNA talk-list message is from

1999


It keeps the original formatting.
numero = 22401
interpreted = N
texte = How about setting the max found items pref to a low number.> -----Original Message----- > From: Peter Ostry [mailto:po@ostry.com] > Sent: Thursday, January 07, 1999 11:40 AM > To: WebDNA-Talk@smithmicro.com > Subject: Re: Full text search > > > At 17:35 Uhr -0800 06.01.1999, PCS Technical Support wrote: > > >>So a complete search will look into 6000 fields for a match of > 3 fields per > >>line and at the same time in 4000 fields for the occurence of 3 > characters. > >> > >>Will this be slow? > > > >That's probably not too bad. There are sites searching thru 200,000 > >records in full-text descriptions along with other required fields. > > > Oops, I made a mistake in my calculation, the correct numbers are this: > One search session looks into 3x2000 fields (which are required) and into > 12x2,000 to find 3 letters. > That makes 30,000 fields. I will have one life database and three years > in the archive, so the biggest search will run through max. > 120.000 records > - I am a little scared about the heavy wildcard search with wo in 12 (!) > fields... > Do you still say this could be ok? > > I am just wondering, what has more effect on speed with wo???data: > Number of records? Number of fields? Can I multiply records x > fields to get > a rule of thumb for a specific machine? > My search requires grouping - does grouping speed up or slow down? > > I tried to push WebCat beyond the limit, with 500.000 records and 10 > fields. Like all databases it is still usable, when it finds one or few > records. But it gets exhausted (no wonder) when it finds many records. > Maybe I should set up a learning dirty words-system to store > all requests > which return more then 500 records or so and forbid them in the future. > This technique makes sense with 4D - but makes it sense for WebCat too? > > > Peter > > ++++++++++++++++++++++++++++++++++++++++++++++++ > Peter Ostry - Vienna/Austria - www.ostry.com > Fon ++43-1-877 74 54 Fax ++43-1-877 74 54-21 > ++++++++++++++++++++++++++++++++++++++++++++++++ > Associated Messages, from the most recent to the oldest:

    
  1. Re: full text search ? (Frank Nordberg 2002)
  2. Re: full text search ? (Kenneth Grome 2002)
  3. Re: Full text search (Peter Ostry 1999)
  4. Re: Full text search (PCS Technical Support 1999)
  5. RE: Full text search (Olin Lagon 1999)
  6. RE: Full text search (Olin Lagon 1999)
  7. Re: Full text search (Peter Ostry 1999)
  8. Re: Full text search (PCS Technical Support 1999)
How about setting the max found items pref to a low number.> -----Original Message----- > From: Peter Ostry [mailto:po@ostry.com] > Sent: Thursday, January 07, 1999 11:40 AM > To: WebDNA-Talk@smithmicro.com > Subject: Re: Full text search > > > At 17:35 Uhr -0800 06.01.1999, PCS Technical Support wrote: > > >>So a complete search will look into 6000 fields for a match of > 3 fields per > >>line and at the same time in 4000 fields for the occurence of 3 > characters. > >> > >>Will this be slow? > > > >That's probably not too bad. There are sites searching thru 200,000 > >records in full-text descriptions along with other required fields. > > > Oops, I made a mistake in my calculation, the correct numbers are this: > One search session looks into 3x2000 fields (which are required) and into > 12x2,000 to find 3 letters. > That makes 30,000 fields. I will have one life database and three years > in the archive, so the biggest search will run through max. > 120.000 records > - I am a little scared about the heavy wildcard search with wo in 12 (!) > fields... > Do you still say this could be ok? > > I am just wondering, what has more effect on speed with wo???data: > Number of records? Number of fields? Can I multiply records x > fields to get > a rule of thumb for a specific machine? > My search requires grouping - does grouping speed up or slow down? > > I tried to push WebCat beyond the limit, with 500.000 records and 10 > fields. Like all databases it is still usable, when it finds one or few > records. But it gets exhausted (no wonder) when it finds many records. > Maybe I should set up a learning dirty words-system to store > all requests > which return more then 500 records or so and forbid them in the future. > This technique makes sense with 4D - but makes it sense for WebCat too? > > > Peter > > ++++++++++++++++++++++++++++++++++++++++++++++++ > Peter Ostry - Vienna/Austria - www.ostry.com > Fon ++43-1-877 74 54 Fax ++43-1-877 74 54-21 > ++++++++++++++++++++++++++++++++++++++++++++++++ > Olin Lagon

DOWNLOAD WEBDNA NOW!

Top Articles:

Talk List

The WebDNA community talk-list is the best place to get some help: several hundred extremely proficient programmers with an excellent knowledge of WebDNA and an excellent spirit will deliver all the tips and tricks you can imagine...

Related Readings:

carriage returns in data (1997) typhoon... (1997) Protect (1997) PIXO with cometsite ... and/or other plugins (1998) [WebDNA] Successful, working WebDNA7/CentOS install? (2013) Problem displaying search result (1997) TCPSEND (1999) [WebDNA] RESTART WebDNA (2016) WCS Newbie question (1997) Wonderin' whats the way (1998) pulling URL information (2003) 3 card formulas! (1999) passing search criteria (1997) Date and Time Math (1997) Simple way to create unique SKU (1997) problems with 2 tags shakur (1997) dates and hex formatting (1997) still facing truncated [texta] problem (2000) Probably a very simple question? (1997) headers (2004)