Re: search engine friendly URLS (Mac) and Lycos!
This WebDNA talk-list message is from 1998
It keeps the original formatting.
numero = 16677
interpreted = N
texte = >OK, if I understand some of the earlier postings correctly (on this list >and/or the WebStar list), to allow search engine spidering of my Webcatalog >site I can use either: > >A) WebCatalog autoproxy -- with Webcatalog 2.1 installed, or > >B) Welcome -- 3'rd party program > >By using one or the other, friendly URLS (no ? symbols, etc.) would be >returned to users and search engines, right? >Hi Dale, cool name!I assume you are talking about Firesite VDM autoproxy in (A). This only has the effect of making the links in your pages virtual domain savvy. I'm pretty sure it doesn't touch your path arguments (and I'm sure Mark will correct me if I'm wrong here).>From what I understand only (B) would give friendly URLS w/ no args by replacing ? with | and & with / (or similar), and then defining the reverse for decoding on the other end. I don't know of anyone who is actually doing this, and would be interested to hear how well it works.>If this is right so far... can anyone summarize the pros and cons of both >approaches? (anything to be aware of regarding memory usage, speed, >logging, etc?) >(B) can be kind of dangerous, because you could potentially put a search engine into an infinite space by mapping your urls to static-esque URLs. Also be very careful about adding items to your cart using hrefs, or you may find that search engines will start purchasing items on your site!I also thought everyone would be interested to know that Lycos now appears to be understanding SOME path arguments when it indexes (one set of arguments per template?). This is both good and bad, because every time the spider revisits your site it is assigned a new cart number. This results in the replication of identical pages in Lycos' index. So, we currently have the www.dhorse.com home page indexed and displayed <<15>> times in Lycos, each with a different cart number. I'm not sure why ALL of my pages are not indexed yet, though; only about 6 templates have been indexed...To fix the multiple indexing problem, we are looking into assigning a specific cart number to the spiders when they visit (and are picked out of the crowd by their [IPADDRESS]. Once the users follow that link to our site, we use [referrer] to determine if we should reassign their cart number to prevent multiple purchases using the same cart. Sound reasonable?Speaking of which, does anyone have a bookmark for a list of search engine IP addresses? I saw one a few weeks ago, but can't seem to find it again (and lost the bookmark to a munged hard drive). And no, I couldn't find the page using a search engine... How ironic... :)One almost down, 10 search engines to go...>It would be very cool to allow search engine spidering of the entire site!It will be a very cold day, err, I mean good day when this happens.>TIA for tips and advice, > >Dale Stokdyk >www.me2u.com > >The Other -Dale ________________________ ___________________________ | Dale LaFountain | mailto:dalel@dhorse.com | | MIS Director,WebMaster | http://www.dhorse.com/ | | Dark Horse Comics, Inc.| Phone: 503-652-8815 x324 | \________________________|___________________________/ ________________________ ______________________________ | Dale LaFountain | mailto:dalel@dhorse.com | | MIS Director,WebMaster | web: http://www.dhorse.com/ | | Dark Horse Comics, Inc.|Phone: 503-652-8815 x324 | \_________ID97___________|______________________________/
Associated Messages, from the most recent to the oldest:
>OK, if I understand some of the earlier postings correctly (on this list >and/or the WebStar list), to allow search engine spidering of my Webcatalog >site I can use either: > >A) WebCatalog autoproxy -- with Webcatalog 2.1 installed, or > >B) Welcome -- 3'rd party program > >By using one or the other, friendly URLS (no ? symbols, etc.) would be >returned to users and search engines, right? >Hi Dale, cool name!I assume you are talking about Firesite VDM autoproxy in (A). This only has the effect of making the links in your pages virtual domain savvy. I'm pretty sure it doesn't touch your path arguments (and I'm sure Mark will correct me if I'm wrong here).>From what I understand only (B) would give friendly URLS w/ no args by replacing ? with | and & with / (or similar), and then defining the reverse for decoding on the other end. I don't know of anyone who is actually doing this, and would be interested to hear how well it works.>If this is right so far... can anyone summarize the pros and cons of both >approaches? (anything to be aware of regarding memory usage, speed, >logging, etc?) >(B) can be kind of dangerous, because you could potentially put a search engine into an infinite space by mapping your urls to static-esque URLs. Also be very careful about adding items to your cart using hrefs, or you may find that search engines will start purchasing items on your site!I also thought everyone would be interested to know that Lycos now appears to be understanding SOME path arguments when it indexes (one set of arguments per template?). This is both good and bad, because every time the spider revisits your site it is assigned a new cart number. This results in the replication of identical pages in Lycos' index. So, we currently have the www.dhorse.com home page indexed and displayed <<15>> times in Lycos, each with a different cart number. I'm not sure why ALL of my pages are not indexed yet, though; only about 6 templates have been indexed...To fix the multiple indexing problem, we are looking into assigning a specific cart number to the spiders when they visit (and are picked out of the crowd by their
[ipaddress]. Once the users follow that link to our site, we use
[referrer] to determine if we should reassign their cart number to prevent multiple purchases using the same cart. Sound reasonable?Speaking of which, does anyone have a bookmark for a list of search engine IP addresses? I saw one a few weeks ago, but can't seem to find it again (and lost the bookmark to a munged hard drive). And no, I couldn't find the page using a search engine... How ironic... :)One almost down, 10 search engines to go...>It would be very cool to allow search engine spidering of the entire site!It will be a very cold day, err, I mean good day when this happens.>TIA for tips and advice, > >Dale Stokdyk >www.me2u.com > >The Other -Dale ________________________ ___________________________ | Dale LaFountain | mailto:dalel@dhorse.com | | MIS Director,WebMaster | http://www.dhorse.com/ | | Dark Horse Comics, Inc.| Phone: 503-652-8815 x324 | \________________________|___________________________/ ________________________ ______________________________ | Dale LaFountain | mailto:dalel@dhorse.com | | MIS Director,WebMaster | web: http://www.dhorse.com/ | | Dark Horse Comics, Inc.|Phone: 503-652-8815 x324 | \_________ID97___________|______________________________/
Dale LaFountain
DOWNLOAD WEBDNA NOW!
Top Articles:
Talk List
The WebDNA community talk-list is the best place to get some help: several hundred extremely proficient programmers with an excellent knowledge of WebDNA and an excellent spirit will deliver all the tips and tricks you can imagine...
Related Readings:
Not really WebCat (1997)
Nt's Latest? (1997)
Error.html (1997)
Harvesting invalid email addresses from bounced emails??? (2000)
WebCat2b15MacPlugin - [protect] (1997)
Founditems context returning only 1 item (1997)
Triggers under Windows NT (2001)
Practice runs ? (1997)
NetSplat and WebCat2 (1997)
[WebDNA] HTTP post help (2012)
WebCatalog2 Feature Feedback (1996)
Configuring E-mail (1997)
b12 cannot limit records returned and more. (1997)
Unformatted Messages (1998)
SMSI: Forged email addresses on the talk list ... (2002)
&max= (2003)
Dreamweaver MX (again) (2002)
WebCat and WebTV (1997)
Copyright ? (1997)
Emailer [cart] file names (1997)