Need help installing PHP, configuring a script, or configuring a server? Then come on in and post your questions! We'll try to help the best we can !
Moderator: General Moderators
mfcurry
Forum Newbie
Posts: 3 Joined: Wed Mar 29, 2006 10:56 pm
Post
by mfcurry » Wed Mar 29, 2006 11:03 pm
Hey all,
I have a site that tracks Amazon price changes via RSS. As you can guess this means there are a ton of dynamically generated feeds. Bloglines attempts to update many of the feeds at the same time. To combat this I pre-generate the feeds. The problem is bloglines still thinks 33% of the feeds are bad. Looking at the apache access log for the bad feeds I see many lines like this:
Code: Select all
65.214.39.151 - - [29/Mar/2006:09:56:18 -0800] "GET /feed/amazon/wishlist/2BCDF6JES6O7J HTTP/1.1" 200 316 "-" "Bloglines/3.0-rho (http://www.bloglines.com; 1 subscriber)"
I believe the 316 is the size of the returned page. This is consistent with all the feeds that give errors. Of couse when I go directly to that feed it is fine, and I have no way of telling what bloglines got that it thinks is an error. So my question is: Is 316 significant in any way? Some apache error return or timeout? I checked the error log, but there is nothing helpful there.
Thanks.
feyd
Neighborhood Spidermoddy
Posts: 31559 Joined: Mon Mar 29, 2004 3:24 pm
Location: Bothell, Washington, USA
Post
by feyd » Thu Mar 30, 2006 9:52 am
200 is the HTTP response code for OK (successful request)
The number following the response code, 316 here, is the content length returned: 316 bytes.
mfcurry
Forum Newbie
Posts: 3 Joined: Wed Mar 29, 2006 10:56 pm
Post
by mfcurry » Thu Mar 30, 2006 10:24 am
Is there anyway for me to tell what was returned? The 316 content length is consistent with all the requests that bloglines views as errors:
Code: Select all
65.214.39.151 - - [30/Mar/2006:06:28:40 -0800] "GET /feed/amazon/product/B0009Q1IEC HTTP/1.1" 200 316 "-" "Bloglines/3.0-rho (http://www.bloglines.com; 1 subscriber)"
65.214.39.151 - - [30/Mar/2006:06:28:40 -0800] "GET /feed/amazon/product/B000BAR8CM HTTP/1.1" 200 316 "-" "Bloglines/3.0-rho (http://www.bloglines.com; 1 subscriber)"
65.214.39.151 - - [30/Mar/2006:06:28:40 -0800] "GET /feed/amazon/product/B0000AN4EG HTTP/1.1" 200 316 "-" "Bloglines/3.0-rho (http://www.bloglines.com; 1 subscriber)"
65.214.39.151 - - [30/Mar/2006:06:28:40 -0800] "GET /feed/amazon/product/B00005LDVH HTTP/1.1" 200 316 "-" "Bloglines/3.0-rho (http://www.bloglines.com; 1 subscriber)"
I just can't figure out what is actually returned. Sometimes the normal feed is returned:
Code: Select all
65.214.39.151 - - [30/Mar/2006:00:54:07 -0800] "GET /feed/amazon/product/B0000U1OCI HTTP/1.1" 200 6589 "-" "Bloglines/3.0-rho (http://www.bloglines.com; 2 subscribers)"
65.214.39.151 - - [30/Mar/2006:01:25:40 -0800] "GET /feed/amazon/product/B0000U1OCI HTTP/1.1" 200 6589 "-" "Bloglines/3.0-rho (http://www.bloglines.com; 2 subscribers)"
65.214.39.151 - - [30/Mar/2006:01:58:13 -0800] "GET /feed/amazon/product/B0000U1OCI HTTP/1.1" 200 316 "-" "Bloglines/3.0-rho (http://www.bloglines.com; 2 subscribers)"
Of course I've hit that feed a hundred times and I never get the 316 length content.
feyd
Neighborhood Spidermoddy
Posts: 31559 Joined: Mon Mar 29, 2004 3:24 pm
Location: Bothell, Washington, USA
Post
by feyd » Thu Mar 30, 2006 10:33 am
Maybe it's a request spamming or race condition. It's hard to tell at this point.