Page 1 of 1

Apache sometime not returning RSS feed

Posted: Wed Mar 29, 2006 11:03 pm
by mfcurry
Hey all,
I have a site that tracks Amazon price changes via RSS. As you can guess this means there are a ton of dynamically generated feeds. Bloglines attempts to update many of the feeds at the same time. To combat this I pre-generate the feeds. The problem is bloglines still thinks 33% of the feeds are bad. Looking at the apache access log for the bad feeds I see many lines like this:

Code: Select all

65.214.39.151 - - [29/Mar/2006:09:56:18 -0800] "GET /feed/amazon/wishlist/2BCDF6JES6O7J HTTP/1.1" 200 316 "-" "Bloglines/3.0-rho (http://www.bloglines.com; 1 subscriber)"
I believe the 316 is the size of the returned page. This is consistent with all the feeds that give errors. Of couse when I go directly to that feed it is fine, and I have no way of telling what bloglines got that it thinks is an error. So my question is: Is 316 significant in any way? Some apache error return or timeout? I checked the error log, but there is nothing helpful there.

Thanks.

Posted: Thu Mar 30, 2006 9:52 am
by feyd
200 is the HTTP response code for OK (successful request)
The number following the response code, 316 here, is the content length returned: 316 bytes.

Posted: Thu Mar 30, 2006 10:24 am
by mfcurry
Is there anyway for me to tell what was returned? The 316 content length is consistent with all the requests that bloglines views as errors:

Code: Select all

65.214.39.151 - - [30/Mar/2006:06:28:40 -0800] "GET /feed/amazon/product/B0009Q1IEC HTTP/1.1" 200 316 "-" "Bloglines/3.0-rho (http://www.bloglines.com; 1 subscriber)"
65.214.39.151 - - [30/Mar/2006:06:28:40 -0800] "GET /feed/amazon/product/B000BAR8CM HTTP/1.1" 200 316 "-" "Bloglines/3.0-rho (http://www.bloglines.com; 1 subscriber)"
65.214.39.151 - - [30/Mar/2006:06:28:40 -0800] "GET /feed/amazon/product/B0000AN4EG HTTP/1.1" 200 316 "-" "Bloglines/3.0-rho (http://www.bloglines.com; 1 subscriber)"
65.214.39.151 - - [30/Mar/2006:06:28:40 -0800] "GET /feed/amazon/product/B00005LDVH HTTP/1.1" 200 316 "-" "Bloglines/3.0-rho (http://www.bloglines.com; 1 subscriber)"
I just can't figure out what is actually returned. Sometimes the normal feed is returned:

Code: Select all

65.214.39.151 - - [30/Mar/2006:00:54:07 -0800] "GET /feed/amazon/product/B0000U1OCI HTTP/1.1" 200 6589 "-" "Bloglines/3.0-rho (http://www.bloglines.com; 2 subscribers)"
65.214.39.151 - - [30/Mar/2006:01:25:40 -0800] "GET /feed/amazon/product/B0000U1OCI HTTP/1.1" 200 6589 "-" "Bloglines/3.0-rho (http://www.bloglines.com; 2 subscribers)"
65.214.39.151 - - [30/Mar/2006:01:58:13 -0800] "GET /feed/amazon/product/B0000U1OCI HTTP/1.1" 200 316 "-" "Bloglines/3.0-rho (http://www.bloglines.com; 2 subscribers)"
Of course I've hit that feed a hundred times and I never get the 316 length content.

Posted: Thu Mar 30, 2006 10:33 am
by feyd
Maybe it's a request spamming or race condition. It's hard to tell at this point.