Forums >> General >> When are comics checked for updates?

When are comics checked for updates?

1  2 


meeowth
Teto
510 posts
'Kay.
sniffnoy
Default-avatar
63 posts
OK, point of confusion: SFAICT, it looks like updates are being checked every 4 hours after the 14-hour delay. Was the 2-hour figure stated earlier just wrong, or are things really that slow? I must admit, when I said 2+epsilon earlier, I actually had rather large values of epsilon in mind... I hope that didn't cause any confusion...
meeowth
Teto
510 posts
Looking at how often errors are generated for broken comics, it sure does look like the comics are checked almost exactly every 4 hours.

I'm not sure how long it takes to check the average comic, but if it was 2 seconds then it would take 2 hours to go through 4,000 comics.

A couple optimizations on our preset methods might get that number down a bit, but we can't be sure until we try.

Alternately, this could be a case of Time.now.ago(60 * 120) resulting in a check every 4 hours, with the check time being negligible! Anyone have an idea on this? (since the comment on the line seems to indicate 2 hours is the intention)
sniffnoy
Default-avatar
63 posts
Thought: Perhaps the 14-hour delay should be made longer? If the current rate of 4 hours is coming about due to things being slow, maybe increasing the delay would help that? And if it's not, it just really is 4 hours, then you'll want the delay to be congruent to 24 mod 4, so 12 or 16 hours would be better.
meeowth
Teto
510 posts
I just changed a couple of the methods to more efficient ones, the changes aren't live to the site yet, but we'll know they're live when the last output of comicgenesis comics no longer includes the period.
rgejman
Rgejman
264 posts
I believe the 4 hour figure comes about because, as some have mentioned, it takes more than 4 hours to check all of the comics in the "queue." Sniffnoy's suggestion of increasing the time to 16 hours is a good one, so I'll do that for now. If you all see that the average time goes down to < 4 hours and approaches 2, then maybe we can bump it up to every 18 or 20 hours. Anyway, I wouldn't worry about the efficiency of the regexp. The major time sink is, of course, actually waiting for the other server to respond!

Here is a suggestion that would actually speed up the time it takes to check comics:

Make comic checking asynchronous and check 5 or 10 at a time. I haven't done much multithreaded ruby, but it should be possible and would probably make the biggest dent in the problem.
sniffnoy
Default-avatar
63 posts
Something to seems to have gone wrong - comics are now not being checked for at least about a day!
corruption
Users%2fcorruption%2fthumb%2favatar
715 posts
That was dealt with in the "Nothing Updating" forum over in problems.
1  2 


Forums >> General >> When are comics checked for updates?


Insert link to comic