WiGLE.net

Parsing stopped last night, my point in the queue hasn't changed overnight.

What keeps happening? Is this an everyday thing where it stops for half the day?

WiGLE currently has 573 files queued for processing.

Wow. Is there any way to have the queue notice that it's hung and move some of the queue to another queue for processing? Like if it see's it's a 1MB file and it hasn't finished in 30 minutes, move that file to another queue to be looked at manually and then continue processing the rest of the queue.

Maybe find out what the longest time a file might take for processing, big files can take a long time. Suppose the longest processing time for a given month is 48 minutes. After 50 minutes, stop processing that file and move it to the end of the queue. At least that would keep the queue moving.

801 and now passing a full day

Yes, file processing is turned off during database maintenance or other intensive background tasks. It is back on now.

just saw that Thanks!

are the stats updating? Mine dont seem to be changing since the uploads started working again

Your stats look to be updating. Everything is processed in what is known as an "eventually consistent" manner, which increases overall throughput but not everything lines up until all the pieces have independently finished processing.

Processing appears to be stuck since yesterday. There are 676 files in the queue. Is there some maintenance ongoing?

File processor was in an error condition, will have to handle that. Back running now.

Great, thanks bobzilla.

Processing appears to be stuck at the moment. 643 files on the queue.

Looks like the processing is stuck currently. 182 files in the queue.

Meanwhile the queue has grown to 901 files... Isn't an admin around to inform uploaders about what is wrong? Or even better, to inform us about what is being done to tackle the problem?

1180 and counting...