Extremely slow pull times #262

Open
opened 2025-08-30 15:54:56 -04:00 by ctinalk · 6 comments
ctinalk commented 2025-08-30 15:54:56 -04:00 (Migrated from github.com)

I was having a similar issue with the script stopping after pulling the list of works to update (attaching a picture of that screen), so I decided to restart the process. But when I run it now in the Powershell option, the downloads are extremely slow. Usually 2-3 minutes between, but a fair number taking 10 minutes, and one taking 20 minutes. I have the download from link, EPUB and PDF options selected, no series, no images, all pages, logged into AO3. Admittedly there are a fair amount in the link, but I've done downloads like this in the past, and timeouts happened, but that was fine.
Thank you for all you do!

Image

I was having a similar issue with the script stopping after pulling the list of works to update (attaching a picture of that screen), so I decided to restart the process. But when I run it now in the Powershell option, the downloads are extremely slow. Usually 2-3 minutes between, but a fair number taking 10 minutes, and one taking 20 minutes. I have the download from link, EPUB and PDF options selected, no series, no images, all pages, logged into AO3. Admittedly there are a fair amount in the link, but I've done downloads like this in the past, and timeouts happened, but that was fine. Thank you for all you do! ![Image](https://github.com/user-attachments/assets/2db259a9-c0e8-4d23-bb14-316279f9aac7)
goldstargloww commented 2025-09-01 22:50:45 -04:00 (Migrated from github.com)

i'm not sure how related this is, but this might be some sort of change on ao3's end? downloading from ao3 using gallery-dl has been super slow for me today, i'm getting a lot of timeouts and error 525s. i don't remember exactly, but when i'm pretty sure when i last did this months ago, it worked without any issues. i figured that since this issue was only opened a few days ago, it might be a similar issue

i'm not sure how related this is, but this might be some sort of change on ao3's end? downloading from ao3 using [gallery-dl](https://github.com/mikf/gallery-dl) has been super slow for me today, i'm getting a lot of timeouts and error 525s. i don't remember exactly, but when i'm pretty sure when i last did this months ago, it worked without any issues. i figured that since this issue was only opened a few days ago, it might be a similar issue
goldstargloww commented 2025-09-14 15:02:53 -04:00 (Migrated from github.com)

this issue seems to have fixed itself for gallery-dl now, how does it work here for you? i'm pretty sure it was an issue on ao3's end

if you have any trouble with pagination i think that was also a recent change

this issue seems to have fixed itself for gallery-dl now, how does it work here for you? i'm pretty sure it was an issue on ao3's end if you have any trouble with pagination i think that was also a recent change
ctinalk commented 2025-09-15 17:39:32 -04:00 (Migrated from github.com)

this issue seems to have fixed itself for gallery-dl now, how does it work here for you? i'm pretty sure it was an issue on ao3's end

if you have any trouble with pagination i think that was also a recent change

I'll try again now and let it run for a few hours, but on initiation after logging in it's still very slow.

> this issue seems to have fixed itself for gallery-dl now, how does it work here for you? i'm pretty sure it was an issue on ao3's end > > if you have any trouble with pagination i think that was also a recent change I'll try again now and let it run for a few hours, but on initiation after logging in it's still very slow.
foggraven commented 2025-11-27 17:30:56 -05:00 (Migrated from github.com)

I've been running into this too. It's taking several hours to update 3 or 4 stories.

There was an update today for the downloader so I thought it might have been that, but trying after it's still the same.

Checking the logs all I'm getting is 520s.

Image Image
I've been running into this too. It's taking several hours to update 3 or 4 stories. There was an update today for the downloader so I thought it might have been that, but trying after it's still the same. Checking the logs all I'm getting is 520s. <img width="1329" height="426" alt="Image" src="https://github.com/user-attachments/assets/4c690655-c052-4bb4-b063-72f8860a3f33" /> <img width="1202" height="225" alt="Image" src="https://github.com/user-attachments/assets/8dbfa5fb-1646-46d1-a783-365c8c6931ec" />
nianeyna commented 2025-11-27 20:28:04 -05:00 (Migrated from github.com)

There is unfortunately not a lot I can do about this since it's on ao3's end - you're getting blocked by their cloudflare configuration. The fact that it was working fine for me when I was testing the update earlier today though makes me think that maybe cloudflare has beef with your specific ip addresses for whatever reason. You could try using a different internet connection - simplest way if you have a laptop is just cart it off to a cafe or a friend's place or something and see if it works better there. if you've got a desktop or it's otherwise inconvenient to physically move your computer you could try turning off your vpn if you have one, or getting a vpn if you don't have one. a phone hotspot might also work, although make sure you turn off wifi on the phone first if you try that one.

There is unfortunately not a lot I can do about this since it's on ao3's end - you're getting blocked by their cloudflare configuration. The fact that it was working fine for me when I was testing the update earlier today though makes me think that maybe cloudflare has beef with your specific ip addresses for whatever reason. You could try using a different internet connection - simplest way if you have a laptop is just cart it off to a cafe or a friend's place or something and see if it works better there. if you've got a desktop or it's otherwise inconvenient to physically move your computer you could try turning off your vpn if you have one, or getting a vpn if you don't have one. a phone hotspot might also work, although make sure you turn off wifi on the phone first if you try that one.
foggraven commented 2025-11-28 06:23:39 -05:00 (Migrated from github.com)

There is unfortunately not a lot I can do about this since it's on ao3's end - you're getting blocked by their cloudflare configuration. The fact that it was working fine for me when I was testing the update earlier today though makes me think that maybe cloudflare has beef with your specific ip addresses for whatever reason. You could try using a different internet connection - simplest way if you have a laptop is just cart it off to a cafe or a friend's place or something and see if it works better there. if you've got a desktop or it's otherwise inconvenient to physically move your computer you could try turning off your vpn if you have one, or getting a vpn if you don't have one. a phone hotspot might also work, although make sure you turn off wifi on the phone first if you try that one.

1st off wow was not expecting such a clear well laid out response, or so fast.
2nd, ty big time! Tried with a different ip and it worked perfectly.

> There is unfortunately not a lot I can do about this since it's on ao3's end - you're getting blocked by their cloudflare configuration. The fact that it was working fine for me when I was testing the update earlier today though makes me think that maybe cloudflare has beef with your specific ip addresses for whatever reason. You could try using a different internet connection - simplest way if you have a laptop is just cart it off to a cafe or a friend's place or something and see if it works better there. if you've got a desktop or it's otherwise inconvenient to physically move your computer you could try turning off your vpn if you have one, or getting a vpn if you don't have one. a phone hotspot might also work, although make sure you turn off wifi on the phone first if you try that one. 1st off wow was not expecting such a clear well laid out response, or so fast. 2nd, ty big time! Tried with a different ip and it worked perfectly.
Sign in to join this conversation.
No labels
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
nianeyna/ao3downloader#262
No description provided.