Unable to download in bulk

lucidsunfl0wers commented

2025-12-11 10:02:32 -05:00

(Migrated from github.com)

Pretty much what it says on the tin. I've initialised the programme with my file preference, login details, etc., but am unable to download from a .txt file of links. I've completed all the troubleshooting steps, though the log visualisers seemingly don't have any data? I'm attempting to download 333 works, so I assumed the number of characters may be an issue, and have tried varying numbers of works in the same text file. The only number of links that has worked is one, which I was able to download as an HTML with images with no trouble. I clear log.jsonl every time I reattempt, so I don't think the programme is skipping over works it thinks it's downloaded already. Strangely enough, when attempting to download fics in bulk, I receive [x] second breaks from ao3, so I can only assume that requests are being sent to ao3, they're just not going through.

A brief rundown of what I've tried to solve this issue:

Reducing number of fics downloaded at a time
Changing file format
Putting .txt file of links in root of programme vs in my computer's Downloads folder
Clearing log.jsonl
Clearing data.json
Running from uv & from Windows installer

Pretty much what it says on the tin. I've initialised the programme with my file preference, login details, etc., but am unable to download from a .txt file of links. I've completed all the troubleshooting steps, though the log visualisers seemingly don't have any data? I'm attempting to download 333 works, so I assumed the number of characters may be an issue, and have tried varying numbers of works in the same text file. The only number of links that has worked is one, which I was able to download as an HTML with images with no trouble. I clear log.jsonl every time I reattempt, so I don't think the programme is skipping over works it thinks it's downloaded already. Strangely enough, when attempting to download fics in bulk, I receive [x] second breaks from ao3, so I can only assume that requests _are_ being sent to ao3, they're just not going through. A brief rundown of what I've tried to solve this issue: - Reducing number of fics downloaded at a time - Changing file format - Putting .txt file of links in root of programme vs in my computer's Downloads folder - Clearing log.jsonl - Clearing data.json - Running from uv & from Windows installer

nianeyna commented

2025-12-11 17:13:29 -05:00

(Migrated from github.com)

Can you email or attach the .txt file you're trying to download from?

lucidsunfl0wers commented

2025-12-11 17:49:58 -05:00

(Migrated from github.com)

ao3 download test.txt

Here it is!

[ao3 download test.txt](https://github.com/user-attachments/files/24113236/ao3.download.test.txt) Here it is!

nianeyna commented

2025-12-11 17:55:00 -05:00

(Migrated from github.com)

Try a find/replace of "downloads" with "works" and see if that fixes it

lucidsunfl0wers commented

2025-12-12 16:28:36 -05:00

(Migrated from github.com)

Didn't realise that was still in there! I considered that the problem was
because I wasn't using direct download links, but that got me a 503
instead. Earlier in my troubleshooting process I had works instead of
downloads and that also didn't work.

On Thu, Dec 11, 2025, 5:55 PM nianeyna @.***> wrote:

nianeyna left a comment (nianeyna/ao3downloader#276)
https://github.com/nianeyna/ao3downloader/issues/276#issuecomment-3644127051

Try a find/replace of "downloads" with "works" and see if that fixes it

—
Reply to this email directly, view it on GitHub
https://github.com/nianeyna/ao3downloader/issues/276#issuecomment-3644127051,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ARKY3YWQ7LY2PRW5UEPHPOL4BHY5XAVCNFSM6AAAAACOX2KMCOVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZTMNBUGEZDOMBVGE
.
You are receiving this because you authored the thread.Message ID:
@.***>

Didn't realise that was still in there! I considered that the problem was because I wasn't using direct download links, but that got me a 503 instead. Earlier in my troubleshooting process I had works instead of downloads and that also didn't work. On Thu, Dec 11, 2025, 5:55 PM nianeyna ***@***.***> wrote: > *nianeyna* left a comment (nianeyna/ao3downloader#276) > <https://github.com/nianeyna/ao3downloader/issues/276#issuecomment-3644127051> > > Try a find/replace of "downloads" with "works" and see if that fixes it > > — > Reply to this email directly, view it on GitHub > <https://github.com/nianeyna/ao3downloader/issues/276#issuecomment-3644127051>, > or unsubscribe > <https://github.com/notifications/unsubscribe-auth/ARKY3YWQ7LY2PRW5UEPHPOL4BHY5XAVCNFSM6AAAAACOX2KMCOVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZTMNBUGEZDOMBVGE> > . > You are receiving this because you authored the thread.Message ID: > ***@***.***> >

nianeyna commented

2025-12-12 18:04:22 -05:00

(Migrated from github.com)

I ran that file through the "f" option (after replacing "downloads" with "works") and wasn't able to reproduce your issue - everything worked as expected. Is log.jsonl also empty after attempting a download, or is it only the visualization that doesn't have any data?

lucidsunfl0wers commented

2025-12-12 18:17:21 -05:00

(Migrated from github.com)

log.jsonl has data after attempting a download. I was eventually able to download by importing from my read later, but it's much more labour-intensive with the scale I'm working at since these works weren't in my read later before this lol. The log looks different for each option (f vs m), but I don't know if this is indicative of anything.

Here's an excerpt comparing the two. Lines 1 & 2 are from me downloading with the m option, line 3 is another unsuccessful attempt with f.

{"link": "https://archiveofourown.org/works/25972810", "title": ["25972810 Pomegranate Promises - Takara_Phoenix"], "workskin": true, "success": true, "timestamp": "12/11/2025, 22:35:10"}

{"link": "https://archiveofourown.org/users/[USERNAME REDACTED]/readings?show=to-read", "message": "starting page", "level": "debug", "timestamp": "12/11/2025, 22:35:10"}

{"link": "https://archiveofourown.org/downloads/14673273", "message": "starting page", "level": "debug", "timestamp": "12/12/2025, 18:10:35"}```

log.jsonl has data after attempting a download. I was eventually able to download by importing from my read later, but it's much more labour-intensive with the scale I'm working at since these works weren't in my read later before this lol. The log looks different for each option (f vs m), but I don't know if this is indicative of anything. Here's an excerpt comparing the two. Lines 1 & 2 are from me downloading with the m option, line 3 is another unsuccessful attempt with f. ``` {"link": "https://archiveofourown.org/works/25972810", "title": ["25972810 Pomegranate Promises - Takara_Phoenix"], "workskin": true, "success": true, "timestamp": "12/11/2025, 22:35:10"} {"link": "https://archiveofourown.org/users/[USERNAME REDACTED]/readings?show=to-read", "message": "starting page", "level": "debug", "timestamp": "12/11/2025, 22:35:10"} {"link": "https://archiveofourown.org/downloads/14673273", "message": "starting page", "level": "debug", "timestamp": "12/12/2025, 18:10:35"}```

nianeyna commented

2025-12-12 18:23:09 -05:00

(Migrated from github.com)

It looks like you still have the links with "downloads" in the url - can you try with "works" links and let me know what the log says?

Rows
Columns

Unable to download in bulk #276