Can wget, httrack or some other program download all of a user's questions and answers on https://curiouscat.me?
How can I use httrack to download all the question and answers of a user called
"foo" on https://curiouscat.me, where their site will be https://curiouscat.me/foo?
The particular username I have in mind has more than 500 questions. When using
a web browser, the only way to get to the earlier questions is to PageDown or
(hit "End" key). But this gets tedious.
For a particular example, see https://curiouscat.me/curiouscat
Can httrack or wget or something else come to the rescue?
Basically what I want is a webpage that contains all of a user's Q&A, which you can manually get if you keep scrolling down (or keep pressing PageDown or End).
how to download all Q&As of a user on curiouscat.me
Forum rules
Do not post support questions here. Before you post read the forum rules. Topics in this forum are automatically closed 30 days after creation.
Do not post support questions here. Before you post read the forum rules. Topics in this forum are automatically closed 30 days after creation.
- pepperminty
- Level 6
- Posts: 1064
- Joined: Thu Jun 23, 2011 10:51 pm
how to download all Q&As of a user on curiouscat.me
Last edited by LockBot on Wed Dec 07, 2022 4:01 am, edited 1 time in total.
Reason: Topic automatically closed 30 days after creation. New replies are no longer allowed.
Reason: Topic automatically closed 30 days after creation. New replies are no longer allowed.
Re: how to download all Q&As of a user on curiouscat.me
I've literally only got a few minutes, but this might be what you need - else someone might point you to another scaper/spider.
- pepperminty
- Level 6
- Posts: 1064
- Joined: Thu Jun 23, 2011 10:51 pm
Re: how to download all Q&As of a user on curiouscat.me
Thanks, Chris, but that program is just for 2 Bulletin Board platforms.chrisuk wrote:I've literally only got a few minutes, but this might be what you need - else someone might point you to another scaper/spider.
- pepperminty
- Level 6
- Posts: 1064
- Joined: Thu Jun 23, 2011 10:51 pm