how to download all Q&As of a user on curiouscat.me

Chat about just about anything else
User avatar
pepperminty
Level 5
Level 5
Posts: 688
Joined: Thu Jun 23, 2011 10:51 pm

how to download all Q&As of a user on curiouscat.me

Postby pepperminty » Thu Oct 05, 2017 7:07 am

Can wget, httrack or some other program download all of a user's questions and answers on https://curiouscat.me?

How can I use httrack to download all the question and answers of a user called
"foo" on https://curiouscat.me, where their site will be https://curiouscat.me/foo?
The particular username I have in mind has more than 500 questions. When using
a web browser, the only way to get to the earlier questions is to PageDown or
(hit "End" key). But this gets tedious.

For a particular example, see https://curiouscat.me/curiouscat
Can httrack or wget or something else come to the rescue?

Basically what I want is a webpage that contains all of a user's Q&A, which you can manually get if you keep scrolling down (or keep pressing PageDown or End).

User avatar
chrisuk
Level 4
Level 4
Posts: 499
Joined: Thu Jun 12, 2008 6:16 am

Re: how to download all Q&As of a user on curiouscat.me

Postby chrisuk » Thu Oct 05, 2017 1:02 pm

I've literally only got a few minutes, but this might be what you need - else someone might point you to another scaper/spider.
Chris

Manjaro MATE - Antergos MATE - MX Linux - LMDE MATE

User avatar
pepperminty
Level 5
Level 5
Posts: 688
Joined: Thu Jun 23, 2011 10:51 pm

Re: how to download all Q&As of a user on curiouscat.me

Postby pepperminty » Thu Oct 05, 2017 1:10 pm

chrisuk wrote:I've literally only got a few minutes, but this might be what you need - else someone might point you to another scaper/spider.

Thanks, Chris, but that program is just for 2 Bulletin Board platforms.

User avatar
pepperminty
Level 5
Level 5
Posts: 688
Joined: Thu Jun 23, 2011 10:51 pm

Re: how to download all Q&As of a user on curiouscat.me

Postby pepperminty » Tue Oct 17, 2017 6:16 pm

bump


Return to “Open chat”