Usage with autheticated site

[shobhitxp]

Hi,

Can you help me in suggesting how can I pass username and password for my site (its password protected) for crawling?

Regards
Shobhit

[boutell]

Hi Shobhit,

This is not currently a feature that orbweaver has. It would be an
interesting challenge to accommodate it fully since there are so many
different types of login on websites (assuming your site isn't just using
basic auth, which is rare these days). I would certainly be interested in
talking about how this feature might work, looking at pull requests, etc.

On Mon, Oct 5, 2015 at 5:04 AM, shobhitxp [email protected] wrote:

Hi,

Can you help me in suggesting how can I pass username and password for my
site (its password protected) for crawling?

Regards
Shobhit

—
Reply to this email directly or view it on GitHub
#1.

*THOMAS BOUTELL, *DEV & OPS
P'UNK AVENUE | (215) 755-1330 | punkave.com

[mokchend]

One way to solve this is to rely on a cookie key/pair values once authenticated, whatever the authN mechanism used behind the scene, like the curl command with --cookie parameter ?