Hey,
I am using typesense for a docusaurus project that is behind basic auth.
The environment variables DOCSEARCH_BASICAUTH_USERNAME and DOCSEARCH_BASICAUTH_PASSWORD should be used to still be able to scrape that site.
In scraper/src/documentation_spider.py the variables are read an stored into http_user and http_pass but never used afterwards.
What do I miss? Or was the feature not implemented?
Thanks
|
http_user = os.environ.get('DOCSEARCH_BASICAUTH_USERNAME', None) |
Hey,
I am using typesense for a docusaurus project that is behind basic auth.
The environment variables
DOCSEARCH_BASICAUTH_USERNAMEandDOCSEARCH_BASICAUTH_PASSWORDshould be used to still be able to scrape that site.In scraper/src/documentation_spider.py the variables are read an stored into http_user and http_pass but never used afterwards.
What do I miss? Or was the feature not implemented?
Thanks
typesense-docsearch-scraper/scraper/src/documentation_spider.py
Line 27 in f384490