Hi again,
I have ran in to another issue, it looks like Selenium is struggling with the headless Chrome installed. I have updated recently and so it could be that its running in to a feature that has been removed:
Traceback (most recent call last):
File "/home/osint/LazyOSINT/./main.py", line 169, in
main()
File "/home/osint/LazyOSINT/./main.py", line 162, in main
lin = [ x.result() for x in concurrent.futures.as_completed( linkedinT ) ]
File "/home/osint/LazyOSINT/./main.py", line 162, in
lin = [ x.result() for x in concurrent.futures.as_completed( linkedinT ) ]
File "/usr/lib/python3.9/concurrent/futures/_base.py", line 433, in result
return self.__get_result()
File "/usr/lib/python3.9/concurrent/futures/_base.py", line 389, in __get_result
raise self._exception
File "/usr/lib/python3.9/concurrent/futures/thread.py", line 52, in run
result = self.fn(*self.args, **self.kwargs)
File "/home/osint/LazyOSINT/lib/linkedinCompanyScraper.py", line 207, in scrapeThoseEmployeez
self.driver.find_element_by_xpath( see_employees_xpath ).click()
File "/home/osint/.local/lib/python3.9/site-packages/selenium/webdriver/remote/webdriver.py", line 394, in find_element_by_xpath
return self.find_element(by=By.XPATH, value=xpath)
File "/home/osint/.local/lib/python3.9/site-packages/selenium/webdriver/remote/webdriver.py", line 976, in find_element
return self.execute(Command.FIND_ELEMENT, {
File "/home/osint/.local/lib/python3.9/site-packages/selenium/webdriver/remote/webdriver.py", line 321, in execute
self.error_handler.check_response(response)
File "/home/osint/.local/lib/python3.9/site-packages/selenium/webdriver/remote/errorhandler.py", line 242, in check_response
raise exception_class(message, screen, stacktrace)
selenium.common.exceptions.NoSuchElementException: Message: no such element: Unable to locate element: {"method":"xpath","selector":"//div[@Class="mt2"]"}
(Session info: headless chrome=88.0.4324.182)
Hi again,
I have ran in to another issue, it looks like Selenium is struggling with the headless Chrome installed. I have updated recently and so it could be that its running in to a feature that has been removed:
Traceback (most recent call last):
File "/home/osint/LazyOSINT/./main.py", line 169, in
main()
File "/home/osint/LazyOSINT/./main.py", line 162, in main
lin = [ x.result() for x in concurrent.futures.as_completed( linkedinT ) ]
File "/home/osint/LazyOSINT/./main.py", line 162, in
lin = [ x.result() for x in concurrent.futures.as_completed( linkedinT ) ]
File "/usr/lib/python3.9/concurrent/futures/_base.py", line 433, in result
return self.__get_result()
File "/usr/lib/python3.9/concurrent/futures/_base.py", line 389, in __get_result
raise self._exception
File "/usr/lib/python3.9/concurrent/futures/thread.py", line 52, in run
result = self.fn(*self.args, **self.kwargs)
File "/home/osint/LazyOSINT/lib/linkedinCompanyScraper.py", line 207, in scrapeThoseEmployeez
self.driver.find_element_by_xpath( see_employees_xpath ).click()
File "/home/osint/.local/lib/python3.9/site-packages/selenium/webdriver/remote/webdriver.py", line 394, in find_element_by_xpath
return self.find_element(by=By.XPATH, value=xpath)
File "/home/osint/.local/lib/python3.9/site-packages/selenium/webdriver/remote/webdriver.py", line 976, in find_element
return self.execute(Command.FIND_ELEMENT, {
File "/home/osint/.local/lib/python3.9/site-packages/selenium/webdriver/remote/webdriver.py", line 321, in execute
self.error_handler.check_response(response)
File "/home/osint/.local/lib/python3.9/site-packages/selenium/webdriver/remote/errorhandler.py", line 242, in check_response
raise exception_class(message, screen, stacktrace)
selenium.common.exceptions.NoSuchElementException: Message: no such element: Unable to locate element: {"method":"xpath","selector":"//div[@Class="mt2"]"}
(Session info: headless chrome=88.0.4324.182)