Selenium Base Chrome not Found when Deployed the Application

[Orbiszeus]

Dear Michael, I deployed my application over the Streamlit that crawls some sites over your undetected chrome crawler. However, when I deployed the program. Could you please help me. I am getting this Exception:

Warning: uc_driver not found. Getting it now:


*** chromedriver to download = 127.0.6533.72 (Latest Stable) 


Downloading chromedriver-linux64.zip from:

https://storage.googleapis.com/chrome-for-testing-public/127.0.6533.72/linux64/chromedriver-linux64.zip ...

INFO:     127.0.0.1:45864 - "POST /crawl HTTP/1.1" 500 Internal Server Error

ERROR:    Exception in ASGI application

Traceback (most recent call last):

  File "/home/adminuser/venv/lib/python3.11/site-packages/uvicorn/protocols/http/httptools_impl.py", line 399, in run_asgi

    result = await app(  # type: ignore[func-returns-value]

             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "/home/adminuser/venv/lib/python3.11/site-packages/uvicorn/middleware/proxy_headers.py", line 70, in __call__

    return await self.app(scope, receive, send)

           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "/home/adminuser/venv/lib/python3.11/site-packages/fastapi/applications.py", line 1054, in __call__

    await super().__call__(scope, receive, send)

  File "/home/adminuser/venv/lib/python3.11/site-packages/starlette/applications.py", line 123, in __call__

    await self.middleware_stack(scope, receive, send)

  File "/home/adminuser/venv/lib/python3.11/site-packages/starlette/middleware/errors.py", line 186, in __call__

    raise exc

  File "/home/adminuser/venv/lib/python3.11/site-packages/starlette/middleware/errors.py", line 164, in __call__

    await self.app(scope, receive, _send)

  File "/home/adminuser/venv/lib/python3.11/site-packages/starlette/middleware/exceptions.py", line 65, in __call__

    await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)

  File "/home/adminuser/venv/lib/python3.11/site-packages/starlette/_exception_handler.py", line 64, in wrapped_app

    raise exc

  File "/home/adminuser/venv/lib/python3.11/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app

    await app(scope, receive, sender)

  File "/home/adminuser/venv/lib/python3.11/site-packages/starlette/routing.py", line 756, in __call__

    await self.middleware_stack(scope, receive, send)

  File "/home/adminuser/venv/lib/python3.11/site-packages/starlette/routing.py", line 776, in app

    await route.handle(scope, receive, send)

  File "/home/adminuser/venv/lib/python3.11/site-packages/starlette/routing.py", line 297, in handle

    await self.app(scope, receive, send)

  File "/home/adminuser/venv/lib/python3.11/site-packages/starlette/routing.py", line 77, in app

    await wrap_app_handling_exceptions(app, request)(scope, receive, send)

  File "/home/adminuser/venv/lib/python3.11/site-packages/starlette/_exception_handler.py", line 64, in wrapped_app

    raise exc

  File "/home/adminuser/venv/lib/python3.11/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app

    await app(scope, receive, sender)

  File "/home/adminuser/venv/lib/python3.11/site-packages/starlette/routing.py", line 72, in app

    response = await func(request)

               ^^^^^^^^^^^^^^^^^^^

  File "/home/adminuser/venv/lib/python3.11/site-packages/fastapi/routing.py", line 278, in app

    raw_response = await run_endpoint_function(

                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "/home/adminuser/venv/lib/python3.11/site-packages/fastapi/routing.py", line 193, in run_endpoint_function

    return await run_in_threadpool(dependant.call, **values)

           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "/home/adminuser/venv/lib/python3.11/site-packages/starlette/concurrency.py", line 42, in run_in_threadpool

    return await anyio.to_thread.run_sync(func, *args)

           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "/home/adminuser/venv/lib/python3.11/site-packages/anyio/to_thread.py", line 56, in run_sync

    return await get_async_backend().run_sync_in_worker_thread(

           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "/home/adminuser/venv/lib/python3.11/site-packages/anyio/_backends/_asyncio.py", line 2177, in run_sync_in_worker_thread

    return await future

           ^^^^^^^^^^^^

  File "/home/adminuser/venv/lib/python3.11/site-packages/anyio/_backends/_asyncio.py", line 859, in run

    result = context.run(func, *args)

             ^^^^^^^^^^^^^^^^^^^^^^^^

  File "/mount/src/metro_analyst/menu_crawler.py", line 390, in crawler_endpoint

    menu_crawler(url, is_area)

  File "/mount/src/metro_analyst/menu_crawler.py", line 297, in menu_crawler

    with SB(uc=True, headless=True) as sb:

  File "/usr/local/lib/python3.11/contextlib.py", line 137, in __enter__

    return next(self.gen)

           ^^^^^^^^^^^^^^

  File "/home/adminuser/venv/lib/python3.11/site-packages/seleniumbase/plugins/sb_manager.py", line 955, in SB

    sb.setUp()

  File "/home/adminuser/venv/lib/python3.11/site-packages/seleniumbase/fixtures/base_case.py", line 14838, in setUp

    self.driver = self.get_new_driver(

                  ^^^^^^^^^^^^^^^^^^^^

  File "/home/adminuser/venv/lib/python3.11/site-packages/seleniumbase/fixtures/base_case.py", line 4037, in get_new_driver

    new_driver = browser_launcher.get_driver(

                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "/home/adminuser/venv/lib/python3.11/site-packages/seleniumbase/core/browser_launcher.py", line 1847, in get_driver

    return get_local_driver(

           ^^^^^^^^^^^^^^^^^

  File "/home/adminuser/venv/lib/python3.11/site-packages/seleniumbase/core/browser_launcher.py", line 3790, in get_local_driver

    driver = undetected.Chrome(

             ^^^^^^^^^^^^^^^^^^

  File "/home/adminuser/venv/lib/python3.11/site-packages/seleniumbase/undetected/__init__.py", line 226, in __init__

    raise Exception("Chrome not found! Install it first!")

Exception: Chrome not found! Install it first!

[mdmintz]

Exception: Chrome not found! Install it first!

The exception message was clear: Chrome not found! Install it first!

SeleniumBase does not install Chrome for you. Chrome needs to be installed separately before running SeleniumBase tests.

[mdmintz]

SeleniumBase does not install Chrome for you. On Linux, you will need to get google-chrome-stable. The steps may be a little different depending on the flavor of Linux that you have. See StackOverflow, (or similar), for determining the best way to install Chrome on your system.

[Orbiszeus]

I was wondering because I am going to be downloading Chrome to the Streamlit Linux Machine which works like a docker and every push on the Github reflects on there. So, do I have to write a script that downloads Chrome (not the driver), or can I just put a path to a driver? So, I need a script that automatically downloads the Chrome to the Linux Machine? Also do you reckon my script must run evertime the machine stops? What I mean is the script that downloads Chrome to the machine or If it downloads one time and just does not forget?

[mdmintz]

You'll need a script that downloads google-chrome-stable / google-chrome to the Linux machine.

[Orbiszeus]

Would chromium is enough? Or it must be either one of these --> google-chrome-stable / google-chrome

[mdmintz]

Must be either google-chrome-stable or google-chrome.

[Townsend0]

i have the same error altho i have chrome on my machine and it does work on my machine but when uploading it to kaggle it wont work