Quic Proxy

If your proxy gives you a 504 error, it means the server failed to complete the request within the time period you specified. Refreshing the page may help. Another option is to switch to another browser. You can also use the incognito mode, pre-clearing the browser cache. Pay attention to plug-ins that can also cause this error.

Free proxies, while seemingly profitable and attractive, are actually not very effective. They cannot boast of security, speed, stability and acceptable duration of work. Qualitative and reliable proxies require a certain investment, but they can be obtained from companies that have a good reputation as proxy service providers. You can also find out about all the nuances of proxy selection with the help of special proxy databases.

While using Selenium for web automation, it's important to note that websites can detect the presence of automation tools, including Selenium. To reduce the chances of detection, you can take certain measures to make your Selenium-driven browser instance appear more like a regular user. Here are some techniques to hide Selenium from the browser

1. User Agent Spoofing

Change the user agent of the browser to mimic that of a real user. This can be done by setting the user agent string before launching the browser:

from selenium import webdriver

options = webdriver.ChromeOptions()
options.add_argument("--user-agent=Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/91.0.4472.124 Safari/537.36")

driver = webdriver.Chrome(options=options)

2. Window Size and Position

Set the window size and position to common values used by human users. This can be done using the set_window_size and set_window_position methods:

driver.set_window_size(1366, 768)
driver.set_window_position(0, 0)

3. Disable Browser Extensions

Disable browser extensions to make the browser instance more similar to a clean user profile:

options.add_argument("--disable-extensions")

4. Headless Mode

Run the browser in headless mode, which means it runs without a graphical user interface. Headless mode can be less likely to be detected:

options.add_argument("--headless")

5. Disable Images and CSS

Some automation detection mechanisms analyze whether images and CSS are loaded. You can disable them:

prefs = {"profile.managed_default_content_settings.images": 2, "profile.managed_default_content_settings.stylesheet": 2}
options.add_experimental_option("prefs", prefs)

6. Change Automation Flags

Some websites use JavaScript to detect automation. You can experiment with changing the values of WebDriver-related flags:

options.add_argument("--disable-blink-features=AutomationControlled")

7. Use Proxies

Rotate IP addresses using proxies to mimic different users accessing the site.

Simply, in the connection properties of your PC or mobile device, you need to enter the data of the proxy server through which you will be connecting. In Windows, for example, this is done through "Settings", then "Network and Internet", and in the next window you should open the tab "Proxy server".

Enter the settings using the gear icon (home screen) and click on it. Under "Wireless Networks", click on "Wi-Fi" and then click on "WiredSSID" and select "Change Network". Check the "Advanced" checkbox, and then select "Manual" for the proxy server. Click "Save" and close the settings.