Wayback Machine Proxy

Go to "Control Panel" and in "Small icons" mode, find the item "Browser properties", aka "Internet Options". In the "Connection" tab, click on "Network Settings", and then leave the item "Automatic detection of parameters" enabled in the window that opens, and disable everything else.

To scrape JSON data using RxJava in a Java application, you can use the RxJava library along with an HTTP client library to make requests. Below is an example using RxJava2 and OkHttp to scrape JSON data from a URL asynchronously.

Add Dependencies

Add the following dependencies to your project:

    io.reactivex.rxjava2
    rxjava
    2.x.y 




    com.squareup.okhttp3
    okhttp
    4.x.y 

Write the Code:

import io.reactivex.Observable;
import io.reactivex.schedulers.Schedulers;
import okhttp3.OkHttpClient;
import okhttp3.Request;
import okhttp3.Response;

public class JsonScrapingExample {

    public static void main(String[] args) {
        String url = "https://api.example.com/data"; // Replace with your JSON API URL

        // Create an Observable that emits a single item (the URL)
        Observable.just(url)
                .observeOn(Schedulers.io()) // Specify the IO thread for network operations
                .map(JsonScrapingExample::fetchJson)
                .subscribe(
                        jsonData -> {
                            // Process the JSON data (replace this with your scraping logic)
                            System.out.println("Scraped JSON data: " + jsonData);
                        },
                        Throwable::printStackTrace
                );
    }

    // Function to fetch JSON data using OkHttp
    private static String fetchJson(String url) throws Exception {
        OkHttpClient client = new OkHttpClient();
        Request request = new Request.Builder()
                .url(url)
                .build();

        try (Response response = client.newCall(request).execute()) {
            if (!response.isSuccessful()) {
                throw new Exception("Failed to fetch JSON. HTTP Code: " + response.code());
            }

            // Return the JSON data as a string
            return response.body().string();
        }
    }
}

2. • Replace the url variable with the actual URL of the JSON API you want to scrape.
   • The fetchJson function uses OkHttp to make an HTTP request and fetch the JSON data.

3. Run the Code:

   • Execute the Java code to fetch and process the JSON data asynchronously using RxJava.

This example uses RxJava's Observable to create an asynchronous stream of events. The observeOn(Schedulers.io()) part specifies that the network operation (fetchJson) should run on the IO thread to avoid blocking the main thread.

Make sure to handle exceptions appropriately and adjust the code based on the structure of the JSON API you are working with.

In Selenium, you can add headers to your web requests using the webdriver.ChromeOptions class. This is useful when you want to simulate certain HTTP headers in your Selenium-driven browser. Here's an example of how to add headers to Selenium using the Chrome WebDriver:

from selenium import webdriver

# Create ChromeOptions object
chrome_options = webdriver.ChromeOptions()

# Add headers to the options
chrome_options.add_argument("--disable-blink-features=AutomationControlled")  # Example header

# Instantiate the Chrome WebDriver with options
driver = webdriver.Chrome(options=chrome_options)

# Now you can use the driver for your automation tasks
driver.get("https://example.com")

# Close the browser window when done
driver.quit()

In this example, we use the add_argument method of ChromeOptions to add headers. The specific argument --disable-blink-features=AutomationControlled is an example of a header that might be used to mitigate detection mechanisms that check for automation.

You can customize the headers by adding more add_argument calls with the desired headers. Here's an example of adding custom headers:

chrome_options.add_argument("user-agent=Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/91.0.4472.124 Safari/537.36")
chrome_options.add_argument("accept-language=en-US,en;q=0.9")
# Add more headers as needed

Remember to adapt the headers based on your requirements and the website you are interacting with. The headers you add should mimic those of a regular user to reduce the chances of detection.

To enter the browser in normal mode via Selenium WebDriver, you need to set the desired capabilities for the browser you want to use. Here's an example of how to do this in Python:

from selenium import webdriver
from selenium.webdriver.common.desired_capabilities import DesiredCapabilities

# Set the desired capabilities for the browser
desired_caps = DesiredCapabilities.CHROME
desired_caps['browserName'] = 'chrome'
desired_caps['version'] = 'latest'

# Initialize the WebDriver with the desired capabilities
driver = webdriver.Chrome(desired_capabilities=desired_caps)

# Open a web page in normal mode
driver.get('https://www.example.com')

# Do some actions on the web page
# ...

# Close the browser
driver.quit()

In this example, we are using the Chrome browser, but you can replace 'chrome' with any other browser that Selenium supports, such as 'firefox', 'edge', or 'safari'. The 'version' parameter is set to 'latest', which means that the latest version of the browser will be used.

Note that the DesiredCapabilities class is deprecated in the latest versions of Selenium. Instead, you can use the ChromeOptions class for Chrome or the FirefoxOptions class for Firefox to set the desired capabilities. Here's an example using ChromeOptions:

from selenium import webdriver
from selenium.webdriver.chrome.options import Options

# Set the desired capabilities for the browser
chrome_options = Options()
chrome_options.add_argument('--start-maximized')  # Optional: start the browser in full screen

# Initialize the WebDriver with the desired capabilities
driver = webdriver.Chrome(options=chrome_options)

# Open a web page in normal mode
driver.get('https://www.example.com')

# Do some actions on the web page
# ...

# Close the browser
driver.quit()

This will also open the Chrome browser in normal mode.

In Telegram on PC, proxies can be set up through the application settings. You need to open the "Advanced settings" item, then - select "Connection type". By default, the Windows system proxy is used, but you can specify it manually or disable it altogether.