Gelbooru Proxy

The first thing you need to do to use a proxy in your browser is to make the necessary settings. In Google Chrome browser, go to "Network" and then find and click on "Change proxy settings". In the "Internet properties" window that opens, go to "Connection" and click on the "Network settings" button at the bottom. When a new window opens, check the "Use proxy server for local connections" box and the "Do not use proxy server for local addresses" box. Enter the proxy port and IP address in the corresponding fields, close the window and click "OK".

One way to bypass parsing protection is to use a proxy server. After all, collecting information is most often done through special software. And it can be automatically blocked. But not when a proxy or VPN is used.

To scrape images in C#, you can use the HTMLAgilityPack library for parsing HTML and retrieving image URLs. Here's a basic example

Install HTMLAgilityPack

You can install the HTMLAgilityPack NuGet package using the following command in the Package Manager Console:

Install-Package HtmlAgilityPack

Write a C# script to scrape images:

using System;
using System.Collections.Generic;
using HtmlAgilityPack;

class Program
{
    static void Main()
    {
        string url = "https://example.com"; // Replace with the URL of the page you want to scrape images from

        // Download HTML content from the URL
        HtmlWeb web = new HtmlWeb();
        HtmlDocument document = web.Load(url);

        // Extract image URLs
        List imageUrls = ExtractImageUrls(document, url);

        // Print the extracted image URLs
        foreach (string imageUrl in imageUrls)
        {
            Console.WriteLine(imageUrl);
        }
    }

    static List ExtractImageUrls(HtmlDocument document, string baseUrl)
    {
        List imageUrls = new List();

        // Select image elements using XPath
        var imageElements = document.DocumentNode.SelectNodes("//img[@src]");

        if (imageElements != null)
        {
            foreach (var imageElement in imageElements)
            {
                // Extract image URL from the src attribute
                string imageUrl = imageElement.GetAttributeValue("src", "");

                // Make the URL absolute if it's a relative URL
                imageUrl = new Uri(new Uri(baseUrl), imageUrl).AbsoluteUri;

                // Add the URL to the list
                imageUrls.Add(imageUrl);
            }
        }

        return imageUrls;
    }
}

This script uses HTMLAgilityPack to load the HTML content of a webpage and extract image URLs using XPath. The ExtractImageUrls method selects image elements with the XPath query "//img[@src]", retrieves the src attribute, and converts relative URLs to absolute URLs.

Run the script:

Replace the url variable with the URL of the webpage you want to scrape images from.

Run the script to see the list of image URLs.

Selenium WebDriver primarily supports locating elements using a variety of locator strategies such as ID, class name, tag name, name, xpath, and CSS selector. However, jQuery locators are not directly supported in Selenium WebDriver by default.

If you want to use jQuery selectors to locate elements, you have a few options

1. Execute jQuery Commands with JavaScript

You can execute JavaScript code, including jQuery, using the execute_script method in Selenium WebDriver. This allows you to leverage jQuery selectors to find elements.

from selenium import webdriver

driver = webdriver.Chrome()
driver.get("https://example.com")

# Example: Using jQuery to find an element by class name
element = driver.execute_script("return $('.your-class-name')[0];")

# Interact with the element
element.click()

driver.quit()

In this example, replace $('.your-class-name')[0]; with your actual jQuery selector.

2. Use WebDriver's Built-in Locators

In most cases, you can achieve the same result using Selenium WebDriver's built-in locator strategies without relying on jQuery. For example, to locate an element by class name:

from selenium import webdriver

driver = webdriver.Chrome()
driver.get("https://example.com")

# Example: Using WebDriver's built-in class name locator
element = driver.find_element_by_class_name("your-class-name")

# Interact with the element
element.click()

driver.quit()

Use CSS selectors, XPath, or other supported locators based on your specific needs.

Using the built-in WebDriver locators is generally recommended as it avoids the need to include jQuery and simplifies your code. However, if you have a specific reason to use jQuery, you can resort to executing JavaScript code as demonstrated in the first option.

In Windows 10 you need to go to "Settings", go to "Network and Internet", open the tab "Proxy" and make the necessary settings for the connection (under "Manual", the item should also be made active).