NiFi Untrusted Proxy

The basic configuration is written in nginx.conf file in the program directory. You need to create a server article and specify there the port number and the place for cached data. Thus, for example, by using port 8080 you may organize a local proxy to test your own sites.

When scraping dates from a website using Java, the SimpleDateFormat class is commonly used for parsing and formatting dates. Below is an example demonstrating how to scrape dates from a webpage and parse them using SimpleDateFormat. Additionally, you can use a library like Jsoup for HTML parsing.

Make sure to replace the URL, HTML parsing logic, and date format patterns with your specific requirements.

import org.jsoup.Jsoup;
import org.jsoup.nodes.Document;
import org.jsoup.nodes.Element;
import java.io.IOException;
import java.text.ParseException;
import java.text.SimpleDateFormat;
import java.util.Date;

public class DateScrapingExample {

    public static void main(String[] args) {
        String url = "https://example.com"; // Replace with the URL of the webpage containing dates

        try {
            // Fetch HTML content using Jsoup
            Document document = Jsoup.connect(url).get();

            // Replace the following logic with the actual HTML parsing logic for dates
            Element dateElement = document.selectFirst(".date-selector"); // Replace with the appropriate selector
            String dateString = dateElement.text(); // Get the text content of the element

            // Parse the date using SimpleDateFormat
            SimpleDateFormat inputFormat = new SimpleDateFormat("yyyy-MM-dd HH:mm:ss");
            Date parsedDate = inputFormat.parse(dateString);

            // Format the date for display
            SimpleDateFormat outputFormat = new SimpleDateFormat("EEE, MMM d, yyyy 'at' h:mm a");
            String formattedDate = outputFormat.format(parsedDate);

            // Print the formatted date
            System.out.println("Scraped Date: " + formattedDate);
        } catch (IOException | ParseException e) {
            e.printStackTrace();
        }
    }
}

In this example:

• We use the Jsoup library to fetch the HTML content from the specified URL.
• We assume there is an HTML element with a class name of "date-selector" containing the date text. Adjust the selector based on the structure of the webpage you are scraping.
• The SimpleDateFormat class is used to parse the scraped date string into a Date object using the specified input format.
• Another SimpleDateFormat is used to format the date into a more readable output format.

Note: Make sure to handle exceptions appropriately, and adjust the date format patterns according to the actual format used on the webpage.

To save cookies in SQLite3 using Selenium, you'll need to follow these steps:

1. Install the required packages: Make sure you have Selenium and SQLite3 installed. You can install SQLite3 using pip:

pip install sqlite3

2. Connect to the SQLite3 database: Before saving cookies to SQLite3, you need to establish a connection to the database.

import sqlite3

# Connect to the SQLite3 database (or create it if it doesn't exist)
conn = sqlite3.connect("cookies.db")
cursor = conn.cursor()

# Create the cookies table if it doesn't exist
cursor.execute("""
CREATE TABLE IF NOT EXISTS cookies (
    id INTEGER PRIMARY KEY AUTOINCREMENT,
    name TEXT NOT NULL,
    value TEXT NOT NULL,
    domain TEXT NOT NULL,
    path TEXT NOT NULL,
    expiry TEXT NOT NULL
)
""")

# Commit the changes and close the connection
conn.commit()
conn.close()

3. Save cookies to SQLite3 using Selenium: In your Selenium code, you can save cookies to the SQLite3 database by iterating through the cookies in the browser and inserting them into the database.

from selenium import webdriver
from selenium.webdriver.chrome.options import Options
import sqlite3

# Set the path to the ChromeDriver executable
chrome_driver_path = "path/to/chromedriver"

# Set the preference to save downloaded files with a specific name pattern
options = Options()
options.add_argument("download.default_directory='path/to/download/folder'")
options.add_argument(f"download.download_path='path/to/download/folder'")
options.add_preference("download.filename_template", "%f - %r")

# Initialize the Chrome WebDriver with the specified options
driver = webdriver.Chrome(executable_path=chrome_driver_path, options=options)

# Your Selenium code goes here

# Connect to the SQLite3 database
conn = sqlite3.connect("cookies.db")
cursor = conn.cursor()

# Get all cookies from the browser
cookies = driver.get_cookies()

# Insert cookies into the SQLite3 database
for cookie in cookies:
    cursor.execute("""
    INSERT INTO cookies (name, value, domain, path, expiry)
    VALUES (?, ?, ?, ?, ?)
    """, (cookie['name'], cookie['value'], cookie['domain'], cookie['path'], cookie['expiry']))

# Commit the changes and close the connection
conn.commit()
conn.close()

# Your code to save the cookies to SQLite3

# Close the browser
driver.quit()

Replace path/to/chromedriver, path/to/download/folder, and %f - %r with the appropriate values for your setup.

This example saves the cookies from the browser to the SQLite3 database. You can modify the code to load cookies from the database and set them in the browser as needed.

Technically, ISP can block only some intermediary servers by IP-addresses. But it's impossible to block absolutely all VPN-servers, because there are so many of them and their addresses are constantly changing. Accordingly, in this case, you just need to use another VPN-server.

Paid proxies are definitely better and more reliable than free ones. How do you test them? You can simply use the Hidemy Name service. It also shows which protocols the service uses and how reliable the connection is.