Trunk Proxy

Rotary proxies are proxies that cyclically change their real IP address. This is used to make it harder to track their location. The port usually changes as well. How this happens depends on the software used on the proxy server.

Fail2Ban is a security tool that analyzes log files for malicious patterns and bans IP addresses that show suspicious activity. Although Fail2Ban is primarily designed to work with TCP-based protocols like SSH, HTTP, and MySQL, it can be configured to work with UDP-based protocols, including UDP flood attacks.

To use Fail2Ban to protect your server from UDP flood attacks, follow these steps:

1. Install Fail2Ban:

sudo apt-get update
sudo apt-get install fail2ban

2. Create a custom UDP log file:

Create a log file to store the UDP flood attack data. This log file should be located in the /var/log/ directory, and it should have the appropriate permissions. For example, you can create a log file named udp-flood.log:

sudo touch /var/log/udp-flood.log
sudo chown syslog:adm /var/log/udp-flood.log
sudo chmod 640 /var/log/udp-flood.log

3. Configure Fail2Ban to monitor the UDP log file:

Create a new filter file for UDP flood attacks, for example, /etc/fail2ban/filter.d/udp-flood.conf:

[Definition]
failregex = ^.*UDP.*Flood.*
ignoreregex =

Replace HOST with the actual hostname or IP address of your server, and with the IP address of the attacking host.

Next, create a new action file for UDP flood attacks, for example, /etc/fail2ban/action.d/udp-flood.conf:

[Definition]
actionstart =
actionstop =
actioncheck =
actionban = iptables -I INPUT -s  -j DROP; iptables-save
actionunban = iptables -D INPUT -s  -j DROP; iptables-save

Replace IP with the IP address of the banned host.

Finally, create a new jail configuration file for UDP flood attacks, for example, /etc/fail2ban/jail.d/udp-flood.local.conf:

[udp-flood]
enabled = true
port = 
logpath = /var/log/udp-flood.log
maxretry = 3
findtime = 300
bantime = 1800
action = udp-flood

Replace UDP_PORT with the UDP port you want to monitor.

Reload Fail2Ban configuration:

sudo systemctl reload fail2ban

To use a proxy, follow these steps:

1. Choose a proxy server: Select a reliable proxy server from a reputable list.

2. Configure your browser or software: Set up your browser or software to use the proxy server.

3. Test the connection: Verify that the proxy is working correctly by checking your IP address or using a proxy checker tool.

4. Monitor your connection: Keep an eye on the connection for stability and speed.

5. Be cautious: Be aware of potential security risks and avoid sharing sensitive information while using proxies.

To keep only unique external links while scraping with Scrapy, you can use a set to track the visited external links and filter out duplicates. Here's an example spider that demonstrates how to achieve this:

import scrapy
from urllib.parse import urlparse, urljoin

class UniqueLinksSpider(scrapy.Spider):
    name = 'unique_links'
    start_urls = ['http://example.com']  # Replace with the starting URL of your choice
    visited_external_links = set()

    def parse(self, response):
        # Extract all links from the current page
        all_links = response.css('a::attr(href)').extract()

        for link in all_links:
            full_url = urljoin(response.url, link)

            # Check if the link is external
            if urlparse(full_url).netloc != urlparse(response.url).netloc:
                # Check if it's a unique external link
                if full_url not in self.visited_external_links:
                    # Add the link to the set of visited external links
                    self.visited_external_links.add(full_url)

                    # Yield the link or process it further
                    yield {
                        'external_link': full_url
                    }

        # Follow links to other pages
        for next_page_url in response.css('a::attr(href)').extract():
            yield scrapy.Request(url=urljoin(response.url, next_page_url), callback=self.parse)

- visited_external_links is a class variable that keeps track of the unique external links across all instances of the spider.
- The parse method extracts all links from the current page.
- For each link, it checks if it is an external link by comparing the netloc (domain) of the current page and the link.
- If the link is external, it checks if it is unique by looking at the visited_external_links set.
- If the link is unique, it is added to the set, and the spider yields the link or processes it further.
- The spider then follows links to other pages, recursively calling the parse method.

Remember to replace the start_urls with the URL from which you want to start scraping.

You can bypass the blocking of the messenger by using the built-in proxy server in the application. To do this, go to "Settings" and then to the section "Data and storage". Here, in the "Proxy settings" tab, you will find the "Add proxy" item. A shield icon on the top line of the menu will indicate that the proxy is enabled.