Are there any Java frameworks dedicated to web scraping?

Yes, there are several Java frameworks and libraries dedicated to web scraping. These frameworks simplify the process of extracting data from websites by providing tools to fetch, parse, and manipulate HTML and other web content. Below are some of the popular Java frameworks and libraries used for web scraping:

1. Jsoup

Jsoup is a popular Java library for working with real-world HTML. It provides a very convenient API for extracting and manipulating data, using the best of DOM, CSS, and jquery-like methods. Jsoup can parse HTML from a URL, file, or string and provides methods to find and extract data, using DOM traversal or CSS selectors.

Example usage of Jsoup:

import org.jsoup.Jsoup;
import org.jsoup.nodes.Document;
import org.jsoup.nodes.Element;
import org.jsoup.select.Elements;

public class WebScraper {
    public static void main(String[] args) throws Exception {
        String url = "http://example.com";
        Document doc = Jsoup.connect(url).get();
        Elements links = doc.select("a[href]");

        for (Element link : links) {
            System.out.println("Link: " + link.attr("href"));
            System.out.println("Text: " + link.text());
        }
    }
}

2. HtmlUnit

HtmlUnit is a "GUI-Less browser for Java programs." It models HTML documents and provides an API that allows you to invoke pages, fill out forms, click links, etc., just like you do in your normal browser. It has fairly good JavaScript support and is typically used for testing purposes but can also be used for web scraping.

Example usage of HtmlUnit:

import com.gargoylesoftware.htmlunit.WebClient;
import com.gargoylesoftware.htmlunit.html.HtmlPage;

public class WebScraper {
    public static void main(String[] args) {
        WebClient webClient = new WebClient();
        try {
            HtmlPage page = webClient.getPage("http://example.com");
            String pageAsText = page.asText();
            System.out.println(pageAsText);
        } catch (Exception e) {
            e.printStackTrace();
        } finally {
            webClient.close();
        }
    }
}

3. Jaunt

Jaunt is a Java library for web scraping and JSON querying that makes it easy to search, find, and manipulate data from a webpage or JSON document. It provides a range of search and traversal methods, much like Jsoup.

4. Apache HttpClient

Apache HttpClient can be used for more advanced HTTP operations and handling, such as dealing with login forms, cookies, and custom headers. While not a full-fledged web scraping framework, it's often used in conjunction with other libraries like Jsoup for fetching web pages.

Example usage of Apache HttpClient with Jsoup:

import org.apache.http.client.HttpClient;
import org.apache.http.client.methods.HttpGet;
import org.apache.http.impl.client.HttpClients;
import org.apache.http.util.EntityUtils;
import org.jsoup.Jsoup;
import org.jsoup.nodes.Document;

public class WebScraper {
    public static void main(String[] args) {
        HttpClient client = HttpClients.createDefault();
        HttpGet request = new HttpGet("http://example.com");
        try {
            String responseBody = EntityUtils.toString(client.execute(request).getEntity());
            Document doc = Jsoup.parse(responseBody);
            // Now you can use Jsoup on 'doc' as in the previous examples
        } catch (Exception e) {
            e.printStackTrace();
        }
    }
}

5. WebDriver (Selenium)

Selenium WebDriver is mostly used for automating web applications for testing purposes but can also be used for web scraping. It's particularly useful when you need to interact with web pages that are heavily dependent on JavaScript.

When choosing a Java framework for web scraping, consider the complexity of the web pages you want to scrape, your familiarity with the framework, and the specific features you need, such as JavaScript execution or handling complex navigation scenarios.