Jsoup set user agent example shows how to set Jsoup user agent in Java. The example also shows the default Jsoup user agent as well as how to set Jsoup user agent to Google Chrome, Firefox or any other browser of your choice.
What is the default Jsoup user agent?
When you connect to any URL or website, Jsoup uses the Java version of your computer as a default user agent string. That is because, under the hood, Jsoup uses built-in Java classes Connection/HTTPURLConnection to connect to the URL. You can verify the Jsoup default user agent by running the below-given code.
|
1 2 3 4 5 6 7 8 9 10 11 12 13 |
try{ String strText = Jsoup .connect("http://www.useragentstring.com/") .get() .text(); System.out.println(strText); }catch(IOException ioe){ System.out.println("Exception: " + ioe); } |
Output
|
1 |
UserAgentString.com - Java version 1.7.0_60 … |
Your output could be different according to the Java and Jsoup versions you are using.
How to set the user-agent header for Jsoup?
You can use the userAgent method of the Jsoup Connection class to set the user agent of your choice.
|
1 |
Connection userAgent(String userAgent) |
This method sets the “user-agent” header of the request to the value specified as the method argument.
You can verify your browser’s user agent string by visiting http://www.useragentstring.com. The below given example sets the user agent to Chrome 41.0.2228.0.
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 |
package com.javacodeexamples.libraries.jsoup; import java.io.IOException; import org.jsoup.Jsoup; public class SetJSoupUserAgentExample { public static void main(String[] args) { try{ String strText = Jsoup .connect("http://www.useragentstring.com/") .userAgent("Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/41.0.2228.0 Safari/537.36") .get() .text(); System.out.println(strText); }catch(IOException ioe){ System.out.println("Exception: " + ioe); } } } |
Output
|
1 |
UserAgentString.com - Chrome version 41.0.2228.0 … |
You can also set the user agent to mimic a mobile device to request the mobile version of the website. You can do so by setting the user agent to Android, iPhone, Windows, or any other mobile device user agent. You can get a complete list of the user agent string from here.
You should always set the referrer and connection timeout values along with the user agent string. If you are behind a proxy server, you should set the proxy in Jsoup as well. It becomes necessary if your requests are being blocked by the webservers.
This example is a part of the Jsoup tutorial with examples.
Please let us know your views in the comments section below.
About the author
- Gson – Serialize HashMap null entries - April 5, 2023
- Gson: Convert String to JsonObject without POJO - April 5, 2023
- Gson – Convert JSON to a Typed ArrayList - April 5, 2023
Hi !
So you set the proxy for the whole connections from the JVM.
Do you have an idea to set the proxy for this Jsoup.connect() only ?