Skip to content

Updated

Screaming Frog Proxy:
Settings, Login and Crawl Speed

  1. Screaming Frog takes one proxy for the whole crawl: open Network settings, tick Use Proxy Server, enter host and port, tick Use Proxy Credentials for the login, and restart the program.
  2. Pick an HTTP endpoint (port 2222 on Proxy302), because the settings we read mention no SOCKS support.
  3. The exit IP decides which country the site sees, and the speed settings decide whether you start getting 429 errors.

Check it right after buyingExample output

curl -x http://USER:PASS@HOST:PORT https://ipinfo.io/json

ip
203.0.113.24
country
US
Matches the country you picked
Day 15
203.0.113.24
Same address for the whole term
Example addresses (203.0.113.0/24), not real exits
01 / 08Where the proxy goes

Set the proxy once in Network settings, restart, then slow the crawl down in Speed settings before you scale it up.

Where the proxy goes

In the Windows and Linux builds the settings are under File > Settings > Network. On macOS they are under Screaming Frog SEO Spider > Settings > Network. Tick Use Proxy Server, enter the address and port, and tick Use Proxy Credentials if the proxy needs a username and password. The program has to be restarted for the change to apply.

Two limits matter for planning. Only one proxy can be configured, and you cannot add exceptions, so every HTTP and HTTPS request of the crawl goes through it or none does. The same Network section holds Use IPv4 Only, which is on by default.

Settings that matter for a crawl through a proxy

Settings that matter for a crawl through a proxy
ItemWhereWhat it does
Use Proxy ServerSettings > NetworkSends the crawl through the proxy address and port you enter.
Use Proxy CredentialsSettings > NetworkAdds the proxy username and password. Without it a proxy that needs a login answers 407.
Max ThreadsConfiguration > SpeedSimultaneous requests, default 5. Lower it first if the site slows down.
Limit URI/sConfiguration > SpeedCaps requests per second through Max URL/s. The guide notes Max Threads can be left alone when you throttle this way.
Auto throttleConfiguration > SpeedSlows requests to a host that pushes back with 429 or 503 responses.

Menu names from the Screaming Frog user guide, read 20 November 2026. Names can change between versions.

Geo, login and what a proxy changes

A proxy changes the IP address the site sees, so it is the tool for checking what visitors in another country get: redirects by country, language versions, localised prices. It does not change the User-Agent, so set that separately if the site reacts to it.

If the target site itself needs a login, that is a different setting from Use Proxy Credentials: the proxy login only opens the proxy.

Which IP fits which crawl

Which IP fits which crawl
ItemFits whenWatch for
Rotating residentialYou audit many pages and want requests to leave from different IPs, or you check another country.A new IP on each new connection, a reused keep-alive connection keeps its IP, so logged-in or IP-allowlisted pages can break.
Static ISPThe site allows crawling only from a fixed IP, or you want the same IP for repeated audits.One fixed IP carries the whole crawl, so keep Max Threads and URL/s low.
Rotating datacenterUS-only checks where speed matters and IP type does not.Many sites treat datacenter IPs more strictly than residential ones.

Behaviour of Proxy302 lines from the product facts and line tests, 20 November 2026. No result is guaranteed for a given site.

Set it up with Proxy302

  1. Step 1

    In the console choose the line and generate the connection. For rotating residential one login works over HTTP on port 2222 and SOCKS5 on port 3333; use the HTTP line for Screaming Frog.

  2. Step 2

    Open My assets and copy HOST, PORT, USERNAME and PASSWORD.

  3. Step 3

    In Screaming Frog tick Use Proxy Server, enter HOST and the HTTP port, tick Use Proxy Credentials, paste the login, then restart the program.

  4. Step 4

    Crawl a handful of URLs first, with Max Threads at 1 or 2 or Limit URI/s on, and check the response codes before you raise the speed.

  5. Step 5

    To confirm the country, crawl https://ipinfo.io/json through the same proxy and read the exit IP.

Common problems

Every URL returns 407 or a connection error

Check Use Proxy Credentials is ticked, the username and password are copied in full, and the port is the HTTP one.

Fix Copy the values from My assets again and restart the program.

Stop when If a curl request through the same proxy also fails, the problem is the proxy details, not Screaming Frog.

Crawl runs, then 429 or 503 appears

Check Max Threads and URL/s are too high for the site.

Fix Turn on Limit URI/s, lower Max URL/s, and keep Auto throttle on.

Stop when If 429 stays at one URL per second, stop and ask the site owner for an allowance.

Pages differ from what you see in a browser

Check The browser is not using the same proxy, or the site reacts to the User-Agent.

Fix Check the exit IP in the browser and in the crawler, and compare the User-Agent.

Stop when Pages that need a login are not covered by the proxy login.

Questions about Screaming Frog and proxies

How do I add a proxy to Screaming Frog?

Open Settings > Network, tick Use Proxy Server, enter address and port, tick Use Proxy Credentials for a login, and restart. On macOS the menu is Screaming Frog SEO Spider > Settings > Network.

Can Screaming Frog use several proxies?

Only one proxy can be configured. To get different exit IPs over a crawl, use one gateway address that changes the IP on each new connection.

Does Screaming Frog support SOCKS5?

The settings we read describe an address, a port and credentials and do not mention SOCKS. Use an HTTP proxy line to stay on the documented path.

How fast should a crawl through a proxy run?

Start low, for example Max Threads at 1 or 2 or Limit URI/s on, watch for 429 and 503 responses, and raise the speed in small steps.

Does a proxy guarantee the crawl is not blocked?

No. A proxy changes the IP only; the site can still react to speed, User-Agent and other signals.

Further reading

Setup guides Proxy302 publishes on GitHub on the same topic:

Reference links

2
  1. Screaming Frog SEO Spider user guide: Configuration

    Official documentation · Confirmed on:

    Read on 20 November 2026: proxy settings sit under File > Settings > Network (Windows, Linux) or Screaming Frog SEO Spider > Settings > Network (macOS) with the options "Use Proxy Server" and "Use Proxy Credentials"; one proxy only, restart required; speed is under Configuration > Speed with Max Threads (default 5), Limit URI/s with Max URL/s, and auto throttle for 429 and 503.

  2. Proxy302 product facts and price list

    Product observation · Confirmed on:

    Product facts file of the site (values checked against the console, the backend and the price table on 18-19 October 2026): products, prices in US$ (1 PTC = US$1), lease terms, protocols and ports, countries, quantity limits, no free trial.

Ready to try it?

Create an account, top up once, then pick rotating residential, static ISP or datacenter IPs and have one running in your browser within minutes.