A check page or HTTP 403 appears
Check Requests are too fast, or the path is one the site closes.
Fix Slow down, reduce parallel requests and compare the path with robots.txt; adding IPs is not the fix.
Updated
curl -x http://USER:PASS@HOST:PORT https://ipinfo.io/json
Property sites are country-bound and strict about paths: choose the exit country, read the robots.txt and pace slowly.
Property portals are local: Zillow and Redfin cover the United States, and Idealista runs separate Spanish, Italian and Portuguese sites. Results, currency and language follow the country site and the visitor location, and a request from another country may be redirected or shown differently.
Set the proxy country to the market you collect and check the exit before running. For neighbourhood-level work inside the US, the Premium line takes a state or city; see the US state and city guide.
| Item | What we read | What it means for a script |
|---|---|---|
| Zillow (zillow.com) | All crawlers (*): /api/ and /homes/ disallowed, with a list of Allow lines for specific listing-index pages such as /homes/for_sale/ and /homes/for_rent/ and their paged versions; map-rectangle URLs (_rect) disallowed | Only the listed index pages are open; map and API paths are closed, so check each URL against the file |
| Redfin (redfin.com) | All crawlers (*): /stingray/ (with an Allow for newest_listings.rss), /myredfin/, /tools and /api/v1/buildings/properties disallowed; no listing-page path is blocked as a whole. Redfin also publishes downloadable housing market data in its Data Center | Listing pages are not listed as closed, but the internal API paths are; for market-level numbers use the downloads first |
| Idealista (idealista.com) | All crawlers (*): /ajax/*, listing photo and virtual-tour paths (/inmueble*/foto, /inmueble*/visita-virtual), many ?ordenado-por= sort URLs, /pagina/ and /*/pagina-*.htm paged URLs disallowed | Sorting and paging URLs are closed, so a crawl that walks result pages page by page is outside the file; plan around it |
Sources: robots.txt of zillow.com, redfin.com and idealista.com, and the Redfin Data Center page, opened 20 November 2026. The files change often and match the longest rule first; read the current one for every URL pattern you use. This is not legal advice, and site terms may say more.
A new IP is given on each new connection and a reused connection keeps its IP, so the number of IPs is not the lever; the pace is. Concurrent connections are not limited by the proxy, but start with one request every several seconds per site and stop on 429 or a check page.
Collect public listing data only, keep the source URL and date with every record, and do not collect owner or agent personal data. If you need market-level statistics rather than individual listings, Redfin's downloads are the cleaner source and cost no proxy traffic.
import time
import urllib.robotparser
import requests
# One connection per country, copied from My assets (HTTP port 2222; the same login also works over SOCKS5 on 3333).
PROXY = "http://LOGIN:PASSWORD@proxy.proxy302.com:2222"
PROXIES = {"http": PROXY, "https": PROXY}
UA = "my-housing-research/1.0 (contact: you@example.com)"
CHECKS = [
("https://www.zillow.com", "/homes/for_sale/"),
("https://www.redfin.com", "/city/30772/TX/Austin"),
] # replace with the public pages you are allowed to read
print("exit country:", requests.get("https://ipinfo.io/json", proxies=PROXIES, timeout=(5, 20)).json().get("country"))
for site, path in CHECKS:
rp = urllib.robotparser.RobotFileParser(site + "/robots.txt")
rp.read()
if not rp.can_fetch(UA, site + path):
print("robots.txt says no:", site + path)
continue
r = requests.get(site + path, proxies=PROXIES, headers={"User-Agent": UA}, timeout=(5, 20))
print(site + path, r.status_code, len(r.text))
time.sleep(5) # keep the pace slow; stop on 429 or a check page
Illustrative example: replace LOGIN, PASSWORD, the contact address and the paths. For SOCKS5 install requests[socks] and use socks5h:// with port 3333.
Open Rotating Residential Proxies. Budget is US$1.50 per GB (country level); Premium is US$5 per GB and lets you pick a state or city.
Set the Region to the United States, Spain or the country you read, and generate a connection. Copy host, port, username and password from My assets.
Run the script above or open ipinfo.io through the proxy. Expected: the country you set.
Fetch only paths the file leaves open, pause between requests, and save the listing URL, the country site and the date.
Check Requests are too fast, or the path is one the site closes.
Fix Slow down, reduce parallel requests and compare the path with robots.txt; adding IPs is not the fix.
Check The exit country does not match the site you read.
Fix Check the exit on ipinfo.io and set the country of that site.
Check requests[socks] is not installed.
Fix Run python -m pip install "requests[socks]" or use the HTTP line on port 2222.
Rotating residential in the United States, from US$1.50 per GB. Zillow's robots.txt closes /homes/ except listed index pages, so check each URL against it first.
Its robots.txt closes sort and paged result URLs and some media paths. Read the file and the site terms; a proxy does not change what is allowed.
Yes: Redfin's Data Center offers downloadable housing market data.
Only for neighbourhood-level work. Premium takes a state or city; country-level collection works on Budget.
Setup guides Proxy302 publishes on GitHub on the same topic:
Official documentation · Confirmed on:
Opened on 20 November 2026: All crawlers (*): /api/ and /homes/ disallowed, with a list of Allow lines for specific listing-index pages such as /homes/for_sale/ and /homes/for_rent/ and their paged versions; map-rectangle URLs (_rect) disallowed
robots.txt is a crawler-etiquette file and can change; it is not a legal opinion and the site terms may say more.
Official documentation · Confirmed on:
Opened on 20 November 2026: All crawlers (*): /stingray/ (with an Allow for newest_listings.rss), /myredfin/, /tools and /api/v1/buildings/properties disallowed; no listing-page path is blocked as a whole. Redfin also publishes downloadable housing market data in its Data Center
robots.txt is a crawler-etiquette file and can change; it is not a legal opinion and the site terms may say more.
Official documentation · Confirmed on:
Opened on 20 November 2026: All crawlers (*): /ajax/*, listing photo and virtual-tour paths (/inmueble*/foto, /inmueble*/visita-virtual), many ?ordenado-por= sort URLs, /pagina/ and /*/pagina-*.htm paged URLs disallowed
robots.txt is a crawler-etiquette file and can change; it is not a legal opinion and the site terms may say more.
Official documentation · Confirmed on:
Opened on 20 November 2026: the page offers downloadable housing market data (a weekly and monthly Housing Market Tracker, a Balance of Power report and other trackers) under a Downloads section.
Official documentation · Confirmed on:
Opened on 17 November 2026 and re-read 20 November: proxies are passed as a dict to the proxies argument; user:password goes in the URL; SOCKS needs requests[socks]; socks5h resolves DNS on the proxy; requests have no timeout unless one is set.
Product observation · Confirmed on:
Product facts file of the site (dated 10 November 2026), read on 20 November 2026: per-GB prices of both rotating residential lines, traffic does not expire, countries and city targeting, protocols and ports, no free trial.
Create an account, top up once, then pick rotating residential, static ISP or datacenter IPs and have one running in your browser within minutes.