Change language
Python.Engineering Wiki Max retries exceeded with URL in requests

Max retries exceeded with URL in requests

ast Python module | code Python module | COM PHP module | dis Python module | errno Python module | html Python module | http Python module | imp Python module | io Python module | os Python module | PS PHP module | Python functions | re Python module | Sessions PHP module | socket Python module | StackOverflow | string Python module | trace Python module | traceback Python module | xml Python module
Michael Zippo Michael Zippo

I"m trying to get the content of App Store > Business:

import requests
from lxml import html

page = requests.get("https://itunes.apple.com/in/genre/ios-business/id6000?mt=8")
tree = html.fromstring(page.text)

flist = []
plist = []
for i in range(0, 100):
    app = tree.xpath("//div[@class="column first"]/ul/li/a/@href")
    ap = app[0]
    page1 = requests.get(ap)

When I try the range with (0,2) it works, but when I put the range in 100s it shows this error:

Traceback (most recent call last):
  File "/home/preetham/Desktop/eg.py", line 17, in <module>
    page1 = requests.get(ap)
  File "/usr/local/lib/python2.7/dist-packages/requests/api.py", line 55, in get
    return request("get", url, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/requests/api.py", line 44, in request
    return session.request(method=method, url=url, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/requests/sessions.py", line 383, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python2.7/dist-packages/requests/sessions.py", line 486, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/requests/adapters.py", line 378, in send
    raise ConnectionError(e)
requests.exceptions.ConnectionError: HTTPSConnectionPool(host="itunes.apple.com", port=443): Max retries exceeded with url: /in/app/adobe-reader/id469337564?mt=8 (Caused by <class "socket.gaierror">: [Errno -2] Name or service not known)