I tried the sample provided within the documentation of the requests library for python. With async.map(rs), I get the response codes, but I want to get the content of each page requested. This, for example, does not work: out = async.map(rs) print out[0].content 14 Answers 14
I’m using the Requests library and accessing a website to gather data from it with the following code: r = requests.get(url) I want to add error testing for when an improper URL is entered and a 404 error is returned. If I intentionally enter an invalid URL, when I do this: print r I get … Read more
I’m performing a simple task of uploading a file using Python requests library. I searched Stack Overflow and no one seemed to have the same problem, namely, that the file is not received by the server: import requests url=”http://nesssi.cacr.caltech.edu/cgi-bin/getmulticonedb_release2.cgi/post” files={‘files’: open(‘file.txt’,’rb’)} values={‘upload_file’ : ‘file.txt’ , ‘DB’:’photcat’ , ‘OUT’:’csv’ , ‘SHORT’:’short’} r=requests.post(url,files=files,data=values) I’m filling the value … Read more
This is the raw request for an API call: POST http://192.168.3.45:8080/api/v2/event/log?sessionKey=b299d17b896417a7b18f46544d40adb734240cc2&format=json HTTP/1.1 Accept-Encoding: gzip,deflate Content-Type: application/json Content-Length: 86 Host: 192.168.3.45:8080 Connection: Keep-Alive User-Agent: Apache-HttpClient/4.1.1 (java 1.5) {“eventType”:”AAS_PORTAL_START”,”data”:{“uid”:”hfe3hf45huf33545″,”aid”:”1″,”vid”:”1″}}””” This request returns a success (2xx) response. Now I am trying to post this request using requests: >>> import requests >>> headers = {‘content-type’ : ‘application/json’} >>> data … Read more
Just a short, simple one about the excellent Requests module for Python. I can’t seem to find in the documentation what the variable ‘proxies’ should contain. When I send it a dict with a standard “IP:PORT” value it rejected it asking for 2 values. So, I guess (because this doesn’t seem to be covered in … Read more
Im using Python 2.7.3 and Requests. I installed Requests via pip. I believe it’s the latest version. I’m running on Debian Wheezy. I’ve used Requests lots of times in the past and never faced this issue, but it seems that when making https requests with Requests I get an InsecurePlatform exception. The error mentions urllib3, … Read more
I’m trying to get the content of App Store > Business: import requests from lxml import html page = requests.get(“https://itunes.apple.com/in/genre/ios-business/id6000?mt=8”) tree = html.fromstring(page.text) flist = [] plist = [] for i in range(0, 100): app = tree.xpath(“//div[@class=”column first”]/ul/li/a/@href”) ap = app[0] page1 = requests.get(ap) When I try the range with (0,2) it works, but when … Read more
What’s the best way to download a python package and it’s dependencies from pypi for offline installation on another machine? Is there any easy way to do this with pip or easy_install? I’m trying to install the requests library on a FreeBSD box that is not connected to the internet. 12 Answers 12
So I recently stumbled upon this great library for handling HTTP requests in Python; found here http://docs.python-requests.org/en/latest/index.html. I love working with it, but I can’t figure out how to add headers to my get requests. Help? 4 Answers 4
The Python requests module is simple and elegant but one thing bugs me. It is possible to get a requests.exception.ConnectionError with a message like: Max retries exceeded with url: … This implies that requests can attempt to access the data several times. But there is not a single mention of this possibility anywhere in the … Read more
