Home / Questions / 402091
Accepted
Juan Luis
Asked: 2021-10-29 09:49:39 +0800 CST 2021-10-29 09:49:39 +0800 CST

Problem downloading file in python

  • 772

I am trying to download some microdata from the Canary Institute of Statistics , specifically the microdata from the Survey on Tourist Expenditure for the first quarter of 2020.

This is what I have tried:

import requests
url = 'http://www.gobiernodecanarias.org/istac/galerias/documentos/C00028A/egt-metodologia-2018-microdatos-2020q1.html'
EGT = requests.get(url)
EGT

And python returns me: <Response [200]>

I have also tried:

import wget
 
url = 'http://www.gobiernodecanarias.org/istac/galerias/documentos/C00028A/egt-metodologia-2018-microdatos-2020q1.html'
wget.download(url, 'C:\Trabajo\ISTAC_project\ISTAC_python/egt-metodologia-2018-microdatos-2020q1.html')

That generates a file .htmlwith the address where the microdata is in zip format that I need but it does not download the file.

How can I then download the file?

python

2 Answers

  1. Best Answer

    you can do it like this:

    import requests
import os

url = 'http://www.gobiernodecanarias.org/istac/galerias/documentos/C00028A/egt-metodologia-2018-microdatos-2020q1.html'

# permitimos la redireccion con allow_redirects=True
EGT = requests.get(url,allow_redirects=True)

"""
 obtenemos la nueva url
 que nos devuelve la redireccion
 split("/") creamos un arreglo de la url separado por el caracter /
 y con [-1] obtenemos el ultimo elemento del arreglo 

"""
name = EGT.url.split("/")[-1]
# obtenemos el path
path = os.path.join(os.getcwd(),name)

# abrimos un archivo en modo wb = write/binary y + es crear si no existe
with open(path,"wb+") as f:
    # escribimos el contenido devuelto dentro del archivo
    f.write(EGT.content)


print("descarga completa en {}".format(path))
    • 1

  2. This alternative reads and saves the file to disk. It doesn't unzip it. The end result is that you have a datos.zipin your directory.

    The solution defines a function download_urlthat receives the URL and an output filename. Optionally you can indicate the size of the read buffer.

    import requests

url = 'http://www.gobiernodecanarias.org/istac/galerias/documentos/C00028A/egt-metodologia-2018-microdatos-2020q1.html'

def download_url(url, save_path, chunk_size=128):
    r = requests.get(url, stream=True)
    with open(save_path, 'wb') as fd:
        for chunk in r.iter_content(chunk_size=chunk_size):
            fd.write(chunk)

download_url(url, "datos.zip", 1024)
    • 1