--- title: datahelper keywords: fastai sidebar: home_sidebar summary: "Generic helper functions that are independent of the specific machine learning library used" description: "Generic helper functions that are independent of the specific machine learning library used" nb_path: "data_helper.ipynb" ---
{% raw %}
{% endraw %} {% raw %}

download_data_files[source]

download_data_files(data_dir:str='data', overwrite=False, progbar=True, use_int32=True)

Downloads the data from google drive.

  • data_dir: relative path to where data is downloaded.
  • overwrite: If files exist they will not be downloaded again. NB/todo: the function does not check if there is a complete download of the file.
  • progbar: simple progbar that says how much data that has been downloaded for each file.
  • use_int32: The interaction data is a very large file and is not possible to load into memory in some cases (e.g. google colab). Therefore, we recommend using the int32 data type when loading the data.
{% endraw %} {% raw %}
{% endraw %}