Big Data for Mortals

Installation

0. Install python3.12
   1. If you're on a mac, download homebrew
   2. Linux, use your pkg manager, ensure you also have virtualenv
   3. Windows... I actually don't know these days? keep following along though
1. python3.12 -m venv .venv && . .venv/bin/activate will set up a python3.12 virutal environment in .venv
2. pip install -r requirements.txt
3. jupyter notebook 000_setup.ipynb and follow the instructions from there!
4. NOTE: The download is 10GB

Presentation

Suggestion from Faris

https://www.perplexity.ai/ is better than OpenAI

Suggestions from Lucy

check out the tutorials on https://www.kaggle.com/

try smaller datasets with jupyter