Step 1: Local Laptop Cluster Setup

Teach them Local laptops Cluster Setup… then ask them to do it on another laptop and try

scala-2.12.4

jdk-8u202-windows-x64

Anaconda3-2022.10-Windows-x86_64

https://www.apache.org/dyn/closer.lua/spark/spark-3.3.1/spark-3.3.1-bin-hadoop2.tgz

https://github.com/steveloughran/winutils/archive/refs/heads/master.zip

Environment Variables (windows)

HADOOP_HOME = C:\SPARK\hadoop

JAVA_HOME = C:\Program Files\Java\jdk1.8.0_202

SCALA_HOME = C:\SPARK\scala

SPARK_HOME = C:\SPARK\spark

PYSPARK_PYTHON = C:\Users\user\anaconda3\python.exe

PATH Variables:

%SPARK_HOME%\bin

%HADOOP_HOME%\bin

%SCALA_HOME%\bin

%JAVA_HOME%\bin

Jupyter Environment Variables

PYSPARK_DRIVER_PYTHON = C:\Users\User\anaconda3\Scripts\jupyter.exe

PYSPARK_DRIVER_PYTHON_OPTS = notebook

STep 2: Local Spark Shell

people.json

Step 3: Spark cluster in Google Cloud

wordcount.py

pi.py

Step 4: Spark cluster in AWs Databricks

telecom_churn.csv

Step 5: Spark on colab

How To Start A Spark Session & Read in CSV frrom Website.ipynb

Datacamp Pyspark Cheatsheets

Datacamp - PySpark_RDD_Cheat_Sheet.pdf

Datacamp - PySpark_SQL_Cheat_Sheet.pdf

Step 6: Pyspark DataFrames

Dataframes with PySpark Example 1 by Dr Alvin.ipynb

Dataframes with PySpark Example 2 by Dr Alvin.ipynb

purchases.csv (this dataset has 4 millions rows.. u can’t open in Excel!)

DataFrames with PySpark Example 2 (EXERCISE) by Dr Alvin Ang.ipynb

Step 7: Showcase VAEX

VAEX for Crunching Big Data by Dr Alvin Ang.ipynb

Automated_Traffic_Volume_Counts.csv (this dataset is 3GB!!!)

Others

https://sparkbyexamples.com/

dl_data.csv

sales.csv

hierarchical-clustering-with-python-and-scikit-learn-shopping-data.csv

transformations.csv

customer_data.csv

Structured_Streaming_with_PySpark.ipynb

KMEANS_PySpark_by_Dr_Alvin.ipynb

Hierarchical_Clustering_In_Spark_With_Bisecting_K_Means.ipynb

PCA_with_PySpark.ipynb

NN_Pyspark_Dr_Alvin_Ang.ipynb

Normalizer,_Scaler,_Bucketizer_and_Binarizer_with_PySpark_by_Dr_Alvin_Ang.ipynb

8 steps to learn Spark.pdf

Pyspark Cheatsheet.pdf

https://www.linkedin.com/in/nandeshreddy/

Optimus.pdf

Soya Kim - Big Data Healthcare

Spark Commands by Raj Bharat.txt

https://www.youtube.com/watch?v=lisIQ9ohU8g

https://www.datanami.com/2024/03/05/duckdb-walks-to-the-beat-of-its-own-analytics-drum/

IBM Spectrum Conductor SPARK for dummies.pdf

SGX Stock Names.txt

NN_Python_Dr_Alvin_Ang.ipynb

https://starttechacademy.com/cnn-for-computer-vision-in-python/

Keras Datasets: https://keras.io/api/datasets/

Excel Mario Pixels.xls

Singtel.csv

CHEQUE - Digital Recognition by Deep Learning Techniques.pdf

halal food prediction paper using ANN.pdf

https://thehighestofthemountains.com/brainmaps.html

deep learning interview questions.pdf

Keras Cheatsheet.pdf

https://stanford.edu/~shervine/teaching/cs-229/cheatsheet-deep-learning

https://raw.githubusercontent.com/tertiarycourses/datasets/master/video_game_sales_training.csv

https://generated.photos/faces/asian-race

https://quickdraw.withgoogle.com/

https://neuralnetworksanddeeplearning.com/index.html

https://www.dkriesel.com/en/science/neural_networks

https://www.deeplearningbook.org/

ANN

Dr. Alvin’s IBF Day 3 - ANN Regression.ipynb

Dr. Alvin’s IBF Day 3 - ANN Classification.ipynb

CNN

Understanding CNN with Dr. Alvin.ipynb

Dr. Alvin's IBF Day 4 CNN on MNIST Digits Dataset.ipynb

(Classifying Handwritten Digits with CNN)

Trained Classification Model for Fashion MNIST Dataset.h5

Predicting Images of Clothes using CNN by Dr Alvin Ang.ipynb

Predicting Images of Common Objects using CNN by Dr Alvin Ang.ipynb

https://setosa.io/ev/image-kernels/

RNN

Understanding LSTM Input and Output (RNN) by Dr. Alvin Ang.ipynb

IBF Day 4: Predicting DBS Stock Price using RNN by Dr Alvin Ang.ipynb

LSTM Forex Paper.pdf

Datacamp DL Cheatsheets

Datacamp - Keras_Cheat_Sheet.pdf

List / Tuples / Dictionary / Sets

• Why is Python Data Structures Important.pdf

Fall of OOP.pdf

FP instead of OOP.pdf

• slides for Python Fundamentals.pdf

• Python Fundamentals with Dr Alvin.ipynb

• Checklist for Python Fundamental.doc

• WA for Python Fundamental.doc

• PP for Python Fundamental.doc

• RG for WA for Python Fundamental.pdf

• RG for PP for Python Fundamental.pdf

Basic Python Handwritten Programming Notes.pdf

Intermediate

[Comprehension.i.for.i.in.range] + [Mounting.Google.Drive.File.IO] + [Object.Oriented.Programming.Class.Inheritance .Parents] + [SQLite.Databasing] + [Error.Handling.IndexError.IOError.TypeError.ValueError]

Day 2 with Dr Alvin.ipynb

Mounting and Creating Files in Google Drive with Colab.ipynb

Updating HR Records using Object Oriented Programming by Dr. Alvin Ang

• Ch 0: Understanding Instance / Init / Self.ipynb

• Ch 1: Using only 1 Parent Class (Full Time Employees).ipynb

• Ch 2: Using 1 Parent Class (Employee) and 2 Child Classes (Full Time vs Part Time Staff).ipynb

https://pandas.pydata.org/docs/user_guide/visualization.html#visualization-barplot

https://python-tricks.com/matplotlib-introduction/

https://python-tricks.com/plotting-in-pandas/

https://www.tutorialspoint.com/how-to-change-the-text-color-of-font-in-the-legend-using-matplotlib

https://tonysyu.github.io/raw_content/matplotlib-style-gallery/gallery.html

https://www.digitalocean.com/community/tutorials?q=python&hits_per_page=12

Python PDFS

69 Python Projects.pdf

30 Python Libraries to Boost Your Data Science Productivity.pdf

Python Data Science Tips Full Archive by avi chawla. subs tack. com

Alvin's Answer for Plano's Assessment.pdf

OOP cheatsheet.pdf

How to learn Python like a Pro.pdf

https://www.hospitalmanagementasia.com/tech-innovation/harnessing-the-power-of-data-in-healthcare/ (Sean Singhealth)

https://developers.googleblog.com/en/data-science-agent-in-colab-with-gemini/

https://jsontotable.org/

Python Cheatsheets

Datacamp - Importing_Data_Cheat_Sheet_ Python.pdf

Datacamp - Working_With_Text_Data_in_Python.pdf

Datacamp - Working_with_Dates_and_Times_Cheat_Sheet_ Python.pdf

Datacamp - Seaborn_Cheat_Sheet.pdf

Datacamp - Reshaping_data_with_Python.pdf

Datacamp - Python_Cheat_Sheet.pdf

Datacamp - Python_Basics_Cheat_Sheet.pdf

Datacamp - Pandas_Cheat_Sheet.pdf

Datacamp - Numpy_Cheat_Sheet.pdf

Datacamp - Matplotlib_Cheat_Sheet.pdf

Datacamp - Data Wrangling Cheat Sheet PYthon.pdf

Datacamp - Regular_Expressions_Cheat_Sheet.pdf

PYTHON CHEATSHEETS.pdf

Numpy User Guide.pdf

python notes.pdf

Python Tips and Tricks.pdf

python basics cheatsheet.pdf

why python index start at 0.pdf

Data_Science_With_Python_Workflow by Business Science.io.pdf

PANDAS Training

• slides for PANDAS wth Dr. Alvin.pdf

• WA for PANDAS.doc

• PP for PANDAS.doc

• Checklist for PANDAS.doc

• RG to WA for PANDAS.pdf

• RG to PP for PANDAS.ipynb

• How to Join Append Concat Two Tables with Python by Dr Alvin Ang.ipynb

• pandas cheat sheet.pdf

• Restructuring CSV for Data Science.pdf

• https://dataprep.ai/

• https://docs.profiling.ydata.ai/latest/

Statistics

[Descriptive.Stats] + [Seaborn.Visualization] + [Hypothesis.Testing.ANOVA] + [LR.MR.R2]

Day 4 with Dr Alvin.ipynb (Statistics)

Python Visualization

Data Visualization with Python by Dr Alvin Ang.ipynb

Top 7 Python Libraries for Data Visualization.pdf

Python Plotly.pdf

Practical Guide to Matplotlib.pdf

Python Specials

DataPrep + MissingNo by Dr Alvin Ang.ipynb

Ways to Display Json Formats Neatly in Python by Dr Alvin Ang.ipynb

How to Create Random Data with Python by Dr Alvin Ang.ipynb

ProxyCurl_API.ipynb

https://nubela.co/proxycurl/linkdb.html (scrape linkedin)

boston_housing_data.csv

Canada.xlsx

List of Seaborn CSVs

fmri.csv

module_5_auto.csv

https://github.com/xiaohk/stickyland

https://colab.research.google.com/github/jakevdp/PythonDataScienceHandbook/blob/master/notebooks/Index.ipynb

https://www.kdnuggets.com/2022/12/top-5-nlp-cheat-sheets-beginners-professional.html

AirBnB NYC Data 2019.csv

https://docs.python.org/3/library/functions.html

https://docs.python.org/3/library/stdtypes.html

https://docs.python.org/3/index.html

https://docs.python.org/3/library/index.html

https://fortune.com/education/articles/using-python-for-data-science/

Bad Python in Excel Review

https://www.iesve.com/software/python-scripting

Steps in Data Wrangling and Cleansing

Converting JSON to CSV from Scikit Learn Datasets by Dr. Alvin Ang.ipynb

How to Do Train Test Splits with Python by Dr Alvin Ang.ipynb

Data Wrangling a Population of Countries’ Dataset

Population of Countries in 2000.csv

Data Wrangling a Population of Countries Dataset by Dr Alvin Ang.ipynb

Data Wrangling & Visualizing Healthcare Datasets

Hospital Admissions

hospital-admissions-by-sector-annual.csv

Data Cleansing a Hospital Admissions Dataset by Dr Alvin Ang.ipynb

Health Expenditure

government-health-expenditure.csv

Data Cleansing a Government Health Expenditure Dataset.ipynb

Long Term Care Facilities

number-of-residential-long-term-care-facilities-sector-breakdown.csv

Data Wrangling a Long Term Care Facilities Dataset by Dr Alvin Ang.ipynb

Data Cleansing a Rock Song Dataset

rock.csv

Data Cleansing a Rock Song Dataset with Python by Dr. Alvin Ang.ipynb

Data Wrangling Air Quality Datasets

Data Wrangling Air Quality Datasets with Python by Dr Alvin Ang.ipynb

Searching and Slicing a Video Games Dataset

vgsales.csv

Searching and Slicing a Video Games Dataset with Python by Dr Alvin Ang.ipynb

Wrangling Automobile Datasets

Slicing & Dicing a Motorcars Dataset (European + Japanese Cars)

mtcars.csv

Slicing & Dicing a Motorcars Dataset with Python by Dr Alvin Ang.ipynb

Factors Affecting Price of European and Japanese Cars

automobileEDA.csv

Feature Selection on Automobile Dataset with Python by Dr. Alvin Ang.ipynb

Dealing with Missing Data in European Cars Dataset

auto.csv

Data Cleansing a European Automobile Dataset with Python by Dr Alvin Ang.ipynb

Cross Validating a European and Japanese Cars Dataset

cleansed_auto.csv

Cross Validating a European and Japanese Car Dataset by Dr Alvin Ang.ipynb

Python for Finance

• Slides for Python 4 Finance.pdf

• WA for Python 4 Finance.doc

• PP for Python 4 Finance.doc

• Assessment Guide to PP for Pyhon 4 Finance.ipynb

• Checklist for Python 4 Finance.doc

• RG to WA for Python 4 Finance.pdf

• RG to PP for Python 4 Finance.ipynb

• LendingClubLoan(200 rows).csv

• LendinClubLoan(22k rows - very dirty).csv

• Repayment.csv

• Lending Club Loan Data Dictionary.xls

• https://www.kaggle.com/datasets/wordsforthewise/lending-club

• https://drive.google.com/file/d/1VCaoIFxzpYgzCaIerj24EWx-wW87C440/view?usp=drive_link (alvin’s google drive FULL LendingClubLoan Dataset)

• Feature Selection on Lending Club Loan Dataset by Dr Alvin Ang.ipynb

• Data Cleansing the Lending Club Loan Dataset by Dr Alvin Ang.ipynb

• Train Test Splitting the Lending Club Loan Dataset by Dr Alvin Ang.ipynb

• Imploring YFinance by Dr Alvin Ang.ipynb

• https://home.tpq.io/

• https://www.quantifisolutions.com/

• https://wmi.edu.sg/dmp-online-singapore/ RAY DALIO

• TO_IMPROVE.ipynb

Hypothesis Testing and ANOVA with Python

Hypothesis Testing and ANOVA with Python by Dr Alvin Ang.ipynb

Confusion Matrix

• https://mlr-org.com/

• https://www.openml.org/

• https://riverml.xyz/latest/

• https://www.obviously.ai/

• https://mlflow.org/

• https://www.mltut.com/

• https://ciml.info/

• https://mlu-explain.github.io/

• https://machinelearningprojects.net/

• https://colah.github.io/

• Learn ML by Shivam Modi.pdf

• ML guide with Code by Shivam Modi.pdf

• ML Life Cycle by Shivam Modi.pdf

• Quick Machine Learning in Python.pdf

• ML DL AI Cheat sheet by NIKHIL YADAV.pdf

• ML Cheatsheet.pdf

• Another ML Cheatsheet.pdf

• ML Math.pdf

• Machine Learning Infographics Cheatsheet.pdf

• ML Cheat sheet by Business Science.io.pdf

• the little book of deep learning

• Probability Cheatsheet

• AI for Everyone notes by Andrew Ng

• Dataiku ML Basics.pdf

• Lecture Notes on AI.pdf

• How to Load the Iris Dataset into Python by Dr. Alvin Ang.ipynb

• Various Places to Get Datasets for Machine Learning by Dr Alvin Ang.ipynb

• Various Ways of Train Test Splits with Python by Dr Alvin Ang.ipynb

• ML Cheatsheet by DataCamp.pdf

• https://thecleverprogrammer.com/2020/11/15/machine-learning-projects/

• 30 Python Libraries to Boost Your Data Science Productivity.pdf

• https://terencelucasyap.com/predicting-singapore-pools-4d-lottery-winning-numbers-machine-learning/

• Scalable Efficient Big Data Pipeline Architecture – Machine Learning for Developers

• https://www.akkio.com/beginners-guide-to-machine-learning

• ML Terminology - Chris Albon.zip

MLOps

• MLOps Explained by Ubuntu.pdf

• Guide to MLOPs by Ubuntu.pdf

• MLOps for Dummies Databricks.pdf

• https://www.dailydoseofds.com/mlops-crash-course-part-1/

Unsupervised Learning

Clustering

• Overview of Clustering Methods.pdf

• KMeans_using_Python_by_Dr_Alvin.ipynb

• Hierarchical_Clustering_using_Python.ipynb

• Clustering Cheatsheet by Business Science.io.pdf

PCA

• PCA_with_Python.ipynb

Train Test Split

Supervised Learning

Linear / Multiple / Polynomial Regression

• Advertising.csv

• automobileEDA.csv

• Simple Linear Regression with Statsmodel by Dr Alvin Ang.ipynb

• Simple Linear Regression using SKLearn by Dr Alvin Ang.ipynb

• Multiple Regression using Scikit Learn with Python by Dr Alvin Ang.ipynb (Advertising.csv)

• Multiple Regression using Scikit Learn with Python (Part II) by Dr Alvin Ang.ipynb (AutomobileEDA.csv)

• Polynomial Regression with Python by Dr Alvin Ang.ipynb

• Using Multiple Regression OLS to do Feature Importance Selection (on Iris Dataset) by Dr Alvin Ang.ipynb

Support Vector Machine (SVM)

• Understanding SVM using Python by Dr Alvin Ang.ipynb

• Simple SVM Applied to Iris Dataset with Python by Dr Alvin Ang.ipynb

• Grid, Random and Bayes Search - Hyperparameter Tuning on SVM with Python by Dr Alvin Ang.ipynb

Decision Tree / Random Forest

• wine_small.csv

• wine.csv

• Decision Tree (Classification) on the Iris Flower Dataset using Python by Dr Alvin Ang.ipynb

• Using Decision Tree Classifier (DTC) to do Feature Importance Selection (on Iris Dataset) by Dr Alvin Ang.ipynb

• Using Random Forest Classifier (RFC) to do Feature Importance Selection (on Iris Dataset) by Dr Alvin Ang.ipynb

• Random Forest (Classification) on the Iris Flower Dataset using Python by Dr Alvin Ang.ipynb

Metrics, Normalization and Regularizations

• Classification Metrics for ML Models by Dr Alvin Ang.ipynb

Bias / Variance

• Understanding Bias vs Variance in Python by Dr. Alvin Ang.ipynb

L1 and L2 Regularization

• L1 Lasso and L2 Ridge and Elastic Net Regression using Python by Dr Alvin Ang.ipynb

MinMax and Standard Scaler

• Decision Tree (Classification) on the Iris Flower Dataset using Python by Dr Alvin Ang.ipynb

Datacamp ML Cheatsheets

• Datacamp - ML+Cheat+Sheet.pdf

• Datacamp - Scikit-Learn_Cheat_Sheet.pdf

• Datacamp - Supervised_Machine_Learning_Models.pdf

• Datacamp - Unsupervised_Machine_Learning_Models.pdf

ML4Trading Practical Test.doc

Technical Analysis

million-moves.pdf

• Steps to Teach ML for Trading.txt

• Steps for ML Trading by Dr. Alvin Ang

• Facilitator Guide for Machine Learning 101 for Financial Trading.ipynb

• Learning TA-Lib in Python by Dr. Alvin Ang.ipynb

• pyfolio no longer maintained

• How to Plot Candlestick Chart using Plotly by Dr. Alvin Ang.ipynb

• pandas_ta full list of technical indicators as of 2024

• MQL5 Programming for Traders.pdf

CFTE

• CFTE Syllabus.pdf

• CFTE Level 1 Mock Exam.pdf

• CFTE Level 2 Mock Exam.pdf

• 
  https://cathiesark.com/

• https://algoventure.first-4.com/ai-algo-3267-2099-9273

• https://fiscal.ai/

• https://hlaiman.com/

• https://www.pyquantnews.com/

• https://www.ntuclearninghub.com/en-gb/-/course/algorithmic-trading-essentials

• https://www.thetradveller.com

• https://www.iexexchange.io/

• https://tastytrade.com/

• https://www.quantconnect.com/

• https://braincompany.co/

• https://botspot.trade/

• https://www.northpointgl.com/

• https://wundernn.io/predictorium

• https://predictnow.ai/

• https://eoddata.com/stocklist/SGX.htm (ticker symbol)

• https://autochartist.com/

• https://ml4trading.io/

• https://www.trade-ideas.com/

• https://seekingalpha.com/

• https://algorithmictrading.substack.com/

• https://www.quantfactory.ai/

• https://www.quantrocket.com/

• https://roic.ai/

• https://www.backtrader.com/

• https://www.priceactionlab.com/Blog/price-action-lab-software/

• https://www.tradeoxy.com/

• https://wire.insiderfinance.io/

• https://tradologics.com/

• https://www.alpharithms.com/

• https://www.gurufocus.com/guru/warren%2Bbuffett/summary

• https://danelfin.com/

• https://wavebasis.com/

• https://fractalerts.com/

• https://www.benzinga.com/apis/

• https://forgeglobal.com/

• https://equityzen.com/

• https://www.youtube.com/@Algovibes

• https://greyhoundanalytics.com/

• https://www.fxmagnetic.com

• https://www.histdata.com/

• https://www.backtestzone.com/

• https://million-moves.com/

• https://www.quantreo.com/

• https://polygon.io/

• https://insightsentry.com/

• https://www.ssga.com/sg/en/individual

• https://www.dividends.sg/

• https://sginvestors.io/

• https://quickfs.net/

• https://singaporeanstocksinvestor.blogspot.com/ (AK)

• https://www.dymonasia.com/career/

• https://www.xtxmarkets.com/

• https://www.360t.com/

• https://www.qcp.capital/

• https://www.tower-research.com/

• https://www.jumptrading.com/

• https://drw.com/

• https://www.virtu.com/

• https://24exchange.com/

• https://fairxchange.co.uk/

• https://www.bgcg.com/bgc/

• https://www.preqin.com/

• https://www.okx.com/

• https://group.softbank/en

• https://www.globalxetfs.com/

• https://www.ark-funds.com/

• https://eodhd.medium.com/trading-predictions-using-ai-and-python-cdaad4de3447

• https://thepythonlab.medium.com/xgboost-in-stock-returns-prediction-using-technical-indicators-and-vix-index-700fda74b425

• https://github.com/suparjotamin/stockie

• https://medium.com/geekculture/a-simple-way-to-download-financial-data-from-investing-com-in-python-8262271c804f

• https://medium.com/trading-data-analysis/metatrader5-python-trading-bot-230bd19285e9

• slides for R Stats.pdf

• WA for R Stats.doc

• PP for R Stats.doc

• Checklist for R Stats.doc

• RG to WA for R Stats.pdf

• RG to PP for R Stats.pdf

• RG to PP for R Stats.R

Datacamp R Cheatsheets

• Datacamp - R_Cheat_Sheet.pdf

• Datacamp - Working_With_Text_Data_in_R.pdf

• Datacamp - Working_with_Dates_and_Time_in_R.pdf

• Datacamp - Reshaping_data_with_tidyR_in_R.pdf

• Datacamp - ggplot2_cheat_sheet.pdf

• Datacamp - data table cheat sheet_R.pdf

• Datacamp - Manipulating_Data_in_dplyr_Cheat_Sheet.pdf

• Datacamp - Tidyverse_Cheat_Sheet.pdf

• Data_Science_With_R_Workflow by Business Science.io.pdf

R Sites

• https://togaware.com/projects/rattle/index.html

• https://universeofdatascience.com/

• https://www.r-bloggers.com/2022/06/the-most-overlooked-r-package-that-can-get-you-through-a-data-science-job-interview/

• https://online.stat.psu.edu/statprogram/tutorials/statistical-software/r

• https://biostat.app.vumc.org/wiki/Main/RS

• https://tuos-bio-data-skills.github.io/intro-stats-book/

• https://statsandr.com/

• https://www.reneshbedre.com/

• https://style.tidyverse.org/

• https://cran.r-project.org/web/packages/available_packages_by_name.html

• https://r-charts.com/

• https://r-graph-gallery.com/

• https://posit.co/resources/cheatsheets/

• https://yihui.shinyapps.io/formatR/

• https://www.kaggle.com/code/rtatman/data-cleaning-challenge-json-txt-and-xls

• https://education.rstudio.com/learn/

• https://www.business-science.io/finance/2020/02/26/r-for-excel-users.html

• https://www.rdocumentation.org/

• https://r-packages.io/

• https://graphic-walker-data-explorer.netlify.app/

• https://github.com/Kanaries/GWalkR

• slides for Tidyverse R.pdf

• WA for Tidyverse R.doc

• PP for Tidyverse R.doc

• Checklist for Tidyverse R.doc

• RG to WA for Tidyverse R.pdf

• RG to PP for Tidyverse R.pdf

• RG to PP for Tidyverse R.R

Text Mining with R

• Text Mining with R by Dr. Alvin Ang.R

• TIDY-TEXT-2019

Data Wrangling with R

• Data Wrangling with Tidyverse by Dr Alvin Ang.R

• Data Wrangling with Core R by Dr Alvin Ang.R

Data Visualization with R

• Data Visualisation with BASIC R by Dr. Alvin Ang.R

• Data Visualisation with GGPLOT R by Dr. Alvin Ang.R

Regression with R

• Simple Linear Regression using R by Dr. Alvin Ang.R

• Multiple Regression using R by Dr Alvin Ang.R

Statistics with R

• Statistics with Tidyverse by Dr Alvin Ang.R

• Correlation Funnel.R

ML with R

• https://lgatto.github.io/IntroMachineLearningWithR/index.html

• https://mlr-org.com/

• https://www.tmwr.org/

• https://matthewrenze.com/workshops/practical-machine-learning-with-r/

• https://saedsayad.com/data_mining.htm

• https://www.tidymodels.org/

1st Project

Extras

• slides for BASIC Tableau.pdf

• slides for Tableau Actions and Analytics.pdf

• slides for Tableau Quick Table Calculations.pdf

• slides for Tableau Data Wrangling.pdf

• slides for Tableau Filtering.pdf

• slides for Tableau Calculated Fields and LOD.pdf

• slides for Tableau MAPS.pdf

• WA for Tableau Visualization.doc

• PP for Tableau Visualization.doc

• Checklist for Tableau Visuzliation.doc

• RG for Tableau Visualization Written.pdf

• RG for Tableau Visualization Practical.pdf

• slides for STORYTELLING Tableau.pdf

• WA for Tableau STORYTELLING.doc

• PP for Tableau STORYTELLING.doc

• Checklist for Tableau STORYTELLING.doc

• RG for Tableau STORYTELLING Written.pdf

• RG for Tableau STORYTELLING Practical.pdf

Different Map Types in Tableau

• https://www.tableau.com/learn/training/pre-2021.1-tableau-free-training-videos#reveal-528045

2nd Project

Storytelling

• Change Over Time:

  https://public.tableau.com/app/profile/ben.jones/viz/WorldPopulationDay/1_ChangeOverTime

  World Population Day.twbx

  https://public.tableau.com/app/profile/andy.kriebel/viz/EPLInjuries/InjuryCrisis

  EPL Injuries.twbx

• Drill Down:

  https://public.tableau.com/views/EarthquakesOnTheRise-Full/Earthquakestory

  https://public.tableau.com/app/profile/mac.bryla/viz/TellmeaboutWill/TellmeaboutWill

  Tell me about Will.twbx

• Zoom Out:

  https://public.tableau.com/app/profile/halftimeheroes/viz/OlympicGamesStories-ZoomOut/ZoomOut

  Olympic Games Zoom Out.twbx

  https://public.tableau.com/app/profile/tea.ravn.nielsen/viz/ItalianCO2Emissions-Zoom-outInteractiveDataStory/Story1

  Italian CO2

• Contrast:

  https://public.tableau.com/app/profile/robertrouse/viz/Pyramids_1/EgyptianPyramids

  The Pyramids of Egypt.twbx

• Outliers

  https://public.tableau.com/app/profile/steph.baranya/viz/AdultVersion_final/SOSChildrensVillagesX-MasCampaignSantaGetInvolvedDonate

  SOS Children.twbx

Tableau Desktop Specialist

• WA for Tableau Desktop Specialist.doc

• PP for Tableau Desktop Specialist.doc

• Checklist for Tableau Desktop Specialist.doc

• RG for WA Tableau Desktop Specialist.pdf

• RG for PP Tableau Desktop Specialist.twbx

• Tableau Desktop Specialist Exam Guide.pdf

• Tableau Desktop Specialist Sample Questions Data.xls

Profile Links

• https://public.tableau.com/app/profile/dr.alvin.ang

• https://public.tableau.com/app/profile/hisan.shafaque/viz/1996-97ChicagoBullsBuckets/BullsBuckets

• https://public.tableau.com/app/profile/pawan.sachdeva/viz/HowHappyAreWe_15891520173890/HowHappyAreWe

• https://public.tableau.com/app/profile/janapati.balaji

• https://public.tableau.com/app/profile/vincenttzc

• Superstore-Profitability.twbx

• https://public.tableau.com/app/profile/thi.ho

• https://www.channelnewsasia.com/author/clara-ho

• https://public.tableau.com/app/profile/ryo.takahashi5457/vizzes

• https://www.tableau.com/products/public/download

• https://www.upwork.com/nx/search/talent/?nbs=1&q=TABLEAU

• https://www.pexels.com/

• https://www.freepik.com/

• https://unsplash.com/

Tableau Prep

• The Tableau Prep Workspace.pdf

• Flow Pane Steps.pdf

Datacamp Tableau Cheatsheets

• Datacamp - Data Storytelling Cheat Sheet.pdf

• Datacamp - Data Visualizations.pdf

• Datacamp - Tableau+Cheat+Sheet.pdf

Tableau Data Analyst

• Tableau Certified Data Analyst Exam Guide.pdf

• Tableau Certification Question and Answers.pdf

Elections

• https://elections.viz.sg/

• election article on linkedin

• https://elections.data.gov.sg/en

• CNA on Elections

• OneMap Electorial Divisions

• https://www.eld.gov.sg/elections_map_electoral.html

• Tan Kah Ming Predict HDB Price.pdf

Maps

• https://public.tableau.com/s/sites/default/files/media/co2_emissions_by_london_borough.zip

• USGS_Quake.xlsx

• https://community.tableau.com/s/question/0D54T00000C6TDLSA3/singapore-map-not-displayed

• https://data.gov.sg/search?res_format=SHP

• Singapore Towns.csv

• https://www.tableau.com/solutions/customer/jal-expanding-the-use-of-tableau-throughout-the-company

• https://www.tableau.com/visualization/what-is-geospatial-visualization

Others

• https://coolors.co/

• https://colorbrewer2.org/

• https://www.figma.com/

• https://www.uxpin.com/

• Tableau Introduction by Princeton University.pdf

• https://tableaupublic.princeton.edu/#/signin

• https://www.thetableaustudentguide.com/

• STRAITS TIMES TABLEAU

Tableau Official Help

• https://public.tableau.com/app/profile/tableau.docs.team/vizzes

• https://www.tableau.com/about/blog/LOD-expressions

• https://public.tableau.com/en-us/s/resources

• https://tableaupracticetest.com/#get-our-most-popular-downloads

• 4D Tableau

• slides for SQL.pdf

• PP for SQL.doc

• Checklist for SQL.doc

• RG for SQL.pdf

https://www.sqltranslate.app/

https://formula.dog/

https://sequal.dev/

SQL CHEAT SHEET.pdf

SQL in 14 Days.pdf

Company Database.db

album.db

test.db

world.db

world_data.xls

Steel Data SQL Challenge.pdf

https://www.prisma.io/dataguide

https://ladvien.com/business-intelligence-mysql/

https://medium.com/@i-sql-you-to-join-me

https://about.smartquery.dev/

Datacamp SQL Cheatsheets

Datacamp - Joining_Data_in_SQL.pdf

Datacamp - SQL_for_Data_Science.pdf

Datacamp - SQL_Window_Functions.pdf

https://sqlitetutorial.net/

EY SQL Breach News

https://www.dbta.com/Columns/SQL-Server-Drill-Down/

https://blog.devops.dev/sql-analysis-of-netflix-dataset-808e870e5bd6

https://github.com/pawelsalawa/sqlitestudio/releases

https://www.databasejournal.com/

For those with problems installing….

https://alpha.sqliteviewer.app/

https://sqliteonline.com/

https://www.draxlr.com/tools/sql-formatter/

Oracle SQL

https://www.oracle.com/database/technologies/xe-downloads.html

https://www.oracle.com/database/sqldeveloper/

https://querygpt.xyz/

https://dbdb.io/

SQL Queries.pdf

SQL Data Cleansing.pdf

How to Speed Up SQL Queries.pdf

How to use WHERE in SQL.pdf

How to use SQL in BI.pdf

5 SQL Certs.pdf

5 types of sql commands.pdf

Top 10 SQL Compressed.pdf

How to Write Better SQL.pdf

SQL Interview Questions.pdf

How to use SQL to Track User Retention.pdf

How to Write Nested Queries in SQL.pdf

What are CTEs in SQL.pdf

• slides for POWER BI - PART 1.pdf

• slides for POWER BI - PART 2.pdf

• Checklist for Power BI.doc

• WA for Power BI.doc

• PP for Power BI.doc

• RG for WA for Power BI.pdf

• RG for PP for Power BI.pdf

• https://www.alvinang.sg/power-bi

• Power BI Step by Step.pdf

• Power BI Training Guide.pdf

• End to End Power BI.pdf

• Data Storytelling by BCG.pdf

• How to Choose the Right Chart by Chartio.pdf

• TradingView Tree Map

• https://www.worldmonitor.app/

• https://workout-wednesday.com/power-bi-challenges/

• https://curbal.com/

• https://training.foresightbi.com.ng/courses/power-bi-developer-internship

• The 10 Commandments of Good Graphics by Steve Figard.pdf

• Gartner MAGIC QUADRANT 2022 FOR BI TOOLS

Datacamp Power BI Cheatsheets

• Datacamp - Formulas_in_DAX_Cheat_Sheet.pdf

• Datacamp - Power+BI_Cheat+Sheet.pdf

• which charts to use.pdf

• 18 types of bar charts.pdf

• how to tell data storytelling.pdf

• how to build CEO dashboard.pdf

• 6 mistakes to avoid in Data Analytics.pdf

• 7 Data Analytics Projects.pdf

• slides for Resource Allocation with Excel Solver.pdf

• WA for Resource Management.doc

• PP for Resource Management.doc

• Checklist for Resource Management.doc

• RG for WA Resource Management.pdf

• RG for PP Resource Management.pdf

• RG to PP for Resource Management.xls

• https://www.superdecisions.com/

• https://medium.com/operations-research-bit/topics-in-operations-research-704d462b0f14

• AHP for Perdaus.xls

• Course Activity for Stats with Excel.xls

• slides for Stats.pdf

• PP for 2 Day Stats.doc

• WA for 2 Day Stats.doc

• Checklist for 2 Day Stats.doc

• RG TO WA for 2 Day Stats.pdf

• RG TO PP for 2 Day Stats.pdf

• PP for 1 Day Stats.doc

• Checklist for 1 Day Stats.doc

• RG for 1 Day Stats.pdf

Degree of Freedom

Statistics Cheatsheets

Statistics Cheatsheet.pdf

Statistics Quick Reference Guide.pdf

Stats with Excel (Course Activity)

• https://stats.mom.gov.sg/SL/Pages/Labour-Force-Introduction.aspx

• https://careerfoundry.com/en/blog/data-analytics/standard-error-vs-standard-deviation/

• https://thesire.sg/average-penis-size-in-singapore-sg/

• MOH Covid

• SUSS Statistics Formulas.pdf

• TRUMP FIRES STATISTICIAN

• NUH CTO.pdf

• Poor Man with 2 kids Jump MRT Commit Suicide Singapore.pdf

• Poor Man Jump MRT Commit Suicide

15 Data Fallacies

• https://www.statssolver.com/calculators/hypothesis-testing.html

• https://www.statskingdom.com/140MeanT2eq.html

• https://www.drdawnwright.com/tail-of-the-test-interpreting-excel-data-analysis-t-test-output/

• https://support.microsoft.com/en-us/office/use-the-analysis-toolpak-to-perform-complex-data-analysis-6c67ccf0-f4a9-487c-8dec-bdb5a2cefab6

Datacamp Statistics Cheatsheets

• Datacamp - Descriptive_Statistics_Cheat_Sheet.pdf

• Datacamp - Probability_Cheat_Sheet.pdf

STRIPE - The_DNA_of_an_Adaptive_Enterprise

STRIPE - Stripe_2023_Insights_Report

https://www.channelnewsasia.com/singapore/syndicate-card-counting-mbs-casino-baccarat-formula-plead-guilty-3969121

Data Analytics with Excel Course

• WA for DA with Excel.doc

• PP for DA with Excel.doc

• RG to WA for DA with Excel.pdf

• RG to PP for DA with Excel.pdf

• Checklist for DA with Excel.doc

• slides for DA with Excel - Topic 1 Basic Data Management.pdf

• slides for DA with Excel - Topic 2 Formulas.pdf

• slides for DA with Excel - Topic 3 Charts.pdf

• slides for DA with Excel - Topic 4 Pivot Tables Pivot Charts.pdf

• slides for DA with Excel - Topic 5 What If Analysis.pdf

• ACTIVITIES for DA with Excel.xlsx

• PP Q1.xls

• PP Q2.xls

• PP Q3.xls

• Preparation.doc

• excel data analysis.pdf

• 10 Excel functions every Financial Analyst should know.pdf

• https://imagetoexcel.com/

• https://www.instagram.com/excelbychris/

• https://excel-skool.com/

• https://www.excel-bot.com/

• https://formulabot.com/

• https://aiexcelbot.com/

• https://formula.dog/

• https://excelformulabeautifier.com/

• https://www.formulaboost.com/parse

• https://prettyexcel.org/

• https://www.michael-saunders.com/stocksapp/pages/info.html#financial

Datacamp Excel Cheatsheets

• Datacamp - Data Manipulation in Excel Cheat Sheet.pdf

• Datacamp - Excel_Cheat_Sheet.pdf

• https://www.datacamp.com/tutorial/reduce-excel-file-size

• Slides for PQ.pdf

• Slides for PP.pdf

• WA for PQPP.doc

• PP for PQPP.doc

• Checklist for PQPP.doc

• RG to WA for PQPP.pdf

• RG to PP for PQPP.pdf

• https://www.powerqueryformatter.com/

• https://www.sqlbi.com/tools/power-pivot-utilities/

• Slides for DOE.pdf

• WA for DOE.doc

• PP for DOE.doc

• Checklist for DOE.doc

• RG to WA for DOE.pdf

• RG to PP for DOE.pdf

• https://support.minitab.com/en-us/datasets/doe-data-sets/golf-ball-data/

• https://support.minitab.com/en-us/minitab/21/help-and-how-to/statistical-modeling/doe/how-to/mixtures/create-mixture-design/before-you-start/overview/

• https://sigmazone.com/catapult-grid/

• https://www.itl.nist.gov/div898/handbook/pri/pri.htm

• Response Surface Design (old Minitab manual).pdf

• Mixture Design (old minitab manual).pdf

• Taguchi Design (old minitab manual).pdf

• Getting Started with Minitab Statistical Software.pdf

• https://www.jmp.com/support/help/en/18.0/?os=win&source=application#page/jmp/introduction-to-doe.shtml#

• Reactor Response.jmp

• Reactor Factors.jmp

• Reactor 32 Runs.jmp

• Tennis Ball.jmp

• Plasticizer.jmp

• Nylon Tube.jmp

• https://www.tablesgenerator.com/markdown_tables#

• https://ozh.github.io/ascii-tables/

• Slides for Google Sheets Training.pdf

• Google Sheets Exercise.xls

Bodies

• https://cdmp.info/

• https://www.dama.org/cpages/home

• https://datagovernance.com/

• https://edmcouncil.org/

• https://booksite.elsevier.com/9780123743695/10steps_DataCategories.pdf

Open Refine

• https://openrefine.org/

• https://librarycarpentry.github.io/lc-open-refine/aio.html

• https://datacarpentry.github.io/OpenRefine-ecology-lesson/aio.html

• https://web.archive.org/web/20190105063215/http://enipedia.tudelft.nl/wiki/OpenRefine_Tutorial

Tools

• https://datakitchen.io/

• https://bestofbi.com/products/sql-power-dqguru-data-quality/

• https://greatexpectations.io/

• https://www.getdbt.com/

• https://dagster.io/

• https://www.dataqualitypro.com/

• https://open-metadata.org/

• https://griffin.apache.org/

• https://datacleaner.github.io/

• https://datascienceatthecommandline.com/

• https://www.datafix.com.au/cookbook/index.html

• https://hunni.io/

• https://www.amundsen.io/

Datasets

• doaj-article-sample.csv

• Portal_rodents.csv

• Checklist for data quality.xls

• Data Quality Example.xls

• EmployeeSales (edited for Data Quality Course).xls

• Data Quality Rules.xls

• https://dataproducts.substack.com/p/data-is-not-a-microservice

• https://www.montecarlodata.com/blog-who-is-responsible-for-data-quality/

Blogs

• https://atlan.com/data-governance-framework/?ref=/open-source-data-governance-tools/

• https://atlan.com/data-governance-framework/

• https://www.edq.com/blog/data-quality-vs-data-governance/

• https://atlan.com/data-mesh-principles/

• https://atlan.com/master-data-management-vs-metadata-management/

• https://atlan.com/improve-data-quality/

• https://atlan.com/data-quality-metrics/

• https://www.gartner.com/smarterwithgartner/how-to-improve-your-data-quality

• https://tdan.com/category/data-topics/data-quality-articles-blogs-education

Singapore Public Service

• Statistical Best Practices by Singstat (2020).pdf

• Improve Data Quality by Singstat (2020).pdf

• STB Data Governance Playbook.pdf

• MAS Data Governance.pdf

Slides and Whitepapers

EY - Becoming an Analytics Organization.pdf

Creating an Enterprise Data Strategy - Beye Network.pdf

A Definitive Guide to Data Governance - Trillium Software.pdf

TADA Data Quality Concepts.pdf

Introduction to Data Governance and Stewardship - Salesforce.pdf

5 Levels of Master Data Management Maturity - Baseline Consulting.pdf

Dataprep - Acclerate Data for AI.pdf

ISO Data Quality 8000-1 (partial).pdf

ISO-8000-61-2016 (partial).pdf

ISO-8000-2.pdf

ISO 8000-150.pdf

ISO-8000-63.pdf

ISO and TDQM.pdf

A Product Perspective on Total Data Quality Management - Richard Wang.pdf

Datacamp Data Quality Cheatsheets

Datacamp - Cheat Sheet DS For Business Leaders.pdf

Datacamp - Data Quality Dimensions.pdf

Datacamp - Data Governance Cheat Sheet.pdf

What Makes a Good Data Set by Tableau.pdf

https://www.warehouse-science.com/

https://topseng.com/

Car Production Line Game 1