Welcome to part 2 of STA 380, a course on machine learning in the MS program in Business Analytics at UT-Austin. All course materials can be found through this GitHub page. Please see the course syllabus for links and descriptions of the readings mentioned below.

Hi! Here's a change.

Instructors:

• Dr. James Scott. Office hours on M T W, 12:30 to 1:15 PM, CBA 6.478.
• Dr. David Puelz. Office hours TBA.

The exercises are available here. These are due Monday, August 15th at 5 PM, U.S central time. Pace yourself over the next few weeks, and start early on the first couple of problems!

Slides: The data scientist's toolbox
Good data-curation and data-analysis practices; R; Markdown and RMarkdown; the importance of replicable analyses; version control with Git and Github.

Readings:

• Introduction to RMarkdown
• RMarkdown tutorial
• Introduction to GitHub
• Getting starting with GitHub Desktop
• Jeff Leek's guide to sharing data

Your assignment after the first class day:

• Create a GitHub account.
• Create your first GitHub repository.
• Inside that repository (on your local machine), create a toy RMarkdown file that does something---e.g. simulates some normal random variables and plots a histogram.
• Knit that RMarkdown file to a Markdown (.md) output.
• Push the changes to GitHub and view the final (knitted) .md file.

These instructions will make sense after you read the tutorials above!

Slides: Some fun topics in probability

Optional reference: Chapter 1 of these course notes. There's a lot more technical stuff in here, but Chapter 1 really covers the basics of what every data scientist should know about probability.

Topics: data visualization and wrangling with R.

Slides:

• Data visualization
• Data wrangling

R materials:

• Lessons 4-6 of Data Science in R: A Gentle Introduction. You'll find lesson 5 a bit basic so feel free to breeze through that. The main thing you need to take away from lesson 5 is the use of pipes (%>%) and the summarize function.
• datavis_intro.R and nycflights_wrangle.R.

The bootstrap; joint distributions; using the bootstrap to approximate value at risk (VaR).

Slides: Introduction to the bootstrap

Reference: ISL Section 5.2 for a basic overview of the bootstrap.

For the class exercises, you will need to refer to any basic explanation of the concept of value at risk (VaR) for a financial portfolio, e.g. here, here, or here.

R scripts and data:

• creatinine_bootstrap.R and creatinine.csv
• portfolio.R

Supplemental resources:

• Lessons 8 and 9 of Data Science in R: A Gentle Introduction
• Section 2 of these notes, on bootstrap resampling. You can ignore the stuff about utility if you want.

Basics of clustering; K-means clustering; hierarchical clustering.

Slides: Introduction to clustering.

Scripts and data:

• cars.R and cars.csv
• hclust_examples.R
• linkage_minmax.R

Readings:

• ISL Section 10.1 and 10.3 or Elements Chapter 14.3 (more advanced)
• K-means++ original paper or simple explanation on Wikipedia. This is a better recipe for initializing cluster centers in k-means than the more typical random initialization.

Principal component analysis (PCA).

Slides: Introduction to PCA

Scripts and data for class:

• pca_intro.R
• nbc.R, nbc_showdetails.csv, nbc_pilotsurvey.csv
• congress109.R, congress109.csv, and congress109members.csv
• ercot_PCA.R, ercot.zip

A few other examples we may or may not have time to cover in class:

• FXmonthly.R, FXmonthly.csv, and currency_codes.txt
• NCI60.R
• gasoline.R and gasoline.csv

Readings:

• ISL Section 10.2 for the basics or Elements Chapter 14.5 (more advanced)
• Shalizi Chapters 18 and 19 (more advanced). In particular, Chapter 19 has a lot more advanced material on factor models, beyond what we covered in class.

Networks and association rule mining. If time: spectral clustering.

Slides: Intro to networks. Note: these slides refer to "lastfm.R" but this is the same thing as "playlists.R" below.

Some supplemental slides on association rule mining. These contain the details of the apriori algorithm. If there's time we might cover some of this in class, but mainly we'll focus on the shorter intro slides above, together with the example R scripts below.

Software you'll need:

• Gephi, a great piece of software for exploring graphs
• The Gephi quick-start tutorial

Scripts and data:

• medici.R and medici.txt
• playlists.R and playlists.csv
• microfi.R, microfi_households.csv, and microfi_edges.txt.

Supplemental resource: In-depth explanation of the Apriori algorithm

Co-occurrence statistics; naive Bayes; TF-IDF; topic models; vector-space models of text (if time allows).

Slides:

• Introduction to text.
• Introduction to Naive Bayes text classification

Scripts and data:

• congress109_bayes.R
• tm_examples.R and selections from the Reuters newswire
• smallbeer.R and smallbeer.csv