Updates as I dive more into stuff

indrayam · Jan 8, 2025 · bd635aa · bd635aa
1 parent 15c57b7
commit bd635aa
Show file tree

Hide file tree

Showing 9 changed files with 245 additions and 42 deletions.
diff --git a/AI-Online-References.md b/AI-Online-References.md
@@ -0,0 +1,5 @@
+# AI Online References
+
+A dump of all AI links (under _AI_ > _AI Streams..._) that I have collected over the past year or so. I will organize them later.
+
+
diff --git a/AI-Skills.md b/AI-Skills.md
@@ -1,5 +1,103 @@
 # AI Skills
 
-- Machine Learning
-- Deep Learning
-- Generative AI
+- Essential Math for Data Science, Ch 1-13
+- Hands-On Machine Learning with Scikit-Learn, Keras, and TensorFlow 3rd Ed, Ch 1-17
+- A Quick Start Guide to LLMs 2nd Ed, Ch 1-4
+- Generative AI on AWS, Ch -12
+
+## 1. Mathematics for Machine Learning/AI
+- Essential Math for Data Science
+- [Linear Algebra for Machine Learning - Jon Krohn](https://learning.oreilly.com/course/linear-algebra-for/9780137398119/)
+- [Calculus for Machine Learning - Jon Krohn](https://learning.oreilly.com/course/calculus-for-machine/9780137398171/)
+- [The Essential Machine Learning Foundations: Math, Probability, Statistics, and Computer Science - Jon Krohn](https://learning.oreilly.com/course/the-essential-machine/9780137903245/)
+- **OPTIONAL**
+  - Linear Algebra Step-by-Step, Kuldeep Singh
+  - Practical Linear Algebra for Data Science, Mike Cohen
+  - Linear Algebra: Theory, Intuition, Code, Mike X Cohen
+  - Practical Statistics for Data Scientists, 2nd Ed - Andrew Bruce, Peter Bruce
+  - Math for Deep Learnig, Ronald T. Kneusel
+  - Bayesian Statistics the Fun Way, Will Kurt
+  - Before Machine Learning Vol 1 - Linear Algebra
+  - Mathematics for Machine Learning, Marc Peter Deisenroth
+  - [Calculus for Machine Learning: Intro (ML Foundations Series) - Jon Krohn](https://learning.oreilly.com/live-events/calculus-for-machine-learning-intro-ml-foundations-series/0636920059505/0790145076348/) May 2024
+  - [Linear Algebra with Python: Essential Math for Data Science - Michael Cullan](https://learning.oreilly.com/live-events/linear-algebra-with-python-essential-math-for-data-science/0636920303268/0636920363125/) Sep 2019, Feb 2020
+  - [Linear Algebra with Python: Essential Math for Data Science - Russell Martin](https://learning.oreilly.com/live-events/linear-algebra-with-python-essential-math-for-data-science/0636920303268/0636920303251/) Sep 2019, Feb 2020
+  - [Linear Regression with Python: Essential Math for Data Science - Michael Cullan](https://learning.oreilly.com/live-events/linear-regression-with-python-essential-math-for-data-science/0636920303282/0636920363163/) Feb 2020  
+  - [Linear Algebra Done Right](https://www.youtube.com/playlist?list=PLGAnmvB9m7zOBVCZBUUmSinFV0wEir2Vw)
+  - [AI Math YouTube Playlist](https://www.youtube.com/playlist?list=PLeM4O8deP8GO3vIx_9eboO9tVpUKHYqRg)
+
+## 2. Python and Python Data Analysis
+- Python Crash Course, 3rd Ed
+- Python for Data Analysis, 2nd Ed
+- **OPTIONAL**
+  - *Automate the Boring Stuff with Python, 3rd Ed*
+  - *Python Data Science Handbook, 2nd Ed*
+  - Fluent Python, 2nd Ed
+  - Python Testing with pytest, 2nd Ed
+
+## 3. AI Concepts 101
+- The Hundred-Page Machine Learning Book
+- The Hundred-Page Language Models Book
+- **OPTIONAL**
+  - How AI Works
+  - Engineer's Pocket Guide to Surviving AI
+  - The Complete Obsolete Guide to Generative AI
+  - A Simple Guide to Retrieval Augmented Generation
+  - A Damn Fine Stable Diffusion Book
+
+
+
+## 4. Machine Learning and Deep Learning
+- Data Science from Scratch, 2nd Ed
+- Hands-On Machine Learning with Scikit-Learn, Keras, and TensorFlow, 3rd Ed
+- **OPTIONAL**
+  - Designing Machine Learning Systems (DMLS)
+  - Deep Learning Illustrated
+  - [Machine Learning from Scratch - Thomas Nield](https://learning.oreilly.com/live-events/machine-learning-from-scratch/0636920054754/0636920095746/) Aug 2023
+  - [Deep Learning for Beginners in 3 Weeks - Thomas Nield](https://learning.oreilly.com/live-events/deep-learning-for-beginners-in-3-weeks/0636920079316/0636920096447/) Sep 2023
+  - [Practical Deep Learning for Coders - Jeremy Howard](https://www.youtube.com/playlist?list=PLfYUBJiXbdtSvpQjSnJJ_PmDQB_VyT5iU)
+  - [Practical Deep Learning Part 2 - Jeremy Howard](https://www.youtube.com/playlist?list=PLfYUBJiXbdtRUvTUYpLdfHHp9a58nWVXP)
+  - [Fundamentals of Machine Learning for Software Engineers](https://learning.oreilly.com/live-events/fundamentals-of-machine-learning-for-software-engineers/0790145079967/0642572005362/) Dec 2024
+  - [Explainable Machine Learning Models—with Interactivity](https://learning.oreilly.com/live-events/explainable-machine-learning-modelswith-interactivity/0636920061943/0636920085001/)
+
+## 5. Generative AI using Large Langugage Models (LLMs)
+- Quick Start Guide to Large Language Models
+- Generative AI on AWS
+- **OPTIONAL**
+  - AI Engineering (AIE)
+  - Amazon Bedrock in Action
+  - [A Hacker's Guide to LLM - Jeremy Howard](https://www.youtube.com/watch?v=jkrNMKz9pWU)
+  - [From Software Engineer to AI Data Scientist - Ed Donner](https://learning.oreilly.com/live-events/from-software-engineer-to-ai-data-scientist/0642572007671/0642572010692/) Dec 2024
+  - [Choosing the Right LLM - Ed Donner](https://learning.oreilly.com/live-events/choosing-the-right-llm/0642572002832/0642572010148/) Dec 2024
+  - [Transformer Architectures for Generative AI - Sinan Ozdemir](https://learning.oreilly.com/live-events/transformer-architectures-for-generative-ai/0642572010589/0642572010588/) Dec 2024
+  - [Deep Learning for Modern AI - Sinan Ozdemir](https://learning.oreilly.com/live-events/deep-learning-for-modern-ai/0642572005084/0642572010124/) Dec 2024
+  - [LLMs, GPT, and Prompt Engineering for Developers - Sinan Ozdemir](https://learning.oreilly.com/live-events/llms-gpt-and-prompt-engineering-for-developers/0636920094338/0636920094337/) Sep 2023
+  - [Using Open- and Closed-Source LLMs in Real World Applications - Sinan Ozdemir](https://learning.oreilly.com/live-events/using-open-and-closed-source-llms-in-real-world-applications/0636920094342/0636920094341/) Sep 2023, July 2024
+  - [Generative AI for Cloud Practitioners - Chad Smith](https://learning.oreilly.com/live-events/generative-ai-for-cloud-practitioners/0642572001983/0642572008116/) Nov 2024
+  - [AWS AI Practitioner Crash Course - Chad Smith](https://learning.oreilly.com/live-events/aws-ai-practitioner-crash-course/0642572009853/0642572009852/) Dec 2024
+  - [Fundamentals of Large Language Models: A hands-on approach in 2 Weeks - Jonathan Fernandes](https://learning.oreilly.com/live-events/fundamentals-of-large-language-models-a-hands-on-approach-in-2-weeks/0636920089792/0636920092359/) Aug/Sep 2023
+  - [Prompting Bootcamp](https://learning.oreilly.com/live-events/prompting-bootcamp/0636920097098/0642572010284/) Dec 2024
+  - [AI, ChatGPT, and other Large Language Models (LLMs) Security - Omar Santos](https://learning.oreilly.com/live-events/ai-chatgpt-and-other-large-language-models-llms-security/0636920092790/0636920096557/) Aug 2023
+
+## 6. AI Frameworks and Tools
+- Hugging Face in Action
+- LangChain in Action
+- Multi-Agent Systems with AutoGen 
+- Deep Learning with Python, 3rd Ed
+- **OPTIONAL**
+  - Deep Learning with PyTorch, 2nd Ed
+  - Neural Networks from Scratch in Python
+  - [Hands-On Deep Neural Networks with PyTorch - Robert Alvarez](https://learning.oreilly.com/live-events/hands-on-deep-neural-networks-with-pytorch/0636920305781/0636920093856/) Sep 2023
+  - [Introduction to Deep Learning with PyTorch - Sinan Ozdemir](https://learning.oreilly.com/live-events/introduction-to-deep-learning-with-pytorch/0636920086096/0636920092737/) Aug 2023
+  - [PyTorch 2.0 - Joe Papa](https://learning.oreilly.com/live-events/pytorch-20/0636920055927/0636920092412/) Sep 2023
+  - [Practical Introduction To The World Of Computer Vision And Deep Learning With TensorFlow & Keras - Richmond Alake](https://learning.oreilly.com/live-events/practical-introduction-to-the-world-of-computer-vision-and-deep-learning-with-tensorflow-keras/0636920060577/0636920061406/) Dec 2021
+
+## 7. GPU/CUDA Programming
+- Programming Massively Parallel Processors, 3rd Ed
+- GPU Programming with Python and CUDA
+- **Optional**
+  - [Getting Started with CUDA for Python Programmers - Jeremy Howard](https://www.youtube.com/watch?v=nOxKexn3iBo&t=357s&pp=ygUSamVyZW15IGhvd2FyZCBjdWRh)
+  - [Going Further with CUDA for Python Programmers - Jeremy Howard](https://www.youtube.com/watch?v=eUuGdh3nBGo&t=4s&pp=ygUSamVyZW15IGhvd2FyZCBjdWRh)
+
+## 8. AI Papers
+...
diff --git a/README.md b/README.md
@@ -1,42 +1,7 @@
-# AI Nerd Notes
+  # AI Nerd Notes
 
-## AI 101/Trends
+Time to (re)learn Software.
 
-- Machine Learning for Kids
-- The Complete Obsolete Guide to Generative AI
-- Engineer's Guide to Surviving AI
-- Quick Start Guide to Large Language Models, 2nd Ed (Sinan Ozdemir)
-- How AI Works
-- A Simple Guide to Retrieval Augmented Generation
-- A Damn Fine Stable Diffusion Book
-- HuggingFace in Action
-- LangChain in Action
-- Generative AI on the AWS
+## What is Software 2.0?
 
-## AI Machine Learning
-- The Hundred Page Machine Learning Book
-- Machine Learning Yearning
-- Designing Maching Learning Systems (Chip H)
-- Design a Machine Learning System (from Scratch)
-- Production Machine Learning
-- Rules of Machine Learning: Best Practices for ML Engineering
-
-## AI Deep Learning
-- Neural Networks From Scratch
-- Deep Learning for Coders with fastai and PyTorch
-- Deep Learning Illustrated
-
-## AI LLMs/GenAI
-- AI Engineering (Chip H)
-- Generative AI in Action
-- Build a Large Language Model (from Scratch)
-- *Build LLM Applications (from Scratch)*
-- LLMs in Production
-- Multi-Agent Systems with AutoGen
-
-## AI Widsom
-- Co-Intelligence
-- Why Machines Learn
-- AI Snake Oil
-- The Skill Code
-- A Brief History of Intelligence
+Source: [Software 2.0](https://karpathy.medium.com/software-2-0-a64152b37c35)
diff --git a/cli/glow.md b/cli/glow.md
@@ -0,0 +1,9 @@
+# glow
+
+Display Markdown files in the terminal with style.
+
+## Useful commands
+
+```bash
+brew install glow
+```
diff --git a/cli/interpreter.md b/cli/interpreter.md
@@ -0,0 +1,21 @@
+# Open Interpreter
+
+- [Source](https://github.com/openinterpreter/open-interpreter)
+Open Interpreter lets LLMs run code (Python, Javascript, Shell, and more) locally. You can chat with Open Interpreter through a ChatGPT-like interface in your terminal by running $ interpreter after installing.
+
+This provides a natural-language interface to your computer's general-purpose capabilities:
+
+Create and edit photos, videos, PDFs, etc.
+Control a Chrome browser to perform research
+Plot, clean, and analyze large datasets
+...etc.
+
+## Useful Commands
+
+```bash 
+# This command failed to install
+uv tool install open-interpreter
+# While this one worked. Guess they are seriously working on the development branch to get ready for 1.0.0 release
+uv tool install git+https://github.com/OpenInterpreter/open-interpreter.git@development
+interpreter --version
+```
diff --git a/cli/llm.md b/cli/llm.md
@@ -0,0 +1,58 @@
+# llm CLI
+
+## Useful commands
+
+```bash
+llm version --help
+llm models
+llm models default
+llm --help
+llm aliases
+llm plugins --help
+llm plugins
+llm install llm-gpt4all
+llm install llm-gguf
+llm install llm-ollama
+llm install llm-gemini
+# To update the model
+llm install -U llm-gemini
+llm install llm-claude-3
+# To update the model
+llm install -U llm-claude-3
+llm install llm-bedrock
+llm install llm-groq
+llm keys
+llm keys path
+llm keys set gemini
+llm keys set openai
+llm keys set claude
+llm keys set groq
+cat '/Users/anasharm/Library/Application Support/io.datasette.llm/keys.json'
+llm aliases list --json
+llm aliases path
+llm aliases set 2-flash-think gemini-2.0-flash-thinking-exp-1219
+```
+
+## AI Model Invocations
+
+```bash
+curl -s https://www.nytimes.com/ | strip-tags .story-wrapper | ttok -t 4000 | llm --system 'summary bullet points'
+```
+
+```bash
+llm -m 2-flash describe -a https://static.simonwillison.net/static/2024/pelicans.jpg
+```
+
+```bash
+llm -m gemini-2.0-flash-thinking-exp-1219 "Generate an SVG of a pelican riding a bicycle"
+llm -m 2-flash -a https://arxiv.org/pdf/1902.08318 "a bullet point list of the most unusual ideas"
+```
+
+```bash
+llm -m gemini-2.0-flash-thinking-exp-1219 -a https://storage.googleapis.com/generativeai-downloads/images/geometry.png "What's the area of the overlapping region?"
+```
+
+```bash
+llm -m groq-llama-3.3-70b 'A sassy name for a pet sasquatch'
+```
+
diff --git a/cli/ttok.md b/cli/ttok.md
@@ -0,0 +1,19 @@
+# ttok
+
+## Useful Commands
+
+```bash
+uv tool install ttok
+ttok Hello World
+echo "Hello World" | ttok
+echo -n "Hello World" | ttok
+ttok boo Hello there this is
+ttok boo Hello there this is -m gp2
+ttok boo Hello there this is -m gpt2
+ttok boo Hello there this is -m gpt-4o-mini
+ttok boo Hello there this is -m gpt-4o
+ttok आनंद 
+ttok आनंद -m gpt2
+ttok आनंद -m gpt-4o
+ttok आनंद -m gpt-4o-mini
+```
diff --git a/cli/yt-dlp.md b/cli/yt-dlp.md
@@ -0,0 +1,15 @@
+# yt-delp
+
+A feature-rich command-line audio/video downloader supporting various sites. Source: [yt-dlp](https://github.com/yt-dlp/yt-dlp)
+
+## Installation
+
+```bash
+uv tool install "yt-dlp[default]"
+```
+
+## Useful commands
+
+```bash
+yt-dlp --help
+```
diff --git a/cli/zshrc-functions.md b/cli/zshrc-functions.md
@@ -0,0 +1,13 @@
+# zshrc functions
+
+- [Source](https://simonwillison.net/2024/Dec/19/q-and-qv-zsh-functions/)
+- [Source](https://davidgasquez.com/useful-llm-tools-2024/)
+
+## LLM Hacks
+
+The functions are available in your `macosx` zshrc plugin file.
+
+```bash
+q https://simonwillison.net/ 'What has Simon written about recently?'
+qv 'https://www.youtube.com/watch?v=uRuLgar5XZw' 'what does Simon say about open source?'
+```
Original file line number	Diff line number	Diff line change
		@@ -0,0 +1,5 @@
		# AI Online References

		A dump of all AI links (under _AI_ > _AI Streams..._) that I have collected over the past year or so. I will organize them later.