Jeremy Ellis, ex: Rocksetta now LinkedIn
I help to bring Tiny ML to universities in developing countires https://tinyml.seas.harvard.edu/team and hopefully this group will publish a paper about the process later this year (2024)
I am in the top 25 (July 2024) of Github Open Source contributors for Canada (hpssjellis) see website at https://github.com/gayanvoice/top-github-users/blob/main/markdown/public_contributions/canada.md
First academic paper TinyML4D: Scaling Embedded Machine LearningEducation in the Developing World started during the workshop at: ICTP Italy Summer 2023
https://ca.linkedin.com/in/jeremy-ellis-4237a9bb
.
https://github.com/hpssjellis/maker100-curriculum
Click for More QR Codes for presentations
.(Cheaper version of my Maker100 course using the SeeedStudio XIAO-esp32s3 sense and rakwireless 2270 sticker tracker full Robotics Course)
https://github.com/hpssjellis/maker100-eco
.
Single web page that use webserial to do most of the Machine Learning work we use other sites to make ML work on microcontrollers. I have this working for the Nano33 Ble Sense, NiclaVision, RakWireless 2270 Sticker tracker.
https://hpssjellis.github.io/tinyMLjs/public/index.html
.
You can just search for this is the arduino IDE to install it. Has over 100 examples presented in the maker100 robotics course using the PortentaH7 with Vision Shield.
https://github.com/hpssjellis/portenta-pro-community-solutions
.
Surprisingly usefull, small tensorflowLite-micro library for the Arduno IDE. This time you need to download the zipped file from the github and install
using ( Sketch-->include library --> add .zip Library). Very small and easy to use tensorflow micro library. Try the sine wave and view the plotter to see if it works on your microcontroller.
https://github.com/hpssjellis/RocksettaTinyML
.
Reall old work I did on single page static websites that load many advanced vision Machine Learning models. Worth a check
https://hpssjellis.github.io/beginner-tensorflowjs-examples-in-javascript/
.
Machine Learning motion vibration analysis sending P2P LoRa to a receiver connected to this website that shows visually and the data for ML inference.
https://hpssjellis.github.io/mcu-stable-edu-launch/rak2270-sticker-tracker/html/lora-webpage-best.html
.
Not exciting the first set of assignments should be typed, I give the code to students willing to work with it and make it better.
https://github.com/hpssjellis/high-school-javascript-game-dev-assignment-images
.
.
With technology you start multiple projects and some of them are successful and others need updates or get deprecated or just aren't right for you. Here is my list!
| Title and LInk | Description | Percent Complete |
|---|---|---|
47 |
. | 0% |
46 maker100-curriculum |
Empowering Students in Robotics, IoT, and Machine Learning. The Maker100 curriculum offers a hands-on approach to learning robotics, IoT, and machine learning, tailored for high school and undergraduate students. Designed to empower students to tackle real sensor, actuator technology issues on resource contrained tinyML devices, this curriculum eliminates the need for a specialist robotics instructor, as the students need to do most of the problem solving. Key Features: - Versatile Microcontroller Use: The curriculum is not tied to a specific microcontroller, encouraging the purchase of different microcontrollers every few years to stay current with technology. - Collaborative Learning: First-year technology educators can learn alongside their students, fostering a collaborative and dynamic learning environment. - Focus on Problem-Solving: The core strength of this course lies in its emphasis on technology problem-solving, equipping students with the skills to innovate and adapt. Draft price-list |
80% |
45 chatbot-learn-to-code |
My take on how to learn to code in an age when you can just talk to an LLM and it produces the code for you. Is that learning? We can ask an expert to do something for us, but does that have any learning value? Lets dig into possible ways to use chatBots to learn not just do the work for us. The demo webpage index is here | 10% |
44 Demo recording-js-looper/ |
Here is the github recording-js-looper/ This is an attempt to understand the Pros and Cons of using a chatBot to computer program. You get something that works really fast, but as you start developing it and making it fit your needs I found I got lost in how it worked and only minimally learnt anything. Cocnlusion, best to use the chatbot to teach you how to do advanced work but then do the advanced work yourself. I am going to do more work in this area. | 90% |
43 Grove Vision AI V2 |
Using the Grove Vision AI V2 with the Seeedstudio Xiao-Esp32S3 to improve my RoboCar | 70% |
42 gitpod-wasm-emscripten-binaryen |
Converting C++ code to WASM using ENSCRIPTEN and BINARYEN hopefully using Gitpod or CodeSandBox to make things much easier. Possible things to convert from C++ to WASM is the tensorflow-converter tool so it can be used from the web and even compiling Arduino code put on the web. I don't think this will work with tensorflowJS | 90% deprecated |
41 Rabbit R1 |
I have ordered a Rabbit R1 Personal Companion On Jan 9th, when I head about it. By January 10th it was sold out after the first 10K were ordered. I think a new round of ordering is possible or are they all pre-order? rabbit.tech. I plan to do an uboxing video but mainly about Pros and Cons. Go to my github issues and add possible things to try by going out on the rabbit r1 |
50% A cool device but until "TeachMode" works this has not much interest for me. The rabbit hole is actually good for organizing your work. |
40 aMCC the anterior-midcingulate-cortex-and-teenagers |
The anterior midcingulate cortex (aMCC) which I will introduce to my students as the DAM-C^2 (Dam C squared: Develop the aMCC) may be part of the solution to a decade long attempt of mine to find out why coding is so hard to teach to non-natural coders in this smart phone era. Students need to get used to doing things that are not that much fun. | 40% |
39 Maker100-eco |
After the success of my Maker100 Robotics, IoT and TinyML Machine Learning course staring the $113.90 USD Arduino PortentaH7 with $69 USD LoRa Vision Shield I have decided to make an economic version of the in-preson course staring the $13.99 USD Seeedstudio XiaoEsp32s and the $14.50 USD RakWireless RAK2270StickerTracker. This is an in-person course, the links and videos are organizational quick reminders of what to do to become proficient at Robotics (IoT and Machine Learing) with microcontrollers. Most of the rest of the course will need an instructor or be solved through research such as using ChatGPT etc. SeeedStdio Playlist or the RakWireless Playlist | 90% Maker100-Eco Youtube Playlist |
38 my-examples-of-the-gptstore |
GPT Store. I know nothing about it as of Nov 9th 2023 but it sounds interesting. I guess I need a ChatGPT-plus subscription | Deprecated! |
37 RAK2270 Sticker-Tracker |
This is a postage sticker that you QR code it to TrackPac.io for a year subscription and it auto launches a Helium network connectivity. Tear open the bottom of the sticker and you have battery activated it for hourly temperature, LoRaWan locaiton measurements with. The device comes with an accelerometer but needs to be programmed. Arduino IDE seems to be supported | 90% See above maker100-eco course |
36 RocksettaTinyML |
I found a 3 year old library I made based on eleoquentTinyML that still loads machine learning models on Micro-controllers in a very simple way. Seriously easy. So I am adding relevant Nicla- Vision examples etc. Every ML model has an input array to a prediction that returns an output array, in whatever types you declare. That's it! Seems useful, since Google TFLITE Micro has deprecated the Google TFLM arduino examples library | 80% This will be used in the 2024 maker100-eco course see above |
35 tensorflowjs-to-arduino-for-tinymljs |
Gitpod ready tensorflowJS converter to convert models made using Javascript into TFLITE and TFMicro (C header file) ready models | 70% This also will be used in the 2024 maker100-eco course |
34 google-coral-micro |
Google Coral Micro First look and installation on the Arduino and Linux (Ubuntu) | Deprecated. This has been paused until Google makes a new updated version and supports it, as this one seems to have been deprecated here |
33 xiao-esp32s3 |
XIAO ESP32S-Sense First look and some working code | 80% Will be used in the new maker100-eco course |
32 Machine Learning Conference Personalized Playlists |
Started this project in August 2023. A group of conference ready, machine learning, short, youtube videos that can be strung together in a personalized playlist for teachers to present a 1-5 day TinyML hands-on conference, most likely about: Edge Impulse, TinyMLjs, Seeedstudio XiaoEsp32S3 and accesories and the Arduino PortentaH7 and Nicla Vision and others | 10% This also will be used in the 2024 maker100-eco course above |
31 tinyMLjs |
Started this project in early June 2023. Making teaching machine learning possible from a single vanilla Javascript webpage using webSerial to load any sensor data from any microcontroller directly onto the webpage or from a previously saved CSV file and to train a TensorflowJS ML model and export that model or upload a saved model so that new incoming data can be graphed and classified. If needed the results can then be easily sent back to the microcontroller to control acutators. Possibly the best thing I have every made! | 75% This also will be used in the 2024 maker100-eco course |
30 Portenta Pro Community Solutions Library |
A massive library of example Arduino sketches solely for the Arduino PortentaH7, many of these examples will form the basis for the Maker100 course below being developed for Feb 2022. | 95% Proud of this. Wondering if I should make a library for the 2024 maker100-ec course |
29 Maker100 |
A University level, tested on High School Students, general introduction for Microcontroller Sensing, Automation, Communication and Machine Learning. Completely designed around the Arduino Poretenta but could be used in part with a few other microcontrollers | 95% Proud of this! |
28 HuggingFace |
I spent a week when I found out that HuggingFace has given Javascript access to their huge hub of machine learning datasets. This is a great set of single page demos that is a starting point for lots of projects | 98% |
27 RoboCar |
The EdgeImpulse.com TinyML Vision Machine Learning Hcked Shredder toy car that I have been working on for several years. It now works well enough to show others | 75% Blog for this here |
26 WebMLSerial |
WebMLSerial is my attempt to bring tnsorflowJS web Machine Learning with WebSerial to connect microcontrollers to web pages to teach the future of TinyML now. | 99% I have moved most of this to my TinyMLjs website. Still waiting for mass adoption for Android phones |
25 DIY-Flexible-PCB |
Not pretty but working pcb's on flexible heat resistanct kapton tape prototyping before using a serivce that makes flexible PCB's | 5% I know it works but need to make the examples |
24 DIY-3dPrinted-PCB |
Not pretty but working pcb's in a 3D Printed sturcture for prototyping before using a serivce that makes static PCB's | 5% I know it works but need to make the examples |
23 Wearable-Electrolyte-Sweat-Sensor |
Electrolyte measurements using blood, sweat or tears (or urine). I am going to start with total conductivity and then move towards more specific ion selective electrodes. The first issue is the physical problem of getting a sweat sample in a way to constantly monitor the conductivity. | 2% I have a total conductivity sensor, just need to test it to get started |
22 Tensorflowjs Browser Javascript Single page Machine learning |
Javascript web browser Machine Learning typically each webpage is a single file. | Started around 2017 with deeplearnjs 98% complete |
21 Arduino Portenta Research |
My Basic research of the Arduino Portenta with Machine Learning. Started around July 2020 | 98% |
20 Edge Impulse Videos and Research |
As I am an Edge Impulse Ambassador I am always looking how to make using Edge Impulse with Arduinos easier Videos here | 30% |
19 Portenta MQTT Ethernet Server arduino Library |
Use one of the Portenta Shields Ethernet connectivity to make the Arduino Portenta into an MQTT server for communication about IoT data.Has some stability issues | 70% |
18 Portenta MQTT Wifi Server arduino Library |
Use one of the Portenta Shields Ethernet connectivity to make the Arduino Portenta into an MQTT server for communication about IoT data. Has some stability issues | 70% |
17 Helium LoRaWan cryptocurrency Portenta Connectivity |
An Advanced part of my Maker100 course is to use the LoRaWan Helium HNT Peoples Network to communicate Arduino Portenta Data with either the world or your own local needs. Video and Docs should be out soon. | 80% |
16 Portenta RC Machine Learning Car control |
Controling an RC car except on board using the Arduino Portenta and some Machine Learning. This is for an after school course I teach with GearbotsBC | 80% |
15 Machine Learning with Javascript and TensorflowJS |
Old ML project using TensorflowJS and Javascript in the browser. I might get back to this when I find an easy way for a cell phone to connect to the Arduino Portenta directly. | 90% |
14 Maker101 |
Combining Javascript, TensorflowJS, Edge Impulse and the Arduino PortentaH7 for a more advanced Maker course with more in depth Machine Learning and connectivity, would need colaboration with a few Universities youtube blogging Professors. I might just link to the EdgeImpulse University Github. It seems very well done | 20% |
13 No link yet |
. | . |
12 Adruino Portenta Stackable PCB making using easyEDA and JLCPCB |
The Arduino Portenta has 2x80 pin HD connectors. This is a bit of a problem to make stackable boards unless you find out it is fairly easy using easyEDA and JLCPCB. | 100% THE PCB WORKS, NOW WHAT TO DO WITH IT! |
11 Particle Photon Robotics |
A fully 5 year High School tested Robotics program using the Particle Photon | 100% Deprecated! |
10 LoRaWan with the Portenta Murata Module |
Some cool research into fully using the LoRa and LoRaWan capabilities of the Arduino Portenta Murata Module. Takes some fancy board switching using the GrumpyOldPizza github installed as "Tlera Corp STM32L0 Boards" board that the Portenta can run a program that communicates with it. Unless I need it I am kind of finished with it, since Arduino updated their MKRWAN library to include LoRaWan connectivity in North America. Would really like to see the MKRWAN library allow peer-to-peer LoRa connectivity for the Portenta LoRa Vision Shield | 80% |
09 easyEDA |
Teaching PCB design using EasyEDA. My advance Robotics and animation students only need this link to be able to start makiing PCB's. My school Machine Learning Club was given by the PAC some money to pay for boards from JLCPCB | 70% |
08 Voltera.io |
PCB designer hardware to make your own PCB's. Drills, Lays conducting ink, on both sides, punch copperr rivets into the holes, lays solder paste, place your items (probably top side only), auto heats and melts solder paste. Very Cool! | 30% I now have a V-One for use in my classroom |
07 WebSerial |
Started June 2022. Connect the Arduino PortentaH7 or Seeduino XIAO (probably any microcontroller) to a webpage on your computer or cell phone (tested on Android using webSerial Polyfill) to send and receive Serial communication. Demo page here, Arduino sketch here . This is important to allow a cell phone to do the power hungry Machine Learning while the arduino collects sensor data or drives actuators to do something. | 95% |
06 tinyml.seas.harvard.edu |
Part of the working group for the Harvard, John A. Paulson School of Engineering and Applied Sciences (SEAS) TinyMLedu Tiny Machine Learning Open Education Initiative. TinyML4D. Presently helping to present the monthly Undergrad and Graduate student projects in a Show and Tell. Also hoping to be part of a group meeting this July 2023 at the International Center for Theoretical Physics in Italy. My Show and Tell Youtube Playlist for tinyML4D | Started May 2022 |
05 pecha-kucha-lightning-talks-template |
How to combine Powerpoint with .pdf files but using Coders markdown and Vanilla Javascript. Fork this repo to make yuor own Lightning Talk Pecha Kucha Presentation | 98% |
04 my-robotics-machine-learning-teaching-lightning-talk-pecha-kucha Demo |
My July 2022 state of teaching Robotics and Machine learning to High School Students. Where I am at and how it is going 5 min pre-recorded Presentation Github at my-robotics-machine-learning-teaching-lightning-talk-pecha-kucha | 95% |
03 https://hpssjellis.github.io/lightening-talk-Pecha-Kucha-tensorflowjs/ |
Old style of lots of individual images for each slide. Worked fine but each link was not clickable. Github at lightening-talk-Pecha-Kucha-tensorflowjs | 100% |
02 https://github.com/hpssjellis/diy-flexible-pcb-biosensor |
DIY making Flexible BioSensors with the PortentaH7 or XIAO microcontrollers | Started Oct 2022 10% |
01 https://github.com/hpssjellis/multi-language-edgeimpulse-tutorial-vision-cell-phone |
Example of my new multi-language Tutorial technique which I will connect with my future teaching Videos. Makes for a searchable tutorial that also has a video component | 50% |
I am a technology teacher from BC, Canada.
Presently working on improving my 7 year student tested Arduino Clone Robotics course old course here to a new robotics and Machine Learning course called maker100 designed for any non-engineering University program and is planned to be ready for Jan 2022.
The course introduces all the hands on basics of robotics; sensors and actuators, with a simplified Edge Impulse Machine Learning introduction all based around the (in my opinion) best all round microcontroller the new Arduino Pro boards: ~$100 USD PortentaH7 the easy to program dual core 160 pin cybertruck of an Arduino, ~$50 USD Portenta Vision shields (Ethernet and LoRaWan), ~$50 USD Portenta Breakout Board. The course uses my ever-changing offical Arduino IDE Library of examples portenta-pro-community-solutions
Showing the Dual Core, 160 Pin, PortentaH7 on a breadboard upside down so the snap on Ethernet Vision Shield, Camera and Microphones are facing up, but still with easy access to the SD card and control button, visible is the Wifi and BLE antenae.
Needs extra male and female headers to do this.
In researching the above Robotics Machine Learning Maker 100 program, I designed a simplified way to use TensorflowJS and TensorflowLite/micro with the Arduino boards. It is too complex for my High School students but would work well for a web based Javascript and Arduino C++ introduction to GoogleAI
I would be willing to work over the duration of a few years with a University Professor on a paid Google or other program to develop a TensorflowJS and TensorFlowMicro course as a University introduction to TinyML, Tensorflow and Machine Learning. Using my working code, adapted with the Professors ideas and theory. Potentially my hands on videos, with the Professors theory videos.
My TensorflowJS site is www.rocksetta.com/tensorflowjs Note: everything is Vanilla Javascript as easy as possible. Examples are clear, Keras based and simple for students to build from.
My best, easiest TensorflowJS Vanilla Javascript example is this xOr example
My TinyML Portenta examples site is here although an easier example is on the above library.
Name: Jeremy Ellis
Pronouns: he/him
Education: B. Sc. Chemistry 1986, B. vEd Swecondary School and a Diploma Counseling.
Teaching: Have taught High School Math, General Science and Physics 11/12
Now Teaching Coding (Game Development), Animation, Robotics and 3D Printing. All self developed courses.
Passionate about Open Source and the general public having hands on experience with both Robotics and Machine Learning.
I also teach a STEM class after school Thursdays at GearBots.org
Looking into how I can support capable Indigenous students to have access to Machine Learning
Website: https://rocksetta.com/
Github: This page! https://github.com/hpssjellis
Twitter: Rocksetta on Twitter
or
Instagram: jerteach on Instagram
TikTok (new) Rocksetta on TikTok
or
my Gitpod of EdgeImpulse https://github.com/hpssjellis/my-gitpod-of-edge-impulse
This page https://github.com/hpssjellis/hpssjellis
Arduino Portenta https://github.com/hpssjellis/my-examples-for-the-arduino-portentaH7
Maker100 https://github.com/hpssjellis/maker100
My Portenta Arduino Library https://github.com/hpssjellis/portenta-pro-community-solutions
Particle Robotics course https://github.com/hpssjellis/particle.io-photon-high-school-robotics
My Maker Videos https://github.com/hpssjellis/my-examples-of-my-best-maker-videos
Fancvy ways to do javascript https://github.com/hpssjellis/js-examples
MSS Machine Learning Club https://github.com/hpssjellis/mss-machine-learning-club or https://github.com/hpssjellis/fraser-valley-IDS-robotics-machine-learning-javascript-high-school
LoRa on the Portneta (advanced) https://github.com/hpssjellis/portenta-lora-murata-stm32lo
Particle websocket hacking https://github.com/hpssjellis/Particle-Spark-Core-Photon-Websocket-Hack
Arduino websocket https://github.com/hpssjellis/arduino-simple-websocket
Bunch of STL 3D Printing files since I am too lazy to put things on Thingiverse.com https://github.com/hpssjellis/my-3D-printing-stl
Messing with browser web-BLE https://github.com/hpssjellis/my-3D-printing-stl only good on windows not Mac
Openthread as a gitpod https://github.com/hpssjellis/my-gitpod-of-openthread
I messed with Quantum computing for a few months https://github.com/hpssjellis/my-examples-for-quantum-computing
TensorflowJS to Arduino c header files https://github.com/hpssjellis/Gitpod-auto-tensorflowJS-to-arduinon or https://github.com/hpssjellis/gitpod-tensorflowjs-to-arduino
Cartoon yourself (load the gitpage) https://github.com/hpssjellis/zoom-cartoon-svg
Something I made witgh tensorflowjs https://github.com/hpssjellis/beginner-tensorflowjs-examples-in-javascript
Wolfram try the gitpage https://github.com/hpssjellis/wolfram-notebook-embedder
Virus estimator try the gitpage https://github.com/hpssjellis/personal-virus-estimator
vscode javascript https://github.com/hpssjellis/javascript-with-vscode-intellisense-no-ES6-no-Typescript
Nordic NRF52840 https://github.com/hpssjellis/everything-nrf52840-usb-dongles
??? https://github.com/hpssjellis/char-rnn-tensorflow-music-3dprinting
3D Animation https://github.com/hpssjellis/3D-Animation
Nano 33 IOT guide https://github.com/hpssjellis/Arduino-Nano-33-IoT-Ultimate-Guide
GITPOD HTML from github https://hpssjellis.github.io/rocksetta-gitpod-links/
Particle IOTA https://hpssjellis.github.io/rocksetta-gitpod-links/
TensorflowJS Pecha Kucha ligthening talks see the gipage https://github.com/hpssjellis/lightening-talk-Pecha-Kucha-tensorflowjs
ParticlePhoton cloud9 https://github.com/hpssjellis/particle-photon-on-cloud9
Cordova Phoengap https://github.com/hpssjellis/my-gitpod-cordova or https://github.com/hpssjellis/my-gitpod-ionic-cordova
Tensorflwojs speech https://github.com/hpssjellis/tfjs-models-purejs-speech-commands
tensorflowjs BVH animation https://github.com/hpssjellis/tensorflowjs-bvh
Celebrity TensorflowJS see gitpage https://github.com/hpssjellis/celeb2-classify gitpage at https://hpssjellis.github.io/celeb2-classify/
tensorflowjs faceapi see gitpage https://github.com/hpssjellis/face-api.js-for-beginners-more-accurate
Particle photon raspberry pi https://github.com/hpssjellis/particle-photon-raspberry-pi-iot
Teachable machine https://github.com/hpssjellis/teachable-machine
tensorflowjs playground https://github.com/hpssjellis/playground
ASH on windows https://github.com/hpssjellis/my-installs-for-bash-on-windows
https://www.youtube.com/c/Rocksetta/playlists
https://www.youtube.com/playlist?list=PL57Dnr1H_egsQPnEObWHPhK1Q4g_IDWcR
https://www.youtube.com/playlist?list=PL57Dnr1H_egtm0pi-okmG0iE_X5dROaLw
https://www.youtube.com/playlist?list=PL57Dnr1H_egsL0r4RXPA4PY2yZhOJk5Nr
https://www.youtube.com/watch?v=dnDb-RAvxHg&list=PL57Dnr1H_egukaDgFqwEnDVStd7Jktg1E
I get migraines but am wading through the Snake Oil and will eventually be able to reduce it from about 1 every 3 weeks, to a much lower number. Getting used to multiple migraines the first week of school. My migraine repositiroy is pre-migraine
Both my arms dislocate, but I find that the less I play: rugby, kayak, rockclimb, volleyball, pillow fight the less it is a problem.
I don't seem to have as good control of my memory as I would like.
https://rocksetta.com/keyfreemusic/keyfreemusic.html
