forked from harrylepotter/carplay-receiver
-
Notifications
You must be signed in to change notification settings - Fork 0
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
1 parent
cb9179a
commit 3179f60
Showing
1 changed file
with
24 additions
and
53 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,73 +1,44 @@ | ||
| Python Carplay library for the "Autobox" dongles | ||
|  | ||
|
|
||
| # Dongles | ||
|
|
||
| These are readily available from Amazon, but are also available from cheaper sources. The one I got was labelled "Carlinkit" here: https://www.aliexpress.com/item/32829019768.html | ||
| Python Carplay implementation for the "Autobox" dongles. Forked from https://github.com/electric-monk/pycarplay to include audio/video output via mpv and key presses | ||
|
|
||
| They're provided with an Android APK (and if you hunt around online, a Windows CE version of the 'player' application also exists). | ||
| Video of WIP here: | ||
| https://www.youtube.com/watch?v=D8P99BTqCCo | ||
|
|
||
| ## Interesting observations | ||
| # Dongles | ||
|
|
||
| * During boot, a bunch of files are copied to the dongle, with a target path beginning with `/tmp/` and occasionally `/etc/`. This implies the dongle itself is running something like Linux. | ||
| * Some files are also written to change settings, such as night mode, left or right hand drive, and "charge mode" for the USB port. | ||
| * There may be multiple versions, possibly including whether or not the dongle supports wireless CarPlay, but I haven't investigated. I suspect the one I have doesn't support wireless CarPlay because there's a point at which the dongle can indicate support, optionally requesting a driver is uploaded, and mine never sends the message. | ||
| These are readily available from Amazon, but are also available from cheaper sources. The one I got was labelled "Carlinkit" here: https://www.aliexpress.com/item/32829019768.html | ||
|
|
||
| # Setup | ||
|
|
||
| The code provided was based on findings from the APK. As such, some functionality is duplicated that may not be necessary. The primary case is the copying of various "assets" to the dongle that happens on every boot. To acquire these assets, a script is provided. | ||
| ## Download assets from the .APK | ||
| The dongle relies on the copying of various "assets" to the dongle that happens on every boot. To acquire these assets, a script is provided. | ||
|
|
||
| Simply run: | ||
| ``` | ||
| ./downloadassets.sh | ||
| ``` | ||
| from the repository root. | ||
|
|
||
| This script simply uses the URL that was printed on the front of the box my dongle came in. | ||
| ## Dependencies | ||
| This script relies on the following packages (installed via `apt-get` or otherwise): | ||
| * ffmpeg | ||
| * mpv | ||
| * libmpv | ||
| * libmpv-dev | ||
|
|
||
| ## Python environment | ||
| ## Setup and running | ||
|
|
||
| The code is intended for Python3. To install the necessary packages, run this command: | ||
| ``` | ||
| pip3 install pyusb simplejson | ||
| pip3 install pyusb | ||
| ``` | ||
|
|
||
| # Implementation | ||
|
|
||
| Though I thought it'd be fun to have CarPlay on a Tesla, I was really interested in the dongle itself. | ||
|
|
||
| They're pretty mysterious, providing CarPlay and Android Auto functionality in a way that clearly wasn't intended by Apple or Google. Further investigation indicates they may come from a line of products that can also support AirPlay and other streaming without needing an Apple-specific dongle. | ||
|
|
||
| ## Structure | ||
|
|
||
| The program is split into a few files: | ||
|
|
||
| * decoder.py | ||
| * convenience wrapper for a subprocess running `ffmpeg`, to take the received h264 and generate PNGs | ||
| * server.py | ||
| * convenience wrapper for `http.server`, to server a basic "CarPlay" PNG-based webpage and get the touches out | ||
| * link.py | ||
| * the USB-specific code, wrapping `pyusb` and the dongle's default interface with a reader thread (which parses messages) and a writer thread (with locking, as each module runs in its own thread) | ||
| * protocol.py | ||
| * implemention of various messages the dongle sends and/or receives | ||
| * teslabox.py | ||
| * test code to make the CarPlay webpage appear in a Tesla | ||
|
|
||
| ## Issues | ||
|
|
||
| 1. I only implemented the basic messages required to get things to work. | ||
| * There's messages coming in that I can probably decode but didn't as they're not required right now. This includes a bunch of stuff relating to which microphone to use. | ||
| * Android Auto hasn't been tested, nor has iOS 13 (though I imagine compatibility issues would be a dongle issue firstly). There's some evidence that Android Auto will behave quite differently with a bunch of different messages. | ||
| 2. `ffmpeg` is communicated with via pipes. | ||
| * This means if you don't read the `stdout` pipe fast enough, it blocks even if it has plenty of input data. | ||
| * This could be solved with a native `ffmpeg` wrapper for python, or by just rewriting this all in C++. | ||
| 3. It maxes out a Raspberry Pi model B, even with `ffmpeg` dropping frames intentionally. | ||
| 4. Tesla-specific: | ||
| * The Tesla web browser won't open private IPs. It may be possible to have a Raspberry Pi act as an AP and provide the interface on a "public" IP that it internally serves, then serve the rest of the internet normally, but I haven't tried this. | ||
| 5. Doesn't seem to work on MacOS X (High Sierra) | ||
| * I assume it's a libusb issue. | ||
|
|
||
| # Finally... | ||
|
|
||
| All work here was done simply as a research project, and largely for fun. I hope it can be of use to others who are interested! | ||
| To run, call | ||
| ``` | ||
| sudo python3 carplay.py | ||
| ``` | ||
| (note: you need a user that is allowed to manipulate usb devices, or run as) | ||
|
|
||
| Copyright (C) 2019 Colin Munro | ||
| # Implementation | ||
| # Finally | ||
| The real 'guts' of this project that drive device communication were not Implemented by me. They were discovered by Colin Monro (Electric-monk). His repo is here: https://github.com/electric-monk/pycarplay |