May 26, 2023 : Regarding Nreal to Change Name of Company to "Xreal"
Nreal Japan, a developer and seller of augmented reality (AR) glasses, announced on May 26 that it will change its company name and brand name.
From now on, "Nreal" will be developed as "XREAL," and after May 25, the respective names will be as follows
- Company name : Japan Xreal Co. (formerly Japan Nreal Co., Ltd.)
- Brand name : XREAL (formerly Nreal)
- Official website URL: https://www.xreal.com/jp (Formerly https://www.nreal.jp/)
- Product name
- XREAL Air (Formerly Nreal Air)
- XREAL Adapter (formerly Nreal Adapte)
- XREAL Light (Formerly Nreallight)
This project aims to visualize the sensor information of the surroundings using "Nreal Ari," which was released on March 4, 2022.
A device called ReSpeaker Mic Array v2.0 is used to detect the direction of sound. This device can be used as long as it can be powered via USB, and we will connect it to Raspberry Pi to measure the sound. Nreal is connected to a Raspberry Pi micro-HDMI via a dedicated Nreal converter to enable screen output.
- Sound Direction Detection and Corresponding Object Generation Using Python's "Pygame", we implemented a function to generate an arrow-like object from the direction of the detected sound.
- Speech Recognition and Text Display Speech recognition using "SpeechRecognize" in Python.
- Transition Mode Using Touch Sensor The touch sensor enables switching to object generation mode, switching to text display mode, and switching recognition languages.
git clone 'this repo'
cd Nreal_IoT
sudo pyhton3 main.pyIt is assumed to be run with administrator privileges and with python3 series. Depending on your environment, there may be libraries to install.
- Pyhton
- Nreal
- ReSpeaker Mic Array v2.0
- Raspberry Pi
git clone https://github.com/respeaker/usb_4_mic_array.git
cd usb_4_mic_arrayThe sensor information such as voice direction is acquired by importing the information in the code "tuning.py" in this file. Then, create a DOA.py with below code under usb_4_mic_array folder and run 'python DOA.py'For details, please refer to the following URL.
https://wiki.seeedstudio.com/ReSpeaker_Mic_Array_v2.0/#vad-voice-activity-detection
For the touch sensor, refer to the following OSOYOO site for code implementation. https://osoyoo.com/ja/2017/03/24/%e5%9f%ba%e4%ba%8e%e6%a0%91%e8%8e%93%e6%b4%be%e7%9a%84%e8%a7%a6%e6%91%b8%e5%bc%80%e5%85%b3/
Example
sudo wget http://osoyoo.com/driver/touchsensor.py
sudo python ./touchsensor.py