Back to List
CommunityAIVoiceJarvis

XiaoZhi AI(Jarvis)

OpenNextion XiaoZhi Ai is an open‑source voice AI solution that turns your OpenNextion screen into a conversational AI terminal. It integrates with Qwen, DeepSeek, and Doubao for natural dialogues. Offline wake‑up and local recognition ensure low latency and privacy.

Preview

xiaozhi-ai-01
xiaozhi-ai-02
xiaozhi-ai-03

Hardware Requirements

Development Boards

ONX2432G028
ONX2432G028Required
ONX3248G035
ONX3248G035Required

Accessories

Nextion Dual MIC Board
Nextion Dual MIC BoardOptional
Nextion BOX Speaker
Nextion BOX SpeakerOptional
Nextion IO Adapter V2
Nextion IO Adapter V2Optional

Getting Started

Feature Overview

FeatureDescription
Voice ConversationSpeak to the device and it will respond to you in real time.
AI Large Model DrivenPowered by large models such as Qwen and DeepSeek, delivering natural and intelligent responses.
Offline Voice Wake‑UpWake the device without an internet connection – fast response and privacy protection.
Voice or Touch Wake‑UpUse the wake word "Hey Jarvis" or tap the screen to wake the XiaoZhi AI assistant for voice interaction.
Emoji DisplayThe screen shows emojis and status indicators, making interaction more engaging.
Multi‑Language SupportSupports Chinese, English, Japanese, and more.
CustomizationTheme, character language, voice, AI agent, and extensions can all be modified online via the xiaozhi.me platform.

Operation Instructions

  • REST Button – After updating the voice assistant configuration, press the REST button to apply the changes.
  • Touch Screen – Toggle the voice assistant between idle and listening states.

Quick Start

Preparation
  • 1 × supported OpenNextion ESP32‑S3 smart display
  • 1 × USB data cable
  • 1 × microphone module
  • 1 × speaker module
  • 1 × Windows/Mac computer
  • 2.4 GHz WiFi network

Note: The ESP32 device provides microphone and speaker interfaces, but these modules are not included and must be obtained separately. You may refer to officially compatible accessories or use other compatible hardware.

Before starting, ensure the USB cable supports data transfer and maintain a stable connection between the board and your computer.

Flashing the Firmware
  1. Click Flash Online at the top of the page.
  2. Select the OpenNextion device model you are using.
  3. Choose the corresponding serial port when prompted in the browser.
  4. Wait for erasing, writing, and verification to complete. Do not unplug the USB cable during this process.

After successful flashing, the board will automatically restart and boot into the Xiaozhi AI.

Device Wi‑Fi Provisioning

After the device successfully connects to a 2.4 GHz Wi‑Fi network:

Guide image 1 Guide image 2

Connecting to the Server

  • Before starting, open the xiaozhi.me platform, register, and log in with your phone number.
Guide image 3
  • After device provisioning is complete, the screen will display and voice‑broadcast a 6‑digit pairing code. Enter this code on the xiaozhi platform to connect the device to the xiaozhi server; a default voice model Agent will be configured automatically.
Guide image 4 Guide image 5
Agent Configuration

Click "Configure" on the model to set the device's theme background color, the Agent's character language, voice, large model, and extension capabilities. The main features depend on the xiaozhi.me platform.

*After making changes, press the REST button on the device to update the configuration.

Guide image 6 Guide image 7

Device Theme Configuration

  • Customizable wake word, theme mode, etc.
Guide image 8 Guide image 9
  • For this configuration to take effect, a.binfile must be generated. You can download this.binfile or flash it online.
Guide image 10
Adding or Removing Associated Devices

Click the "Devices" button on the model to delete associated devices, add new devices, or perform OTA updates.
Guide image 11Guide image 12

Resources

FAQ

What is XiaoZhi AI and how is it different from ordinary voice assistants?

XiaoZhi AI is an open-source project that turns your OpenNext screen into an AI voice chatbot. It connects to large language models like Qwen and DeepSeek, delivering smarter and more natural responses. It also supports offline wake-up, voiceprint recognition, and other features, making it more intelligent than ordinary voice assistants.

Do I need to know programming to use this project?

No. The project provides ready-to-flash firmware that doesn't require a development environment – beginners can download and flash it directly. You only need to set up a development environment if you want to customize features or modify the code.

Do I need to pay to use the official xiaozhi.me server?

Personal users can register an account and use real‑time models like Qwen for free. If you prefer to deploy your own server, the project documentation also provides third‑party open‑source solutions.

Which chip platforms are supported?

Supported chip platforms include ESP32‑C3, ESP32‑S3, and ESP32‑P4. This project is specifically adapted for the OpenNextion G‑series 2.8‑inch and 3.5‑inch capacitive touch screens.

Can the device control smart home devices?

Yes. Through the MCP protocol, XiaoZhi AI can enable smart home control, PC desktop operations, knowledge search, email sending/receiving, and more. For details, refer to the MCP protocol documentation in the official project.

How do I unbind the device from an account?

If you want to move the device to another xiaozhi platform account, you need to delete the device from the originally bound xiaozhi account first. If you cannot reach the original account owner, you can request unbinding via email: send to xiaozhi.ai@tenclass.com with the subject line "Device Unbinding Request, Device ID XXX, MAC Address XXX".

How do I obtain the Device ID and MAC address?

Device ID – If your device is working properly, try asking it verbally during a conversation. MAC Address – You will need to use a serial tool to read the serial output and locate the MAC address information.

Do I need the device and the computer accessing the xiaozhi platform to be on the same Wi‑Fi network when configuring the Agent or device?

No. The device communicates with the xiaozhi server over the internet, not through the local network. Even the initial connection between the device and the xiaozhi platform goes through the cloud, so they do not need to be on the same local network.

Does voice wake‑up require an internet connection?

No. Offline voice wake‑up uses ESP‑SR technology and is performed entirely locally without an internet connection. However, this only wakes the device – it will not respond to any queries, as all conversations rely on cloud‑based large language models.