The JoyAI App introduces a digital human capable of real-time video shopping. Users can point their camera at a product, and the AI analyzes the image to provide information and shopping guides. The process, including searching for similar items and placing orders, happens entirely within the video call interface without switching apps.
The AI assistant, known as 'Universal Doctor,' can assist with offline shopping by checking ingredient risks for snacks or providing reviews for electronics. The system supports natural interruptions and topic changes with second-level response times, covering the entire journey from demand expression to payment in a single conversation thread.
Users can create personalized AI digital humans by uploading a single photo. These custom characters can have unique appearances, personalities, voices, and interaction scenarios. Using multimodal technology, these avatars can sing, dance, speak dialects, and perform actions, serving as both conversational partners and content creation tools for social media.
Beyond shopping, the app integrates various JD.com ecosystem services. This includes ordering food, topping up phone credit, booking hotels, and accessing health or financial consultations. The app features AI-driven health diagnostics via the 'Dawei' agent and financial analysis through 'JingXiaobei.'
Payment is handled via JD AI Pay, which uses voiceprint verification instead of passwords. The app has seen significant growth this year, with the number of conversational users increasing more than 15 times.
