This project is a comprehensive, production-ready management system for Pepper humanoid robots, featuring advanced capabilities in AI integration, face recognition, natural language processing, and robotic control.
Copyright Notice: This software is proprietary research work. All rights reserved by the original creator. See LICENSE file for usage terms.
This research project was developed to explore:
- Full-Stack Development: Complete backend API with modern web interfaces
- AI/ML Integration: Advanced face recognition and conversational AI capabilities
- Cloud-Native Architecture: Integration with Google Cloud Platform services
- Robotic Control Systems: Comprehensive movement and interaction management
- Production-Ready Code: Well-structured, documented, and tested codebase
The project consists of three main components, each demonstrating different aspects of modern software development:
A Flask-based RESTful API backend providing comprehensive robot management capabilities:
- User authentication and authorization
- Face recognition and identity management
- Robot movement and sequence control
- AI conversation integration
- SSH-based robot communication
- Multi-language support (Indonesian/English)
- Web-based administration interface
Key Technologies:
- Python 3.11.1, Flask
- SQLite database with SQLAlchemy ORM
- JWT authentication
- Google Cloud Storage integration
- RESTful API design
An intelligent voice-based conversation system:
- Speech-to-Text using Google Cloud Speech-to-Text API
- Natural language processing with Google Vertex AI (Gemini)
- Text-to-Speech with Google Cloud TTS
- Session management and conversation history
- Docker containerization for cloud deployment
Key Technologies:
- Flask REST API
- Google Vertex AI (Gemini 2.0 Flash)
- Google Cloud Speech-to-Text & Text-to-Speech
- Docker & Cloud Run deployment ready
Advanced face recognition system with cloud storage integration:
- Real-time face detection and recognition
- DeepFace-based facial analysis
- Google Cloud Storage as distributed database
- Automatic synchronization and caching
- RESTful API for robot integration
Key Technologies:
- Flask API
- DeepFace library
- OpenCV for image processing
- Google Cloud Storage
- VGGFace model integration
- Movement sequence management
- Dance and walk pattern control
- Real-time robot state monitoring
- SSH-based command execution
- Real-time face detection and identification
- Multi-person recognition
- Cloud-based face database
- Automatic model synchronization
- Natural language understanding
- Context-aware conversations
- Voice input/output support
- Multi-turn dialogue management
- JWT-based authentication
- Password reset functionality
- Secure credential management
- Role-based access control
- Responsive admin dashboard
- Real-time status monitoring
- Interactive robot control panels
- Multi-language UI support
- Python 3.11.1 - Core programming language
- Flask - Web framework
- SQLAlchemy - ORM for database management
- JWT - Authentication tokens
- OpenCV - Computer vision
- DeepFace - Face recognition
- Google Cloud Storage - Distributed file storage
- Google Cloud Speech-to-Text - Voice recognition
- Google Cloud Text-to-Speech - Voice synthesis
- Google Vertex AI (Gemini) - Natural language processing
- HTML5/CSS3 - Modern web standards
- JavaScript/jQuery - Interactive UI
- Bootstrap - Responsive design framework
- Docker - Containerization
- Git - Version control
- Virtual Environments - Dependency isolation
pepper-robots/
├── pepper-be/ # Main backend management system
│ ├── app/
│ │ ├── controller/ # API controllers
│ │ ├── model/ # Database models
│ │ ├── services/ # Business logic services
│ │ ├── templates/ # Web UI templates
│ │ ├── static/ # CSS, JS, images
│ │ └── utils/ # Utility functions
│ ├── tests/ # Unit and integration tests
│ └── docs/ # API documentation
│
├── pepper-ai-discussion/ # AI conversation service
│ ├── app.py # Main Flask application
│ ├── Dockerfile # Container configuration
│ └── requirements.txt # Python dependencies
│
└── final test face reco app/ # Face recognition service
├── app.py # Face recognition API
├── gcs_handler.py # Cloud storage integration
└── pepper_client.py # Robot client library
- Python 3.11.1 or higher
- Google Cloud Platform account with appropriate APIs enabled
- Access to Pepper robot (for full functionality testing)
-
Clone the repository
git clone <repository-url> cd pepper-robots
-
Set up backend system
cd pepper-be python -m venv venv venv\Scripts\activate # Windows # source venv/bin/activate # Linux/Mac pip install -r requirements.txt
-
Configure environment variables
- Set up
.envfile with database and API credentials - Configure Google Cloud credentials
- Set up
-
Run the application
python run.py
For detailed setup instructions for each component, please refer to the individual README files in each subdirectory.
- ✅ Modular architecture with separation of concerns
- ✅ Comprehensive error handling
- ✅ RESTful API design principles
- ✅ Database normalization and optimization
- ✅ Security best practices implementation
- 🔬 Integration of multiple AI services
- 🔬 Cloud-native architecture
- 🔬 Real-time robot-human interaction
- 🔬 Scalable microservices design
- 📚 Inline code documentation
- 📚 API endpoint documentation
- 📚 Setup and deployment guides
- 📚 Architecture diagrams and explanations
This project showcases proficiency in:
- Software Engineering: Clean code, design patterns, architecture
- AI/ML Integration: Face recognition, NLP, speech processing
- Cloud Computing: GCP services, distributed systems
- Full-Stack Development: Backend APIs, frontend interfaces
- DevOps: Containerization, deployment automation
- Robotics: Robot control systems, sensor integration
This project represents original research and development work in the field of human-robot interaction and AI integration. All code, documentation, and architecture decisions were made with the intention of demonstrating:
- Technical Competency: Advanced programming and system design skills
- Best Practices: Industry-standard development methodologies
- Innovation: Creative integration of modern technologies
- Completeness: Full-stack, production-ready system
The codebase is production-ready and demonstrates real-world application development capabilities suitable for enterprise-level projects and academic research.
This software is proprietary and protected by copyright law. See the LICENSE file for complete terms and conditions.
Copyright © 2025. All Rights Reserved.
This project is the intellectual property of the original creator and is intended for research and academic purposes. Any use, reproduction, or distribution requires explicit written permission from the copyright holder.
If you reference this work in academic papers, research, or any publication, please cite appropriately:
[Author Name]. (2025). Pepper Robot Management System:
A Comprehensive AI-Integrated Robotic Control Platform.
[Research Institution/Affiliation].
This project represents significant original research and development effort in the field of human-robot interaction, AI integration, and robotic control systems.