Students at Kraków University of Technology have developed an AI-powered Polish Sign Language translator that converts hand gestures into text in real time using a standard smartphone camera.
Students at the Faculty of Electrical and Computer Engineering (WIEiK) at Kraków University of Technology are demonstrating how artificial intelligence can be used to address real social challenges. A team of second-year Computer Engineering students has developed a prototype sign language translator that uses AI and computer vision to convert hand gestures into text in real time.
The project highlights the University’s emphasis on combining cutting-edge engineering with practical applications that have the potential to improve accessibility for people with hearing impairments.
AI Meets Accessibility
The project, titled “Rozumiemy się bez słów” (We Understand Each Other Without Words), was created by Dmytro Burkovskyi, Oleksii Izvarin and Illia Kostruba under the supervision of Dr Karol Sucheń as part of the Mikrokontroler Student Scientific Association.
Developed during the students’ second year of study, the prototype demonstrates how emerging engineers are already tackling complex research and development challenges using artificial intelligence, machine learning and computer vision technologies.
How the System Works
The application translates gestures from the Polish Sign Language alphabet into text using a standard smartphone camera.
Unlike many existing solutions, the system does not require specialist gloves, motion sensors or additional hardware. Instead, the camera analyses the user’s hand, identifies 21 key landmark points and tracks their movement before processing the information through LSTM and Transformer Encoder AI models to recognise individual signs.
The project covers the complete development process, including:
- Image acquisition and hand tracking
- Preparation of AI training datasets
- Machine learning model development
- Mobile application design and implementation
- Real-time gesture recognition
By relying solely on a smartphone camera, the technology has the potential to become a widely accessible communication tool for hard-of-hearing communities.
Addressing a Real Social Need
Improving accessibility remains one of the most important practical applications of artificial intelligence, and the student team has focused their work on making communication more inclusive.
The developers plan to expand the system beyond recognising individual letters. Future development aims include:
- Recognition of complete words and sentences
- A three-dimensional sign language avatar
- Integration with online messaging platforms
- Compatibility with video conferencing applications
These enhancements could significantly broaden the application’s everyday usefulness.
Early Success for Future Engineers
One of the most notable aspects of the project is that it has been developed by second-year undergraduate students. Their work reflects the Faculty’s approach to engineering education, where students gain practical research experience from the early stages of their studies while working with modern AI technologies.
The project has also attracted attention beyond the University. Kraków University of Technology has showcased the application through its official news channels, while the student team and their academic supervisor have presented the project during an interview with TVP3 Kraków, demonstrating how the technology could support communication in everyday situations.
Why It Matters for Kraków
Kraków continues to strengthen its reputation as one of Poland’s leading centres for technology, innovation and higher education. Projects such as this demonstrate how local universities are not only advancing research but also developing practical solutions with genuine social value.
By combining artificial intelligence with accessibility, students at the Faculty of Electrical and Computer Engineering are contributing to technologies that could help remove communication barriers while showcasing the talent emerging from Kraków’s academic community.
Engineering a More Inclusive Future
The AI-powered sign language translator developed at Kraków University of Technology illustrates how innovative thinking and practical engineering can come together to address real-world challenges. Although currently at the prototype stage, the project demonstrates both the technical capabilities of its creators and the growing role of artificial intelligence in making everyday communication more accessible.
Click here for more latest Kraków news!
