Semantics modeling of graphical data

My earlier research in the Laboratory of Dialogue Systems, LSD, at the Faculty of Informatics, Masaryk University. In this research group, we aimed at developing techniques and applications enabling visually impaired people to explore pictures by means of natural language. Our approach was based on ontology-based semantic modeling of graphical data, automated picture annotation, and smart dialogue interaction.

Software:

The GATE system (Graphics Accessible To Everyone) was designed and developed to help visually impaired people to explore pictures by the dialogue in natural language. The key concept lies in well-structured annotations backed by formal ontologies that enable us to generate dialogues strategies automatically from the picture content.

Related projects:

2007 – 2010

Dialogue generation of web presentations and graphics for visually impaired people

My role: Member of the research team, the key researcher responsible for software architecture and semantic modeling.

1999 – 2004

Selected publications:

  • KOPEČEK, Ivan and Radek OŠLEJŠEK. Annotating and Describing Pictures — Applications in E-learning and Accessibility of Graphics. In Computers Helping People with Special Needs: 12th International Conference, ICCHP 2010. Berlin: Springer-Verlag, 2010. p. 124-130, 7 pp.
  • KOPEČEK, Ivan and Radek OŠLEJŠEK. Dialogue-Based Processing of Graphics and Graphical Ontologies. In Text, Speech and Dialogue. Proceedings of 11th International Conference. Berlin: Springer, 2008. p. 601-608, 8 pp.
  • KOPEČEK, Ivan and Radek OŠLEJŠEK. Hybrid Approach to Sonification of Color Images. In The 2008 International Conference on Convergence and Hybrid Information Technology. Los Alamitos: IEEE Computer Society, 2008. p. 722-727, 6 pp.
  • KOPEČEK, Ivan and Radek OŠLEJŠEK. GATE to Accessibility of Computer Graphics. In Computers Helping People with Special Needs: 11th International Conference, ICCHP 2008. Berlin: Springer-Verlag, 2008. p. 295-302, 8 pp.

>> all publications