New doctoral dissertation

June 12, 2023
VILNIUS TECH Library invites you to follow the published new dissertations. The dissertation „Improving image captioning methods using machine learning approaches“ („Vaizdų antraščių generavimo metodų tobulinimas mašininio mokymosi metodais“) prepared by VILNIUS TECH, Viktar Atliha. The dissertation was prepared in 2018–2023, supervisor Prof. Dr Dmitrij Šešok.

The dissertation was defended at the public meeting of the Dissertation Defense Council of the Scientific Field of Informatics Engineering in the Senate Hall of Vilnius Gediminas Technical University at 2 p. m. on 12 June 2023.

Recently, computer vision (CV) and natural language processing (NLP) fields started gaining increasing attention from researchers and the industry. While the first bunch of methods allows for solving many tasks within the images and pictures domain, such as image classification, image detection, etc., the others work in a text domain, including text classification or translation tasks. However, many problems remain on a border between the two mentioned domains that have a practical use. One of them is called image captioning. The goal of image captioning systems is to automatically generate a human-like textual description of the given image. Such systems could be used for smoother human–computer interactions, information retrieval, or, more importantly, to help visually impaired people. To succeed, algorithms used in these systems should consume low resources (particularly, acquire little memory) and be of high quality. As the image captioning task is a cross-domain, and state-of-the-art models for computer vision and natural language processing tasks use deep learning models, it also leads to using such approaches for the image captioning task. However, most of the well-known methods of improving image captioning models tend to be focused more on quality improvement, considering no additional resources are needed. Thus, the best models, for now, are very big and unsuitable for use on mobile and other memory-constrained devices where they could bring the greatest practical benefit. The dissertation consists of an introduction, three main chapters, and general conclusions. The First Chapter reviews existing research on image captioning. The Second Chapter investigates the application of model compression methods for existing image captioning models, proposing several methods of reducing the model size without significant quality loss. The Third Chapter focuses on improving image captioning models without significant changes (or without changes at all) in model architecture, highlighting the importance of such methods. The performed experiments and analysis showed that image-captioning models could be significantly compressed without almost any quality loss. Application of all proposed methods allowed to reduce the model size by 91%, losing only up to 3% in the main quality metrics. More than that, methods proposed for improving quality without changing models’ architecture allowed for almost neutralizing this effect, leading to up to 5% quality improvements.

Doctoral dissertation readers can search via VILNIUS TECH Virtual Library.

Related news

From biological bridges to living facades: how civil engineers are reshaping cities
From biological bridges to living facades: how civil engineers are reshaping cities
Modern buildings are no longer made of concrete and steel alone. Biology, artificial intelligence, and sustainable technologies are becoming an integral part of construction, transforming the way cities are designed and built. As technology advances and environmental awareness grows, civil engineers are developing innovative materials and construction methods that are more sustainable, durable, and environmentally responsible. One of these innovators is Assoc. Prof. Dr. Ronaldas Jakubovskis, a researcher at the Faculty of Civil Engineering at VILNIUS TECH, whose work is helping shape the future of urban environments. Turning Research into Real-World Structures Assoc. Prof. Dr. Ronaldas Jakubovskis serves as a Senior Researcher at the Laboratory of Innovative Building Structures, where his work focuses on developing advanced structural solutions through experimental testing, laboratory research, and numerical modelling. However, innovation rarely begins with a completely new idea. According to Dr. Jakubovskis, much of the research process is dedicated to analysing existing materials and construction technologies to understand how they can be improved. [caption id="attachment_88679" align="alignnone" width="2560"] Ronaldas Jakubovskis[/caption] „The most rewarding moment is when years of laboratory research become a real structure that can be built and experienced in a natural environment,“ he says. Although he works in academia, Dr. Jakubovskis sees himself primarily as a civil engineer supporting other civil engineers. While structural designers and project managers oversee the overall design of buildings and infrastructure – determining layouts, dimensions, and cost-effective construction solutions – researchers provide the specialised expertise needed to develop new materials and solve complex engineering challenges. „Practising engineers often don't have enough time to investigate highly specialised solutions or explore entirely new materials – that's where we come in. Sometimes we analyse complex structural behaviour through numerical modelling, and sometimes we investigate how emerging materials can be applied in construction. In my opinion, research engineers don't quite fit the traditional stereotype of scientists wearing white lab coats or solving abstract equations all day. Our work is highly practical—we often design, manufacture, and physically test new structural systems ourselves.“ Engineering That Leaves a Visible Legacy Among the projects he is most proud of is the Biological Bridge installed at the Kairėnai Botanical Garden, as well as the Living Concrete wall currently being developed for the rooftop of the Lithuanian National Drama Theatre. Both projects demonstrate how engineering can merge sustainability, science, and architectural design. „These projects represent the culmination of years of laboratory work and numerical modelling. They are demonstration structures that show what is possible when innovative materials meet advanced engineering. I also value their aesthetic qualities. Designing complex organic forms allows you to feel a little like a sculptor creating a work of art.“ Looking ahead, Dr. Jakubovskis believes his greatest achievements are still to come. His long-term vision is to create buildings with façades intentionally designed to be colonised by living organisms, allowing them to interact naturally with their environment while providing ecological and functional benefits. [caption id="attachment_88005" align="alignnone" width="2560"] Ronaldas Jakubovskis[/caption] „We are currently developing larger demonstration projects, seeking research funding, and expanding international collaborations. I believe that within the next five years, we'll be able to stand in front of one of these buildings and say: this is a significant achievement.“ A Profession That Will Still Matter in 100 Years For Dr. Jakubovskis, choosing civil engineering was an easy decision. Since childhood, he enjoyed watching buildings rise from the ground and observing construction sites and heavy machinery. „You don't need extraordinary dreams to become a civil engineer. If you want to build, you become an engineer. It's not like travelling to space or conducting research in Antarctica.“ What motivates him most is the opportunity to create structures that remain valuable for decades – or even centuries. „Every civil engineer feels proud when driving past a bridge or building they helped design, and they will always point it out to everyone in the car,“ he says with a smile. His own career began in structural design after completing his third year of university. He later pursued doctoral studies focusing on the cracking behaviour and deformation of reinforced concrete structures before returning to industry. Eventually, an invitation to rejoin VILNIUS TECH brought him back to academia. „I came back, and today I'm doing exactly what I truly enjoy.“ Advice for Future Engineers As both a researcher and lecturer at the Faculty of Civil Engineering, Dr. Jakubovskis emphasises that a university education is essential for anyone pursuing a career in civil engineering. „It would be extremely difficult to master this profession through self-study alone. Should you begin with theoretical mechanics, mechanics of materials, or structural mechanics? University programmes are carefully designed so that knowledge develops step by step, preparing graduates to become highly qualified professionals.“ He also offers practical advice to prospective students: „Don't be afraid of mechanics, physics, or mathematics. Every semester, identify a few key subjects, understand them thoroughly, and make sure you truly master them. Once those foundations are in place, everything else builds naturally.“ Industry Investing in Future Engineers Preparing the next generation of civil engineers is a shared responsibility between universities and industry. As digitalisation, artificial intelligence, and emerging technologies continue to reshape construction, employers increasingly recognise the importance of investing in future talent. The Faculty of Civil Engineering at VILNIUS TECH enjoys long-standing partnerships with the Lithuanian Builders Association (LSA) and the Lithuanian Association of Civil Engineers (LSIS), both of which actively support education and professional development. The Faculty's industry partners – including Hanner, Gilesta, and Alvora – offer scholarships to first-year Civil Engineering students, helping talented young people begin their studies. Other partners, such as Naresta, PST Group, HSC Baltic, and numerous construction companies, contribute by delivering guest lectures, presenting real-life projects, and inviting students to construction sites, where they gain first-hand experience of modern engineering practice. These close collaborations ensure that VILNIUS TECH programmes remain aligned with industry needs while providing students with practical knowledge, professional skills, and valuable connections long before graduation. Learn more about Civil Engineering studies at VILNIUS TECH and discover how you can help shape the cities of tomorrow.
More
Discover JSTOR: Explore Scholarly Journals and Primary Sources
Discover JSTOR: Explore Scholarly Journals and Primary Sources
With exams behind you and more time available for independent exploration, we invite you to take advantage of VILNIUS TECH’s subscribed database, the JSTOR Archival Journals and Primary Sources Collection. This collection offers not only scholarly articles but also original historical documents, images, primary sources, manuscripts, plant specimens, cultural heritage objects, and other unique materials. JSTOR also provides access to more than 4,000 academic journals covering a wide range of subjects, including literature, history, politics, psychology, economics, business, life sciences, natural sciences, the arts, and more. By combining scholarly articles and primary sources on a single platform, JSTOR makes it easier to discover new research perspectives, uncover unexpected connections across disciplines, and enrich both study and research activities. What can you discover in JSTOR? Nineteenth-century pamphlets on technological innovations and social change. Historical letters, speeches, and documents. Millions of plant specimens from around the world. Photographs, maps, and 3D models of cultural heritage objects. Works of art, posters, and historical photographs. More than 4,000 academic journals across a wide range of disciplines. Access is available from VILNIUS TECH computer network or via VPN. As a security measure, two-factor authentication is additionally required (i.e. verification from mobile device app or by call).
More