ADaSci Banner 2024

Text and Image Query System for Image Datasets

Author(s): Kejitan Dontas, Krishna Kumar Tiwari

Abstract

In this paper, we have described the approach we used to build an end to end system for text and image query on image data sets, we also call it TIQS (Text & Image Query System). The system retrieves relevant images from a (given annotated) data set based on a sample image or a text query. We have used images from two data sets. 1. Visual Genome dataset from Stanford [1][3] and 2. ADE20K data set from CSAIL MIT [4][5][6]. The Visual Genome data set is fully annotated and can be directly used for text queries. To respond to image-based queries, the images are segmented and annotated (into 150 categories) using PSPNET[9]. When a sample image is presented to retrieve similar images, the sample image too is segmented and annotated using PSPNET. A novel similarity score is defined between the sample image and images in the database, and the images with high similarity scores are presented to the user.

Picture of Association of Data Scientists

Association of Data Scientists

The Chartered Data Scientist Designation

Achieve the highest distinction in the data science profession.

Elevate Your Team's AI Skills with our Proven Training Programs

Strengthen Critical AI Skills with Trusted Generative AI Training by Association of Data Scientists.

Our Accreditations

Get global recognition for AI skills

Chartered Data Scientist (CDS™)

The highest distinction in the data science profession. Not just earn a charter, but use it as a designation.

Certified Data Scientist - Associate Level

Global recognition of data science skills at the beginner level.

Certified Generative AI Engineer

An upskilling-linked certification initiative designed to recognize talent in generative AI and large language models

Join thousands of members and receive all benefits.

Become Our Member

We offer both Individual & Institutional Membership.