• भारत सरकार Government of India
  • शिक्षा मंत्रालय Ministry of Education
  • भारतीय प्रौद्योगिकी संस्थान खड़गपुर Indian Institute of Technology Kharagpur
Login Here to Submit Project Proposal
Login
(995) | Multimodal Machine Translation - convergence of multiple modes of input (Submitted On 23-FEB-2024)
  • (PI) - Prof. Josef van Genabith UNIVERSITÄT DES SAARLANDES
    From Date: 01-12-2019 | To Date : 20-12-2019
    No Of Participants: 21
    Contact Hrs : 40
    Total Contact Hrs : 40
    Visiting Institute
    National Institute of Technology Silchar
    Course
    Machine Translation
    Outcome of The Visit

    A. Conducted a full credit course on Machine Translation for B.Tech., M.Tech. and PhD students of Computer Science and Engineering dept.

    B. Following the visit of the German PI, several meetings were held between the Indian PI and Co-PI and the German PI and the following points were discussed and updated.

    As part of the proposal, the current progress on dataset collection from social media was discussed. Because of the increasing privacy policy of the social media, the dataset is collected from news article (https://ifp.co.in) after signing a copyright agreement for the usage of its content for academic and research purpose. As of now, there are 3770 news articles and corresponding images collected. The original news in English are automatically translated into Manipuri, Hindi and Germany using different machine translation systems in order of build synthetic parallel dateset of the respective language pairs. Further, the translated sentences by the respective systems mentioned are post-edited using MateCat, an online CAT tool. The post-editing task of 50 news articles in the German was carried out with the help of German collaborators of Universitat des Saarlandes, Germany. The English to German translation and post-editing task was carried out during the visit of Indian researcher, Loitongbam Sanayai Meetei during 7th September 2019 till 29th November 2019. The post editing of the same set of 50 articles of Manipuri and Hindi are completed at NIT Silchar as of today.

    The other points of discussion included:

    1. Possibility of Joint research supervision between NIT Silchar and Universitat des Saarlandes, Germany
    2. Planned visit of Germany Co-PI to NIT Silchar
    3. Organising of workshops relevant to our project in India or Europe.
    4. Planning of MOU between NIT Silchar, India and Universitat des Saarlandes, Germany for a joint research collaboration in future.

    Participants

    ANWESHA DAS, SANTOSH PAL, DEEPALI JAIN, ARNAB KUMAR MISHRA, LOITONGBAM SANAYAI MEETEI, CANDY LALREMPUII , PANKAJ KUNDAN DADURE , PRANITA BARO , AAKASH RAJ , SUMIT KUMAR , HONEY CHAUDHARY , SAKSHI SINGH , DEBARTHA SAHA ,GEBRE ERUFAEL WONDIE ASTATKIE , RINGKI DAS , ALOK SINGH , SALAM MICHAEL SINGH , NIVEDITA SINGH , SUBHRA JYOTI BAROI , HIMANSU TRIPATHI , ANGANA BORAH

    ALL STUDENTS ARE FROM NIT SILCHAR

  • (COPI) - Dr. Thoudam Doren Singh National Institute of Technology Silchar
    From Date: 01-06-2019 | To Date : 30-06-2019
    No Of Participants: 0
    Contact Hrs : 0
    Total Contact Hrs : 0
    Visiting Institute
    UNIVERSITÄT DES SAARLANDES
    Outcome of The Visit

    During the visit, Co-PI interacted with German PI and Co-PI of the
    collaboration project and charted out the action plan for the deliverables. The Co-PI also
    interacted with graduate and PhD students of the university and attended several
    technical meetings.
    The Indian Co-PI gave a presentation of the work done at NIT Silchar to the
    researchers of DFKI and Saarland University.

No data founds
  • Loitongbam Sanayai Meetei
    Roll No : 18-3-05-109
    Visit to date 29-11-2019 | Visit from date : 07-09-2019
    Email: loismeetei@gmail.com
    Home Institute
    National Institute of Technology Silchar
    Visit Institute
    UNIVERSITÄT DES SAARLANDES
    Area Of Research

    Natural Language Processing and Machine Learning

  • ​ Recent Advances in Machine Translation (RAMT)
    From Date : 15-03-2021 | To Date : 19-03-2021
    No of Participants : 104
    Workshop Overview

    One of the core NLP problems is to build systems that break down language barriers among different speakers. The task of Machine translation (MT) is to automatically translate a source language to a target language. From text to text translation, researchers are incorporating various input modalities(such as text, image, speech etc) to improve the quality of MT output. The
    multimodal machine translation (MMT)
    incorporates features using multiple modalities to generate the target output. RAMT-2021 would provide a roadmap to young researchers (PG/ PhD/ Post Doc)
    working in the field of machine translation with a focus on multimodal approach.

    Participants

    Mr. Dhupam Arun Kumar, Raghu Institute Of Technology (Autonomous), Visakhapatnam;
    Chitranshu Garg, Shree Cement Limited;
    Pandeshwari, Don Bosco;
    Ankumon Sarmah, Dibrugarh University;
    Md Ghouse Mohiddin Khan, Bharathiar University, Coimbatore;
    Sneha Baidya, Guru Nanak Institute Of Technology;
    M R Ramesh, Indira Gandhi Centre For Atomic Research, Kalpakkam;
    Srikanth Thota, Gitam University;
    N Donald Jefferson Thabah, Assam University, Silchar;
    Aakash Banerjee, IIT Bombay;
    Dr. Lokesh Kumar, AKU Patna;
    Er. Rajamahanti Surya Kiran, Sanketika Vidya Parishad Engineering College (Andhra University);
    Chanambam Sveta Devi, Assam University, Silchar;
    Ancy George, College Of Engineering Thalassery;
    Priyanka Holkar, SCOE, Pune;
    Loitongbam Sanayai Meetei, National Institute Of Technology Silchar;
    Tanmoy Majumder, Tripura Institute Of Technology;
    Irshed Hussain, NIT Silchar;
    Shefali Saxena, National Institute Of Technology, Hamirpur;
    Gopal Krishna, NIT Silchar;
    Kusum Lata, NIT Hamirpur;
    Kondapalli Beulah, Gayatri Vidya Parishad College Of Engineering(A);
    Alok Singh, NIT Silchar;
    Salam Michael Singh, NIT Silchar;
    Priyanka Jaiswal, YCCE;
    Aditya Jain, IIT Bombay;
    Prakash Kumar Nayak, Central Institute Of Technology Kokrajhar;
    Jagdish Kaur, Punjabi University Patiala;
    Nikhil Saini, Indian Institute Of Technology Bombay;
    Nabasmita Phukan, Jorhat Engg College;
    Himani Chugh, Chandigarh Group Of Colleges;
    Khwairakpam Amitab, North Eastern Hill University;
    Afreen Khan, Aligarh Muslim University;
    Rahul Kumar, Government Engineering College Samastipur Bihar;
    Divaker Sharma, Jamia Millia Islamia;
    Banteilang Mukhim, North Eastern Hill University;
    Aiom M Mitri, Shillong College Shillong;
    Hitesh Wankhede, Reliance Jio;
    Deepali Jain, National Institute Of Technology Silchar;
    Abhishek Barua, Centre For Advanced Post Graduate Studies, Bput, Rourkela, Odisha;
    Dilip Kumar Bagal, Government College Of Engineering, Kalahandi, Odisha;
    Garvit Pandey, Mits (1957) Gwalior;
    Satyendr Singh, Bml Munjal University, Gurugram, Haryana;
    Ringki Das, NIT Silchar;
    O. Jamsheela, Emea College Of Arts And Science;
    Candy Lalrempuii, NIT Silchar;
    Sudheer Kumar Mishra, NIT Hamirpur;
    Jayaditya Pandey, RGPV Bhopal;
    Aiusha Vellintihun Hujon, St. Anthony's College, Shillong;
    Jyotsana Khatri, Indian Institute Of Technology Bombay;
    Debolina Mahapatra, National Institute Of Technology, Patna;
    Arwinder Singh, Punjabi University, Patiala;
    Anwesha Pal, Ramkrishna Mahato Government Engineering College (Formerly Purulia Government Engineering College);
    Debartha Saha, National Institute Of Technology Silchar;
    Sakshi Singh, NIT Silchar;
    Dr. Gudikandhula Narasimha Rao, Andhra University, Visakhapatnam;
    Kumari Abhilasha, NIT Patna;
    Smita Reddy, Trident;
    Abhishek Ravi, Mitaoe;
    Dr Pradeep N, Bapuji Institute Of Engineering And Technology;
    Eduri Raja, NIT Silchar;
    Jigyasa Pandey, RGPV Bhopal;
    Satya Ranjan Dash, Kalinga Institute Of Industrial Technology, Deemed to be University;
    Vanlalmuansangi Khenglawt, Mizoram University;
    Sourav Dutta, Saarland University, Germany;
    Kamal Kant Ahirwar, Dr. Harisingh Gour Vishwavidyalaya, Sagar (M.P.);
    Diganta Baishya, Jorhat Engineering College;
    Subhadeep Ghosh, Amity University, Kolkata;
    Shiva Singh, NIT patna;
    Dr. Sanghamitra Nath, Tezpur University;
    Seema Rani, GJUST Hisar;
    Santosh Kumar Satapathy, Pondicherry Engineering College,Puducherry;
    Azaz Ahmed, R.G.P.V;
    Dr. Ayyagari Srinagesh, R.V.R. & J.C.College Of Engineering;
    Sunil Ramchandra Gupta, Prof Ram Meghe Institute Of Technology And Research, Badnera-Amravati;
    Kankana Dutta, Dibrugarh University;
    Sudhansu Bala Das, NIT Rourkela;
    Y. Susheela, Vaageswari College Of Engineering;
    Kavita Rani, GJUST Hisar;
    S.Gayathree, University Of Jaffna;
    Riju Das, Jorhat Engineering College;
    Ashish Yadav, Chandigarh College Of Engineering And Technology, Sector-26, Chandigarh;
    Hitesha Mukherjee, IIIT Bangalore;
    Pooja Kumari, NIT Silchar;
    Manish Singh Rana, J.K. Institute Of Applied Physics And Technology, Allahabad;
    Priyanka, Punjabi University, Patiala;
    Kimasha Borah, Centre For Computer Science And Applications;
    Heena Mahendra Agrawal, Shri Ramdeobaba College Of Engineering And Management, Nagpur;
    Surbhi Sharma, Banasthali Vidhyapeeth;
    Haulath K, Emea College Kondotty;
    Sunita Rawat, Shri Ramdeobaba College Of Engineering & Management;
    Ashwini Vinayak Zadgaonkar, Shri Ramdeobaba College Of Engineering And Management , Nagpur;
    Kondapalli Beulah, Gvp College Of Engineering (A), Visakhapatnam;
    Vonesh Nath, SSITM;
    Chetan Agarwal, National Institute Of Technology, Hamirpur, (H.P.);
    Himanshu V. Taiwade, PIET, Nagpur;
    Santosh Kumar Patro, Jharkhand Rural Health Mission Society(Jrhms), Govt. Of Jharkhand;
    Ramanpreet Kaur, Khalsa College For Women, Sidhwan Khurda;
    Sanjay Kumar Singh, Amity University Rajasthan Jaipur;
    Kuldeep Anil Hule, Army Institute Of Technology Pune;
    Sunanda Mishra, Assam University;
    Sahinur Rahman Laskar, NIT Silchar;
    Nakul Sharma, Sinhgad Academy Of Engineering;
    Karan Gurtu, University Of Pune;

  • Proceedings of the First Workshop on Multimodal Machine Translation for Low Resource Languages (MMTLRL 2021)
    ISBN No : INCOMA Ltd View more
    Author
    Thoudam Doren Singh, Cristina Espana i Bonet, Sivaji Bandyopadhyay, Josef Van Genabith
    Publisher :
    INCOMA Ltd
    Monograph Overview

    Language does not exist in a vacuum. Yet, for a long time, large parts of NLP have focused on text- (or speech-) only scenarios: most work on machine translation (MT) e.g. is on text-to-text MT. In principle, the inclusion of additional context in the form of other modalities offers the promise of improving a
    translation. In practice, this is often hard (Lala et al. 2017, Elliott 2018). In this workshop, we would like to combine two strands of research that are hitherto not well connected: research on low-resource MT and research on multi-modal MT (MMMT). The reason why we would like to explore the connection is the following: while there has been important progress on both sides, including unsupervised (Artetxe et al. 2018, Lample et al. 2018) and self-supervised MT (Ruiter et al. 2019), and neural-network based modality combinations in MMMT (Çaglayan et al. 2019), the potential of mustering information in other modalities (such as images, videos and spoken language) to complement the text signal in lowresource MT has not yet been explored extensively. However, a combination may hold promise: a richer multimodal signal may help address some of the challenges that come with low-resource scenarios. Of
    course, there are no guarantees: a richer multimodal signal and with it an increase in the dimensionality of the data may make the problem worse.

  • Type : PROCEDING

    Extraction and Identification of Manipuri and Mizo Texts from Scene and Document Images

    Author: Loitongbam Sanayai Meetei, Thoudam Doren Singh, Sivaji Bandyopadhyay

    Publication Year: 2019

    Volume: 11941
    Pages: 405 - 414
    Venue: Tezpur University
    Publisher: Springer LNCS
    Ref Doi: https://doi.org/10.1007/978-3-030-34869-4_44

    View more
  • Type : PROCEDING

    WAT2019: English-Hindi Translation on Hindi Visual Genome Dataset

    Author: Loitongbam Sanayai Meetei, Thoudam Doren Singh, Sivaji Bandyopadhyay

    Publication Year: 2019

    Volume: 6
    Pages: 181 - 188
    Venue: Hong Kong, China
    Publisher: Association for Computational Linguistics
    Ref Doi: 10.18653/v1/D19-5224

    View more
  • Type : PAPER_CONF

    NITS-VC System for VATEX Video Captioning Challenge 2020

    Author: Alok Singh, Thoudam Doren Singh, Sivaji Bandyopadhyay

    Publication Year: 2020

    Volume: 0
    Pages: 0 - 0
    Venue: Online
    Publisher: Workshop on Language & Vision with applications to Video Understanding (LVVU 2020) - In conjunction with CVPR 2020
    Ref Doi: https://arxiv.org/abs/2006.04058

    View more
  • Type : PROCEDING

    Generation and Evaluation of Hindi Image Captions of Visual Genome

    Author: Alok Singh, Loitongbam Sanayai Meetei, Thoudam Doren Singh, Sivaji Bandyopadhyay

    Publication Year: 2021

    Volume: 170
    Pages: 65 - 73
    Venue: Shillong, India
    Publisher: Springer LNNS
    Ref Doi: https://doi.org/10.1007/978-981-33-4084-8_7

    View more
  • Type : PROCEDING

    Attention based video captioning framework for Hindi

    Author: Alok Singh, Thoudam Doren Singh, Sivaji Bandyopadhyay

    Publication Year: 2021

    Volume: 0
    Pages: 0 - 0
    Publisher: Springer Nature
    Ref Doi: https://doi.org/10.1007/s00530-021-00816-3

    View more