Natural Language Processing and the Web

Natural Language Processing and the Web

Course content is available at the NLP 4 Web Moodle Website.

News: On December 3rd the lecture will be held in Room E 102

Please note that the content of this website may be subject to change

Lecturers

  • Prof. Dr. Iryna Gurevych
  • Dr. György Szarvas

Practice Classes

  • Niklas Jakob
  • Benjamin Herbert

Timetable

  • Lecture: Thursday 9:50-11:30, Room S2 02 | C205
  • Practice class: Thursday 11:40-13:10 S2 02 | C 003

Exams

  • information will be available soon

Course content

The Web contains more than 10 billion indexable web pages, which can be retrieved via search queries. The lecture will present Natural Language Processing (NLP) methods to (1) automatically process large amounts of unstructured text from the web and (2) analyse the use of Web data as a resource for other NLP tasks.

  • Processing of unstructured web content
    • Introduction
    • NLP Basics – Tokenisation, Part of Speech Tagging, Chunking, Stemming, Lemmatization
    • UIMA-1, i.e. principles
    • UIMA-2, i.e. applications
    • Web contents and their characteristics – diverse genres of web contents, e.g. personal web sites, news sites, blogs, forums, wikis
    • Web contents and their characteristics – continued
    • Web as corpus – innovative use of the web as a very big, distributed, linked, growing and multilingual corpus
    • Web as corpus – continued
  • NLP applications for the web
    • Subjectivity Analysis
    • Information retrieval – introduction to the basics of information retrieval
    • Web information retrieval – natural language interfaces for web information retrieval
    • Question answering
    • Summarization
    • Mining Web 2.0 Sites, such as Wikipedia and Wiktionary
    • Quality Assessment of Web Contents

Literature

  • Kai-Uwe Carstensen, Christian Ebert, Cornelia Endriss, Susanne Jekat, Ralf Klabunde, Computerlinguistik und Sprachtechnologie. Eine Einführung, Heidelberg: Spektrum-Verlag, März 2004. (2. Auflage) ISBN 3827414075
  • T. Götz & O. Suhre, Design and implementation of the UIMA Common Analysis System, IBM Systems Journal, 2004, 43, 476-489.
  • Adam Kilgarriff & Gregory Grefenstette, Introduction to the special issue on the web as corpus, Computational Linguistics, MIT Press, 2003, 29, 333-347
  • Christopher D. Manning, Prabhakar Raghavan and Hinrich Schütze, Introduction to Information Retrieval, Cambridge University Press. 2008.