About

MADAR (Multi-Arabic Dialect Applications and Resources) is a three-year joint project among the NLP Group at Carnegie Mellon University in Qatar (CMU-Q), the Computational Approaches to Modeling Language (CAMEL) Lab at New York University Abu Dhabi (NYUAD), and Columbia University. The project also involves collaborators from the University of Bahrain (UoB). The project aims at improving dialectal Arabic processing by:

• developing resources for Arabic Dialect modeling, including the creation of a 25-city multi-dialect lexicon and a 25-city multi-dialect parallel corpus;
• developing machine translation systems among dialects, dialects and English, dialects and Standard Arabic; and
• developing dialect identification systems that can work on a variety of granularity levels.

Members

Nizar Habash

Lead Principal Investigator

NYUAD

Kemal Oflazer

Co-lead Principal Investigator

CMU-Q

Houda Bouamor

Principal Investigator

CMU-Q

Owen Rambow

Principal Investigator

Columbia

Mohammed Salameh

Postdoctoral Researcher

CMU-Q

Wajdi Zaghouani

Postdoctoral Researcher

CMU-Q

Ossama Obeid

Research Associate

CMU-Q/NYUAD

Dana Abdulrahim

Linguist

UoB

Salam Khalifa

Research Assistant

NYUAD

Alexander Erdmann

Research Assistant

NYUAD

Fadhl Eryani

Research Assistant

NYUAD

Publications

• Addressing Noise in Multidialectal Word Embeddings.

  Alexander Erdmann, Nasser Zalmout and Nizar Habash.

  In Proceedings of Conference of the Association for Computational Linguistics (ACL), Melbourne, Australia, 2018.
  PDF
  BibTex

  @inproceedings{Erdmann-etal-2018,
    author = {Alexander Erdmann and Nasser Zalmout and Nizar Habash},
    title = {Addressing Noise in Multidialectal Word Embeddings},
    booktitle = {Proceedings of Conference of the Association for Computational Linguistics},
    year = {2018},
    address = {Melbourne, Australia},
    language = {english}
  }
                

• Unified Guidelines and Resources for Arabic Dialect Orthography.

  Nizar Habash, Salam Khalifa, Fadhl Eryani, Owen Rambow, Dana Abdulrahim, Alexander Erdmann, Reem Faraj, Wajdi Zaghouani, Houda Bouamor, Nasser Zalmout, Sara Hassan, Faisal Al Shargi, Sakhar Alkhereyf, Basma Abdulkareem, Ramy Eskander, Mohammad Salameh and Hind Saddiki.

  The International Conference on Language Resources and Evaluation (LREC 2018), Miyazaki, Japan, 2018.
  PDF
  BibTex

  @inproceedings{Habash-etal-2018,
    author = {Nizar Habash and Salam Khalifa and Fadhl Eryani and Owen Rambow and Dana Abdulrahim and Alexander Erdmann and Reem Faraj and Wajdi Zaghouani and Houda Bouamor and Nasser Zalmout and Sara Hassan and Faisal Al Shargi and Sakhar Alkhereyf and Basma Abdulkareem and Ramy Eskander and Mohammad Salameh and Hind Saddiki},
    title = {Unified Guidelines and Resources for Arabic Dialect Orthography},
    booktitle = {The International Conference on Language Resources and Evaluation},
    year = {2018},
    address = {Miyazaki, Japan},
    language = {english}
  }
                

• MADARi: A Web Interface for Joint Arabic Morphological Annotation and Spelling Correction.

  Ossama Obeid, Salam Khalifa, Nizar Habash, Houda Bouamor, Wajdi Zaghouani and Kemal Oflazer.

  The International Conference on Language Resources and Evaluation (LREC 2018), Miyazaki, Japan, 2018.
  PDF
  BibTex

  @inproceedings{Obeid-etal-2018,
    author = {Ossama Obeid and Salam Khalifa and Nizar Habash and Houda Bouamor and Wajdi Zaghouani and Kemal Oflazer},
    title = {MADARi: A Web Interface for Joint Arabic Morphological Annotation and Spelling Correction},
    booktitle = {The International Conference on Language Resources and Evaluation},
    year = {2018},
    address = {Miyazaki, Japan},
    language = {english}
  }
                

• The MADAR Arabic Dialect Corpus and Lexicon.

  Houda Bouamor, Nizar Habash, Mohammad Salameh, Wajdi Zaghouani, Owen Rambow, Dana Abdulrahim, Ossama Obeid, Salam Khalifa, Fadhl Eryani, Alexander Erdmann and Kemal Oflazer

  The International Conference on Language Resources and Evaluation (LREC 2018), Miyazaki, Japan, 2018.
  PDF
  BibTex

  @inproceedings{Bouamor-etal-2018,
    author = {Houda Bouamor and Nizar Habash and Mohammad Salameh and Wajdi Zaghouani and Owen Rambow and Dana Abdulrahim and Ossama Obeid and Salam Khalifa and Fadhl Eryani and Alexander Erdmann and Kemal Oflazer},
    title = {The MADAR Arabic Dialect Corpus and Lexicon},
    booktitle = {The International Conference on Language Resources and Evaluation},
    year = {2018},
    address = {Miyazaki, Japan},
    language = {english}
  }
                

• Low Resourced Machine Translation via Morpho-syntactic Modeling: The Case of Dialectal Arabic.

  Alexander Erdmann, Nizar Habash, Dima Taji and Houda Bouamor.

  In Proceedings of the Machine Translation Summit, Nagoya, Japan, 2017.
  PDF
  BibTex

  @inproceedings{Bouamor-etal-2018,
    author = {Alexander Erdmann and Nizar Habash and Dima Taji and Houda Bouamor},
    title = {Low Resourced Machine Translation via Morpho-syntactic Modeling: The Case of Dialectal Arabic},
    booktitle = {Proceedings of the Machine Translation Summit},
    year = {2017},
    address = {Nagoya, Japan},
    language = {english}
  }
                

Resources

MADAR Corpus

The MADAR Corpus is a collection of parallel sentences covering the dialects of 25 cities from the Arab World, in addition to English, French, and Modern Standard Arabic (MSA). This corpus is created by translating selected sentences from the Basic Traveling Expression Corpus (BTEC)^[1] in French and English to the different dialects. The MADAR Corpus will be made available soon to the research community under a non-commercial license. While we only provide the Arabic portions of the corpus, the English parallel text can be acquired directly from the USTAR consortium.

MADAR Lexicon

The MADAR lexicon is a collection of 1,045 concepts extracted from the MADAR Corpus defined in terms of triplets of words and phrases from English, French and MSA, along with multiple equivelant dialectal forms covering 25 cities from the Arab World. Each dialectal form includes its CODA orthography and CAPHI phonology ^[2]. The MADAR Lexicon will be made available soon to the research community under a non-commercial license.

MADARi

To help collect morphological data for the project, we designed the MADAR Annotaion Interface (MADARi). MADARi is a web-based framework consisting of a management interface that allows the lead annotator to upload documents and assign tasks to annotators, and an annotation interfce that allows annotators to efficiently add morpological data to their assigned documents.

MADAR Lexicon Viewer

If you have any suggestions or fixes for the lexicon, please take some time and complete the suggestion form.

* Dialectal Arabic words are written in the Conventional Orthography for Dialectal Arabic (CODA). The guidelines for CODA are here.

* Pronunciation of Arabic words is provided in the CAMEL Arabic Phonetic Inventory (CAPHI), a simplified form of the international phonetic alphabet. The CAPHI guidelines are here.

MADAR Corpus Viewer

[1] Takezawa, T., Kikui, G., Mizushima, M., and Sumita, E. (2007). Multilingual Spoken Language Corpus Development for Communication Research. Computational Linguistics and Chinese Language Processing, 12(3):303–324.

[2] Habash, N., Eryani, F., Khalifa, S., Rambow, O., Abdulrahim, D., Erdmann, A., Faraj, R., Zaghouani, W., Bouamor, H., Zalmout, N., Hassan, S., shargi, F. A., Alkhereyf, S., Abdulkareem, B., Eskander, R., Salameh, M., and Saddiki, H. (2018). Unified Guidelines and Resources for Arabic Dialect Orthography. In Proceedings of the International Conference on Language Resources and Evaluation (LREC 2018), Miyazaki, Japan.