RE: Advice Required - Dialog System for the Quran

2010-02-28 Thread El-Haj, Mahmoud
Dear Mazhar,

Although your question is a bit unrelated to the discussion but kindly refer to 
the following verses:
An-Nisa' [4,59]
'Ali `Imran [3,7]
An-Nahl [16,43]
Al-'Anbya' [21,7]

Hope it will answer your question.

Best,
Mahmoud

From: comp-quran-requ...@comp.leeds.ac.uk 
[mailto:comp-quran-requ...@comp.leeds.ac.uk] On Behalf Of Mazhar Anwar Nurani
Sent: Sunday, February 28, 2010 2:56 PM
To: waj...@ldc.upenn.edu
Cc: comp-quran@comp.leeds.ac.uk
Subject: RE: Advice Required - Dialog System for the Quran

Assalamo Alaikum,

Is there any verse wherein Allah and His Messenger s.a.s allowed any Sheikh to 
issue Fatwa?
Mazhar A. Nurani
--- On Sun, 2/28/10, waj...@ldc.upenn.edu waj...@ldc.upenn.edu wrote:

From: waj...@ldc.upenn.edu waj...@ldc.upenn.edu
Subject: RE: Advice Required - Dialog System for the Quran
To: El-Haj, Mahmoud mel...@essex.ac.uk
Cc: Kais Dukes dukes.k...@googlemail.com, comp-quran@comp.leeds.ac.uk 
comp-quran@comp.leeds.ac.uk
Date: Sunday, February 28, 2010, 6:34 AM

Salam all,

Yes I total agree with Mahmoud and Abdul-Baquee, A QA system for the Quran 
cannot and will not replace a Fatwa or sheikh.

but What I meant by taking the Data from the www.islam-qa.com  and filtering 
the answers when we think that the Question and answer are simple enough to be 
answered in the form of Quranic verse and this could serve in the case of a 
simple QA system for the Quran.

So there is a big job of selecting which question are relevant and are simple 
enough to be included in our candidate list of questions.

Since Kais is targeting at the beginning around 1000 simple questions, I 
believe that we can use that source as start.

I am ready to help with this and I will start to compile as much simple QA as 
possible when I have some time.


Regards,

Wajdi.




Quoting El-Haj, Mahmoud 
mel...@essex.ac.ukhttp://us.mc573.mail.yahoo.com/mc/compose?to=mel...@essex.ac.uk:

 Dear All,

 Very impressive indeed.
 I just have the following questions, concerns and suggestions regarding the 
 Quranic Question Answering System.

 Building a Quranic Question Answering system is great but you need to focus 
 on what type of questions are you going to ask!
 Is it questions on Belief, juristic, transactions, ..etc.

 Trustworthy Resources! What does it exactly mean? Are you intending to just 
 copy/paste questions and answers from different websites? Which sounds 
 retrieving process only.
 What I mean is training a Quranic QA system with Quranic resources is 
 different from training a general QA system using a training data, as the 
 domain is huge and the testing data is different from the training one.

 What Wajdi said about taking all the data from the website he mentioned and 
 filtering the text in the answer keeping just the Quran verses sounds same as 
 having the website on different host. The training here is a matter of 
 matching, as you are only matching users' questions to even the questions in 
 this website or the answers as an expanding process.

 Providing FATWA answers should be Expert in a way to desist the user from 
 asking a Sheikh (Mofti). And we know that most of the questions are being 
 answered based on the Prophet's (Peace Be upon Him) Hadith and behaviours. 
 Where other factors play a big role also, such as the situation, place, age, 
 and gender. A QA system in the way of collecting Correct FATWAS is far away 
 from Quran QAs, as I can't find the benefit of having the Quran as a source 
 (I mean in the system), how is the Quran going to be used to answer such kind 
 of questions?

 As you said you want an intelligent expert question-answering system.
 I suggest that the Quranic QA system should be (as a starting phase) for 
 answering simple questions as Kais said but questions other than Fatwas

 For example (simple questions such as frequencies and quantities), a bit 
 advanced questions that requires text analysis and maybe anaphoric resolution.
 e.g.
 Q: What kind of birds was Sulaiman (Peace Be upon Him) talking to in An-Naml 
 Chapter?
 A: Hoopoe
 Source: And he took attendance of the birds and said, Why do I not see the 
 hoopoe - or is he among the absent? -- [An-Naml, 20].

 Finally, I could imagine one of the following scenarios:
 1- An IR system that treats the question as a query and then retrieves verses 
 that may contain the answer in a ranked order.
 2- An intelligent QA system that provides non-Quranic answers and strengthen 
 that by verse(s).

 I would be really fascinated by Quranic QA system that can answers questions 
 as the one mentioned above.

 Thanks for your time and please correct me if there is something wrong.

 Best wishes,

 Mahmoud EL-Haj
 http://privatewww.essex.ac.uk/~melhaj/
 School Computer Science and Electronic Engineering
 Essex University, Wivenhoe Park,
 Colchester CO4 3SQ, United Kingdom.
 //EASC Corpus: http://privatewww.essex.ac.uk/~melhaj/easc.htm




 -Original Message-
 From: 
 comp-quran-requ...@comp.leeds.ac.ukhttp

Re: Advice Required - Dialog System for the Quran

2010-02-28 Thread Kais Dukes
 who might
not have English as their first language, but would still like to use
a simple QA system etc.

- Although some verses of the Quran require detailed background
information before any meaning can be obtained, there are also many
verses with clear contained ideas and propositions.

- Just because something is hard, possibly controversial, and may have
some drawbacks and limitations, doesn’t mean that we shouldn’t
proceed. Any good piece of science includes an experiment with an
often uncertain outcome. We don't know until we try.

Based on this, I do agree with you (and others) that there are many
things to consider here, but I along with many other members of this
mailing list do look forward to a simple Question-Answering for the
Quran. Although you yourself Eric might not find it very useful, as I
do agree with you there are of course many other better resources out
there - let’s keep in mind that different people like different
things, and that I’m very sure that a simple Question-Answering system
will attract many new visitors and users to the website.

I could be wrong - but we will never know until we try :-) Of course
there are many things we need to keep in mind, but I would like to
suggest we move this discussion on to more practical concerns. My
biggest interest in developing even a simple QA system, is that we
can't do something even better and more advanced without starting with
the basics first. So even if this system is quite simple, we should go
ahead and not give up - otherwise, how will we ever build anything at
all, if we don't start with the first few simple steps towards
something more powerful?

I have very humble aims for a simple Question-Answering system.
However, I wonder what people thought about the Wright Brothers'
attempts at building the first airplane? :-)

I would welcome some positive constructive ideas on how to proceed
with the simple Quran QA system. In particular, any contributions for
lists of questions, and matching verses with answers are most welcome.

Kind Regards,

-- Kais



 On Sun, Feb 28, 2010 at 3:37 PM, Eric van Lit fifkik...@hotmail.com wrote:



 Hi Kais and everybody else,

 I want to point out that the questions you suggested all revolve around one 
 word:

 Allah - Who is Allah?
 Muhammad - Who was Muhammad?
 Islam - What is Islam?
 prophets - Which prophets are mentioned in the Quran?
 Solomon - Is Solomon mentioned in the Quran?
 Jesus - What does the Quran say about Jesus?
 religions - List the religions mentioned in the Quran.
 If you stick with questions like these, what is the difference with an index 
 or concordance? Or is your intention to generate a coherent answer from the 
 relevant verses? If so, I would say that paraphrasing the word of God is not 
 a good idea (this objection is similar to my objection to the pronoun 
 resolution). Also be aware that much of the Quran is context dependent and 
 so one cannot lift one verse up and present it out of its context; important 
 nuances might very well be lost (not to mention the extensive literature on 
 asbab al-nuzul, tafsir, sirah, ahadith etc. to contextualize the Quran even 
 more).

 Yes, we live in a time where it seems that everything has to be summarized in 
 one catchy quote (i.e. if it doesn't fit in a Twitter tweet, it's not 
 important to read) but I honestly don't think an approach like that to the 
 Quran is a correct one. The very character of the Quran - and I mean for 
 example its lack of one big narrative and its apparent contradiction 
 throughout the text - forces the reader to spend time on it, to read bigger 
 parts of it than just some verses here and there. To decompose the Quran to 
 its verse-structure (or do you want to cut into even smaller pieces for 
 this?) and put it back together in an order you deem best is a guarantee for 
 losing its aesthetics and thereby its unique character.

 So to conclude, is what you want pretty much the same as an 
 index/concordance? Then go with that. If you think the QA-system would be 
 different from that, please take note of the pitfalls I've indicated here.

 Just my 2 cents of course.

 Eric van Lit
 M.A. student McGill University



 Date: Sun, 28 Feb 2010 10:48:23 +
 Subject: Re: Advice Required - Dialog System for the Quran
 From: dukes.k...@googlemail.com
 To: comp-quran@comp.leeds.ac.uk

 Hello,

 This discussion thread is getting quite interesting indeed. What do
 you all think of START - the natural language question answering
 system?

 http://start.csail.mit.edu

 I think it's pretty good for simple facts, especially as it usually
 cites the original source resource for each answer. With regards to a
 Quranic QA system, I think that so far the general consensus on this
 mailing list is that there could be two types of system:

 (1) A very basic fact system, which can answer simple questions from
 knowledge in the Quran, backed by Quranic verses.

 (2) A much more advanced system, which combines

Re: Advice Required - Dialog System for the Quran

2010-02-27 Thread Bayan Shawar

Salam Kais,
  in fact we will face one important problem: not all these answers are right, 
so we could not trust any website, we should be sure who sent the fatwa. I 
found some QA, but i am sure not all answers are right, i read some and i found 
it nonsense.
You can have a look at:
http://www.godsmosque.org/topten.htm

But do not trust the answers source, some answers are totally not right in my 
opinion.

Or we may collect the QA then we show it to a scholar to select he correct ones.


I will try to find more,
Best wsihes,
Bayan
--- On Sat, 27/2/10, Kais Dukes dukes.k...@googlemail.com wrote:

 From: Kais Dukes dukes.k...@googlemail.com
 Subject: Re: Advice Required - Dialog System for the Quran
 To: Bayan Shawar bsha...@yahoo.com
 Cc: comp-quran@comp.leeds.ac.uk
 Date: Saturday, 27 February, 2010, 21:25
 Hello Bayan,
 
 I think this sounds very exciting and interesting. As a
 first step, I
 would like to discuss how we can put together a list of
 questions (and
 hopefully answers) related to the Quran, ideally with each
 entry in
 the list linked to a specific verse which contains the
 answer. You
 mentioned Islamway.com - I wonder if you (or others) are
 aware of any
 online sources for questions and answers as well as this,
 that we
 could use to compile the QA knowledge base?
 
 Kind Regards,
 
 - Kais Dukes
 
 Language Research Group
 School of Computing
 University of Leeds
 
 http://corpus.quran.com - The Quranic Arabic Corpus
 comp-quran@comp.leeds.ac.uk
 - Computational Quranic Arabic discussion list
 
  On Sat, Feb 27, 2010 at 7:16 PM, Bayan Shawar bsha...@yahoo.com
 wrote:
  Dear Kais,
   This will be agreat idea, i may help you in this. I
 used the Qur'an before to train the chatbot. I took all
 verses in arabic and English. However the idea was not as
 the one you suggested because my database was only the
 qur'an without interpretation. So when you ask a question
 about Islam, an answer would be obtained from the Qur'an
 verse, so the answer is the verse that match least frequent
 words.
 
  At that time i used some of Islamin questions obtained
 from ISlamway.com, and other islamic sites. Then i asked
 muslims and non muslims to evalute if the answeres obtained
 were related, partially related or non.
 
  Now, are you goinf to use the English version of the
 Qur'an as the sourse of your answer, or as i understood we
 would like to obtain an answer as you mentioned then we
 could refer the user to verse number and soora in Qur'an. In
 this cae in additin to questions, what will be your databse:
 is it a structure database as QA as the one found in TREC.
 Just if you could provide me with an image of how your
 corpus is structured. Then i can use this corpus to feed the
 chatbot with, and we can try to use this chatbot as a QA and
 see how resuts will be, and i will try to modify it or build
 it from scratch.
 
  Eric and me was discussing such idea last July, but i
 was not have enough time, now you raise up the idea to
 surface again, and i will be happy to work on it.
 
  looking forward o hearing from you for further
 cooperation, if you have any question, let me know please.
 
  Best wishes,
  Bayan
 
  --- On Sat, 27/2/10, Kais Dukes dukes.k...@googlemail.com
 wrote:
 
  From: Kais Dukes dukes.k...@googlemail.com
  Subject: Advice Required - Dialog System for the
 Quran
  To: comp-quran@comp.leeds.ac.uk
  Date: Saturday, 27 February, 2010, 20:46
  Hello Members of the Computational
  Quran Mailing List,
 
  Current research in the Quranic Arabic Corpus
 project
  involves:
 
  - Morphological annotation
  - Syntactic annotation
  - Ontology of Quranic Concepts (towards a
 semantic
  representation of the Quran)
 
  As well as extending the morphological and
 syntactic
  annotation of the
  Quran, I am keen to start thinking about a later
 stage of
  this
  research. The final (long-term) aim of this
 project is to
  build an
  intelligent expert question-answering system. An
 example
  might be:
 
  ==
  Question:
  How long should I breastfeed my child for?
 
  Answer:
  Mothers may breastfeed their children two
 complete years
  for whoever
  wishes to complete the nursing [period].
  - Source: The Holy Quran, verse (2:233).
  ==
 
  Such a system would allow general website users to
 ask
  simple
  questions, and get back answers based on facts
 contained in
  verses of
  the Quran. As a first step to constructing such a
 system, I
  am keen to
  get hold of a large list of questions (and
 hopefully
  answers) backed
  by verses of the Quran. I would like to ask the
 members of
  this
  mailing list advice on building together a list of
 sample
  questions
  (e.g. several hundred or several thousand
 questions that
  people might
  commonly ask). Does anybody have any suggestions
 for online
  (or other
  resources) for Islamic questions and answers,
 hopefully
  with all the
  answers directly as verses of the Quran?
 
  It would

RE: Advice Required - Dialog System for the Quran

2010-02-27 Thread El-Haj, Mahmoud
Dear All,

Very impressive indeed.
I just have the following questions, concerns and suggestions regarding the 
Quranic Question Answering System.

Building a Quranic Question Answering system is great but you need to focus on 
what type of questions are you going to ask!
Is it questions on Belief, juristic, transactions, ...etc.

Trustworthy Resources! What does it exactly mean? Are you intending to just 
copy/paste questions and answers from different websites? Which sounds 
retrieving process only.
What I mean is training a Quranic QA system with Quranic resources is different 
from training a general QA system using a training data, as the domain is huge 
and the testing data is different from the training one.

What Wajdi said about taking all the data from the website he mentioned and 
filtering the text in the answer keeping just the Quran verses sounds same as 
having the website on different host. The training here is a matter of 
matching, as you are only matching users' questions to even the questions in 
this website or the answers as an expanding process.

Providing FATWA answers should be Expert in a way to desist the user from 
asking a Sheikh (Mofti). And we know that most of the questions are being 
answered based on the Prophet's (Peace Be upon Him) Hadith and behaviours. 
Where other factors play a big role also, such as the situation, place, age, 
and gender. A QA system in the way of collecting Correct FATWAS is far away 
from Quran QAs, as I can't find the benefit of having the Quran as a source (I 
mean in the system), how is the Quran going to be used to answer such kind of 
questions?

As you said you want an intelligent expert question-answering system.
I suggest that the Quranic QA system should be (as a starting phase) for 
answering simple questions as Kais said but questions other than Fatwas

For example (simple questions such as frequencies and quantities), a bit 
advanced questions that requires text analysis and maybe anaphoric resolution. 
e.g.
Q: What kind of birds was Sulaiman (Peace Be upon Him) talking to in An-Naml 
Chapter?
A: Hoopoe
Source: And he took attendance of the birds and said, Why do I not see the 
hoopoe - or is he among the absent? -- [An-Naml, 20].

Finally, I could imagine one of the following scenarios:
1- An IR system that treats the question as a query and then retrieves verses 
that may contain the answer in a ranked order. 
2- An intelligent QA system that provides non-Quranic answers and strengthen 
that by verse(s).

I would be really fascinated by Quranic QA system that can answers questions as 
the one mentioned above.

Thanks for your time and please correct me if there is something wrong.

Best wishes,

Mahmoud EL-Haj
http://privatewww.essex.ac.uk/~melhaj/
School Computer Science and Electronic Engineering
Essex University, Wivenhoe Park, 
Colchester CO4 3SQ, United Kingdom. 
//EASC Corpus: http://privatewww.essex.ac.uk/~melhaj/easc.htm
 



-Original Message-
From: comp-quran-requ...@comp.leeds.ac.uk 
[mailto:comp-quran-requ...@comp.leeds.ac.uk] On Behalf Of Kais Dukes
Sent: Saturday, February 27, 2010 6:46 PM
To: comp-quran@comp.leeds.ac.uk
Subject: Advice Required - Dialog System for the Quran

Hello Members of the Computational Quran Mailing List,

Current research in the Quranic Arabic Corpus project involves:

- Morphological annotation
- Syntactic annotation
- Ontology of Quranic Concepts (towards a semantic representation of the Quran)

As well as extending the morphological and syntactic annotation of the
Quran, I am keen to start thinking about a later stage of this
research. The final (long-term) aim of this project is to build an
intelligent expert question-answering system. An example might be:

==
Question:
How long should I breastfeed my child for?

Answer:
Mothers may breastfeed their children two complete years for whoever
wishes to complete the nursing [period].
- Source: The Holy Quran, verse (2:233).
==

Such a system would allow general website users to ask simple
questions, and get back answers based on facts contained in verses of
the Quran. As a first step to constructing such a system, I am keen to
get hold of a large list of questions (and hopefully answers) backed
by verses of the Quran. I would like to ask the members of this
mailing list advice on building together a list of sample questions
(e.g. several hundred or several thousand questions that people might
commonly ask). Does anybody have any suggestions for online (or other
resources) for Islamic questions and answers, hopefully with all the
answers directly as verses of the Quran?

It would also be great to hear ideas on how a powerful dialog system
of the Quran might approach - or even any ideas about dialog systems
in general.

Looking forward to any responses. Please feel free to reply directly
to the mailing list (just hit reply all).

Kind Regards,

- Kais Dukes

Language Research Group
School of