How to check an AI legal answer: five questions to ask
This article is general information, not legal advice.
Five checks before you rely on a legal answer from an AI tool: the source, whether it opens, whether it is current, your facts, and who can confirm it.
A confident paragraph
You ask an AI tool a legal question and get back a confident paragraph: a rule, a section number, perhaps the name of a case. It reads well. It may even be right. The difficulty is that a wrong answer reads exactly as well as a right one.
Language models generate the most likely next words. That makes them fluent, but fluency is not accuracy. In legal questions the common failures are specific: a rule that has since been amended or repealed, a rule from another country presented as Indian law, a section number that points to the wrong provision, and citations that simply do not exist.
None of this means AI answers are useless. It means they need checking, and checking is a skill anyone can learn. Here are five questions to ask before you rely on a legal answer from a tool.
1. Does it show its sources?
The first question is whether the answer says where it comes from. A useful legal answer names the Act and section, the rule, or the judgment it relies on.
If there is no source, treat the answer as a lead to follow, not a conclusion. Ask the tool for its source. If it cannot give one, that tells you something too. Showing sources with every answer is a core part of how AI Lawyer's planned research feature is meant to work, for exactly this reason. The article on research with sources goes deeper.
2. Can you open the source and read it?
A source you cannot open is not much better than no source. For Indian law, central and state Acts are published on India Code, the Government of India's official repository of legislation. Judgments of the Supreme Court are published on its website, and High Courts publish theirs on their own sites.
Open the source and check two things: that it exists, and that it says what the answer claims it says. Read the surrounding text, not just the line quoted. Definitions, exceptions and provisos often sit a few lines away and change the meaning.
3. Is it current?
Laws change. Sections are amended, rules are replaced, and new laws take the place of old ones. An answer can quote a provision accurately and still be out of date.
When you read a law on an official site, look for notes on amendments and the date of the version you are reading. For a judgment, consider whether a later decision, or an appeal, may have changed the position. If the answer does not mention dates at all, be cautious.
4. Does it fit your facts?
A general answer is written for a general situation. Yours is specific. Write down the facts that might matter: dates, the exact words of any document, where you are, who the other side is, what has already happened, and any deadlines.
Then ask whether the answer depends on any of them. Often it does, and the answer could change if one fact were different. That list is not wasted work: it is exactly what an advocate will need from you.
5. Who can confirm it?
The last question is who can confirm that the answer applies to you. For general information, your own reading of the source may be enough. For a decision that binds you, such as signing, replying, filing or going to court, the person to confirm it is a qualified advocate.
This is where the line between information and advice does practical work. A tool can help you understand the rule. Applying it to your matter is advice.
The checklist, in short
- Does it show its sources?
- Can you open them and read them?
- Are they current?
- Does the answer depend on facts it does not know?
- Who can confirm it for your situation?
If an answer fails the first three, do not rely on it. If it passes them but question four raises doubts, take your list of facts to an advocate.
How AI Lawyer is planned to help with this
AI Lawyer is planned so that every research answer comes with its sources shown, and so that questions needing advice are directed to a qualified advocate. It will not promise that research is complete or correct; the sources are there so that answers can be checked. It is planned, with no code yet. You can read what it plans to do and what it will not do.
Key takeaways
- An answer without a source is a starting point, not something to rely on.
- Open every source: check that it exists, that it says what the answer claims, and that it is current.
- List the facts that could change the answer and take them to an advocate.
Questions
Can AI tools invent legal sources?
Yes. Language models can produce citations that look real but do not exist, or that do not say what the answer claims. That is why every source should be opened and read.
Where can I read Indian laws myself?
Central and state Acts are published on India Code, the official repository maintained by the Government of India. Judgments are published on court websites.
