Monday, 15 November 2010

It's been a while since the last post, and I wish I had more positive news. In spite of my best efforts Mumbai was not a huge success.

After numerous emails had been ignored over the past few months I decided to go to the Mumbai Directorate of Forensic Science to see if I could try and meet with its Director, Dr. M V Garad. Dr. Garad was last author on a 2009 paper 'Brain signature profiling in India: It’s status as an aid in investigation and as corroborative evidence - as seen from judgements' (don't blame me for the apostrophe.)

Parts of the above paper are cause for concern. In the case of a man accused of murdering an employee and who had taken the Brain Electrical Oscillation Signature (BEOS) profiling test (which had indicated that he was guilty) the court observed that
‘Since the tests are scientific tests, are conducted in scientific manners and with latest scientific machines and therefore, these examinations and its results cannot be discarded in this case as it corroborates with other evidence brought on record by the prosecution including oral as well as documentary and therefore, the results of the said examinations are acceptable in this case.’

Just because the test is based on science and uses technology surely the basis for whether it should be admissible should be that it has been demonstrated to be accurate and reliable, not that it uses the latest machines!

Later in the paper it is stated that
'Being used on approximately 300 subjects suspected to be involved in criminal activities, and the increase in demand for the conduction of this test, is an indication of the usefulness of this particular test in a Forensic Set-up as an aid to investigation.'

This is a circular argument. It is used therefore it is useful and because it is useful it is used... That fact that it is used does not mean that it provides relevant information for an investigation or criminal trial. It could instead be due to the lack of other corroborative evidence due to crimes being minimally investigated with a lack of more tried and tested forensic methods being used.

In conclusion the paper states that:
'Brain Electrical Oscillation Signature Profiling (BEOS) is certainly a useful test as an aid to investigation provided it has been conducted in a scientific manner.'

and
'If the tests of the results are negative, and if they are not supportive of prosecution, the courts may consider that, the purpose for which the test was taken has not been served.'

What is worrying about these conclusions is that the definition of 'a scientific manner' seems to be one in which technology is involved rather than that the test has been rigorously scientifically tested to determine whether it can do what it claims to be able to do and to what degree of accuracy and reliability. The second conclusion is particularly worrying as it shows that test results suggesting that the suspect does not have experiential knowledge of a crime are not considered exonerating evidence. Instead it shows that the reason for using the test in the first place is to provide evidence of guilt in order to convict a suspect.

I had hoped to discuss all this with Dr. Garad, but it seems that showing up on his doorstep was not to bring me any closer to a meeting with him. I did manage to get a brief interview with Dr. Daundkar, the Deputy Director, but he refused to answer most of my questions. When I asked him about the reliabilty of the tests and the chances of false positives he did say that it is not possible to get false positive readings with BEOS and that if a positive result suggesting that you had experiential knowledge of a crime was obtained, but that you were not the one responsible for the crime then perhaps the result was due to knowledge as an accessory to the crime. Chilling. Not to mention utterly baseless. A validation of study funded by TIFAC (the Technology Informtion Forecasting and Assessment Council) "Normative data for brain electrical activation profile" and conducted by the Directorate of Forensic Sciences in Gandhinagar apparently showed a rate of 95% accuracy, though I have yet to see this report. I had been told by Dr. Vaya that it was available on the TIFAC website, but it is not and requests to TIFAC and Dr. Vaya for a copy of it have so far been ignored.

I took a photo of the building on departure. Not quite the documentation I had hoped for.



I still had a few other meetings scheduled and possible leads whilst in Mumbai. I met with Dr Amar Jesani, one of the founders of the Indian Journal of Medical Ethics, and member of its editorial board. Vickram Crishna from Privacy International, also kindly met me and pointed out that another question about the use of these technologies is how the 'experts' are trained and how we can ensure that they are as objective and able as possible. I also met Nandkumar Saravade, a former Indian law enforcement officer, now working in cyber secerity. He informed me that when it comes to technology used in investigations or presented as evidence in trials in India there is "No formal standardisation process to test whether a technology works". He was also of the opinion that there was has not been much science coming into criminal investigations for a long time in India due to the lack of infrastructure and the amount of time it can take to get samples from crime scenes analysed by forensic science laboratories. He stated that labs can take months to analyse samples and so scientific methods of solving crimes can slow down the process, whilst techniques such as BEOS and narcoanalysis can be used as a shortcut by police to get lots of information and quickly.

Leaving Mumbai I had high hopes that I would achieve more in Bangalore. Bangalore is after all home to the inventor of the BEOS system, the National Institute for Mental Health and Neurosciences (NIMHANS) where he worked for 20 years as a clinical psychologist, Axxonet, the company that markets his BEOS profiling system and the place where the technique was born. My hopes were to be dashed.

Dr. C. R. Mukundan, the inventor of BEOS had agreed to meet me in Bangalore back in August, so I was a little surprised that once in India (and after meeting Dr. Vaya) that I received a message from him asking for my credentials to support that I am a forensic psychologist or forensic neuroscientist, working in cognitive electrophsyiology/psychophysiology and stating that he would decide on meeting only once I had supplied this. Having been very clear about the project and my position this came from left field, but I emailed him to explain my background and interest and in response I received this
'I wish I had known these details early enough; I would not have asked you to meet me. There is no chance of you understanding either the electrophysiology or the cognitive neuroscience of BEOS with your back ground, which is quite obvious with the account and the questions that you have in mind.'
And also
'Anyway BEOS was never to be used as evidence in the Court of Law and to the best of knowledge it was never advocated so by me or presented in the courts. I know from publications of the two laboratories engaged in the use of this technique, that its findings have been cited as corroborative evidence when primary evidences were present and accepted so by the court. I understand the test findings have helped as leads in many cases for solving them. However, you must collect these pieces of information from the concerned forensic scientists or laboratories. I do not have any authentic information which I can share with you.

I am told by Axxonet that they will not be in a position to meet you or discuss with you BEOS.'

Interesting. BEOS never intended to be used in a Court of Law? The first line of Dr. Mukundan's patent application for BEOS reads 'The present invention provides a novel electronic investigative device for identification of truth from individuals who have committed an act of offence.' so the technology is meant to decide whether people were involved in crimes, but this information was not to be used by the courts? If the information is accurate and valid then surely it would be useful to the courts. If it is not then what use is it to the criminal investigation? Also why are Axxonet no longer able to meet me or discuss the technology? In an email from Dr. Mukundan in August I was told 'Anyway the engineering team [ie. Axxonet] in is Bangalore and you have to come here for meeting them.'

Further appeals to Dr. Mukundan resulted in his agreeing to meet me again 'I have no problem in meeting you and talking about the scientific aspects of BEOS.', however they now stated that he would not be in Bangalore until 24th November. Not the most helpful offer considering that he knew I was leaving Bangalore on the 19th. Oh well. Can't be helped and he has agreed to answer any scientific questions I have by email. It is probably not worth me being in Bangalore to meet him though if all I can get is email correspondence. That I could have done from London.

I decided to see if Axxonet were indeed unwilling to meet me. I tried calling them, but did not get a response, so decided to turn up and try and arrange a meeting. It took me a few hours to find their offices as addresses in India are not always what they seem. The address for NIMHANS for example is given as Hosur Road on their website - it is about 1.5km from that road - so the Axxonet address, also given as Hosur Road was not the easiest of places to find. But I did and here it is:

Similarly to the DFS, Mumbai this is about all I got from the visit. For every question I asked I was told that 'only Dr. Mukundan can answer that.' I marvel that they manage to get any work done there when he is out of town.

I also visited the State Forensic Laboratory here, and have been told to come back on Thursday. Fingers crossed that they will agree to speak with me.

I have also been to NIMHANS and got a bit more background on Dr. Mukundan and how the BEOS system came into being. More on that another time.

Thursday, 4 November 2010

Technology is against me

It's been a hectic and tiring few days and I have decided that the machines are out to get me.

Everyone thought that Sarah Connor was delusional in Terminator I and II. I am not claiming to being chased by homicidal cyborgs from the future or predicting the attempted annihilation of the human race by Skynet. I only mention it as a word of caution about the reliance we place on computers (he says relying on the computer to write this blog and the internet to publish it, bemoaning the slow internet speed, but grateful to at least have some access after days without!)

Yesterday I was labelled a 'suspect' by the 'Suspect Detection System, SDS'. This is a portable piece of kit apparently used at border controls, in intelligence gathering and pre-employment screening. According to the SDS website it can, in a 5 minute test, 'identify terrorists, employees who has hostile intents, criminals, smugglers or collaborators and direct further interrogation'.

According to SDS I fall into one of these categories, a ruling I would like to protest! I am at least very grateful that I encountered this evil little finger-pointing machine as part of my tour of the Gujarat State Forensic Science Laboratories and not whilst crossing a border into Israel (one of the countries where it is apparently routinely used) where I would have likely been taken for further questioning and screening to find out more about my evil intentions.

The test consisted of a placing two fingers of my hand on some electrodes (presumably to detect galvanic skin response (or amount of sweat present) - one of the indicators of lying used in polygraphs) and answering a series of questions posed by the computer. All the questions it asked me were related to whether I had knowledge, or involvement in starting fires at the 'police station', 'the post office', 'the cinema', 'the mall' and (my favourite) 'the carvery emporium'. If the system had decided I was clean I would have had four rounds of tests and been sent on my way. As it was the system was a little suspicious of me after the questioning, so decided to automatically issue two more rounds of questions to be sure. After these it declared that it was now sure I was a suspect.

On coming back into the room my hosts commented that this wasn't supposed to happen, but most worryingly, instead of declaring a known error rate or other such excuse one said that 'I must be guilty of something'. It is this unquestioning belief that the machine must be right and that I must therefore be hiding something, when there was no reason to suspect my intentions other than that they had the computers word for it.

If the test has shown me not to be a suspect I would still have required far more evidence to convince me that this was a valid screening test. I would have first wanted to know what this was based on, how many 'innocent' and 'guilty' people the system had been tested on to calibrate it, how these 'innocent' and 'guilty' subjects were picked in the first place to be sure that they were worthy of their appointed status and many other things. As it is my experience of a 100% error rate, means that I will require a hell of a lot of evidence to convince me that this isn't a dangerous tool to be used to hassle and interrogate innocent people (even if it does also pick up the occasional terrorist).

Anyway, I didn't go to Gujarat to find out about Suspect Detection Systems. I went there primarily to check out the work they are doing on lie detection using their Brain Electrical Oscillations System (BEOS) which they claim detects experiential knowledge (or lack of knowledge) about details of a crime in a suspect to help provide evidence for their guilt (or innocence).

Over the last two days Dr. Vaya and her staff were very generous with their time in showing me the different techniques they use there and giving me a chance to experience them for myself. I experienced the probes used with BEOS to test a suspect in a real serial killing case a few years ago and also experienced the control test used in a study testing the ability of the system to distinguish between experiential and non-experiential knowledge.

I still have many more questions, which I hope to be able to bring up with the inventor of BEOS, Dr. Mukundan, in Bangalore but from what I have seen and been told so far there seems to be some reasonable evidence that this system can detect experiential knowledge. I want to see far more data and to understand how the system comes up with its 'verdict', as well as talking to some more skeptical scientists about what the technology is revealing before I am prepared to say what I think of the potential for BEOS to be used in real world lie-detection situations.

Sunday, 31 October 2010

Gujarat here I come

Thanks all for the crossed fingers... Dr. S.L. Vaya, Director of the Institute of Behavioral Science has agreed to meet me before her break for Diwali, so I will be flying to Ahmedabad tomorrow and spending Tuesday and Wednesday in her lab.

Apparently I will get to "see everything in action" which I am very excited about. I will be shown their EEG/ERP work (EEG=Electroencephalography - the one where lots of electrodes are stuck to your scalp as in the picture below while the scientists measure the electrical activity of your brain and ERP=Event Related Potential, which is when there is a change in the EEG pattern in response to a stimulus).


And the relevance of this to detecting the truth or lies? Well I will know more after my visit, but the basic idea as I understand it is that the person hooked up to the system is read a series of statements. The person does not need to respond, but if they have 'experiential' knowledge of that statement then the system will detect it. Apparently if I were hooked up and someone read out "I had a curry for lunch today" this would come out as true (as it would have most days this week...) whereas if they read out "I went to McDonald's for lunch today" this would not register (and I'm very happy to have the scan to prove it!). In other words the claim is that the system can detect truth (that you have experienced something, rather than something you believe).

I reserve judgment, but am looking forward to seeing it in action!

Apparently they are also doing research on the old-fashioned polygraph lie-detector test so it will be interesting to compare the outcomes of the two. More on polygraphs later.

I will be sad to say goodbye to the quiet part of Mumbai I am currently staying in, Ballard Estate in Fort. Pretty much the only noise I have heard here is cows mooing. I haven't seen any in the day, but at night they take over the streets...


If anyone can tell me where they go during the day or what they eat I would be very grateful. The area has no grass or hay and is surrounded by a navy installation on three sides and the rest of the city to the West. I am confused.

Friday, 29 October 2010

I love it when A(merican) plan comes together...

So whilst plans in India are still revving their engines waiting to start the USA plans are storming ahead.

Before leaving the UK I was very happy to have already had a range of US contributors on board. I had lawyers (both academic and practicing), bioethicists and neuroscientists lined up as well as Dr. Steven Laken, President of Cephos, a Boston-based commercial lie detection company. You can see Steven on a short Dateline NBC newsclip on the Cephos website showing the fMRI being used to attempt to verify or cast doubts on details of extra marital affairs.

As of this evening I am happy to report that Joel Huizenga, Founder and CEO of California-based 'No Lie MRI' has also agreed to meet me right at the end of my trip. He can be seen (back in 2007) on PBS Wired Science feature about half way through the feature.

So that's the head honchos of the only two companies marketing fMRI-based lie detection in the USA on board. My thanks to both of them for their time in advance.

Now back to focusing on India...

The Good, the Bad and the Diwali

Dr. S.L. Vaya, Director of the Institute of Behavioural Science at Gujarat Forensic Sciences Laboratory has agreed to meet with me. She has a wealth of relevant experience for my project including working as Assistant Director in the lie detector division for fifteen years. She also presented on “Indian scenario in Polygraph and brain electrical oscillation signature profiling tests” at the British Psychological Society in July 2008. So that's the Good news - but am I finally getting somewhere with the Indian leg of my trip? No. She says she will be away from 5th to 13th November, but would be happy to meet after she returns - by which time I'm in Bangalore! So that's the Bad news.

The reason for this? Yes I know it's going to come as a big shock after the title of this post... Diwali (or festival of lights) starts on 3rd November and goes on for 5 days and whilst I've very glad that I will get to experience it I am only happy about this if it doesn't mess with the fellowship!

I have just emailed Dr. Vaya to see if I could fly to Ahmedabad on Sunday and perhaps see her on the 1st and/or 2nd. Please could I ask anyone reading this to cross their fingers for me? I'm over 3 days in to my trip and I need to get some interviews in the bag!

Thursday, 28 October 2010

An early start and second High Court attempt


Having completely failed to sleep last night I thought that I'd go out before dawn and get some photos across Mumbai Harbour as the sun rose. Everyone will be asleep I reasoned, so I'd be able to get a few photos without any hassle. I was partly right... It seems that when the people aren't up then the dogs and the birds take the few hours of ownership they can get seriously. I'd barely made it out of the hotel before I was being growled at by a group of dogs. Deciding that they were welcome to the pavement I moved away quickly, though obviously showing no fear... The pavements by the harbour were flocking with large crows, but they grudgingly moved aside to allow me to take a few photos of the harbour, The Gateway of India and the Taj Mahal Palace and Hotel:


It's big - I'll grant you, but rather less beautiful than the 17th century one inspired by grief and love. This 20th century behemoth was apparently built by a man, having been refused entry to another hotel, with a point to make. Still if this was the usual result of an overzealous bouncer the world would be a very different place.

I digress. Apologies. Back to the Fellowship.

Feeling rather more prepared today I returned to the High Court to see if I could get a better understanding of how the legal system here works or perhaps find out more about what people think of brain scanning-based lie detection. It took a while to get in as first I had to fill out a log explaining who I was and which case I was entering to see. With no case number, name of accused or crime they may have been accused of I was struggling. Wanting to enter for general research had no place on the form, so instead, finally I was told to write that I wanted to enter for a trial in court 18 (I never did get a realistic idea of the number of courts in there or the number of trials taking place at any one time or indeed the range of trials taking place).

Sadly I couldn't take my camera in, but the inside felt like a strange cross between a bureaucratic asylum, a gothic castle and a train station. Confused looking people were passing large files of case notes between each other, if not making more copies of them in the Xerox centre. All of this in a labyrinthine stone structure with unmarked doors save from a LED ticker-tape display above each, which may have been pronouncing judgements going on inside or saying which trial was coming up next. I tried to ask a few people what was going on or what the procedures were and at one point of asking was told by an official at a door that this was the room for 'the liars and their advocates', but I never got a lot further. It was certainly the first place I've been to in Mumbai where I was guaranteed no hassle. The people in there were far to overwhelmed with the processes they were attempting to navigate than to have time to talk to me. This may well be a slight red herring for my fellowship, but I think I need to speak to some lawyers and come back for a third visit. The people inside have too much going on, but I want to find out what passers by think (or those entering or leaving) about evidence and how it is applied and where they think brain scanning-based lie dectection can or should fit in to the mix.

Wednesday, 27 October 2010

High Court attempt and another scam

After a few more hours today sending emails I decided that with no scientists to meet as yet I would instead go for a walk to the High Court in Mumbai. A chance to see the Indian justice system in action and to get more of an insight perhaps into how evidence is presented and assessed.

Managing to get out of the area of Mumbai I have so far confined myself to, Colaba, I was about to enter the Fort area when a man promptly inserted a small pointy stick into my ear. Time for a bogus medicine-man style con... Sadly knowing someone is about to try and con you doesn't necessarily help. A pointy stick in the ear tends to root you to the spot I found... Seconds later after a scrape around, followed - no doubt - by some slight of hand and some concealed clay he pointed out that my ears were full of nasty brown stuff (incidentally not the same colour of any ear wax I have ever seen on a cotton bud). However, I decided to play along and next thing I know he was pulling a small stone out, also covered in clay. All good fun. No idea how I've been managing to hear with all that stuff in there! Even more surprising that my hearing was exactly the same once the stone and other gunk had been 'removed'. Anyway I asked how much this service cost and he conveniently pulled a card, laminated, so therefore legit showing it was 500 rupees. I quite enjoyed the scam, but not that much. I thought 100 was plenty (around £1.40 I think) and also I now know to move away quicker from men with small pointy sticks. I think he also knew he had done well, so all happy I moved on.

Anyway, after a couple of wrong turns I made it to the High Court. Unfortunately too late to get in, so will have to return tomorrow. I thought that while I was there I'd at least get a photo of it. I crossed at least 4 lanes of traffic to get a better view which is a skill I am still working on. Many, many indians crossed before I had the nerve to walk out into the traffic. Getting to the other side I realised that the view was no better from there as the trees conceal most of the building, still having risked life and limb I was going to get my photo. Except I wasn't. Next lesson of the day - camera batteries work far more effectively inside the camera rather than inside the hotel.

Back at the hotel I have at least had some good news - neuroscientist Dr Champadi Raman Mukunda, developer of the BEOS system has been in touch again and is still keen to meet!

So lessons for today:
1) Don't let people stick sharp sticks in your ear
2) Turn up to court early
3) Electrical equipment works best with a power source

Admittedly I really should have known these already. I blame the jet lag.