Author Archives: Daragh O Brien

About Daragh O Brien

Daragh O Brien is the Managing Director of Castlebridge Associates. This site has been one of his side projects for a decade. It needs some love and attention...

Irish Times Blogger says it better than we can… A Trainwreck Compendium

The Irish Times is one of the leading daily newspapers in Ireland. It was also one of the first with a website (www.ireland.com) in the 1990s and has taken the courageous step (in the face of Irish libel laws) of letting selected columnists write blogs as extensions of their regular print columns.

One of my personal favourites is Shane Hegarty. Shane recently blogged about various scandals of lost or misplaced personal information including the debacle of the UK’s Revenue service sticking 25 million person records on 2 cds and promptly losing them in the post. As he is a professional journalist, the piece is well written and informative so we thought we’d share it with you as a Trainwreck Compendium.

Here’s the link to Shane Hegarty’s article, which also appeared in print in the Irish Times.

I shot the Sheriff (but I didn’t update the warrants database)

The headline doesn’t scan as well as the original Bob Marley lyric, but that jarring dischord is nothing compared to the problems with the PNC (Police National Computer) in the UK.

A review is underway of the processes used to update the PNC database across the UK covering the “national process and practice for withdrawing warrants, involving courts, the police, and the crown prosecution service”. The review is also extending into Magistrate Courts (lower level ‘district’ courts in England and Wales) due to “differing practices” which may require procedures to be clarified.

At the heart of the issue is the withdrawal of warrants for thousands of defendants who never turned up for their court dates and have escaped justice because no warrants were issued for their arrest, no police pursued them and their ‘failure to appear’ wasn’t logged on the PNC. The power to withdraw a warrant rests (or should rest) with judges only…

Regular visitors to this site will recall the IQ Trainwreck that emerged about the DNA database in the UK a while ago… oh dear.

Another error from a wunch of bankers…

The Register has this interesting story… a man in Georgia USA received a letter from his bank shortly after he closed his account with them. He believed he had cleared any outstanding charges so was a little bit surprised when he received a letter from the bank insisting he owed them $211 trillion dollars. This is just over 23 times the national debt of the United States (as at 4th Dec 2007).

The letter received by the unfortunate man also informed him that the information regarding his debt would be passed to a credit scoring agency. As this is apparently an automated process the ex-account holder has resigned himself to it appearing on his credit report at some point in the future.

The bank has apologised and has assured the recipient that his details have not been passed on. The bank’s stated root cause for this error was a “word processing error” (how quaint, they seem to still write each individual letter by hand. No mail merge?) and that this was an isolated case.

There is no information whether the poor recipient of this letter has considered suing the bank for the shock and awe that their letter may have caused, or the potential damage to his credit rating if the bank bungles the fix of their bungling.

At $211 trillion dollars this counts as a trainwreck, and is the counterbalance to the story we had a while ago about the Australian man and his uncontrolled overdraft.

ahem… Information Quality problem with the trains…

http://www.theregister.co.uk/2007/11/13/eurostar_glitch/

Again culled from el Reg, here’s an example of an information quality problem that prevents a process (a very trivial process) from being completed.

It seems that the on-line booking system for the EuroStar train linking the UK with Europe doesn’t recognise the existence of the 29th of February 2008. As the leap year day is the day when women can traditionally propose to their partners (as opposed to dropping less and less subtle hints about the need for a big diamond on their finger which happens the other 3 years out of 4) this might pose a problem for some.

Why is this an IQ Trainwreck?…

  • Well, it involves trains so it is just too easy an association to make.
  • A process has been (apologies for this one) derailed by poor quality information (or master data or a poorly designed/implemented data quality check)
  • The comments from the readers of the post sum up the likely responses of people encountering the problem..
    • This is a trivial bug, if that’s how careless they are do I really want to travel by train?
    • They obviously don’t want my business, I’ll fly instead
    • Good grief…. how embarassing for them.

Apparently the Eurostar site isn’t the only one to have this issue… but it is the one that makes the best IQ Trainwreck.

We all know toddlers are terrors…

… but this story (again culled from The Register.co.uk) shows the lengths the US government goes to to stop these known terrors from getting on planes via the Terrorist Screening lists maintained by the Dept Homeland Security.

“USA Today tells the story of a Disney World-loving 6-year-old who shares a name with someone on the “additional screening” list. Little John Anderson hasn’t made it onto the cleared list because his mum finds the TRIP web site confusing.”

So Little Johnny Anderson can’t fly to Disney World without having to prove he isn’t a terrorist. Hard to do for a tired and pissed off six year old, as any parent will tell you. I can only imagine how they explain it to him:

Mommy Anderson: Now Johnny, the nice TSA man only wants to make sure you won’t try to fly a plane into the Magic Kingdom and kill Goofy

L’il Johnny: Whhaaaaaahhhhhh…. iwannagoseegoofynmickeynminniendonalducknowmommy…whahhhh (Johnny kicks TSA agent… join us next week for L’il Johnny goes to Cuba).

Processes are in place for people to get themselves taken of the list via a website… but Johnny’s mother finds the website confusing. Having looked at the site it doesn’t seem to have any clear process entry point for “The US Government thinks (correctly) my child is a terrorist but good God I can keep them under control, please let us go to Disney”. It would seem that Mommy Anderson might need to get L’il Johnny to fill out a form to allow her to make a complaint on his behalf. He’s six. He may not understand that words like pursuant, perjury or that if he lies on the form he could to prison until he is ELEVEN!!

So the process to correct errors in the information is not customer focussed. Mommy Anderson and L’il Johnny just have to put up with his being on a watch list because the process to correct the list isn’t friendly to the information consumer/creator.

L’il Johnny isn’t alone. The Register points out that he shares his story with Javaid Iqbal, a seven year old British boy who was stopped repeatedly at US airports when on holiday in Florida (which if you are seven years old translates as Disneyland). He shared his name with someone who had been deported from the US. His name was shared, not his age. L’il Javaid’s passport is now stamped that he underwent high level security checks, pretty much condemning him to a life of Eurostar trips to EuroDisney from now on. Imagine if his name had been Lee Harvey Oswald.

These are the easy funny stories that highlight weaknesses in the quality of information and processes in this important function of the US Dept of Homeland Security. A less funny story is that

  1. There is some confusion about how big these lists are… a government report says 7555000, but a spokesman for the TSA says that he thinks it is less than half that
  2. 97% of people who have managed to get through the process that Mommy Anderson finds confusing are simply namesakes of people on the lists.
  3. Less than half of the requests to be taken off the lists (to correct inaccuracy in information and improve quality) have been processed since the facility went ‘live’ in February.  41% are “still being discussed” or are awaiting further documentation to prove the claims of the people who complained.

Why is this an IQTrainwreck?

  1. The level of inaccuracy in the information causes disruption to people… L’il Johnny or L’il Javaid won’t understand what is going on. And in Javaid’s case it may actually affect his ability to re-enter the US (or other countries) in later life.
  2. There appears to be a lack of consolidated governance and control… not being able to answer “how many names are on the lists” and get a consistent response is like asking a company how many customers are in their CRM systems and getting mixed responses….( ohhh – bad example).
  3. The processes for correcting information are not ‘customer friendly’ and don’t seem to cater for the existence of children with names who might be too young to understand the processes or even the forms. The fact that parents find the process difficult to navigate suggests there is scope for improvement.

In any other context I’d be in favour of any measure that keeps screaming children off planes, particularly long flights (by which I mean any flight that lasts longer than 6 minutes).

However, I am reminded in these cases of why my father (a civil servant in the Irish Republic and, at the time, a senior trade unionist) used to hate going on trips to the North of Ireland.  Every so often some British Army squaddie or RUC officer would take him out of the car or off the bus for questioning because:

  • He had glasses
  • He had a beard
  • He wasn’t speaking with an English accent
  • therefore he must be Gerry Adams, leader of Sinn Fein and his id papers must be faked.

My parents had a hard time explaining that to the snotty-nosed crying kids in the back seat…

What’s in a number?

From the ever vigilant The Register comes a story of a man who was detained by authorities for 50 days due to an error on the part of his ISP in identifying who had used a particular IP address to upload satirical images of a revered Indian (as in sub-continent, not Native American) leader of the 17th Century.

Details of the story can be found here

This is, to my mind, an IQ trainwreck as it caused a man to be deprived of his liberty for 50 days.

Also, the exact same information from ISPs is being used by law enforcement and Recording Rights groups to find terrorists and filesharers, so problems with the accuracy of the information will lead to wasted law enforcement efforts (terrorism) or defamation (Recording Rights groups accusing you of downloading when you didn’t).

Once the legal system becomes an ‘information consumer’ for this type of data then the standard of care and expectation of quality and accuracy must increase.

Poor quality information on the poor quality management of the data… (if you understand recursion…)

The IT Compliance Institute has reported that the number of affected customer credit card records that were nabbed in the TJX (TKMAXX) Data Breach a while back is actually double the amount originally thought.

Quoting from their coverage…

“Recently filed court documents indicate that the scale of the TJX data breach was essentially double what was originally announced, involving 94 million accounts rather than 45.6 million.

The new number surfaced in court documents filed by a group of banks that are suing the retailer over the incident, and are trying to have the matter certified as a class action suit.

The documents cited figures from the card companies rather than from TJX, indicated that 65 million Visa and 29 million MasterCard accounts were exposed.”

Ho hum.

Why is this a trainwreck?  Why don’t you tell us (we already know).

Nuclear warheads go AWOL on a B-52

Various media (see below for links) have reported the story of the Advanced Cruise Missiles (ACMs) that were flown from a base in North Dakota to a base in Louisiana, apparently by accident, and sat relatively unguarded at both bases for a number of hours before the error was noticed. The flight was supposed to have taken non-nuclear ACMs on the journey to Louisiana to be decommissioned.

The root cause: An Airforce investigation uncovered that the ground crews who loaded the planes had abandoned the formal process for managing the loading and unloading of missiles in favour of their own ‘informal’ system. The Chairwoman of the House Armed Services Strategic Forces sub-committee was quoted as saying:

“These are not just rules that people dreamed up … just so they could check off the boxes,” she said. “This is fundamentally important to the security of the country and the world.”

The coverage from boston.com gives some detail on the various process checks that appear to have been missed or skipped.

The impact:

The potential impact in terms of the risk of nuclear material being stolen or the risk of nuclear contamination if the planes had crashed (the warheads would not have exploded) were thankfully avoided in this case.

However, the impacts have been severe on the careers of those involved. According to the AP Wire service (via AOL), four officers have been relieved of their commands, 65 Airmen have been de-certified from handling nuclear materials and the entire 5th Bomb Wing has been “de-certified from its wartime mission”. Which apparently was not to misplace nukes. Some media services report that the Airforce is planning to fire some of those involved.

Perhaps worryingly the original count of missiles that arrived in Louisiana was put at five and then later upgraded to six.

A conspiracy theorist’s dreamscape if ever we saw one.

http://www.timesonline.co.uk/tol/news/world/us_and_americas/article2396127.ece

http://www.telegraph.co.uk/news/main.jhtml?xml=/news/2007/10/21/wnuke121.xml

http://www.boston.com/news/nation/articles/2007/10/20/4_colonels_relieved_of_command_over_nuclear_armed_flight/

oops Amazon did it again…

Also from “The Register”, it appears that Amazon have again created ‘interesting’ relationships in their data that have had uncomfortable results for their customers.

We previously reported on the IQ trainwreck that occured when Amazon sent email recommendations for sex toys to people who’d never bought such items from Amazon. Today they seem to have gone one better with a search for “Spiderman Watch” on Amazon.co.uk returning a quite prominent sex toy.

The Register posted their story at 15:03 GMT+1 today, and at 16:14 this correspondent found the same item, this time TOP of the search results.

I’ve uploaded a screen grab of my search results and clicking here will bring you to my search string… rather than risk offending readers the screen grabs are linked to rather than displayed as thumbnails.

Spiderman Watch Search Result (Image not presented for fear of offending)

As Amazon uses linkages within its data to present recommendations, purely in the interests of research I followed a few links on the product page for the unexpected result to see what might have lead to the association being created.

Under the product detail for the sex toy Amazon proudly lists that customers who bought items like this also bought “Spiderman – The Animated Series” and a number of innocent children’s toys.

The sex toy and a number of others of similar kind (which revealed themselves when I clicked on the producer name) appear to be categorised “Toys and Games” in the Amazon database… which means that they may (indeed WILL) appear in other searches. For example, if you search for “Rabbit” under the “Toys and Games” category, look what appears in the “New Arrivals” section on the left hand side

Link to Screenshot of Search results for ‘Rabbit’ in ‘Toys and Games on Amazon’.

Further investigation indicates that the root cause here is the nature of the classification and tagging of these particular ‘toys’ in the Amazon database… searching for “Rabbit” under “Toys & Games/Dolls & Accessories” produces an interesting result on the first page… Example of classification/metadata issue

Why is this an IQ Trainwreck?

  1. Reputational Damage – The fact that the item is returned in a search for a children’s product is damaging to Amazon’s reputation as a retailer. As the story has appeared on The Register, it is possible that a ‘slow news day’ will result in it appearing in local nor national press in the UK (and it has been mentioned here).
  2. Derived from information – Amazon search results are returned from Amazon’s database… somewhere in the database a relationship has been created between the term ‘spiderman watch’ and this particular sex toy. This may have happened by accident or through malicious intent on the part of an individual. However the fact that it can happen suggests a lack of control over the information (should it be ‘consistent’ for a search for a children’s watch to return a sex toy? What controls might Amazon consider to improve the quality of their searches and prevent possibly inappropriate content from being shown to children?)
  3. Information is of poor quality – it fails to meet or exceed expectations.

Personally, I wouldn’t want to have to explain to any kids what those particular toys were for.

I am reminded of a story I heard about a particular court case in Ireland a few years ago where a children’s party hire shop sued a classified directory enquiries provider for listing them in the Adult party hire section of the directory….

It’s not only Amazon who have pricing trainwrecks…

Courtesy of the correspondents over at TheRegister.co.uk, we have the story of Woolworths.co.uk who advertised a childrens book for a somewhat astronomical price.. stg£99 million (and 99p) and then charged £2.74 delivery as well…

http://www.theregister.co.uk/2007/01/16/rather_expensive_book/

This is the counter-weight to Amazon’s underpriced TV issues mentioned here previously.

The error is now fixed on the Woolworths site…