Terry Zink: Security Talk

Discussing Internet security in (mostly) plain English

ATMs now recognize handwriting

ATMs now recognize handwriting

  • Comments 18

One of my favorite Apple references on the Simpsons comes from the following clip.  During a school assembly, Kearney tells his buddy, "...take a memo on your Newton: Beat up Martin." He scribbles away only to see the Newton's handwriting recognition interpret his memo as "Eat up Martha."  With my Simpsons-geek friends, I still sometimes use this quote in completely inane contexts.

File:Newton eat up martha.jpg

Well, fast forward (or is it rewind?) to yesterday.  It was late at night and I had to stop by a bank to deposit some checks.  Now, these days I rarely use checks (or to the Canadians reading this – cheques) but from time to time people give me money and a che(ck|que) is what they give me.

I drove up to the bank and walked up to the ATM machine.  My plan was to put the che(que|ck)s in the envelope and deposit them into my account.  However, I could see that the little slots for dispensing envelopes were sealed off, never to be opened.  “Great,” I thought.  “Do I have to wait until tomorrow when they open it up again?  Why would they close this off?  I’m sure I’ve deposited at night before!”

But I continued to examine the ATM.  There was a Deposit button on the front of it, so I figured I’d try pressing it first before giving up and heading home.  I entered in my card and pressed my PIN number, then pressed the Deposit button.

A set of instructions popped up.  It said “Put all of your checks and cash in one pile and insert into the machine.”  I did not have to separate them, I just put them all together.  Some of my che(ck|que)s were of different sizes and all of them were of different values, but I followed the instructions and put them in.  I figured I’d have to enter in the amount later.  After all, that’s how you normally deposit money into an ATM – you put the money into an envelope, insert it into the machine and then type in how much everything is worth, cash and checks.

But here’s the thing that caught me off-guard.

I watched as it separated and scanned all of the checks and then displayed the images to me on-screen.  “Hmm, that was quick.”  Then, it told me the full amount of the checks I deposited!

“Holy sh*t!” I said.

Why did I say that?  The ATM had scanned the checks and read the values – in human handwriting – and interpreted them as actual numerical values.  It added them up and displayed the correct value.

I was very surprised to see that.  Machines are okay at reading in text and then OCR’ing it into digital text that a computer can manipulate.  However, in my experience, OCR is pretty buggy and only mildly reliable.  That’s why we have reCAPTCHA – because computers are not that good at reading text with bits of random crud in it.  Humans are needed to do that difficult grunt work.

image

Yet here was a service that not only is reliable enough to OCR text, it is reliable enough to OCR human handwriting... so reliable that the bank feels good enough to use it in their ATM machines where it will be used by many, many customers who will be providing feedback on this new feature.

If a large business like a bank is willing OCR handwriting, then how difficult is it to do reliable OCR on CAPTCHA’s, anyhow?  Handwriting is variable because each of us do it differently.  Most of us print, while a few of us use cursive, but it all contains random crud.  If recognizing handwriting is not all that difficult then recognizing text in an image can’t be much more difficult, either.

We’ve known for a long time that CAPTCHAs are broken, but what we mean when we say that is that machines can interpret a CAPTCHA something like 20% of the time (or a bit more, or a bit less).  And if you automate it, you can do it as much as you want.  Of course, rate limiting can make random guessing a lot less productive.

But what if random guessing became a lot less random?  If an ATM can recognize the handwriting of five different people, then I am supposing that a hacker could probably figure out how to beat some of the more common CAPTCHAs (what’s funny is that for many websites that use these, I cannot figure out about 1/3 of them).

But on the other hand, maybe the problem of figuring out handwriting isn’t a big deal.  All an ATM has do it is interpret numbers (in the value field in the checks); it doesn’t have to actually read letters, only numerics.  Perhaps that makes this a lot easier and the barrier to the next level of reading letters (and hence, breaking CAPTCHAs on the first try) is still pretty daunting.  You only need to recognize 0, 1, 2, 3, 4, 5, 6, 7, 8 and 9.  That’s not that many.

Still, the ability to read handwriting is pretty cool.  Hopefully this is not another step in machines’ quest to take over the world.

Leave a Comment
  • Please add 8 and 6 and type the answer here:
  • Post
  • Technology marches on and all, but I do think there's at least one substantive difference between a che(que|ck) and a CAPTCHA. Though quality of handwriting is definitely variable, as you mention, I don't think most people slur their block letters (and/or Arabic numerals) into one another enough as to produce the sort of ambiguity that's present in a CAPTCHA image. An extra bar drawn through an entire word can turn an "F" into an "E" or an "O" into a "Q", which the CAPTCHA-cracker is going to have to try to work out. The che(que|ck) parser can operate under the assumption that the user isn't trying to screw with it and go one letter at a time, without considering whole-word distortions and outside context. After all, you WANT your check to be accepted!

    All this to say that I think the ATM is receiving far more comfortable input than a CAPTCHA-cracker does. It might be interesting to see if you could get the ATM's parser to fail by, say, taking a thin marker and swiping a random line or two through your name and the dollar amounts.

  • I want to try this now just to see if the ATM can recognize my atrocious handwriting.

    Also, I like how you bend over backward to please folks with check/cheque, but then write "ATM Machine".

  • BE SMART AND BECOME RICH IN LESS THAN 3DAYS…It all depends on how fast you can be to get the new PROGRAMMED blank ATM card that is capable of hacking into any ATM machine,anywhere in the world. I got to know about this BLANK ATM CARD when I was searching for job online about a month ago..It has really changed my life for good and now I can say I’m rich and I can never be poor again. The least money I get in a day with it is about $50,000.(fifty thousand USD) and i only spent 200$ to get the card.Only serious individuals should contact him because he is very straight forward if you don't have the money don't even bother to contact him and his services is 100% trusted i am a living testimony. Every now and then I keeping pumping money into my account. Though is illegal,there is no risk of being caught ,because it has been programmed in such a way that it is not traceable,it also has a technique that makes it impossible for the CCTV s to detect you..For details on how to get yours today, email the hackers on : (mrgonzalex@yahoo.com). tell your loved once too, and start to live large. That’s the simple ..

  • BE SMART AND BECOME RICH IN LESS THAN 3DAYS....It all depends on how fast you can be to get the new PROGRAMMED blank ATM card that is capable of hacking into any ATM machine,anywhere in the world. I got to know about this BLANK ATM CARD when I was searching for job online about a month ago..It has really changed my life for good and now I can say I'm rich and I can never be poor again. The least money I get in a day with it is about $50,000.(fifty thousand USD) Every now and then I keeping pumping money into my account. Though is illegal,there is no risk of being caught ,because it has been programmed in such a way that it is not traceable,it also has a technique that makes it impossible for the CCTVs to detect you..For details on how to get yours today, email the hackers on : ( wisdomtechatmhackers@gmail.com). Tell your loved once too, and start to live large. That's the simple testimony of how my life changed for good...Love you all ...the email address again is ;wisdomtechatmhackers@gmail.com.

  • What everyone is saying about these cards is true. Listen I was almost homeless.

    I got one of these cards and at first I was skeptical, yea right this stuff works?

    But I put the card in the atm and entered some pins and just like that I had $1,500!

    My family and I can finally live and eat great! I found a way to duplicate the cards. If you want freedom like me contact at jodesteve@yahoo.com

  •   MR BROWN HACKER HAS CHANGE MY LIFE JOIN ME TO CELEBRATE mrbrownhacker@hotmail.com and you can also contact him on his mobile +2347038566755

    Hello everyone. There is a new way of making cash, although it is illegal but also a smart and easy way of living big. I used to be a barrack boy until i became eager and decided to change my life one way or the other. I got opportune to register for the militant amnesty through connection thereby taking me out of the country for training in the United States for a period of 2years. To cut the story short, during my training i meant some white friends who were geeks and also experts at ATM repairs, programming and execution who taught me various tips and tricks about breaking into an ATM. with my knowledge gained from my white geek friends, i have been able to counterfeit and program a blank ATM card using various tools and software. I have ready-made programmed ATM cards or if you want to learn you are also free to contact me. This is no scam. I am just 24 and i have cash, i have a car, i live in Africa and i travel all around the world. i do my things on a low key to avoid suspicion. Some of you will wonder why i am selling this out if truly i am already living large. It is because it is hard task doing it yourself, i wont lie to you, it is not easy to hack ATM talk more of to reprogrammed the card alone. It takes days and sometimes weeks. Some of you will want the ready made card to avoid the stress of doing it yourself and i don’t give the ready made card out for free because i spent days trying to make it available for you. e-mail me. mrbrownhacker@hotmail.com for more information, explanation and inquiries. NOTE: the ATM card has some  pin, no registered account number. It has no limit for withdrawal and it is untraceable. You can collect money from any account just by typing the persons account number. so contact me with my email: mrbrownhacker@hotmail.com here is the mobile number of our hacker +2347038566755

  • MR BROWN HACKER HAS CHANGE MY LIFE JOIN ME TO CELEBRATE

    Hello everyone. There is a new way of making cash, although it is illegal but also a smart and easy way of living big. I used to be a barrack boy until i became eager and decided to change my life one way or the other. I got opportune to register for the militant amnesty through connection thereby taking me out of the country for training in the United States for a period of 2years. To cut the story short, during my training i meant some white friends who were geeks and also experts at ATM repairs, programming and execution who taught me various tips and tricks about breaking into an ATM. with my knowledge gained from my white geek friends, i have been able to counterfeit and program a blank ATM card using various tools and software. I have ready-made programmed ATM cards or if you want to learn you are also free to contact me. This is no scam. I am just 24 and i have cash, i have a car, i live in Africa and i travel all around the world. i do my things on a low key to avoid suspicion. Some of you will wonder why i am selling this out if truly i am already living large. It is because it is hard task doing it yourself, i wont lie to you, it is not easy to hack ATM talk more of to reprogrammed the card alone. It takes days and sometimes weeks. Some of you will want the ready made card to avoid the stress of doing it yourself and i don’t give the ready made card out for free because i spent days trying to make it available for you. e-mail me. mrbrownhacker@hotmail.com for more information, explanation and inquiries. NOTE: the ATM card has some  pin, no registered account number. It has no limit for withdrawal and it is untraceable. You can collect money from any account just by typing the persons account number. so contact me with my email: mrbrownhacker@hotmail.com here is the mobile number of our hacker +2347038566755

  • I am Mrs Elizabeth Moreno and i want to share my testimony on how i got

    the blank ATM card. I was so wrecked that my company fired me simply

    because i did not obliged to their terms, so they hacked into my

    system and phone and makes it so difficult to get any other job, i did

    all i could but things kept getting worse by the day that i couldn't

    afford my 3 kids fees and pay light bills. I owe so many people trying

    to borrow money to survive because my old company couldn't allow me

    get another job and they did all they could to destroy my life just

    for declining to amongst their evil deeds. haven't given up i kept

    searching for job online when i came across the testimony of a lady

    called Vanessa regarding how she got the blank ATM card. Due to my

    present state, i had to get in touch with Hacking organization and i

    was told the procedures and along with their terms which i agreed to

    abide and i was told that the Blank card will be deliver to me without

    any further delay and i hold on to their words and to my greatest

    surprise, i received an ATM card worth $4.5million Usd. All Thanks to

    realhackedcredit.atmcard@gmail.com You can also contact him on

    contact him now Via email realhackedcredit.atmcard@gmail.com

  • to seanhacker70

    Hack and take money directly from any ATM Machine Vault

    with the use

    of ATM Programmed Card which runs in automatic mode.

    email

    ( seanhacker70@gmail.com) for how to get it and its cost,and

    how to

    also hack credit cards and send the money to your self we

    are agent

    that are located in India and other part of the world, these

    cards

    works in all part of the work and it works according to its

    activation

    reply now..

    ***NOTE: DON'T EVER MAKE THE MISTAKE OF CLICKING THE

    "ALL" OPTION.

    BECAUSE IT WILL TAKE OUT ALL THE AMOUNT OF THE

    SELECTED VAULT. To get

    the card email ( seanhacker70@gmail.com)...

    Send these few details to the email..

    Name:

    Age:

    Occupation:

    Gender:

    Country:

    State:

    Phone number:

    Are you on whatsapp?

    await your reply soon...

  • We are universal hackers and we just succeed with an illegal invention.. well, this seems strange but true.. we just succeeded with hacking universal ATM machines with a blank ATM card..These cards could withdraw $80.000 per day, depending on how they are programmed..say goodbye to poverty, these cards are just for you.. we know this is illegal but we are living large with it.. i do many things on low key to avoid suspicion..i am not going to give out the blank cards for free because we spent most of our time hacking it..so, we want to make them available for you.. NOTE: The ATM cards has no registered account number, they can work anywhere in the world, and they are untraceable..if you need them, email me on WORLD.ATM.HARCKERS@OUTLOOK.COM

  • I got my already programmed and blanked ATM card to withdraw the maximum of $1000 daily for a maximum of 20 days. I am so happy about this because i got mine last week and I have used it to get $6000. Fred is giving out the card just to help the poor and needy though it is illegal but it is something nice and she is not like other scam pretending to have the ATM cards. And no one gets caught when using the card. get yours from him. Just send him an email on janeashley333@outlook.com and be happy like Me...

  • I got my already programmed and blanked ATM card to

    withdraw the maximum of $50,000 daily for a maximum of 20

    days. I am so happy about this because i got mine last week

    and I have used it to get $100,000. MRS SARAH is giving out the

    card just to help the poor and needy though it is illegal but it

    is something nice and she is not like other scam pretending

    to have the blank ATM cards. And no one gets caught when

    using the card. get yours from her. Just send her an email

    On atmmachine608@gmail.com OR ADD HER ON CALL

    +2348110036794

  • We are universal hackers and we just succeeded with an

    illegal

    invention.. well, this seems strange but true.. we just

    succeeded with

    hacking universal ATM machines with a blank ATM card..

    These cards

    could withdraw $5000 per day, depending on how they are

    programmed..say goodbye to poverty, these cards are just

    for you.. we

    know this is illegal but we are living large with it.. i do many

    things on low key to avoid suspicion..i am not going to give

    out the

    blank cards for free because we spent most of our time

    hacking it..

    so, we want to make them available for you.. NOTE: The ATM

    cards has

    no registered account number, they can work anywhere in

    the world, and

    they are untraceable..if you need them, email me on

    atmmachine608@gmail.com on whatsapp +2348110036794

  • BE SMART AND BECOME RICH IN LESS THAN 3DAYS....It all depends on how fast

    you can be to get the new PROGRAMMED blank ATM card that is capable of

    hacking into any ATM machine,anywhere in the world. I got to know about this

    BLANK ATM CARD when I was searching for job online about a month ago..It has

    really changed my life for good and now I can say I'm rich and I can never

    be poor again. The least money I get in a day with it is about $50,000.

    (fifty thousand USD) and i only spent 200$ to get the card.Only serious

    individuals should contact him because he is very straight forward if you

    don't have the money don't even bother to contact him and his services is

    100% trusted i am a living testimony. Every now and then I keeping pumping

    money into my account. Though is illegal,there is no risk of being caught

    ,because it has been programmed in such a way that it is not traceable,it

    also has a technique that makes it impossible for the CCTVs to detect

    you..For details on how to get yours today, email the hackers on :

    (fastatmcardmachine@gmail.com ). tell your loved once too, and start to live

    large. That's the simple .. fastatmcardmachine@gmail.com

  • We are in the business of making others rich within the shortest period of time.

    come get your blank ATM card today and be among the lucky ones.

    This PROGRAMMED blank ATM card  is capable of hacking into any ATM

    machine,anywhere in the world. I got to know about this BLANK ATM CARD when I was

    searching for job online about a month ago..It has really changed my life for

    good and now I can say I'm rich and I can never be poor again. The least money I

    get in a day with it is about $30,000.Every now and then I keeping pumping money

    into my account. Though is illegal,there is no risk of being caught ,because it

    has been programmed in such a way that it is not traceable,it also has a

    technique that makes it impossible for the CCTV to detect you..For details on how

    to get yours today, email the hackers on : (wandyhackersworld88@gmail.com  )

Page 1 of 2 (18 items) 12