Video handwriting recognition and classification in R

r
classification
neural_network

#1

We are trying to solve an interesting problem. We have video streams (screen casts) of our writings stored in digital format. Some thing like this:

Video_id x_coordinate y_coordinate time_stamp color_code

In total we have some 50 videos from 5 people totaling up to 200 minutes.

We are now trying to build an application in R, which can train itself on these videos and then can classify which instructor is writing during the video for future videos. Here are some of the questions we have:

  • Is R a good choice for this problem? Or should we use Python?
  • If it is, what could be a good strategy to build this classifier?
  • Which algorithms and libraries should we use? Is this something where Neural networks can be applied?

Finally, if any of you are aware of any tutorials which can help us build this application, it would be of immense help.


#2

Dark_knight (Interesting choice of name),
Here are your answers :

If it is, what could be a good strategy to build this classifier?
Kaggle has similar problem on hand writing recognition, which can give you a kick start on this problem. Here is the link “https://www.kaggle.com/c/digit-recognizer”. The problem is not to recognize handwriting but to recognize digits. But the first step for you is to map handwriting to characters. Once you have the actual character, you can then compare handwriting of actual character to handwriting for similar characters across different instructor. This will help you differentiate between the instructor’s hand writing.

Is R a good choice for this problem? Or should we use Python?
My personal preference will be Python for this analysis.

Which algorithms and libraries should we use? Is this something where Neural networks can be applied?
You are right, this is a classic example to use Neural Nets. Neural Nets act as memory which can retain rules to give a particular answer (by over-fitting). This is exactly what you want here. Hence neural network will become a natural choice.

Happy to have a brain storm on this problem in this thread.

Tavish