Error while performing Natural Language Processing using R


#1

Hello Everyone,

I am working on 0.5 million text sentences, I am working on POS tagging , Chunking and keyword extraction using R. I am trying to use Annotate function and i am getting the below error.Can someone please help me on this

POSAnnotation <- annotate(y1, Maxent_POS_Tag_Annotator(), wordAnnotation)
Error: cannot allocate vector of size 55.5 Gb


#2

R for NLP is not recommended,
Your error says it can create a temporary vector of all your text combinations in R due to limitation of your machine RAM .

SO it is advisable to run it on a very high end machine rather than your desktop or laptop


#3

this might help you