Memory allocation Error in R (Text Mining)

textmining
memory_allocation
r

#1

HI All ,

Receiving memory allocation error in R while doing Text mining and converting a DTM into matrix(100,000x 3000) , so i just want to know if there is a way to avoid this memory error and is python efficient to handle more data than R in similar scenario.


#2

Python may be able to but sounds to me like hardware issue. Can you share system details?


#3

Hardware is good but the concern is that when i apply a function (UDF) as Document. Term. Matrix (100000x3400) which becomes pretty memory intensive, so. Gives error.

Is there a way to avoid such high computational memory usage?

I am. Using I7 with 16 gigs of ram.

Heard from. People that R uses Ram to store objects but. Python stores objects in hard drive hence is more efficient and can handle more data then R?
Is it true?