MemoryError for creating a new numpy array

nanddeep · May 7, 2018, 1:10pm

Hi,

I was trying the Keras CNN Stater Code on Ubuntu 16.04, from the below link:

shubham3121/DL-3/blob/master/DL#3_EDA.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Importing libraries"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "import numpy as np\n",
    "import pandas as pd\n",
    "import seaborn as sns\n",

This file has been truncated. show original

I get “MemoryError:” for
X_train = np.array(train_img, np.float32) / 255.

Any idea, what should I be doing?

jalFaizy · May 8, 2018, 7:53am

Hey @nanddeep,

It would be difficult to suggest anything without proper clarification on the following -

What is the size of the data you are working on? It is big data, i.e. can traditional systems handle that kind of data?
What are the specifications of the system you are currently working on? How much RAM does it have?
Are you running the python process in a standalone way or are there other process/softwares which are running alongside it - such as firefox, media player etc?