MemoryError: Out of Memory

Why This Happens

MemoryError occurs when Python cannot allocate memory. Common causes include reading huge files into memory, creating extremely large lists, or multiplying large sequences.

The Problem

with open('huge_file.csv') as f:
    data = f.readlines()

The Fix

with open('huge_file.csv') as f:
    for line in f:
        process(line)

# Or with pandas chunks:
import pandas as pd
for chunk in pd.read_csv('huge_file.csv', chunksize=10000):
    process(chunk)

Step-by-Step Fix

1. 1

   Use generators

   Replace lists with generators to process lazily.

2. 2

   Process in chunks

   Read files in chunks.

3. 3

   Use memory-efficient types

   Use numpy arrays instead of lists for numeric data.