Python list (in Cython) vs. NumPy

Taking my previous benchmark a little further I decided to see how well iterating over a Python list of doubles compares with using NumPy arrays. Here is an extremely simple example that implements the sum function in Cython and compares the result with NumPy's sum method.

Here is the Cython code:

# --- csum.pyx ---
def csum(list array):
  cdef int i, N=len(array)
  cdef double x, s=0.0
  for i in range(N):
      x = array[i]
      s += x
  return s

Here is a setup.py to build it:

# --- setup.py ---
from distutils.core import setup
from distutils.extension import Extension
from Cython.Distutils import build_ext
setup(cmdclass={'build_ext': build_ext},
    ext_modules = [Extension("csum", ["csum.pyx"])])

To time it in IPython I created a simple file called test.ipy like so:

# --- test.ipy ---
import csum
import numpy
for i in [10, 100, 1000, 10000, 100000, 1000000, 10000000, 100000000, 250000000]:
  print '-'*80
  print 'N =', i
  a = numpy.linspace(0, 1, i)
  b = a.tolist()
  print "Cython:",
  %timeit csum.csum(b)
  print "NumPy:",
  %timeit a.sum()

I run it using IPython and here are the results (formatted a little):

N         Cython       NumPy
10          534 ns       10.1 micros
100         1.76 micros  10.8 micros
1000        15.3 micros  19.3
10000       150 micros   101 micros
100000      1.75 ms      933 micros
1000000     19.7 ms       9.24 ms
10000000    198 ms        92.1 ms
25000000    499 ms       231 ms

This was done on a P4 3 Ghz machine and clearly lists do quite well. At small sizes they outperform NumPy and at really large sizes they are about twice as slow. This is very good considering how general lists are.