Skip to content
Projects
Groups
Snippets
Help
Loading...
Help
Support
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
C
cython
Project overview
Project overview
Details
Activity
Releases
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Issues
0
Issues
0
List
Boards
Labels
Milestones
Merge Requests
0
Merge Requests
0
Analytics
Analytics
Repository
Value Stream
Wiki
Wiki
Snippets
Snippets
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Create a new issue
Commits
Issue Boards
Open sidebar
Gwenaël Samain
cython
Commits
d1d7d48d
Commit
d1d7d48d
authored
May 31, 2014
by
Stefan Behnel
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
clean up and clarify new pure mode docs
parent
570ff121
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
94 additions
and
74 deletions
+94
-74
docs/src/tutorial/pure.rst
docs/src/tutorial/pure.rst
+94
-74
No files found.
docs/src/tutorial/pure.rst
View file @
d1d7d48d
...
@@ -4,142 +4,161 @@
...
@@ -4,142 +4,161 @@
Pure Python Mode
Pure Python Mode
================
================
Sometimes one may want to speed up Python code without losing the possibility to run
In some cases, it's desirable to speed up Python code without losing the
it with the Python interpreter. While pure Python scripts can be compiled with Cython,
ability to run it with the Python interpreter. While pure Python scripts
it usually results in a 20%-50% speed gain only.
can be compiled with Cython, it usually results only in a speed gain of
about 20%-50%.
To go beyond that, Cython provides language constructs to add static typing
To go beyond that, Cython provides language constructs to add static typing
and cythonic functionalities to a Python module to make it run much faster
and cythonic functionalities to a Python module to make it run much faster
when compiled, while still allowing it to be interpreted.
when compiled, while still allowing it to be interpreted.
This is accomplished either via an augmenting :file:`.pxd` file, or
This is accomplished either via an augmenting :file:`.pxd` file, or
via special functions and decorators available after importing ``cython``.
via special functions and decorators available after importing the magic
``cython`` module.
Although it is not typically recommended over writing straight Cython code
Although it is not typically recommended over writing straight Cython code
to a :file:`.pyx` file, one can have specific reasons to do so -
in a :file:`.pyx` file, there are legitimate reasons to do this - easier
easier testing, collaboration with pure Python developers, etc.
testing, collaboration with pure Python developers, etc. In pure mode, you
In pure mode, you are more or less restricted to code that can be expressed
are more or less restricted to code that can be expressed (or at least
(or at least emulated) in Python, plus static type declarations. Anything
emulated) in Python, plus static type declarations. Anything beyond that
beyond that can only be done in .pyx files with extended language syntax,
can only be done in .pyx files with extended language syntax, because it
because it depends on compilation
.
depends on features of the Cython compiler
.
Augmenting .pxd
Augmenting .pxd
---------------
---------------
Using an augmenting :file:`.pxd` allows to let the original :file:`.py` file
Using an augmenting :file:`.pxd` allows to let the original :file:`.py` file
completely untouched.
On the other hand, one needs to maintain both
completely untouched.
On the other hand, one needs to maintain both the
the :file:`.pxd` and the :file:`.py` in parallel
.
:file:`.pxd` and the :file:`.py` to keep them in sync
.
Note that :file:`.pxd` files are used differently when they come together with
While declarations in a :file:`.pyx` file must correspond exactly with those
:file:`.py` than with :file:`.pyx` files (see :doc:`pxd_files`). Declarations
of a :file:`.pxd` file with the same name (and any contradiction results in
in a :file:`.pyx` must correspond to those of the :file:`.pxd`, whilst
a compile time error, see :doc:`pxd_files`), the untyped definitions in a
declarations in a :file:`.py` file can be overridden/augmented
by the more
:file:`.py` file can be overridden and augmented with static types
by the more
specific ones present in a :file:`.pxd`.
specific ones present in a :file:`.pxd`.
If a :file:`.pxd` file is found with the same name as
a :file:`.py` file,
If a :file:`.pxd` file is found with the same name as
the :file:`.py` file
it will be searched for :keyword:`cdef` classes and :keyword:`cdef`/:keyword:`cpdef`
being compiled, it will be searched for :keyword:`cdef` classes and
functions and methods. It will then convert the corresponding
:keyword:`cdef`/:keyword:`cpdef` functions and methods. The compiler will
classes/functions/methods in the :file:`.py` file to be of the correct type.
then convert the corresponding classes/functions/methods in the :file:`.py`
Thus if one has a file :file:`A.py`::
file to be of the declared type.
Thus if one has a file :file:`A.py`::
def myfunction(x, y=2):
def myfunction(x, y=2):
a = x-y
a = x-y
return a + x * y
return a + x * y
def _helper(a):
return a + 1
class A:
class A:
def __init__(self, b=0):
def __init__(self, b=0):
self.a = 3
self.a = 3
self.b = b
self.b = b
def foo(self, x):
def foo(self, x):
print x +
1.0
print x +
_helper(1.0)
and adds :file:`A.pxd`::
and adds :file:`A.pxd`::
cpdef int myfunction(int x,int y)
cpdef int myfunction(int x, int y)
cdef double _helper(double a)
cdef class A:
cdef class A:
cdef public int a,b
cdef public int a,b
cpdef foo(self, double x)
cpdef foo(self, double x)
then
at compilation time :file:`A.py` would be interpreted a
s::
then
Cython will compile the :file:`A.py` as if it had been written as follow
s::
cpdef int myfunction(int x,int y):
cpdef int myfunction(int x,
int y):
a = x-y
a = x-y
return a + x * y
return a + x * y
cdef double _helper(double a):
return a + 1
cdef class A:
cdef class A:
cdef public int a,b
cdef public int a,b
def __init__(self, b=0):
def __init__(self, b=0):
self.a = 3
self.a = 3
self.b = b
self.b = b
cpdef foo(self, double x):
print x + 1.0
while still letting the possibility of running the Python interpreter
cpdef foo(self, double x):
as before with `python A.py`.
print x + _helper(1.0)
Notice how in order to provide the Python wrappers to the definitions
Notice how in order to provide the Python wrappers to the definitions
in the :file:`.pxd`, that is, to be accessible from Python,
in the :file:`.pxd`, that is, to be accessible from Python,
* function signature declarations must be declared as `cpdef`::
* Python visible function signatures must be declared as `cpdef`::
cpdef int myfunction(int x, int y)
cpdef int myfunction(int x,int y)
* C function signatures of internal functions can be declared as `cdef`::
* function definitions must be declared as `cpdef inline`::
cdef double _helper(double a)
cpdef inline int myfunction(int x,int y):
* `cdef` classes (extension types) are declared as `cdef class`;
pass
* `cdef` classes are declared as `cdef class`;
* `cdef` class attributes must be declared as `cdef public` if read/write
Python access is needed, `cdef readonly` for read-only Python access, or
plain `cdef` for internal C level attributes;
* `cdef` class attributes must be declared as `cdef public`;
* `cdef` class methods must be declared as `cpdef` for Python visible
methods or `cdef` for internal C methods.
* `cdef` class methods must be declared as `cpdef`.
In the example above, the type of the local variable `a` in `myfunction()`
is not fixed and will thus be a Python object. To statically type it, one
can use Cython's ``@cython.locals`` decorator (see :ref:`magic_attributes`,
and :ref:`magic_attributes_pxd`).
Also in the example above, one cannot fix the type of the local variable `a
`
Normal Python (:keyword:`def`) functions cannot be declared in :file:`.pxd
`
used within `myfunction` with such definitions. For that purpose
files. It is therefore currently impossible to override the types of plain
one can use ``cython``'s ``@locals`` decorator (see :ref:`magic_attributes`, and
Python functions in :file:`.pxd` files, e.g. to override types of their local
:ref:`magic_attributes_pxd`)
.
variables. In most cases, declaring them as `cpdef` will work as expected
.
Normal Python (:keyword:`def`) functions cannot be declared in
:file:`.pxd` files, so it is currently impossible to override the types of
Python functions in :file:`.pxd` files if they use ``*args`` or ``**kwargs``
in their signature, for instance.
.. _magic_attributes:
.. _magic_attributes:
Magic Attributes
Magic Attributes
----------------
----------------
Special decorators are available
using the
``cython`` module that can
Special decorators are available
from the magic
``cython`` module that can
be used to add static typing within the Python file, while being ignored
be used to add static typing within the Python file, while being ignored
by the interpreter.
by the interpreter.
This option adds the ``cython`` dependency to the original code, but does
This option adds the ``cython`` module dependency to the original code, but
not require to maintain a supplementary file.
does not require to maintain a supplementary :file:`.pxd` file. Cython
provides a fake version of this module as `Cython.Shadow`, which is available
as `cython.py` when Cython is installed, but can be copied to be used by other
modules when Cython is not installed.
"Compiled" switch
"Compiled" switch
^^^^^^^^^^^^^^^^^
^^^^^^^^^^^^^^^^^
* ``compiled`` is a special variable which is set to ``True`` when the compiler
* ``compiled`` is a special variable which is set to ``True`` when the compiler
runs, and ``False`` in the interpreter. Thus the code::
runs, and ``False`` in the interpreter. Thus, the code
::
if cython.compiled:
if cython.compiled:
print("Yep, I'm compiled.")
print("Yep, I'm compiled.")
else:
else:
print("Just a lowly interpreted script.")
print("Just a lowly interpreted script.")
will behave differently depending on whether or not the code is loaded as a
will behave differently depending on whether or not the code is executed as a
compiled :file:`.so` file or a plain :file:`.py` file.
compiled extension (:file:`.so`/:file:`.pyd`) module or a plain :file:`.py`
file.
Static typing
Static typing
^^^^^^^^^^^^^
^^^^^^^^^^^^^
* ``cython.declare`` declares a typed variable in the current scope, which can be
used in
* ``cython.declare`` declares a typed variable in the current scope, which can be
place of the :samp:`cdef type var [= value]` construct. This has two forms, the
used in place of the :samp:`cdef type var [= value]` construct. This has two forms,
first as an assignment (useful as it creates a declaration in
the first as an assignment (useful as it creates a declaration in interpreted
interpreted
mode as well)::
mode as well)::
x = cython.declare(cython.int) # cdef int x
x = cython.declare(cython.int) # cdef int x
y = cython.declare(cython.double, 0.57721) # cdef double y = 0.57721
y = cython.declare(cython.double, 0.57721) # cdef double y = 0.57721
...
@@ -156,17 +175,14 @@ Static typing
...
@@ -156,17 +175,14 @@ Static typing
self.a = 3
self.a = 3
self.b = b
self.b = b
* ``@cython.locals`` is a decorator that is used to specify the types of local
variables
* ``@cython.locals`` is a decorator that is used to specify the types of local
in the function body (including any or all of the argument type
s)::
variables in the function body (including the argument
s)::
@cython.locals(a=cython.double, b=cython.double, n=cython.p_double)
@cython.locals(a=cython.double, b=cython.double, n=cython.p_double)
def foo(a, b, x, y):
def foo(a, b, x, y):
n = a*b
n = a*b
...
...
It cannot be used to type class constructor attributes. See ``cython.declare``
instead to do so.
* ``@cython.returns(<type>)`` specifies the function's return type.
* ``@cython.returns(<type>)`` specifies the function's return type.
* Starting with Cython 0.21, Python signature annotations can be used to
* Starting with Cython 0.21, Python signature annotations can be used to
...
@@ -189,7 +205,7 @@ as well as their unsigned versions ``uchar``, ``ushort``, ``uint``, ``ulong``,
...
@@ -189,7 +205,7 @@ as well as their unsigned versions ``uchar``, ``ushort``, ``uint``, ``ulong``,
``ulonglong``. The special ``bint`` type is used for C boolean values and
``ulonglong``. The special ``bint`` type is used for C boolean values and
``Py_ssize_t`` for (signed) sizes of Python containers.
``Py_ssize_t`` for (signed) sizes of Python containers.
For each type, there are pointer types ``p_int``, ``pp_int``,
. .
., up to
For each type, there are pointer types ``p_int``, ``pp_int``,
etc
., up to
three levels deep in interpreted mode, and infinitely deep in compiled mode.
three levels deep in interpreted mode, and infinitely deep in compiled mode.
Further pointer types can be constructed with ``cython.pointer(cython.int)``,
Further pointer types can be constructed with ``cython.pointer(cython.int)``,
and arrays as ``cython.int[10]``. A limited attempt is made to emulate these
and arrays as ``cython.int[10]``. A limited attempt is made to emulate these
...
@@ -203,15 +219,16 @@ and ``bint`` respectively. Also, the Python builtin types ``list``, ``dict``,
...
@@ -203,15 +219,16 @@ and ``bint`` respectively. Also, the Python builtin types ``list``, ``dict``,
Extension types and cdef functions
Extension types and cdef functions
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
* ``@cython.cclass`` creates a ``cdef class``.
*
The class decorator
``@cython.cclass`` creates a ``cdef class``.
* ``@cython.cfunc`` creates a :keyword:`cdef` function.
*
The function/method decorator
``@cython.cfunc`` creates a :keyword:`cdef` function.
* ``@cython.ccall`` creates a :keyword:`cpdef` function, i.e. one that Cython code
* ``@cython.ccall`` creates a :keyword:`cpdef` function, i.e. one that Cython code
can call at the C level.
can call at the C level.
* ``@cython.locals`` declares local variables (see above). It can also be used to
* ``@cython.locals`` declares local variables (see above). It can also be used to
declare types for the local variables that are used in the signature.
declare types for arguments, i.e. the local variables that are used in the
signature.
* ``@cython.inline`` is the equivalent of the C ``inline`` modifier.
* ``@cython.inline`` is the equivalent of the C ``inline`` modifier.
...
@@ -223,6 +240,7 @@ Here is an example of a :keyword:`cdef` function::
...
@@ -223,6 +240,7 @@ Here is an example of a :keyword:`cdef` function::
def c_compare(a,b):
def c_compare(a,b):
return a == b
return a == b
Further Cython functions and declarations
Further Cython functions and declarations
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
...
@@ -232,7 +250,9 @@ Further Cython functions and declarations
...
@@ -232,7 +250,9 @@ Further Cython functions and declarations
x_ptr = cython.address(x)
x_ptr = cython.address(x)
* ``sizeof`` emulates the `sizeof` operator. It can take both types and
* ``sizeof`` emulates the `sizeof` operator. It can take both types and
expressions.::
expressions.
::
cython.declare(n=cython.longlong)
cython.declare(n=cython.longlong)
print cython.sizeof(cython.longlong)
print cython.sizeof(cython.longlong)
...
@@ -254,16 +274,17 @@ Further Cython functions and declarations
...
@@ -254,16 +274,17 @@ Further Cython functions and declarations
* ``union`` creates union types with exactly the same syntax as ``struct``.
* ``union`` creates union types with exactly the same syntax as ``struct``.
* ``typedef``
creates a new typ
e::
* ``typedef``
defines a type under a given nam
e::
T = cython.typedef(cython.p_int) # ctypedef int* T
T = cython.typedef(cython.p_int) # ctypedef int* T
.. _magic_attributes_pxd:
.. _magic_attributes_pxd:
Magic Attributes within the .pxd
Magic Attributes within the .pxd
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
The special
Cython
module can also be imported and used within the augmenting
The special
`cython`
module can also be imported and used within the augmenting
:file:`.pxd` file. For example, the following Python file :file:`dostuff.py`::
:file:`.pxd` file. For example, the following Python file :file:`dostuff.py`::
def dostuff(n):
def dostuff(n):
...
@@ -279,6 +300,5 @@ can be augmented with the following :file:`.pxd` file :file:`dostuff.pxd`::
...
@@ -279,6 +300,5 @@ can be augmented with the following :file:`.pxd` file :file:`dostuff.pxd`::
@cython.locals(t = cython.int, i = cython.int)
@cython.locals(t = cython.int, i = cython.int)
cpdef int dostuff(int n)
cpdef int dostuff(int n)
Besides the ``cython.locals`` decorator, the :func:`cython.declare` function can also be
The :func:`cython.declare()` function can be used to specify types for global
used to add types to global variables in the augmenting :file:`.pxd` file.
variables in the augmenting :file:`.pxd` file.
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment