gevent.local.local
objects that have no value in the greenlet. See issue #1275.gevent.local.local subclasses correctly supports
@staticmethod functions. Reported by Brendan Powers in
issue #1266.close_fds argument on 3.7.gevent.queue imports _PySimpleQueue instead of
SimpleQueue so that it doesn’t block the event loop.
gevent.monkey.patch_all() makes this same substitution in
queue. This fixes issues with
concurrent.futures.ThreadPoolExecutor as well. Reported in
issue #1248 by wwqgtxx and issue #1251 by pyld.gevent.socket.socket.connect() doesn’t pass the port (service)
to socket.getaddrinfo() when it resolves an AF_INET or
AF_INET6 address. (The standard library doesn’t either.) This
fixes an issue on Solaris. Reported in issue #1252 by wiggin15.gevent.socket.socket.connect() works with more address
families, notably AF_TIPC, AF_NETLINK, AF_BLUETOOTH, AF_ALG and AF_VSOCK.MonkeyPatchWarning for ssl
imports. Now, we only issue it if we detect the one specific
condition that is known to lead to RecursionError. This may produce
false negatives, but should reduce or eliminate false positives.gevent.pywsgi generates HTTP chunks. This is intended to
reduce network overhead, especially for smaller chunk sizes.gevent.pywsgi.
See pull request #1241.gevent.sleep() updates the loop’s notion of the current time
before sleeping so that sleep duration corresponds more closely to
elapsed (wall clock) time. gevent.Timeout does the same.
Reported by champax and FoP in issue #1227.UnboundLocalError in SSL servers when wrapping a socket
throws an error. Reported in issue #1236 by kochelmonster.gevent.queue.Queue. Reported in
issue #1217 by githrdw.gevent.event.Event. Reported in
issue #1211 by Matias Guijarro.gevent.Greenlet.spawn(), especially under
uwsgi. Reported in issue #1212 by Kunal Gangakhedkar.gevent.os.nb_write() and gevent.os.nb_read() not
always closing the IO event they opened in the event of an
exception. This would be a problem especially for libuv.gevent.local.local subclasses that mix-in ABCs can be instantiated.
Reported in issue #1201 by Bob Jordan.gevent.subprocess.Popen uses /proc/self/fd (on Linux) or
/dev/fd (on BSD, including macOS) to find the file descriptors
to close when close_fds is true. This matches an optimization
added to Python 3 (and backports it to Python 2.7), making process
spawning up to 9 times faster. Also, on Python 3, since Python 3.3
is no longer supported, we can also optimize the case where
close_fds is false (not the default), making process spawning up
to 38 times faster. Initially reported in issue #1172 by Ofer Koren.gevent.wsgi was removed.gevent.util.assert_switches to build on the monitoring
functions. Fixes issue #1182.threading.Event, also
monkey-patch the underlying class, threading._Event. Some code
may be type-checking for that. See issue #1136.name attribute in
their repr.map. See pull request #1153.IMap and
IMapUnordered classes are now compiled with Cython, further
reducing the overhead of [Thread]Pool.imap.gevent.event.Event and gevent.event.AsyncResult
are compiled with Cython for improved performance, as is the
gevent.queue module and gevent.hub.Waiter and certain
time-sensitive parts of the hub itself. Please report any
compatibility issues.python -m gevent.monkey <script> accepts more values for
<script>, including paths to packages or compiled bytecode.
Reported in issue #1157 by Eddie Linder.zope.event if that is installed.gevent.monkey has support for plugins in the form of event
subscribers and setuptools entry points. See pull request #1158 and
issue #1162. setuptools must be installed at runtime for its entry
points to function.gevent.config.track_greenlet_tree (aka
GEVENT_TRACK_GREENLET_TREE) to allow disabling the greenlet tree
features for applications where greenlet spawning is performance
critical. This restores spawning performance to 1.2 levels.GEVENT_MONITOR_THREAD_ENABLE to
use it, and GEVENT_MAX_BLOCKING_TIME to configure the blocking
interval.psutil must be installed to use this. See pull request #1150.dnspython resolver as a lightweight alternative to
c-ares. It is generally faster than c-ares and is supported on PyPy.
c-ares may be deprecated in the future. See pull request #1088 and
issue #1103.gevent.time that can be imported instead of
time, much like gevent.socket can be imported instead
of socket. It contains gevent.sleep. This aids
monkey-patching.gevent.local.local now have the same
(substantially improved) performance characteristics of plain
gevent.local.local itself, making them 2 to 3 times faster than
before. See pull request #1117. If there are any compatibility
problems, please open issues.minimal_ident property. It functions
similarly to Thread.ident or id by uniquely identifying the
greenlet object while it remains alive, and it can be reused after
the greenlet object is dead. It is different in that it is small and
sequential. Based on a proposal from PayPal and comments by Mahmoud
Hashemi and Kurt Rose. See issue #755. As always, feedback is
appreciated.gevent.Greenlet objects now have a gevent.Greenlet.name
attribute that is included in the default repr.gevent.local.local objects associated with
each greenlet in gevent.util.format_run_info.gevent.util.GreenletTree to visualize the greenlet tree. This
is used by gevent.util.format_run_info.gevnt.subprocess.Popen accept the restore_signals
keyword argument on all versions of Python, and on Python 2 have it
default to false. It previously defaulted to true on all versions;
now it only defaults to true on Python 3. The standard library in
Python 2 does not have this argument and its behaviour with regards
to signals is undocumented, but there is code known to rely on
signals not being restored under Python 2. Initial report and patch
in pull request #1063 by Florian Margaine.gevent.subprocess.Popen to accept the keyword
arguments pass_fds and start_new_session under Python 2.
They have always had the same default as Python 3, namely an empty
tuple and false, but now are accessible to Python 2.capture_output argument added to Python 3.7 in
gevent.subprocess.run().gevent.config, allowing for gevent to be configured through code
and not necessarily environment variables, and also provide a
centralized place for documentation. See issue #1090.GEVENT_CORE_CFFI_ONLY environment variable has been
replaced with the pre-existing GEVENT_LOOP environment
variable. That variable may take the values libev-cext,
libev-cffi, or libuv-cffi, (or be a list in preference
order, or be a dotted name; it may also be assigned to an
object in Python code at gevent.config.loop).GEVENTARES_SERVERS environment variable is deprecated in
favor of GEVENT_RESOLVER_SERVERS. See issue #1103.shutdown on a closed socket. It was raising
AttributeError, now it once again raises the correct
socket.error. Reported in issue #1089 by André Cimander.loop
objects referenced the default event loop and one of them was
destroyed and then the other one destroyed or (in the libev C
extension implementation only) deallocated (garbage collected). See
issue #1098.gevent._threading has been
simplified.gevent._socket3._fileobject has
been removed. See issue #1084.destroy()
method. The default loop, when destroyed, can again be requested and
it will regenerate itself. The default loop is the only one that can
receive child events.gevent.socket.socket.sendall() up to ten times faster on
PyPy3, through the same change that was applied in gevent 1.1b3 for PyPy2.gevent.greenlet module is now compiled with Cython to
offset any performance decrease due to issue #755. Please open
issues for any compatibility concerns. See pull request #1115 and pull request #1120.gevent.Greenlet, gevent.local and gevent.lock to be
used when the environment variable PURE_PYTHON is set. This is
not recommended except for debugging and testing. See issue #1118.gevent.select.poll.poll() now interprets a timeout of -1 the
same as a timeout of None as the standard requires. Previously,
on libuv this was interpreted the same as a timeout of 0. In
addition, all timeout values less than zero are interpreted like
None (as they always were under libev). See issue #1127.threading.Event.async functions and classes have been renamed to
async_ due to async becoming a keyword in Python 3.7.
Aliases are still in place for older versions. See issue #1047.gevent.subprocess will have a
filename attribute set.threading.Timer class is now monkey-patched and can
be joined. Previously on Python 3.4 and above, joining a Timer
would hang the process.gevent.ssl.SSLSocket.unwrap() behaves more like the standard
library, including returning a SSLSocket and allowing certain
timeout-related SSL errors to propagate. The added standard
library tests test_ftplib.py now passes.gevent.subprocess.Popen accepts a “path-like object” for
the cwd parameter on all platforms. Previously this only worked
on POSIX platforms under Python 3.6. Now it also works on Windows under
Python 3.6 (as expected) and is backported to all previous versions.make is no longer required and the
Makefile is not used. Neither is an external cython command.
Instead, the cythonize function is used, as recommended by
Cython. (The external commands were never required by source
distributions.) See issue #1076.gevent.local.local is compiled with Cython on CPython.gevent.local.local objects without ever exiting, there
would be a leak of the function objects intended to clean up the
locals after the greenlet exited. Introduce a weak reference to
avoid that. Reported in issue #981 by Heungsub Lee.errno.WSAECONNABORTED on Windows. Initial patch in
pull request #999 by Jan van Valburg.gevent.subprocess.Popen.communicate() returns the correct type
of str (not bytes) in universal newline mode under Python 3, or when
an encoding has been specified. Initial patch in pull request #939 by
William Grzybowski.gevent.subprocess.Popen.communicate() (and in general,
accessing Popen.stdout and Popen.stderr) returns the correct
type of str (bytes) in universal newline mode under Python 2.
Previously it always returned unicode strings. Reported in
issue #1039 by Michal Petrucha.gevent.fileobject.FileObjectPosix returns native strings in
universal newline mode on Python 2. This is consistent with what
FileObjectThread does. See issue #1039.socket.send() now catches EPROTOTYPE on macOS to handle a race
condition during shutdown. Fixed in pull request #1035 by Jay Oster.gevent.socket.create_connection() now properly cleans up open
sockets if connecting or binding raises a BaseException like
KeyboardInterrupt, greenlet.GreenletExit or
gevent.timeout.Timeout. Reported in issue #1044 by
kochelmonster.Pool.add now accepts blocking and timeout parameters,
which function similarly to their counterparts in Semaphore.
See pull request #1032 by Ron Rothman.
Defer adjusting the stdlib’s list of active threads until
threading is monkey patched. Previously this was done when
gevent.threading was imported. That module is documented to
be used as a helper for monkey patching, so this should generally
function the same, but some applications ignore the documentation
and directly import that module anyway.
A positive consequence is that import gevent.threading, threading;
threading.current_thread() will no longer return a DummyThread
before monkey-patching. Another positive consequence is that PyPy
will no longer print a KeyError on exit if
gevent.threading was imported without monkey-patching.
See issue #984.
Specify the Requires-Python metadata for improved installation support in certain tools (setuptools v24.2.1 or newer is required). See issue #995.
Monkey-patching after the ssl module has been imported now
prints a warning because this can produce RecursionError.
gevent.local.local objects are now approximately 3.5 times faster
getting, setting and deleting attributes on PyPy. This involved
implementing more of the attribute protocols directly. Please open
an issue if you have any compatibility problems. See issue #1020.
gevent.local.local is compiled with Cython on CPython. It
was already 5 to 6 times faster due to the work on issue #1020,
and compiling it with Cython makes it another 5 to 6 times faster,
for a total speed up of about 35 times. It is now in the same
ballpark as the native threading.local class. It also uses
one pointer less memory per object, and one pointer less memory per
greenlet. See pull request #1024.
More safely terminate subprocesses on Windows with
gevent.subprocess.Popen.terminate(). Reported in issue #1023
by Giacomo Debidda.
gevent now uses cffi’s “extern ‘Python’” callbacks. These should be faster and more stable. This requires at least cffi 1.4.0. See issue #1049.
gevent now approximately tries to stick to a scheduling interval
when running callbacks, instead of simply running a count of
callbacks. The interval is determined by
gevent.getswitchinterval(). On Python 3, this is the same as
the thread switch interval. On Python 2, this defaults to 0.005s and
can be changed with gevent.setswitchinterval(). This should
result in more fair “scheduling” of greenlets, especially when
gevent.sleep(0) or other busy callbacks are in use. The interval
is checked every 50 callbacks to keep overhead low. See
issue #1072. With thanks to Arcadiy Ivanov and Antonio Cuni.
Add initial experimental support for using libuv as a backend
instead of libev, controlled by setting the environment variable
GEVENT_CORE_CFFI_ONLY=libuv before importing gevent. This
suffers a number of limitations compared to libev, notably:
--no-binary option).gevent.sleep and gevent.Timeout) only
support a resolution of 1ms (in practice, it’s closer to 1.5ms).
Attempting to use something smaller will automatically increase it
to 1ms and issue a warning. Because libuv only supports
millisecond resolution by rounding a higher-precision clock to an
integer number of milliseconds, timers apparently suffer from more
jitter.poll call is
that amount. Note that this is what gevent does for libev on
Windows too.gevent.select.poll or a monkey-patched
selectors.PollSelector.abort() the
entire process instead of reporting an error. For example, closing
a file descriptor it is using in a watcher may cause the entire
process to be exited.asyncore; see test_ftplib.py) and
sometimes sockets not getting closed in a timely fashion
(apparently; see test_httpservers.py) and communicating with
subprocesses (it always hangs). Help tracking those down would be
appreciated. Only PyPy2 is tested.Feedback and pull requests are welcome, especially to address the issues mentioned above.
Other differences include:
The order in which timers and other callbacks are invoked may be different than in libev. In particular, timers and IO callbacks happen in a different order, and timers may easily be off by up to half of the supposed 1ms resolution. See issue #1057.
Starting a timer watcher does not update the loop’s time by
default. This is because, unlike libev, a timer callback can cause
other timer callbacks to be run if they expire because the loop’s
time updated, without cycling the event loop. See issue #1057.
libev has also been changed to follow this behaviour.
Also see issue #1072.
Timers of zero duration do not necessarily cause the event loop to cycle, as they do in libev. Instead, they may be called immediately. If zero duration timers are added from other zero duration timer callbacks, this can lead the loop to appear to hang, as no IO will actually be done.
To mitigate this issue, loop.timer() detects attempts to use
zero duration timers and turns them into a check watcher. check
watchers do not support the again method.
All watchers (e.g., loop.io) and the Timeout class have a
close method that should be called when code is done using the
object (they also function as context managers and a with
statement will automatically close them). gevent does this
internally for sockets, file objects and internal timeouts.
Neglecting to close an object may result in leaking native
resources. To debug this, set the environment variables
GEVENT_DEBUG=debug and PYTHONTRACEMALLOC=n before starting
the process.
The traditional cython-based libev backend will not leak if
close is not called and will not produce warnings. The
CFFI-based libev backend will not currently leak but will produce
warnings. The CFFI-based libuv backend may leak and will produce
warnings.
Again, this is extremely experimental and all of it is subject to change.
See issue #790 for history and more in-depth discussion.
AttributeError or have a negative value when not available. In
general these attributes are not portable or documented and are
not implemented by libuv or the CFFI backend. See issue #1076.gevent_handle_error, and part of
gevent_call) are now implemented in Cython instead of C. This
reduces our reliance on internal undocumented implementation
details of Cython and Python that could change. See pull request #1080.Next page: Changes for gevent 1.2