分类: LINUX
2011-12-26 16:24:14
Cache object
The Cache object is used to manage a set of cache files and their associated backend. The backends can be rotated on the fly by specifying an alternate type when used.
Advanced users can add new backends in beaker.backends
class beaker.cache.Cache(namespace, type='memory', expiretime=None, starttime=None, expire=None, **nsargs)Front-end to the containment API implementing a data cache.
Parameters:
Clear all the values from the namespace
get(key, **kw)Retrieve a cached value from the container
get_value(key, **kw)Retrieve a cached value from the container
class beaker.cache.CacheManager(**kwargs)cache(*args, **kwargs)Decorate a function to cache itself with supplied parameters
Parameters:
Example:
# Assuming a cache object is available like: cache = CacheManager(dict_of_config_options) def populate_things(): @cache.cache('mycache', expire=15) def load(search_term, limit, offset): return load_the_data(search_term, limit, offset) return load('rabbits', 20, 0)Note
The function being decorated must only be called with positional arguments.
invalidate(func, *args, **kwargs)Invalidate a cache decorated function
This function only invalidates cache spaces created with the cache decorator.
Parameters:
Example:
# Assuming a cache object is available like: cache = CacheManager(dict_of_config_options) def populate_things(invalidate=False): @cache.cache('mycache', type="file", expire=15) def load(search_term, limit, offset): return load_the_data(search_term, limit, offset) # If the results should be invalidated first if invalidate: cache.invalidate(load, 'mycache', 'rabbits', 20, 0, type="file") return load('rabbits', 20, 0) region(region, *args)Decorate a function to cache itself using a cache region
The region decorator requires arguments if there are more than 2 of the same named function, in the same module. This is because the namespace used for the functions cache is based on the functions name and the module.
Example:
# Assuming a cache object is available like: cache = CacheManager(dict_of_config_options) def populate_things(): @cache.region('short_term', 'some_data') def load(search_term, limit, offset): return load_the_data(search_term, limit, offset) return load('rabbits', 20, 0)Note
The function being decorated must only be called with positional arguments.
region_invalidate(namespace, region, *args)Invalidate a cache region namespace or decorated function
This function only invalidates cache spaces created with the cache_region decorator.
Parameters:
Example:
# Assuming a cache object is available like: cache = CacheManager(dict_of_config_options) def populate_things(invalidate=False): @cache.region('short_term', 'some_data') def load(search_term, limit, offset): return load_the_data(search_term, limit, offset) # If the results should be invalidated first if invalidate: cache.region_invalidate(load, None, 'some_data', 'rabbits', 20, 0) return load('rabbits', 20, 0) ContainerContainer and Namespace classes
beaker.container.ContainerContextalias of
class beaker.container.Containerclass beaker.container.MemoryContainerclass beaker.container.DBMContainerclass beaker.container.NamespaceManager(namespace)Handles dictionary operations and locking for a namespace of values.
The implementation for setting and retrieving the namespace data is handled by subclasses.
NamespaceManager may be used alone, or may be privately accessed by one or more Container objects. Container objects provide per-key services like expiration times and automatic recreation of values.
Multiple NamespaceManagers created with a particular name will all share access to the same underlying datasource and will attempt to synchronize against a common mutex object. The scope of this sharing may be within a single process or across multiple processes, depending on the type of NamespaceManager used.
The NamespaceManager itself is generally threadsafe, except in the case of the DBMNamespaceManager in conjunction with the gdbm dbm implementation.
class beaker.container.MemoryNamespaceManager(namespace, **kwargs)class beaker.container.DBMNamespaceManager(namespace, dbmmodule=None, data_dir=None, dbm_dir=None, lock_dir=None,digest_filenames=True, **kwargs)class beaker.container.FileContainerclass beaker.container.FileNamespaceManager(namespace, data_dir=None, file_dir=None, lock_dir=None, digest_filenames=True,**kwargs)class beaker.container.CreationAbortedErrorDeprecated.
Database class beaker.ext.database.DatabaseNamespaceManager(namespace, url=None, sa_opts=None, optimistic=False,table_name='beaker_cache', data_dir=None, lock_dir=None, **params)class beaker.ext.database.DatabaseContainer Memcached class beaker.ext.memcached.MemcachedNamespaceManager(namespace, url=None, data_dir=None, lock_dir=None, **params)class beaker.ext.memcached.MemcachedContainer Middleware class beaker.middleware.CacheMiddleware(app, config=None, environ_key='beaker.cache', **kwargs)class beaker.middleware.SessionMiddleware(wrap_app, config=None, environ_key='beaker.session', **kwargs) Session class beaker.session.SignedCookie(secret, input=None)Extends python cookie to give digital signature support
class beaker.session.Session(request, id=None, invalidate_corrupt=False, use_cookies=True, type=None, data_dir=None,key='beaker.session.id', timeout=None, cookie_expires=True, cookie_domain=None, secret=None, secure=False,namespace_class=None, **namespace_args)Session object that uses container package for storage.
keyThe name the cookie should be set to. timeoutHow long session data is considered valid. This is used regardless of the cookie being present or not to determine whether session data is still valid. cookie_domainDomain to use for the cookie. secureWhether or not the cookie should only be sent over SSL.class beaker.session.SessionObject(environ, **params)Session proxy/lazy creator
This object proxies access to the actual session object, so that in the case that the session hasn’t been used before, it will be setup. This avoid creating and loading the session from persistent storage unless its actually used during the request.
beaker.session.b64decode(s, altchars=None)Decode a Base64 encoded string.
s is the string to decode. Optional altchars must be a string of at least length 2 (additional characters are ignored) which specifies the alternative alphabet used instead of the ‘+’ and ‘/’ characters.
The decoded string is returned. A TypeError is raised if s were incorrectly padded or if there are non-alphabet characters present in the string.
beaker.session.b64encode(s, altchars=None)Encode a string using Base64.
s is the string to encode. Optional altchars must be a string of at least length 2 (additional characters are ignored) which specifies an alternative alphabet for the ‘+’ and ‘/’ characters. This allows an application to e.g. generate url or filesystem safe Base64 strings.
The encoded string is returned.
SynchronizationSynchronization functions.
File- and mutex-based mutual exclusion synchronizers are provided, as well as a name-based mutex which locks within an application based on a string name.
class beaker.synchronization.NameLock(identifier=None, reentrant=False)a proxy for an RLock object that is stored in a name based registry.
Multiple threads can get a reference to the same RLock based on the name alone, and synchronize operations related to that name.
class beaker.synchronization.SynchronizerImplclass beaker.synchronization.FileSynchronizer(identifier, lock_dir)a synchronizer which locks using flock().
Adapted for Python/multithreads from Apache::Session::Lock::File,
This module does not unlink temporary files, because it interferes with proper locking. This can cause problems on certain systems (Linux) whose file systems (ext2) do not perform well with lots of files in one directory. To prevent this you should use a script to clean out old files from your lock directory.
class beaker.synchronization.ConditionSynchronizer(identifier)a synchronizer using a Condition.
UtilBeaker utilities
class beaker.util.SyncDictAn efficient/threadsafe singleton map algorithm, a.k.a. “get a value based on this key, and create if not found or not valid” paradigm:
exists && isvalid ? get : create
Designed to work with weakref dictionaries to expect items to asynchronously disappear from the dictionary.
Use python 2.3.3 or greater ! a major bug was just fixed in Nov. 2003 that was driving me nuts with garbage collection/weakrefs in this section.
class beaker.util.WeakValuedRegistryclass beaker.util.ThreadLocalstores a value on a per-thread basis
beaker.util.verify_directory(dir)verifies and creates a directory. tries to ignore collisions with other threads and processes.
beaker.util.encoded_path(root, identifiers, extension='.enc', depth=3, digest_filenames=True)Generate a unique file-accessible path from the given list of identifiers starting at the given root directory.
beaker.util.verify_options(opt, types, error)beaker.util.verify_rules(params, ruleset)beaker.util.coerce_session_params(params)beaker.util.coerce_cache_params(params)