CVS log for pvfs2/src/io/job/job-desc-queue.c
	Help

Request diff between arbitrary revisions / Display revisions graphically

merge with Orange-Branch

remove extents, handle ranges, precreate pools and various other things that aren't needed in their current forms with UUIDs

Committed Windows client code to Orange-Branch.

Porting flow etc.

merged in changes from summer at LANL

merging hints/events code into trunk.

reverse merge from HEAD.

reverse merge of changes to HEAD since branch.  Includes small file changes.

Merging small files branch to head.  Includes server side precreation of
data files and file stuffing.

Reverse merged and ported to HEAD.

hints and events.

first cut at job functionality to fill precreate pools; untested

more fixes related to id_gen_fast/safe

Replace id_gen_safe with id_gen_fast.  id_gen_safe is only needed for ids that are getting handed back to us through the system interfaces.  If our own internal ids (pointers) are getting corrupted or freed...Hello valgrind!

Added real load statistics for bmi, flow and trove operations.

revert style changes back to previous versions.

run maint/pvfs2indent-80col.sh on all .c files to correct style :)

updates to my event changes to bring them inline with trunk

The last of phil's feb 2005 insure++ fixes.  "locking was added to the job-desc
queue at some point, but I found a couple of problems: each new queue
construction destroyed a global (rather than per queue) lock, some functions
were unprotected, and some functions were protected in duplicate at the job
layer.  To fix, I removed these locks from the job-desc-queue and expanded the
locking at the job layer a bit to make sure that every queue access is
protected by an external mutex."

one of phil's insure patches: "prevents job desc queue from counting on value
of previously free'd pointer when iterating queue at one point"

- fixed possible flow mutex memory leak (ptr set to null before free
  check was done)
- try to keep the existing mutex (if any) throughout the flow_reset
- make pass over kernel code making sure that out link counts are
  correct again
- fixed directory inode mtime and ctime changes on updates
- misc cleanups

- applied Nathan's expandtab patch (expandtab-2.patch.gz)

  first referenced at:
  http://www.beowulf-underground.org/pipermail/pvfs2-developers/2004-July/000745.html

Added a new job type: "null" jobs.  These are jobs that complete through the
usual test() or testcontext() mechanism, but don't actually do any work.
They simply pass along the error code that was given at post time.
This is useful for manually triggering state changes in arbitrary client
or server state machines.  It is intended as a building block for concurrent
state machine synchronization (not used yet).

- merging in the pvfs2-nm-nb-branch with the main tree
  see ChangeLog for details, or browse the cvs history of the branch
  for full details

NOTE THAT THIS IS A BRANCH COMMIT (tagged as nm-nb-branch).  Feel free
to ignore it completey as it's a snapshot of a work in progress and it
will crash your computer and reformat your hard drive.

This is almost the initial draft of the pvfs2-client-core that
operates in a non-blocking manner.  While it runs, there are still
issues that need to be resolved (that are keeping it out of the main
CVS trunk).  Many other changes were made along the way, so it's more
than just that.

- added compile time option for disabling thread-safety in the client
  library (enabled by default; --disable-thread-safety to disable)
- improved configure summary information emitted at configure time
- added missing non-blocking sysint declarations to sysint header
- re-wrote pvfs2-client-core to use sysint non-blocking operations
  where possible
- made sysint test and testsome() calls more useable from a user point
  of view
- merged dev unexp polling/handling with system interface
- added PINT_sys_dev_unexp call that allows posting unexpected device
  messages so that they can be returned from the sysint testsome
  method in addition to completed sysint operations
- many memory leaks fixed -- many more to go (started adding macros
  for freeing the server response objects)
- added a id_gen_fast_unregister macro that is a no op, to make the
  api more consistent with the id_gen_safe_* calls
- server-config-mgr: report mutex still in use if it is, but also make
  sure not to unlock an already unlocked mutex (valgrind complains)
- many assertions added
- many formatting changes
- many ptr assignments to NULL after freeing in the job interface;
  done while tracking down a problem
- modified the pint-dev device interface to make sure it can handle
  the pvfs2 device in a non-blocking manner
- pint-dev was using buffers larger than it needed across the device;
  fixed them to be the right size
- added a method to free the memory region mapped into the kernel
  through the device
- freed that mapped memory region on pvfs2-client-core shutdown
  (valgrind complained)
- modified device driver to work properly in non-blocking mode from
  userspace by implementing the character device poll method
- modified pint-dev test function to properly handle non-blocking
  responses from the device driver
- modified PINT_flow_reset to not allocate a new mutex unless the old
  one was destroyed
- modified all job uses of the id-generator to use the safe, rather
  than fast, methods (useful for several reasons including safe
  cancellation)
- modified cancellation methods to be able to handle ops that have
  already completed
- modified the job_dev_unexp method to have (and honor) the no
  immediate completion flag if passed (used in the pvfs2-client-core)
- modified the job completion callbacks to make sure to NOT add a
  completed job desc to the completion queue if it's already been
  added (by checking a flag, not scanning).  this is a safety and
  should only be used when a non-thread-safe client library is being
  used in a thread safe env, but we should handle it gracefully anyway
- replaced all kernel allocations of ops through the slab allocator
  handled op_cache to be replaced by a wrapper method (op_alloc(), as
  suggested by Murali) -- the other cache allocations will probably be
  replaced later.  this allows the removal of the extern op_cache
  declaration
- added macros for freeing some of the most heavily used server
  response messages (readdir, lookup, getattr) -- the others are
  coming later
- freed dirents coming out of sysint response object in the
  pvfs2-client

- don't allow anything to be posted to a job_desc_q that's already
  been torn down

job level hooks for request scheduler timers

added asserts in some places where i've hit null pointers

Renamed id_gen_t to PVFS_id_gen_t and moved it definition into pvfs2-types.h.
Also took the #include for id-generator.h out of header files and into .c
files where possible.

filled in some of the basic work cycle code for the device interface

removed queue searching code from testsome(); it now checks status of
job descriptors directly

reformatting

added more output to job queue dump function

added a function that can be used to dump the contents of a job
queue

added in job code; added in request processor code where empty
files were accidentally checked in last time