CVS log for pvfs2/src/io/job/job-desc-queue.h
	Help

Request diff between arbitrary revisions / Display revisions graphically

remove extents, handle ranges, precreate pools and various other things that aren't needed in their current forms with UUIDs

checkpoint on the uuid road

move PVFS_ds_position to different types when appropriate, pass a flag around instead of using special canary values in the handle. Things will be broken for a while.

Merged in changes from Orange-Branch. There were a number of bugs fixed there since this branch was created.

merge with Orange-Branch

*** empty log message ***

per-dataspace handle type precreate pools implementation

initial merge with Orange-Branch. much will be broken

revert cu-security-branch to before the attempted merge with Orange-Branch

merge from HEAD:

make sure that js_p->actual_size and *out_size_p agree for
job_trove_bstream_read/write_list().  Also remove unused (and not working
properly) read_at() and write_at() functions at the job level.

merged in changes from latest Orange-Branch

merged in changes from summer at LANL

merged Orange with Blue - first merging

Merged changes in Blue branch into Orange branch

Applied Phil's patch that fixes size mismatches between js_p->actual_size and *out_size_p in the job_trove_bstream_{read,write}_list call, and revised pipeline.sm accordingly.

make sure that js_p->actual_size and *out_size_p agree for
job_trove_bstream_read/write_list().  Also remove unused (and not working
properly) read_at() and write_at() functions at the job level.

merging hints/events code into trunk.

reverse merge from HEAD.

reverse merge of changes to HEAD since branch.  Includes small file changes.

Merging small files branch to head.  Includes server side precreation of
data files and file stuffing.

implemented function to iterate through handles contained within precreate
pool.  Not tested yet, but intended for use in fsck and similar tools to
prevent precreated handles from showing up as stranded objects.

add flag field to control trove sync in get_handles() for completeness

hints and events.

dynamic allocation of a large array in job descriptor

change logic controlling pool fill callback path; op id didn't seem to be
reliable for this purpose.  Leaving a bunch of bonus gossip messages in
place for now.

rearchitected get_handles() to make error handling more tenable and make it
possible to implement timeout/cancel.  There is some bug running around in
here that causes the handle_info counting to run amok, though.

deal with one of the easier precreate job error cases

pool refillers wake back up now if the pool gets low

preliminary ability to hand out precreated handles.  Some functionality
still missing:
- no signaling in place yet to wake up refiller
- no ability to place handles yet by server id
- some servers are chewing a lot of CPU on first launch (if more than 2
  servers)

first cut at function to block until precreate pool count gets low.  Mostly
works, except the pool count isn't being intialized properly

first cut at job functionality to fill precreate pools; untested

Added real load statistics for bmi, flow and trove operations.

lock_callback added.

Modified job layer to give hint to event manager.
Added UNECPECTED_DECODE to log first possible hint...

eliminate global src/server include

- applied Nathan's expandtab patch (expandtab-2.patch.gz)

  first referenced at:
  http://www.beowulf-underground.org/pipermail/pvfs2-developers/2004-July/000745.html

Added a new job type: "null" jobs.  These are jobs that complete through the
usual test() or testcontext() mechanism, but don't actually do any work.
They simply pass along the error code that was given at post time.
This is useful for manually triggering state changes in arbitrary client
or server state machines.  It is intended as a building block for concurrent
state machine synchronization (not used yet).

implemented modification of timeout system for flows: rather than use an
absolute timeout for completion of flows, instead check every "timeout_sec"
seconds to see if progress has been made on it.  Will only cancel if
timeout_sec seconds passes with no data being transfered.  Needs testing
before being turned on

first cut at a little api for managing timeout values for posted jobs, needs
thread safety and testing before it can be hooked to anything

added event level instrumentation to most of the job calls, reorganized
definitions for operation types in pvfs2-event.h (make it so that the same
op type defines can be used in multiple api's, get rid of power of two values
for op types), probably need to rethink how (if at all) to mask off individual
operations for analysis

shuffled PVFS_aint in pvfs2-types.h over to job_aint in job.h, hopefully
fixing one of the kernel space type problems

job level hooks for request scheduler timers

updated job code to use thread mgr callbacks for trove when in threaded mode

some minor work towards supporting status_user_tag in the job api, just
checking in so I can switch to looking at something else for a bit...

integrated support for the external thread manager into the job interface,
just for BMI operations.  this is the first step towards allowing one
thread to drive BMI for both the job and flow interface.  No performance
benefit yet, but verifies that this stuff works.  Still need to do flow half.

- implemented job_trove_dspace_verify
- implemented ROOT_CHECK parameter in admin interface
- finished up pvfs2-ping and marked "NEEDS TESTING" in todo file

filled in some of the basic work cycle code for the device interface

clean up of ds_attributes (naming convention)

got rid of PVFS_ds_state type, TROVE_ds_state now defined in terms of
PVFS_error type.

got rid of PVFS_ds_id type, TROVE_op_id is now defined in terms of id generator
type

cleaned up vtag type

Filled in missing bits of true context support at the job level.
Still not using it in any useful manner in higher level code yet.

removed queue searching code from testsome(); it now checks status of
job descriptors directly

added a completion queue lock where one was missing before (whoops);
added a flag to the job descriptor to indicate when it has been
completed

reformatting

added a function that can be used to dump the contents of a job
queue

modified the job interface so that it takes _pointers_ to vtags as
arguments.  Adjusted everywhere that uses these functions to pass
in NULL for now.

implemented job_trove_dspace_getattr(), verified that it appears to
work as one of the steps in an I/O operation

renamed struct unexpected_info to struct BMI_unexpected_info, so that
it is more consistent with the rest of the API

added in job code; added in request processor code where empty
files were accidentally checked in last time