CVS log for pvfs2/include/pvfs2-mgmt.h
	Help

Request diff between arbitrary revisions / Display revisions graphically

Merged robust security code into Orange-Branch.

added new uid management app under src/apps/admin/pvfs2-get-uid
also included are a server and client side sm and the uid mgmt implementation files

merge with Orange-Branch

client/server builds, much to fix

uuid converstation, PVFS_x_position changes, server/client side first pass done

added IO byte counters for small_io
added IO byte counters for ONLY small_io and ONLY flows
minor format edit
debug fixes to usrint code

Modifications to perf counter system
Minor formatting and documentation edits

fixed pvfs2-fs-dump.

Merged in changes from Orange-Branch. There were a number of bugs fixed there since this branch was created.

merging Orange Branch changes in

initial merge with Orange-Branch. much will be broken

moved security types into main pvfs2-types.h header

merge of B2O-Blue-Sync,HEAD,and latest of Orange.

commiting changes from merge of Orange and Blue into test branch.

merge from HEAD: http://www.pvfs.org/fisheye/changelog/PVFS/?cs=MAIN:pcarns:20090727185444

Timing measurments

Updates and Fixes.

Phase 2 runs without crashing

merged in changes from summer at LANL

Initial commit of parallel fsck code

patches from Dries Kimpe:
- Added check before redefining USE_GNU in pvfs2-server.c
- Made use of endecode_fields_xxx macro's consistent and solved warning
in case they were compiled out.  The macro should be used as a function
call, and thus have a semicolumn at the end.

merging hints/events code into trunk.

reverse merge from HEAD.

reverse merge of changes to HEAD since branch.  Includes small file changes.

Merging small files branch to head.  Includes server side precreation of
data files and file stuffing.

Added flag to mgmt iterate handles function to allow it to request reserved
handle values.  Will be used to get a list of known precreated handle values
so that they can be accounted for in fsck and validate tools.  Untested.

invented the concept of a null capability and implemented it on the server
and the client

Converted mgmt functions to use const credential references.

updated all references in include/, src/client/, src/common/, src/io/,
src/proto/, and src/server/ to use the new PVFS_credential in place of the
old PVFS_credentials. the admin apps in particular need to be updated to use
the new API.

Reverse merged and ported to HEAD.

hints and events.

Sam's prelude and scheduler updates

needs header declaration.

needed header declaration.

adding map_handle function to mgmt interface.

commit of Murali's unifying config file patch.  Also adding a convert script for converting to the new single fs.conf format.

Merge HEAD changes to TAS-branch.

merge of the WALT3 branch to HEAD.  This patch changes the way state actions
are represented as C structures (what statecomp generates).  It also changes
the main state action parameter from a s_op on the server or an sm_p on the client
to a unified smcb pointer (state machine control block) for all state actions (both client and server).  Finally, initial support for concurrent state machines has
been added to allow state actions to be invoked concurrently .. a first step for
server-to-server.

walt3 reverse merge from head includes merges of pw's sm changes (no state declarations), cleanup of state machine code, and other general merging/fixes.

Update migration branch to current CVS version

Synchronization with HEAD

commit Phil's patches for doing pvfs2-validate.  This adds a PVFS_mgmt_get_config call to the management interface (before it was just handled by the internal config code).  This is a building block for doing consistency checking between config files.  The changes also allow the getattr to be done on datafile handles as well as other handle types (all handle types are supported now).

Moved PVFS_[sys|mgmt]_release functions to internal.  Added some prototypes and placeholders for PVFS_*_cancel.

Move notification of metaserver to source datafile server to ensure consistency of requests. Change prototype of mgmt_migrate request.

Merge HEAD into Walt's branch.
Rework new state machines to the new cleanups introduced by Walt.

Modification for migration added, some functions still need to be adapted after moving to a new branch...

PVFS2-hint support + minor changes (verbose request scheduler)

forget to check this in...

Reverse merges from HEAD..

destroy unused client-side admin-mode setting

Argh, removed redundant print-file-mapping, this is already done by
viewdist... some minor bugfixes...

Migration of datafiles between different servers works. Uses msgpairray.sm,
transfers only one datafile between two servers and rewrites metadata.
Todo: Adaption of request scheduler to ensure that migration and write
I/O do not happen concurrently on source dataserver.
Also allow users to specify command line parameter which supresses
transfer of pvfs2-hints.

Added tool which prints file mapping to server aliases. Added
experimental stubs for migration tools. Added kernel tgid to request ID.
Bugfix of PINT_cached_config_get_one_server_str.

Added PVFS-hint, changed tests for pwrite/odirect/transactions/aio dbpf
 support to allow users to explicitly enable or disable the functionality.
In the aio implementation is a bug since somebody else modified it.

Reverse merge from trunk to lockd-branch...

reverse merge of branch

merge sync coalescing branch.

reverse merge of trunk to branch

* [Phil] removed db stat left over from keyval-per-db days
* [Phil] added stranded bstream checking
* [Phil] added comparison function for dspace db
* [Phil] added db cache size and type config options

* [Julian] added tcp send/recv buffer size options

added testsome,wait, and release functions to external interfaces.

fix deadlock bugs in coalescing code.  add proper state machine debugging.

commit of versioning stuff to branch

from trunk

changed variable name

changes from head merge

changes to perfbase benchmarks and addition of perf counter queue fields

Attached patches implements trusted ports and networks similar to
what PVFS1 implemented.
It adds a new <Security> </Security> tag to the fs.conf config file
and parse utilities accordingly. We can edit these later if there
is a strong need.

Within these tags, you have to specify TrustedPorts <Range of ports> and
TrustedNetwork tcp://<network> tcp://<mask>.
I dont know how to support this cleanly on  non tcp/ip bmi
architectures, so currently this only enables it for the bmi_tcp module
alone. (i guess we could do it for bmi_ib module as well but not done
until someone says that is the right thing to do...)

Also adds support for a --trusted argument to the pvfs2-genconfig script
that will prompt for the trusted port ranges and the network address/masks and write it out
to the fs.conf and server.conf file.

Configure now supports a --enable-trusted to enable all these features.
(NOTE that the fs.conf tags (or lack of one) still allow you to not
select these features even if configure was asked to compile with this
option).

this patch also cleans up all the warnings that arises with gcc
(3.4) and --enable-strict build mode.

[pcarns]: add protocol versioning to PVFS2.  Major version changes are
incompatible up or down.  New clients can't talk to old servers, but new
servers can talk to old clients.

fixed lookup failure with new acache code.  Also removed state-machine-fns.h include from client state machines to alleviate unused function warning.

* added event logging for states
* moved state debug code to state-machine so all state start/end
points get debug messages automatically
* added textlog stuff.  This allows us to write the default event
queue out to a text file that can be converted to slog2 later.

significant protocol changes to solve 64-bit alignedness issues

more doxygen work.

doxygen-related checkins.

- convert mgmt call return values from int to PVFS_error types.
  NOTE: the sysint and mgmt interfaces don't use these types extensively
  as they should, but getting the interfaces to export them is important
  (and was an assumption at one point in the kernel at least that
  previously caused an oops on AMD64).

make statfs return load averages from sysinfo()

- moved to fully 64 bit unsigned gossip masks
- setparam mgmt method now takes uint64_t values instead of int64_t
- added object type printing to acache debugging
- fixed bug in shared-state-machine getattr that could allow
  attributes to come out of the acache with incorrect attr
  types/fields
- fixed bug is msgpair setup for create/mkdir/symlink
- gossip mask change to uint64_t and many gossip cleanups
- misc cleanups

- add PVFS_{i}mgmt_create_dirent mgmt calls
- make request sceduler honor the mgmt-remove-* operations even while
  in admin mode by setting the appropriate flag

- added a client/server operation and mgmt method
  (PVFS_mgmt_get_dirdata_handle/PVFS_imgmt_get_dirdata_handle) for
  retrieving the dirdata handle of a specified 'parent' object (if
  any)
- fixed a crash bug (race) in trove that could return an object on
  queue addition that has already been serviced (since we've signaled
  the trove worker thread before returning the id in the first place);
  should not be a problem if we used safe_register for the ids, but
  otherwise not worth it

- added method PVFS_mgmt_setparam_single that allows parameter sets on
  a single server
- added basic support of pvfs2-set-debugmask to have the ability to
  set debugging masks on a single server (not yet a list of servers)
- converted pvfs2-set-debugmask to use getopt_long; updated usage info
- include proper mgmt header file in pvfs2-remove-object.c
- misc cleanups

- some type movement

- move mgmt decls to proper header file

- applied Nathan's expandtab patch (expandtab-2.patch.gz)

  first referenced at:
  http://www.beowulf-underground.org/pipermail/pvfs2-developers/2004-July/000745.html

- implement non-blocking operations for all sysint and mgmt operations
- refactor blocking operations in terms of non-blocking operations
- change all sysint credential arguments to credential references
- memory leaks, bug fixes, cleanups

NOTE: this is a non-blocking first draft, updates are sure to come

Missed one.

All the _all and _list functions now take the details parameter.  Implemented for all cases.  Applications updated.

Modified perf_mon_list to handle detailed error reporting.

Adjusted parameters to statfs_list call as an example of new "details" interface use.

rename PVFS_pinode_reference -> PVFS_object_ref in system interface, a few
related variable name updates

remove spurious yet harmless semicolon

combo PVFS_id_gen_t -> PVFS_BMI_addr_t, formatting, PVFS error code patch.
Ugly.  Sorry if my formatting pisses someone off; at least I'm not using >
80 columns any more :).

Added PVFS_EPARTIAL (for now anyway; would like a little better name!).
Added error_array to PVFS_mgmt_statfs_list(); dropped in NULL placeholder in
all calls to it.
Added allocation of error array in karma/comm.c to hold particular errors.
Note: none of this is actually *used* yet.

- update perf interface to record the number of metadata read and
  metadata write operations completed in trove
- update pvfs2-perf-mon-example program to dump the metadata statistics
  in addition to the i/o statistics
- the metadata ops are tracked differently than the perf statistics in that
  we're not interested in computing bandwidth at a given timestep, but rather
  the total number of ops at a given timestamp.  so instead of resetting the
  number of ops with each recorded rollover, we use the highest recorded value.
  this allows a meaningful value to be returned in timesteps where no activity
  took place

- keep the statfs object the same, even if sysinfo call isn't available

- add configure test for sys/sysinfo.h (should be on all linux machines)
- add memory and uptime information into the (now ill-named) statfs object
- update pvfs2-statfs to display this newly added information

end times reported by perf monitoring hooks need to be an array, one per
server, due to clock skew across servers

management interfaces must pass in a file system to know what encoding to use when talking to the server

pick up encoding header, add encoding rules for simple types

added untested mgmt API hooks for retrieving server event logs

added stubs for server mgmt operation to retrieve event log

filled in request protocol structures for new mgmt function to retrieve
low level dspace information, including encode/decode routines.
- untested
- still need true scheduler support

added a mgmt function to dump the list of datafiles from a pvfs2 file;
modified io-test to make use of it for testing.
- still need to tidy up and fix some error handling, but it works
for normal cases right now

gave setparam the ability to report back the original value of the parameter
for each server, not utilizing anywhere yet

added stubs for mgmt function to iterate through handles

apply admin mode globally, not per fs_id

added flags to request protocol to allow requests that modify the file
system to proceed when servers are in admin mode

added some simple handle statistics to statfs API- always hardcoded to 0
for now

data now makes it all the way to the client (in theory), still no
locking to protect data, and not verifying on client yet

stubbing in more components of the perf monitoring framework

started implementing server request that will retrieve performance
statistics using a mgmt operation

a bunch of mgmt interface cleanups- pretty much done now, and tools are
updated; will be ripping out some old code later

turned mgmt_setparam_all into a simple function that operates on top
of mgmt_setparam_list, which operates on an explicit list of servers
(given as an array of opaque addresses)

bug fixes, reimplemented server counting functionality

added some stuff to mgmt interface- this is somewhat of a hack to get
to list of servers from config file for pvfs2-ping purposes.  Need this
to clean up some even worse hacks in pvfs2-ping that I don't want
replicated in other utils...

increased the amount of information that can be retrieved with the
mgmt statfs function, can now determine server address and type

reorganized some code for accessing list of physical servers for a given
file system (will be used in multiple places soon), added mgmt interface hook
to get number of servers, added prototypes for statfs function and mgmt statfs
function (that returns array of stats from all servers), not implemented yet

started work on a mgmt function that can send a noop to an arbitrary
server for diagnostic purposes

put a few pieces in place for mgmt_setparam operation, hopefully located
strategically so as not to conflict on merge with the flush...

put in stubs for our first prototype management function; this one will
set a runtime parameter on all active servers for a given file system