CVS log for pvfs2/src/proto/endecode-funcs.h
	Help

Request diff between arbitrary revisions / Display revisions graphically

Merged robust security code into Orange-Branch.

merge with Orange-Branch

Committed Windows client code to Orange-Branch.

changes to PVFS_handle_X

merge with Orange-Branch

formatting changes

Porting client

Porting client

Porting flow etc.

Merged in changes from Orange-Branch. There were a number of bugs fixed there since this branch was created.

merging Orange Branch changes in

initial merge with Orange-Branch. much will be broken

merge of B2O-Blue-Sync,HEAD,and latest of Orange.

commiting changes from merge of Orange and Blue into test branch.

checkpoint

Timing measurments

fix off-by-4 issue in the valgrind ifdef of encode-string

Undo accidental commit to MAIN.  Reverted each file to pre-commit version.

remove debugging cruft

Merge with work from this summer.  Metadata and data storage spaces can now be located on different disks.  Fixed a small bug in string encoding.  Updated test code to reflect new Trove dual-storage space API.  Genconfig updated as well as affected admin apps.

merged in changes from summer at LANL

Initial commit of parallel fsck code

Merge range query changes and other fixes

fixed a nasty little bug where empty strings would be encoded with
uninitialized memory

initial support for solaris.  doesn't include /dev/epoll support.  See trac ticket #97.

*** empty log message ***

merging hints/events code into trunk.

pull in direct IO changes from HEAD.

reverse merge from HEAD.

reverse merge of changes to HEAD since branch.  Includes small file changes.

Merging small files branch to head.  Includes server side precreation of
data files and file stuffing.

Add a seperate thread to handle the db_rep_send sm. Add the server db replication sm.

Updated encoding.

Reverse merged and ported to HEAD.

More work on encode/decode.

Work on encoding, admin tools, and credentials.  Encode still needs work for the new credentials.

Updated capability encode/decode.  Fixed capability transmission across the wire...currently asks for a capability with every getattr and gives one back as well.

Bugfix two for the morning.

Decode/encode bugfix.

Merge from HEAD.  Fleshed out credential.  Encode/decode added for credential and cleaned up for capability.  Added capability/credential into request/response structures.  Fleshed out comments in security module.

Cleanup spacing problem. :/

Updated encode/decode to handle variable length keys.  Added init/dup/free to security module for capabilities, added capability to the object attributes structure with associated encode/decode.  Code in get-attr state machine is commented out, just a placeholder for now.

protocol size limit for layout information; custom encode functions for
layout in order to enforce limit; remember to free decoding memory for
create request fields

Added security module to /test makefile.  Added 8 byte alignment within capability encode/decode as needed.

Added encoding/decoding functions for the PVFS_capability structure.

debugging updates

hints and events.

Add encode variations that zero out the stream for valgrind testing.  Also potentially fixes a potential but unlikely string encoding bug where no NULL was written for the null string.

Merge HEAD changes to TAS-branch.

walt3 reverse merge from head includes merges of pw's sm changes (no state declarations), cleanup of state machine code, and other general merging/fixes.

Update migration branch to current CVS version

Synchronization with HEAD

need 6-field encoding

Upgrade to current CVS version

reverse merge of HEAD to WALT3 branch.

- Support for immutable files
- Cleanups in the pvfs2-bufmap interfaces (replace int with size_t)
- Utility for displaying extended attributes and setting them
- Support for disabling atime updates at the object level, file system level (mount time)
  and directories.

backmerging of HEAD to branch...

Merge HEAD into Walt's branch.
Rework new state machines to the new cleanups introduced by Walt.

Merge posix-extensions-branch to HEAD
This branch implemented patches to the 2.6.16 kernel for the proposed POSIX I/O extensions and those patches are under
the patches subdirectory.
It also implements the PVFS2 specific hooks for these system calls.

Tools that may be of immediate use to the pvfs2 general audience is the pvfs2-lsplus utility in src/apps/admin
that should be noticeably faster than the pvfs2-ls utility if there are a lot of objects in a single directory.
Other features are left out by configure and are not even built if the kernels do not support those features
and callbacks.

Modification for migration added, some functions still need to be adapted after moving to a new branch...

Migration of datafiles between different servers works. Uses msgpairray.sm,
transfers only one datafile between two servers and rewrites metadata.
Todo: Adaption of request scheduler to ensure that migration and write
I/O do not happen concurrently on source dataserver.
Also allow users to specify command line parameter which supresses
transfer of pvfs2-hints.

Reverse merge changes from HEAD to posix-extensions-branch.

merge of murali's changes from trunk.

[pcarns]: Patch to allow modifying distribution, distribution parameters and number of
data files to use within a given directory. Such setting will only impact creation of future files
within the same directory. It does not change existing files' parameters. All such hints
are inherited by newly created directories as well..
[pcarns]: Allow trove to continue to read a list of xattrs/keyvals
without stopping if some subset of keys dont exist in the keyval db. Modifies the keyval_read_list() function
to return an array of completely independant error codes for each key that is read.
[pcarns]: adjust encode_string() macro to make it safe to call on NULL strings
[pcarns]: bug in the getattr state machine that would cause it to read dirent_count most of the time
regardless of whether the attribute mask requested it or not.
[slang]: fix a couple of bugs in the get-attr server-side state machine whereby the dirent_count was being read
using the dirent handle instead of the dirdata handle. Fixed a return value from dbpf_keyval_get_handle_info_op_svc
so that get-attr would not needlessly hang..
[vilayann]: fixes for the viewdist utility yet again, since the keys for the xattrs have changed...

Reverse merge from trunk to lockd-branch...

reverse merge of branch

merge sync coalescing branch.

fix deadlock bugs in coalescing code.  add proper state machine debugging.

*** empty log message ***

First cut of the sys_readdirplus implementation where clients can issue a single
system interface call to get the directory entries as well as the attribute information
of the directory entries.
What this means is that we do not need to call a sys_getattr of the individual directory entries
anymore.
(The kernel version is still untested and won't work until the VFS patch is in place! :))

On the server, there is now a new request/state machine called listattr(poor name, i know!)
which essentially does a vectored getattr for a list of handles as opposed to a getattr
which only does for 1. Perhaps, we need to consolidate them into 1 at a later point of time after
others have given this code a look-see!
On the client, there is a new system interface, and a corresponding statemachine implementation
called readdirplus which does the following algorithm
a) Step 1 - Do a regular readdir
b) Step 2 - Collate all meta handles (obtained from the readdir) and send out 1 listattr
to every server that owns atleast 1 handle from the set.
c) Step 3 - Handles that refer to metafiles (determined by the attributes of the response)
need an additional step to retrieve their file sizes. So we collate all data file handles
of all metafiles, and send out 1 listattr to every server that owns atleast 1 handle from
the set.
d) Step 4 - Copy object attributes obtained for all objects into the sys response structure and
also compute file sizes of regular files since we know the individual dfile handles' file sizes
from Step 3.

Clearly, this is a huge win in terms of performance of listing directories which have large number of directory
entries.
Next step is to hammer out the VFS patches and coreutils patch for ls to get the same benefit.
Also added a new utility called pvfs2-lsplus in src/apps/admin that uses this API.

ib: encode data structures to support heterogenous architectures

changes from head merge

changes to perfbase benchmarks and addition of perf counter queue fields

merging changes from HEAD to dbpf branch

align geteattr req, small_io resp; small_io req alignment to be fixed by Murali with his patch

[pcarns]: add protocol versioning to PVFS2.  Major version changes are
incompatible up or down.  New clients can't talk to old servers, but new
servers can talk to old clients.

updates to my event changes to bring them inline with trunk

merge changes from trunk since branch point into branch.  Effectively moves the branchpoint to the latest trunk.

Murali's patch to add VFS support for extended attributes.

added extended attribute support

set_eattr, get_eattr, and get_eattr_list working

updates for adding extended attributes

* added event logging for states
* moved state debug code to state-machine so all state start/end
points get debug messages automatically
* added textlog stuff.  This allows us to write the default event
queue out to a text file that can be converted to slog2 later.

significant protocol changes to solve 64-bit alignedness issues

change the semantics of decode_skip4 so we can use it in endecode_fields entries
align PVFS_servreq_setattr
align PVFS_symlink_attr
align PVFS_metafile_attr_dfiles
align all strings to 8

fix PVFS_object_attr encode alignment

- fixed test program ls.c and admin program pvfs2-ls.c to not issue
  an extra call to readdir on every run by fixing a slight logic bug
- changed some readdir debugging
- added a directory version that is passed back from the server to
  the client on each successful readdir call (happens to be the
  directory's mtime encoded as an opaque uint64_t)
- updated client and server response structures and encoder to
  accomodate this
- NOTE: the versioning is not perfect since retrieving the directory
  mtime and iterating the handle list isn't an atomic operation with
  respect to the overall readdir op; i.e. there's still a window where
  a difference may not be detected.  then again, since the mtime is in
  seconds granularity, this should not present a major detectable
  problem anyway.  can use a different version number if problems
  arise often in practice

make statfs return load averages from sysinfo()

- add configure test for sys/sysinfo.h (should be on all linux machines)
- add memory and uptime information into the (now ill-named) statfs object
- update pvfs2-statfs to display this newly added information

some warning cleanups (at least on ppc)

avoid malloc(0) which makes efence unhappy

remove stubs to system-wide header

new file, basic encoding and decoding routines, now just used by le-bytefield