CVS log for pvfs2/src/server/chdirent.sm
	Help

Request diff between arbitrary revisions / Display revisions graphically

Merged robust security code into Orange-Branch.

1.put back permission check in {cr|ch|rm}dirent.sm and readdir.sm.
2. change set-attr.sm, pass the change of UID|GID|PERM of a directory to its dirdata.
3. in tree-setattr, add a state to call prelude sm.
4. display dirdata count of a directory in pvfs2-stat.

changing llu handle references to strings

remove extents, handle ranges, precreate pools and various other things that aren't needed in their current forms with UUIDs

changes to PVFS_handle_X

1. add entry verification in chdirent.sm 2. add {cr|ch|rm}dirent retry to sys-rename.sm when dirdata mismatch.

Additional changes for adding a type field to keys in the keyval database

Merged in changes from Orange-Branch. There were a number of bugs fixed there since this branch was created.

turn off permission check and little tree_setattr fix.

merging Orange Branch changes in

fixes to make the new server state machines compile with robust security

Preliminary work for distributed directories - making client aware of DIR_ENT_KEY.

merge of B2O-Blue-Sync,HEAD,and latest of Orange.

commiting changes from merge of Orange and Blue into test branch.

merged Bart Taylor's mtime versioning bug fix from trunk to 2-8 branch

patch from Bart Taylor to fix bug in mtime versioning on server

merged in changes from summer at LANL

fix server bugs due to merge.

merging hints/events code into trunk.

more changes to client/server state machines to support capabilities

Reverse merged and ported to HEAD.

more work on state machine permission checks

more work on state machine permission checks

modified permission checking to use callbacks instead of flags. added custom
checks to the io and small-io state machines.

hints and events.

Big pile-o' changes to make Pete go mad.

The main changes are the implementation of the stuffed create path (now just the create state machine and operation), and the beginnings of the "unstuff" operation.

This also includes the request scheduler and state machine cleanups (required for using prelude with batch_remove) and whatever else I may have happened to change along the way.

This code is able to create files, but writing to them is almost guaranteed to break.

Sam's prelude and scheduler updates

The normal path for a server request operation is to jump to the prelude state machine, which tries schedule the request based on the handle+fsid.  This meant that the request scheduler code had a switch/case returning the handle+fsid for each request we defined.  The function was also overloaded with a readonly parameter (whether the request modified any objects on the server), and a scheduling policy parameter (as the return code), which specified whether the request scheduling could be bypassed for this request.

I moved all that to a per-request parameter structure, that gets specified within the server state machine for the request.  Now there is one array of server requests (moved to pvfs2-server-req.c) which the request scheduler and prelude state machine can poke at to get parameters (defined in the state machine for that request), and based decisions on.

The patch includes some other minor changes:

* A fix to the BMI addr ref count increment/decrement.  Previously, the addr ref count was being incremented/decremented in the prelude/final-response state machines.  That requires that those state machines get invoked, which I don't want to have to depend on.  I've moved the INC call to the unexpected_sm, and the DEC call to where the state machine gets finished in the server.  That way we don't have to worry about whether we're using prelude/final-response.

* Cleanup of the request scheduler.  The way we were changing the mode from normal to admin was sort of embedded into the request scheduling code, so we had to hack the mode change from prelude_sm instead of in setparam.  Also, the request scheduler had to be aware of the setparam fields in the request.  I've moved the mode change code to separate request scheduler and job calls.  I think something similar could be done for the timer code (it doesn't really belong in the request scheduler), but I'll leave that for another patch.

* Changed the way we compile the server binary in Makefile.in to allow for multiple object files.

minor change allows state actions to not be declared at the top of *.sm files.

Merge HEAD changes to TAS-branch.

merge of the WALT3 branch to HEAD.  This patch changes the way state actions
are represented as C structures (what statecomp generates).  It also changes
the main state action parameter from a s_op on the server or an sm_p on the client
to a unified smcb pointer (state machine control block) for all state actions (both client and server).  Finally, initial support for concurrent state machines has
been added to allow state actions to be invoked concurrently .. a first step for
server-to-server.

walt3 reverse merge from head includes merges of pw's sm changes (no state declarations), cleanup of state machine code, and other general merging/fixes.

update to current CVS version because statecomp modifications are neat for my work, thanks!

Remove forward declarations of states.

Update migration branch to current CVS version

changed action return value to SM_ACTION_TERMINATE for terminating
actions.

reverse merge of HEAD to WALT3 branch.

add hints to job layer

backmerging of HEAD to branch...

Merge HEAD into Walt's branch.
Rework new state machines to the new cleanups introduced by Walt.

move frequently used extern declaration into a header file

reverse merge from trunk.  working for now.

Reverse merge changes from HEAD to posix-extensions-branch.

- Misc. cleanups (replaced a big macro with an inline function)
- Removed parent_*time from the *dirent request protocol since time stamps are now
kept at the server and do not need to be sent over the wire (This is the reason why
major version of the wire protocol has been bumped)
- Adjust macros for the *dirent protocol accordingly.
- Add a few more debugging statements to kmod

Patch fixes the atime, mtime and ctime problems that people have
reported with PVFS2.
Patch changes the notion of who sets these times. Earlier behavior was the
clients providing the times to the server. New behavior is to have the
server set these times except in  the implementation of utimes() system
call whereby clients explicitly set the time (atime and mtime).
NOTE: We dont allow the clients to dictate the ctime setting at all since
that is consistent with all file systems.
So what we have is:
read, readdir -> atime update required
write, truncate -> mtime update required
ctime is updated on every setattr implicitly on the server.

Since there is no need for parent_*time fields in the server request for chdirent,
crdirent and rmdirent, the next step is to remove those fields, fix the endecode
macros and bump up the major version of the protocol.

Patch also implements these times lazily by flushing them only at the time
of a close rather than after every read/write which could be pretty
expensive.

added some state machine debugging

Everything compiles.   Crap!  Now I have to see if it runs!!!

Julian's changes to coalescing and dbpf storage options:

- Changes the coalesce code, now we decide the mode (coalesce or not) during
the coalesce function call and not during the enque process.
- Add the coalesce high / low watermark to the dbpf_collection structure, so
colls can have different values.
- Put per default the TROVE_SYNC flag into trove from different statemachines
where we used the macro before. The macro is still there and should be
removed if we agree to this behavior.
- Removes the coalesce config option
- Moves SMALL_IO_MAX_REGIONS to internal and renames it to IO_MAX_REGIONS (we
had it at least 3 times defined somewhere).

correcting compile errors

updated to support SM control block interface

Reverse merge from trunk to lockd-branch...

reverse merge of branch

merge sync coalescing branch.

fix deadlock bugs in coalescing code.  add proper state machine debugging.

onekeyval merge

removed all the keyval type stuff.  Also my prefix callback doesn't seem to be working..

mostly working onekey impl

fixes to immediate completion code.

immediate completion now turns on with: ImmediateCompletion yes option in fs config

fixes to small io stuff to get test-zero-fill working again.  Also committing updates from HEAD to make things easier for merge.

committing lld/llu fixes to 1.3.1 branch

moved the llu and lld macros to an internal header so that we don't have to include pvfs2-config.h in the installed pvfs2-types.h header.

* malloc.h is obsolete in freebsd, check for it
* No error.h in freebsd
* linux allows Lu,Lx, and Ld to be interchangeable with llu,llx, and
lld.  Other platforms (solaris, bsd) don't.  Replaced all the L*
with ll*.
* bsd doesn't have mntent.h.  use fstab.h and our own funcs.
* bsd doesn't know about ssize_t.  Use size_t instead.
* bsd doesn't have asm errnos.  Check for each of those
errno macros and if not defined define to -1
* check for db3/db.h db4/db.h header if db path is specified using
--with-db
* darwin has aio support builtin, doesn't need -lrt
* remove kernel stuff in pvfs2-types.h that sets WORDSIZE.  gcc
defines __LP64__ on archs with 64bit longs so we use that instead.
* darwin's open doesn't accept O_LARGEFILE.  off_t is an int64 by
default.  define O_LARGEFILE if it hasn't been.
* need to run ranlib on darwin after libpvfs2.a gets installed to regenerate
table of contents

Many users reported timestamp problems when listing files mounted on a PVFS2 volume,
This was traced down to the versioned mtime patch that was added to detect race conditions
in readdir and retry. However, the approach was deemed unclean since sometimes the client
was aware of the versioned mtime and sometimes not.
This patch attempts to avoid that drawback by moving it all to the server.
The client does not see of any the versioned mtime stuff at all now.

* added event logging for states
* moved state debug code to state-machine so all state start/end
points get debug messages automatically
* added textlog stuff.  This allows us to write the default event
queue out to a text file that can be converted to slog2 later.

- increased mmap-ra-small buf size from 4K to 16K to avoid many small
  allocations (causes larger mem footprint of client-core)
- adjusted client sysint setattr operation to work in a write-through
  manner with the acache (when enabled)
- fixed client sysint setattr to invalidate the acache entry (if any)
- added some debugging
- misc cleanups

- added a PVFS_util method to get the current system and return it as
  a valid PVFS_time type
- added arguments to the crdirent/chdirent/rmdirent operations that
  now can take optional parent atime/mtime/ctime fields
- added support on server *dirent operations that update the parent
  time attributes (if specified) on successful completion of the
  *dirent operation; null/zero time fields are not updated
- modified sys-create/sys-mkdir/sys-symlink/sys-rename/sys-remove to
  work with the new operations properly; in general,
  create/remove/rename operations updates the mtime and ctime of the
  parent directory, which is now properly supported
- moved some common server side attribute handling code into a macro
  to make it re-useable across several server state machines
- updated en{de}coding of modified operations
- misc cleanups

- error code sanity checks, better error handling, and cleanups on the
  sysint, le-encoder, and related server operations

- added configuration option TroveSyncMeta (can be 'yes' or 'no')
- added configuration option TroveSyncData (can be 'yes' or 'no')
- replaced TroveSyncMode configuration option with separate
  TroveSyncMeta and TroveSyncData options.  the defaults are yes to
  both.  this is a change because previously data was NOT being sync'd
  after reads/writes.  for now, only writes are sync'd if
  TroveSyncData is 'yes'.
- updated pvfs2-genconfig to reflect config option changes
- added top-level and flowproto-multiqueue understanding of the
  data sync mode option via setinfo
- added hook to server to pass data sync mode option to the flow
  implementation via setinfo on a per fs/coll_id basis
- added fp_multiqueue tracking of this to be able to pass the
  appropriate data sync flag to trove on a per fs basis
- misc cleanups

- applied Nathan's expandtab patch (expandtab-2.patch.gz)

  first referenced at:
  http://www.beowulf-underground.org/pipermail/pvfs2-developers/2004-July/000745.html

- added a chdirent server operation useful during renames of target files
  that already exist.
- still working on cleaning up rename, as it does not properly remove some
  data that is left to be removed