FishEye on PVFS/

FishEye on PVFS/ http://www.pvfs.org/fisheye/browse/PVFS/ Recent changes to the "PVFS" repository under directory / Orange-Elaine-Distr-Dir-Branch elaine: Next round of distributed directory changes. Fri, 03 Sep 2010 17:46:26 -0400 elaine http://www.pvfs.org/fisheye/changelog/PVFS?cs=Orange-Elaine-Distr-Dir-Branch:elaine:20100903214626&csize=27 http://www.pvfs.org/fisheye/changelog/PVFS?cs=Orange-Elaine-Distr-Dir-Branch:elaine:20100903214626&csize=27 Orange-Elaine-Distr-Dir-Branch:elaine:20100903214626 elaine Fri, 03 September 2010, 17:46:26 -0400

Next round of distributed directory changes.

/include/pvfs2-types.h	1.156.10.3.6.4	(+4 -0)	view	diffs
/src/client/sysint/acache.c	1.30.20.1.8.4	(+2 -2)	view	diffs
/src/client/sysint/mgmt-create-dirent.sm	1.20.36.6	(+1 -1)	view	diffs
/src/client/sysint/mgmt-remove-dirent.sm	1.16.36.6	(+1 -1)	view	diffs
/src/client/sysint/sys-create.sm	1.127.34.6	(+1 -1)	view	diffs
/src/client/sysint/sys-getattr.sm	1.118.8.7.2.5	(+1 -1)	view	diffs
/src/client/sysint/sys-mkdir.sm	1.66.36.7	(+1 -1)	view	diffs
/src/client/sysint/sys-readdir.sm	1.54.36.5	(+1 -1)	view	diffs
/src/client/sysint/sys-remove.sm	1.107.36.6	(+2 -2)	view	diffs
/src/client/sysint/sys-rename.sm	1.59.36.6	(+2 -2)	view	diffs
/src/client/sysint/sys-symlink.sm	1.76.36.6	(+1 -1)	view	diffs
/src/common/misc/mkspace.c	1.44.10.1.8.3	(+13 -4)	view	diffs
/src/common/misc/pint-util.c	1.30.10.1.8.6	(+40 -23)	view	diffs
/src/common/misc/pvfs2-types-debug.h	1.2.114.1	(+5 -0)	view	diffs
/src/common/misc/pvfs2-util.c	1.104.10.2.8.1	(+5 -0)	view	diffs
/src/proto/PINT-le-bytefield.c	1.58.10.7.2.1	(+14 -0)	view	diffs
/src/proto/pvfs2-attr.h	1.43.10.1.8.5	(+4 -22)	view	diffs
/src/proto/pvfs2-req-proto.h	1.159.8.7.2.4	(+40 -0)	view	diffs
/src/server/get-attr.sm	1.97.8.3.2.8	(+22 -14)	view	diffs
/src/server/lookup.sm	1.59.34.1	(+157 -19)	view	diffs
/src/server/mkdir.sm	1.53.36.5	(+50 -94)	view	diffs
/src/server/precreate-pool-refiller.sm	1.3.38.2	(+2 -2)	view	diffs
/src/server/pvfs2-server-req.c	1.5.10.2.6.1	(+2 -0)	view	diffs
/src/server/pvfs2-server.c	1.269.4.1.8.5	(+7 -2)	view	diffs
/src/server/pvfs2-server.h	1.155.10.4.6.6	(+5 -2)	view	diffs
/src/server/set-attr.sm	1.74.36.1	(+214 -15)	view	diffs
/src/server/tree-communicate.sm	1.1.6.6.2.3	(+156 -22)	view	diffs

]]> Orange-Elaine-Distr-Dir-Branch shuangy: 1. bitmap gossip format in mkspace.c... Fri, 03 Sep 2010 15:28:59 -0400 shuangy http://www.pvfs.org/fisheye/changelog/PVFS?cs=Orange-Elaine-Distr-Dir-Branch:shuangy:20100903192859&csize=2 http://www.pvfs.org/fisheye/changelog/PVFS?cs=Orange-Elaine-Distr-Dir-Branch:shuangy:20100903192859&csize=2 Orange-Elaine-Distr-Dir-Branch:shuangy:20100903192859 shuangy Fri, 03 September 2010, 15:28:59 -0400

1. bitmap gossip format in mkspace.c 2. two fixes in get-attr.sm pointed out by Elaine.

/src/common/misc/mkspace.c	1.44.10.1.8.2	(+6 -5)	view	diffs
/src/server/get-attr.sm	1.97.8.3.2.7	(+2 -14)	view	diffs

]]> Orange-Elaine-Distr-Dir-Branch shuangy: 1. partly change sys-rename operation, lookup still not fixed yet.... Fri, 03 Sep 2010 14:47:50 -0400 shuangy http://www.pvfs.org/fisheye/changelog/PVFS?cs=Orange-Elaine-Distr-Dir-Branch:shuangy:20100903184750&csize=7 http://www.pvfs.org/fisheye/changelog/PVFS?cs=Orange-Elaine-Distr-Dir-Branch:shuangy:20100903184750&csize=7 Orange-Elaine-Distr-Dir-Branch:shuangy:20100903184750 shuangy Fri, 03 September 2010, 14:47:50 -0400

1. partly change sys-rename operation, lookup still not fixed yet. 2. when sending {cr|rm|ch}dirent requests, send the message to dirdata handle instead of metadata handle.

/src/client/sysint/mgmt-create-dirent.sm	1.20.36.5	(+3 -1)	view	diffs
/src/client/sysint/mgmt-remove-dirent.sm	1.16.36.5	(+3 -1)	view	diffs
/src/client/sysint/sys-create.sm	1.127.34.5	(+3 -1)	view	diffs
/src/client/sysint/sys-mkdir.sm	1.66.36.6	(+3 -1)	view	diffs
/src/client/sysint/sys-remove.sm	1.107.36.5	(+6 -2)	view	diffs
/src/client/sysint/sys-rename.sm	1.59.36.5	(+192 -7)	view	diffs
/src/client/sysint/sys-symlink.sm	1.76.36.5	(+3 -1)	view	diffs

]]> Orange-Branch bligon: Modified pjmp code to use a task-id of GETATTR instead of 0, because 0... Thu, 02 Sep 2010 11:54:33 -0400 bligon http://www.pvfs.org/fisheye/changelog/PVFS?cs=Orange-Branch:bligon:20100902155433&csize=1 http://www.pvfs.org/fisheye/changelog/PVFS?cs=Orange-Branch:bligon:20100902155433&csize=1 Orange-Branch:bligon:20100902155433 bligon Thu, 02 September 2010, 11:54:33 -0400

Modified pjmp code to use a task-id of GETATTR instead of 0, because 0 causes the state machine processor to free the frame before returning to the calling machine.

/src/server/list-attr.sm

1.12.10.2

(+8 -3)

view

diffs

]]> Orange-Elaine-Distr-Dir-Branch shuangy: adjust format of gossip bitmap in some process. Wed, 01 Sep 2010 19:21:18 -0400 shuangy http://www.pvfs.org/fisheye/changelog/PVFS?cs=Orange-Elaine-Distr-Dir-Branch:shuangy:20100901232117&csize=3 http://www.pvfs.org/fisheye/changelog/PVFS?cs=Orange-Elaine-Distr-Dir-Branch:shuangy:20100901232117&csize=3 Orange-Elaine-Distr-Dir-Branch:shuangy:20100901232117 shuangy Wed, 01 September 2010, 19:21:18 -0400

adjust format of gossip bitmap in some process.

/src/client/sysint/sys-rename.sm	1.59.36.4	(+1 -1)	view	diffs
/src/server/get-attr.sm	1.97.8.3.2.6	(+29 -3)	view	diffs
/src/server/mkdir.sm	1.53.36.4	(+6 -6)	view	diffs

]]> Orange-Branch bligon: New file that contains machines specifically setup to allow PJMP to work... Tue, 31 Aug 2010 15:07:48 -0400 bligon http://www.pvfs.org/fisheye/changelog/PVFS?cs=Orange-Branch:bligon:20100831190748&csize=1 http://www.pvfs.org/fisheye/changelog/PVFS?cs=Orange-Branch:bligon:20100831190748&csize=1 Orange-Branch:bligon:20100831190748 bligon Tue, 31 August 2010, 15:07:48 -0400

New file that contains machines specifically setup to allow PJMP to work without causing memory leaks.

/src/server/pjmp-machines.sm

1.1.2.1

(+238 -0)

view

new

]]> MAIN bligon: file pjmp-machines.sm was initially added on branch Orange-Branch. Tue, 31 Aug 2010 15:07:48 -0400 bligon http://www.pvfs.org/fisheye/changelog/PVFS?cs=MAIN:bligon:20100831190748&csize=1 http://www.pvfs.org/fisheye/changelog/PVFS?cs=MAIN:bligon:20100831190748&csize=1 MAIN:bligon:20100831190748 bligon Tue, 31 August 2010, 15:07:48 -0400

file pjmp-machines.sm was initially added on branch Orange-Branch.

/src/server/pjmp-machines.sm

1.1

(+0 -0)

deleted

]]> Orange-Branch bligon: Corrected memory leaks associated with using the PJMP state machine command.... Tue, 31 Aug 2010 15:05:31 -0400 bligon http://www.pvfs.org/fisheye/changelog/PVFS?cs=Orange-Branch:bligon:20100831190531&csize=8 http://www.pvfs.org/fisheye/changelog/PVFS?cs=Orange-Branch:bligon:20100831190531&csize=8 Orange-Branch:bligon:20100831190531 bligon Tue, 31 August 2010, 15:05:31 -0400

Corrected memory leaks associated with using the PJMP state machine command. Files affected: src/common/misc/state-machine-fns.c src/server/create-immutable-copies.sm src/server/get-attr.sm src/server/list-attr.sm src/server/module.mk.in src/server/precreate-pool-refiller.sm src/server/pvfs2-server.c src/server/pvfs2-server.h src/server/set-eattr.sm src/server/tree-communicate.sm

/src/common/misc/state-machine-fns.c	1.15.10.2	(+39 -2)	view	diffs
/src/server/create-immutable-copies.sm	1.1.2.6	(+4 -94)	view	diffs
/src/server/get-attr.sm	1.97.8.4	(+2 -0)	view	diffs
/src/server/list-attr.sm	1.12.10.1	(+1 -1)	view	diffs
/src/server/module.mk.in	1.55.10.4	(+1 -0)	view	diffs
/src/server/pvfs2-server.h	1.155.10.8	(+7 -2)	view	diffs
/src/server/set-eattr.sm	1.21.10.4	(+1 -1)	view	diffs
/src/server/tree-communicate.sm	1.1.6.8	(+4 -4)	view	diffs

]]> Orange-Branch mtmoore: update to multiple pre-create pool implementation, only create pools for servers... Fri, 27 Aug 2010 13:26:38 -0400 mtmoore http://www.pvfs.org/fisheye/changelog/PVFS?cs=Orange-Branch:mtmoore:20100827172638&csize=3 http://www.pvfs.org/fisheye/changelog/PVFS?cs=Orange-Branch:mtmoore:20100827172638&csize=3 Orange-Branch:mtmoore:20100827172638 mtmoore Fri, 27 August 2010, 13:26:38 -0400

update to multiple pre-create pool implementation, only create pools for servers of the types they have to give (no I/O handles from meta only servers)

/src/server/precreate-pool-refiller.sm	1.3.10.2	(+2 -2)	view	diffs
/src/server/pvfs2-server.c	1.269.4.4	(+50 -7)	view	diffs
/src/server/pvfs2-server.h	1.155.10.7	(+1 -1)	view	diffs

]]> Orange-Elaine-Distr-Dir-Branch shuangy: 1. add dist-dir-struct to root handle and lost+found handle... Thu, 26 Aug 2010 19:46:50 -0400 shuangy http://www.pvfs.org/fisheye/changelog/PVFS?cs=Orange-Elaine-Distr-Dir-Branch:shuangy:20100826234650&csize=11 http://www.pvfs.org/fisheye/changelog/PVFS?cs=Orange-Elaine-Distr-Dir-Branch:shuangy:20100826234650&csize=11 Orange-Elaine-Distr-Dir-Branch:shuangy:20100826234650 shuangy Thu, 26 August 2010, 19:46:50 -0400

1. add dist-dir-struct to root handle and lost+found handle 2. add dirdata bucket selection to several state machines, however, sys-rename and sys-readdir are not finished yet. There might be other state machines missing. 3. compilable, not expect to run correctly yet. 4. more to change.

/src/client/sysint/mgmt-create-dirent.sm	1.20.36.4	(+18 -2)	view	diffs
/src/client/sysint/mgmt-remove-dirent.sm	1.16.36.4	(+18 -2)	view	diffs
/src/client/sysint/sys-create.sm	1.127.34.4	(+22 -4)	view	diffs
/src/client/sysint/sys-mkdir.sm	1.66.36.5	(+21 -5)	view	diffs
/src/client/sysint/sys-readdir.sm	1.54.36.4	(+1 -0)	view	diffs
/src/client/sysint/sys-remove.sm	1.107.36.4	(+44 -10)	view	diffs
/src/client/sysint/sys-symlink.sm	1.76.36.4	(+20 -2)	view	diffs
/src/common/misc/mkspace.c	1.44.10.1.8.1	(+196 -18)	view	diffs
/src/server/mkdir.sm	1.53.36.3	(+15 -1)	view	diffs
/src/server/pvfs2-server.c	1.269.4.1.8.4	(+1 -1)	view	diffs
/src/server/pvfs2-server.h	1.155.10.4.6.5	(+2 -2)	view	diffs

]]> Orange-Elaine-Distr-Dir-Branch shuangy: add -lm to LIBS in addition to SERVERLIBS Tue, 24 Aug 2010 21:19:25 -0400 shuangy http://www.pvfs.org/fisheye/changelog/PVFS?cs=Orange-Elaine-Distr-Dir-Branch:shuangy:20100825011925&csize=1 http://www.pvfs.org/fisheye/changelog/PVFS?cs=Orange-Elaine-Distr-Dir-Branch:shuangy:20100825011925&csize=1 Orange-Elaine-Distr-Dir-Branch:shuangy:20100825011925 shuangy Tue, 24 August 2010, 21:19:25 -0400

add -lm to LIBS in addition to SERVERLIBS

(+2 -1)

]]> Orange-Elaine-Distr-Dir-Branch shuangy: clean source tree. Mon, 23 Aug 2010 08:56:45 -0400 shuangy http://www.pvfs.org/fisheye/changelog/PVFS?cs=Orange-Elaine-Distr-Dir-Branch:shuangy:20100823125645&csize=1 http://www.pvfs.org/fisheye/changelog/PVFS?cs=Orange-Elaine-Distr-Dir-Branch:shuangy:20100823125645&csize=1 Orange-Elaine-Distr-Dir-Branch:shuangy:20100823125645 shuangy Mon, 23 August 2010, 08:56:45 -0400

clean source tree.

/include/pvfs2.h

1.11.2.2

(+0 -36)

deleted

]]> Orange-Elaine-Distr-Dir-Branch shuangy: incorporate dist-dir-struct to the source tree. It's compilable but not runnable... Sun, 22 Aug 2010 20:10:19 -0400 shuangy http://www.pvfs.org/fisheye/changelog/PVFS?cs=Orange-Elaine-Distr-Dir-Branch:shuangy:20100823001015&csize=23 http://www.pvfs.org/fisheye/changelog/PVFS?cs=Orange-Elaine-Distr-Dir-Branch:shuangy:20100823001015&csize=23 Orange-Elaine-Distr-Dir-Branch:shuangy:20100823001015 shuangy Sun, 22 August 2010, 20:10:19 -0400

incorporate dist-dir-struct to the source tree. It's compilable but not runnable. still have a lot to change and add. Commit as a touch base.

/Makefile.in	1.280.8.1.18.1	(+1 -1)	view	diffs
/include/pvfs2-types.h	1.156.10.3.6.3	(+14 -5)	view	diffs
/include/pvfs2.h	1.11.2.1	(+36 -0)	view	new
/src/client/sysint/acache.c	1.30.20.1.8.3	(+88 -29)	view	diffs
/src/client/sysint/client-state-machine.h	1.177.10.3.2.4	(+7 -2)	view	diffs
/src/client/sysint/mgmt-create-dirent.sm	1.20.36.3	(+1 -1)	view	diffs
/src/client/sysint/mgmt-remove-dirent.sm	1.16.36.3	(+1 -1)	view	diffs
/src/client/sysint/sys-create.sm	1.127.34.3	(+12 -9)	view	diffs
/src/client/sysint/sys-getattr.sm	1.118.8.7.2.4	(+7 -5)	view	diffs
/src/client/sysint/sys-mkdir.sm	1.66.36.4	(+33 -17)	view	diffs
/src/client/sysint/sys-readdir.sm	1.54.36.3	(+2 -2)	view	diffs
/src/client/sysint/sys-remove.sm	1.107.36.3	(+4 -4)	view	diffs
/src/client/sysint/sys-rename.sm	1.59.36.3	(+1 -1)	view	diffs
/src/client/sysint/sys-symlink.sm	1.76.36.3	(+1 -1)	view	diffs
/src/common/misc/dist-dir-utils.c	1.1.2.4	(+19 -0)	view	diffs
/src/common/misc/dist-dir-utils.h	1.1.2.3	(+13 -10)	view	diffs
/src/common/misc/pint-util.c	1.30.10.1.8.5	(+15 -3)	view	diffs
/src/proto/pvfs2-attr.h	1.43.10.1.8.4	(+27 -16)	view	diffs
/src/proto/pvfs2-req-proto.h	1.159.8.7.2.3	(+9 -0)	view	diffs
/src/server/get-attr.sm	1.97.8.3.2.5	(+127 -67)	view	diffs
/src/server/mkdir.sm	1.53.36.2	(+381 -85)	view	diffs
/src/server/pvfs2-server.c	1.269.4.1.8.3	(+1 -2)	view	diffs
/src/server/pvfs2-server.h	1.155.10.4.6.4	(+21 -10)	view	diffs

]]> Orange-Branch mtmoore: update genconfig to use appropriate PrecreateBatchSize and PrecreateLowThreshold... Thu, 19 Aug 2010 16:34:32 -0400 mtmoore http://www.pvfs.org/fisheye/changelog/PVFS?cs=Orange-Branch:mtmoore:20100819203432&csize=1 http://www.pvfs.org/fisheye/changelog/PVFS?cs=Orange-Branch:mtmoore:20100819203432&csize=1 Orange-Branch:mtmoore:20100819203432 mtmoore Thu, 19 August 2010, 16:34:32 -0400

update genconfig to use appropriate PrecreateBatchSize and PrecreateLowThreshold values

/src/apps/admin/pvfs2-genconfig

1.85.8.3

(+2 -2)

view

diffs

]]> Orange-Elaine-Distr-Dir-Branch elaine: *** empty log message *** Wed, 18 Aug 2010 12:03:26 -0400 elaine http://www.pvfs.org/fisheye/changelog/PVFS?cs=Orange-Elaine-Distr-Dir-Branch:elaine:20100818160326&csize=21 http://www.pvfs.org/fisheye/changelog/PVFS?cs=Orange-Elaine-Distr-Dir-Branch:elaine:20100818160326&csize=21 Orange-Elaine-Distr-Dir-Branch:elaine:20100818160326 elaine Wed, 18 August 2010, 12:03:26 -0400

*** empty log message ***

/include/pvfs2-types.h	1.156.10.3.6.2	(+31 -0)	view	diffs
/src/client/sysint/client-state-machine.h	1.177.10.3.2.3	(+4 -0)	view	diffs
/src/client/sysint/sys-getattr.sm	1.118.8.7.2.3	(+9 -7)	view	diffs
/src/client/sysint/sys-mkdir.sm	1.66.36.3	(+18 -1)	view	diffs
/src/common/misc/pint-util.c	1.30.10.1.8.4	(+9 -5)	view	diffs
/src/common/misc/pvfs2-internal.h	1.8.10.2.8.2	(+2 -0)	view	diffs
/src/common/misc/server-config.c	1.115.4.1.8.1	(+101 -8)	view	diffs
/src/common/misc/server-config.h	1.63.10.1.8.1	(+2 -2)	view	diffs
/src/io/job/job-desc-queue.h	1.28.10.1.8.1	(+1 -0)	view	diffs
/src/io/job/job.c	1.188.8.2.2.1	(+89 -15)	view	diffs
/src/io/job/job.h	1.60.10.1.8.1	(+3 -0)	view	diffs
/src/proto/pvfs2-req-proto.h	1.159.8.7.2.2	(+17 -2)	view	diffs
/src/server/create-immutable-copies.sm	1.1.2.4.2.1	(+6 -4)	view	diffs
/src/server/create.sm	1.50.4.2.8.1	(+2 -0)	view	diffs
/src/server/get-attr.sm	1.97.8.3.2.4	(+72 -9)	view	diffs
/src/server/mkdir.sm	1.53.36.1	(+146 -24)	view	diffs
/src/server/precreate-pool-refiller.sm	1.3.38.1	(+24 -6)	view	diffs
/src/server/pvfs2-server.c	1.269.4.1.8.2	(+102 -52)	view	diffs
/src/server/pvfs2-server.h	1.155.10.4.6.3	(+12 -2)	view	diffs
/src/server/tree-communicate.sm	1.1.6.6.2.2	(+1 -2)	view	diffs
/src/server/unstuff.sm	1.3.10.2.6.1	(+1 -0)	view	diffs

]]> Orange-Branch mtmoore: Elaine pointed out backwards arguments 2 and 3 in the job_precreate_pool_get_han... Tue, 17 Aug 2010 15:28:56 -0400 mtmoore http://www.pvfs.org/fisheye/changelog/PVFS?cs=Orange-Branch:mtmoore:20100817192856&csize=1 http://www.pvfs.org/fisheye/changelog/PVFS?cs=Orange-Branch:mtmoore:20100817192856&csize=1 Orange-Branch:mtmoore:20100817192856 mtmoore Tue, 17 August 2010, 15:28:56 -0400

Elaine pointed out backwards arguments 2 and 3 in the job_precreate_pool_get_handles() call

/src/server/create.sm

1.50.4.4

(+1 -1)

view

diffs

]]> Orange-Branch mtmoore: per-dataspace handle type precreate pools implementation Tue, 17 Aug 2010 14:42:21 -0400 mtmoore http://www.pvfs.org/fisheye/changelog/PVFS?cs=Orange-Branch:mtmoore:20100817184221&csize=12 http://www.pvfs.org/fisheye/changelog/PVFS?cs=Orange-Branch:mtmoore:20100817184221&csize=12 Orange-Branch:mtmoore:20100817184221 mtmoore Tue, 17 August 2010, 14:42:21 -0400

per-dataspace handle type precreate pools implementation

/include/pvfs2-types.h	1.156.10.5	(+40 -0)	view	diffs
/src/common/misc/server-config.c	1.115.4.4	(+120 -10)	view	diffs
/src/common/misc/server-config.h	1.63.10.2	(+2 -2)	view	diffs
/src/io/job/job-desc-queue.h	1.28.10.2	(+1 -0)	view	diffs
/src/io/job/job.c	1.188.8.4	(+117 -18)	view	diffs
/src/io/job/job.h	1.60.10.2	(+5 -1)	view	diffs
/src/server/create-immutable-copies.sm	1.1.2.5	(+6 -4)	view	diffs
/src/server/create.sm	1.50.4.3	(+2 -0)	view	diffs
/src/server/precreate-pool-refiller.sm	1.3.10.1	(+21 -9)	view	diffs
/src/server/pvfs2-server.c	1.269.4.3	(+113 -51)	view	diffs
/src/server/pvfs2-server.h	1.155.10.6	(+1 -0)	view	diffs
/src/server/unstuff.sm	1.3.10.4	(+1 -0)	view	diffs

]]> Orange-Branch mtmoore: output formatting changes Tue, 17 Aug 2010 13:51:18 -0400 mtmoore http://www.pvfs.org/fisheye/changelog/PVFS?cs=Orange-Branch:mtmoore:20100817175118&csize=1 http://www.pvfs.org/fisheye/changelog/PVFS?cs=Orange-Branch:mtmoore:20100817175118&csize=1 Orange-Branch:mtmoore:20100817175118 mtmoore Tue, 17 August 2010, 13:51:18 -0400

output formatting changes

/src/apps/devel/pvfs2-db-display.c

1.1.2.2

(+74 -40)

view

diffs

]]>