[csw-maintainers] Preview of the new mirror structure available

[Dagobert Michelsen]

Hi,

I did some work towards the enhanced directory structure for the mirror
we talked about. Goals:

- subscription of master mirror layout should be kept unchanged
- additional subscriptions should be cheap
- mirroring allpkgs/ and experimental/ should be optional
- Skripts to show deltas between catalogs
   - especially experimental-<project> vs. testing vs. current
   - also between current freezes
   - put that information in README

There are still some things to be done but I could also use some
feedback now, so here it is :-)


** The intended layout looks like this:

opencsw/
   experimental/
     <project>/
       pkgs/   (confined to this directory)
         mytest.pkg.gz
       sparc/
         5.8/
           mytest.pkg.gz (hardlinked to pkgs/mytest.pkg.gz)

   testing/
     pkgs/
     sparc/
       5.8/

   distribution/
     allcatalogs/
       catalog-sparc-5.8-20091002
     allpkgs/
       mypkg.tar.gz
     stable/
       sparc/
         5.8/
     current/
       sparc/
         5.8/
           pkg.tar.gz (also hardlinked from allpkgs)
     freeze/
       current-20091002/
         README.20091002
         sparc/
           5.8/
             catalog
             pkg.tar.gz (hardlinked from allpkgs)
           5.9/
             pkg.tar.gz (symlinked to 5.8, same as in current/)
       current-20091003/
         sparc/
           ...
       current-20091004/ -> symlinked to current-20091003 if no change  
in catalog
       stable-20091004/
         ...

** TBD: experimental/ should be filled with the subdirectories from  
what is now in testing/.
    Subdirectories can be created by each maintainer and for each  
folder a subproject
    is created in experimental which can be synced to separately.

** TBD: packages/ can the go from experimental/ to testing/ when no  
open issues persist.
    This can be used to drive servers. Only packages proven there can  
go to current/. See
      http://wiki.opencsw.org/automated-release-process
    for details.

** The repository is browsable via
      http://mirror.opencsw.org/opencsw/distribution/
    Of course you can subscribe with pkg-get/pkgutil to it, but please  
be
    careful as the bandwith it limited to 2 MBit.

** rsync is available. Make sure you don't forget the -H to
** keep hardlinks when syncing!

dam at shell [shell]:/home/dam > rsync rsync://mirror.opencsw.org/opencsw- 
withfreeze
drwxr-xr-x          7 2009/10/30 15:34:22 .
drwxr-xr-x        416 2009/10/30 13:28:29 allcatalogs
drwxrwxr-x       6483 2009/10/28 23:54:53 allpkgs
drwxrwxr-x          4 2009/10/28 23:54:46 current
drwxr-xr-x         66 2009/10/30 16:57:31 freeze
drwxr-xr-x          4 2008/10/24 21:10:13 stable

** TBD: There should be a readme in each freeze stating the changes:

Layout README 20091003
----------------------

Changes 20091003:

Added packages:
- mypkg-1.0.tar.gz

Updated packages:
- yourpkg 1.1 replace 1.0

Removed packages:
- oldpkg 1.1

Changes 20091002:
...