Re: On /home/blast

From: Taylan Akdogan (akdogan@MIT.EDU)
Date: Fri Dec 23 2005 - 12:52:13 EST


Hi,

In addition to what Michael and Aki said. I like to add today's
"home/blast" discussion:

- Increasing the home space would be nice if the associated cost
is not too high. 20 GB is -really- small for 20-30 active users,
which contains 15 (?) PhD theses, for the whole Blast program.
Even some PhD "documents" (including the large figures, etc.),
can take up to GB order-of-magnitude easily, which deserve a
good backup frequently.

- On the other hand; all graduate students and major components
of the Blast projects have a Bud and its large disks (200GB tot),
which is not backed up. I still would use this space, and backup
the crucial data myself periodically (some extra work is the down
side), if increasing the home space becomes not an option. There
are 8 DVD writers, and the DVD media is cheap, and is available
through the common room. I used to do my backup while working on
my thesis.

Regards, and have a happy new year!
Taylan

PS: I had done my job reducing my home usage, as soon as the first
message came about this, and I even gave up some
reproducible-in-the-expense-of-some-extra-work files.

--
---=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=---
Taylan Akdogan              Massachusetts Institute of Technology
akdogan@mit.edu                             Department of Physics
Phn:+1-617-258-0801                Laboratory for Nuclear Science
Fax:+1-617-258-5440                                   Room 26-565
---=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=---

On Dec 23, 2005, at 12:23 PM, Akihisa Shinozaki wrote:

> Hello there, > > I guess the following might help people avoid using the blast05 > home disk but only blast05 account. If you only want to access to > bud?? from your personal computer, for example, Here is a way: > > 1) Type "ssh -C -L 2002:bud??:22 blast05.lns.mit.edu." This bores > "a secure shell tunnel" through the blast05 to bud??. > 2) Type "scp -P 2002 localhost:file1 file2" to copy a file, file1 > on bud?? to your personal computer. > 3) Or type "ssh -p 2002 localhost [command]" to submit some job on > bud?? from your personal computer. > > Is this old news? (well, I know for Chi, it is), > aki > > > Michael Kohl wrote: > >> Hi, >> >> here's my opinion on a short-term and long-term solution for /home/ >> blast: >> I don't think that increasing the size of the user directory >> helps. Instead it will get even worse very soon as people become >> careless (like free expansion of gas). >> >> +very short term: clean up! >> +short term: move inactive users to bud18 >> +long term: introduce quota system (hopefully not necessary) >> >> !!! The user directories /home/blast should only contain data that >> needs >> to be backed up regularly!!! >> >> Therefore, people should be well aware that any raw or crunched >> data or excessive log output shall be stored in the scratch areas. >> Admittedly, I belong to the GB-users, too. Nevertheless, on the >> long term I would favor a quota system over an increase of useless >> beackups. >> >> If you are afraid of data loss when storing data on scratch disks, >> you >> should consider mirroring relevant directories with a second >> location by using the "rsync" utility: >> >> E.g., to mirror all your files from the directory bud01:/scratch/ >> username with bud02:/scratch/username, type >> >> bud01:> cd /scratch/username >> bud01:> rsync -nauvzlRe ssh ./* bud02:/scratch/username >> >> Leave away the "n" option when you're confident in what you're doing. >> Rsync will only copy those files that are either newer or that do >> not exist yet. See "man rsync" for further options. >> >> I'm using rsync for a daily backup of my laptop and can sleep very >> well. >> >> >> $ du -sc /home/blast/* 2>/dev/null | sort -n >> 0 /home/blast/abs >> 0 /home/blast/blast >> 4 /home/blast/USAGE.LOG >> 8 /home/blast/abr >> 8 /home/blast/sktobler >> 16 /home/blast/lost+found >> 28 /home/blast/hxiang >> 108 /home/blast/ransom >> 288 /home/blast/coda >> 504 /home/blast/mbutler >> 516 /home/blast/wc >> 640 /home/blast/amamo >> 764 /home/blast/claudiag >> 828 /home/blast/arnesen >> 1108 /home/blast/rapaport >> 1396 /home/blast/nsavvinv >> 1876 /home/blast/lherman >> 2220 /home/blast/buuren >> 2448 /home/blast/doug >> 2596 /home/blast/alarcon >> 4008 /home/blast/palarczyk >> 4256 /home/blast/jalthouse >> 6092 /home/blast/sbauer >> 6340 /home/blast/grubes >> 6976 /home/blast/kmike >> 13988 /home/blast/wchall >> 16900 /home/blast/maxcht >> 16976 /home/blast/lmgoggin >> 17524 /home/blast/vodhanel >> 18196 /home/blast/almgren >> 18564 /home/blast/sthong >> 20856 /home/blast/flan >> 28068 /home/blast/kovash >> 32916 /home/blast/zapoian >> 35952 /home/blast/tsentalovich >> 38556 /home/blast/zwart >> 41936 /home/blast/zhangchi >> 48916 /home/blast/zilong >> 55420 /home/blast/zhengyi >> 56232 /home/blast/jvieregg >> 57460 /home/blast/maurik >> 66368 /home/blast/cbdandrea >> 76220 /home/blast/ezyryder >> 85260 /home/blast/bibek >> 85808 /home/blast/alicrocker >> 88136 /home/blast/jmpavel >> 90964 /home/blast/jrc >> 96728 /home/blast/mcsziget >> 120368 /home/blast/kboddy >> 121756 /home/blast/franklin >> 122820 /home/blast/kdow >> 125580 /home/blast/ddutta >> 156540 /home/blast/nikolas >> 190180 /home/blast/msteadman >> 201944 /home/blast/edsix >> 212760 /home/blast/cmgreene >> 214336 /home/blast/rfatemi >> 221332 /home/blast/agoodhue >> 236164 /home/blast/dsflash >> 265756 /home/blast/mcilhany >> 269340 /home/blast/seely >> 276496 /home/blast/martina >> 313144 /home/blast/shariton >> 321648 /home/blast/egeis >> 325512 /home/blast/dukedoc02 >> 362568 /home/blast/clasie >> 398248 /home/blast/cvsroot >> 408044 /home/blast/ajmasch >> 418976 /home/blast/amosser >> 425124 /home/blast/chris2 >> 425424 /home/blast/elog >> 456716 /home/blast/degrush >> 481980 /home/blast/tong >> 659884 /home/blast/vziskin >> 673000 /home/blast/hasell >> 679032 /home/blast/akdogan >> 690788 /home/blast/hauke >> 717772 /home/blast/tavi >> 975452 /home/blast/tps >> 1160628 /home/blast/wangxu >> 1190484 /home/blast/karpiusp >> 1295580 /home/blast/kohlm >> 2617704 /home/blast/adrian >> 18884056 total >> >> >> >> Regards and merry Christmas, >> >> Michael >> >> >> >> +-------------------------------------+--------------------------+ >> | Office: | Home: | >> |-------------------------------------|--------------------------| >> | Dr. Michael Kohl | Michael Kohl | >> | Laboratory for Nuclear Science | 5 Ibbetson Street | >> | MIT-Bates Linear Accelerator Center | Somerville, MA 02143 | >> | Middleton, MA 01949 | U.S.A. | >> | U.S.A. | | >> | - - - - - - - - - - - - | - - - - - - - - -| >> | Email: kohlm@mit.edu | K.Michael.Kohl@gmx.de | >> | Work: +1-617-253-9207 | Home: +1-617-629-3147 | >> | Fax: +1-617-253-9599 | Mobile: +1-978-580-4190 | >> | http://blast.lns.mit.edu | | >> +-------------------------------------+--------------------------+ >> >> >> >> >> >> >> >> >> >> >> >> >> >>



This archive was generated by hypermail 2.1.2 : Mon Feb 24 2014 - 14:07:32 EST