Re: On /home/blast

From: Frederick Tong-Uk Lee (tong@lns.mit.edu)
Date: Fri Dec 23 2005 - 14:25:40 EST


Hi,

I have a perl script, bigfile.pl in ~tong/bin/ area, which I wrote when
I was in graduate school.
The usage is,

bigfile.pl 1000000

If you run this in your home area, this will show all files larger than
1000000 (~1MB).
I thought it might help people clearing their home directories.

Cheers,
-T

Wilbur Franklin wrote:

> We should go through the list line-by-line at the next analysis
> meeting and identify inactive users who should be moved to backup
> machines. It won't take long, but Ernie needs this information to
> identify whom to deactivate.
>
> Bill
>
> On Dec 23, 2005, at 12:44 PM, Douglas Kenneth Hasell wrote:
>
>> Hi,
>>
>> I've reduced my disk usage from 673000 to 166516 Hopefully this
>> helps but I think the other big users have to do the same (ie.
>> Adrian, Michael, Wang, Tim, Tavi, etc.) I also think the inactive
>> users like Wang, Hauke, Tong ?, Tim ?, Mosser, etc. could be
>> backed-up and then moved to some other machine which isn't backed up
>> regularly but from which they could recover the files they need if
>> and when they are needed.
>>
>>
>> Cheers,
>>
>> Douglas
>>
>> 26-415
>> M.I.T. Tel:
>> +1 (617) 258-7199
>> 77 Massachusetts Avenue Fax: +1
>> (617) 258-5440
>> Cambridge, MA 02139, USA E-mail:
>> hasell@mit.edu
>>
>> On Dec 23, 2005, at 12:04 PM, Michael Kohl wrote:
>>
>>> Hi,
>>>
>>> here's my opinion on a short-term and long-term solution for
>>> /home/blast:
>>> I don't think that increasing the size of the user directory helps.
>>> Instead it will get even worse very soon as people become careless
>>> (like free expansion of gas).
>>>
>>> +very short term: clean up!
>>> +short term: move inactive users to bud18
>>> +long term: introduce quota system (hopefully not necessary)
>>>
>>> !!! The user directories /home/blast should only contain data that
>>> needs
>>> to be backed up regularly!!!
>>>
>>> Therefore, people should be well aware that any raw or crunched data
>>> or excessive log output shall be stored in the scratch areas.
>>> Admittedly, I belong to the GB-users, too. Nevertheless, on the long
>>> term I would favor a quota system over an increase of useless beackups.
>>>
>>> If you are afraid of data loss when storing data on scratch disks, you
>>> should consider mirroring relevant directories with a second
>>> location by using the "rsync" utility:
>>>
>>> E.g., to mirror all your files from the directory
>>> bud01:/scratch/username with bud02:/scratch/username, type
>>>
>>> bud01:> cd /scratch/username
>>> bud01:> rsync -nauvzlRe ssh ./* bud02:/scratch/username
>>>
>>> Leave away the "n" option when you're confident in what you're doing.
>>> Rsync will only copy those files that are either newer or that do
>>> not exist yet. See "man rsync" for further options.
>>>
>>> I'm using rsync for a daily backup of my laptop and can sleep very
>>> well.
>>>
>>>
>>> $ du -sc /home/blast/* 2>/dev/null | sort -n
>>> 0 /home/blast/abs
>>> 0 /home/blast/blast
>>> 4 /home/blast/USAGE.LOG
>>> 8 /home/blast/abr
>>> 8 /home/blast/sktobler
>>> 16 /home/blast/lost+found
>>> 28 /home/blast/hxiang
>>> 108 /home/blast/ransom
>>> 288 /home/blast/coda
>>> 504 /home/blast/mbutler
>>> 516 /home/blast/wc
>>> 640 /home/blast/amamo
>>> 764 /home/blast/claudiag
>>> 828 /home/blast/arnesen
>>> 1108 /home/blast/rapaport
>>> 1396 /home/blast/nsavvinv
>>> 1876 /home/blast/lherman
>>> 2220 /home/blast/buuren
>>> 2448 /home/blast/doug
>>> 2596 /home/blast/alarcon
>>> 4008 /home/blast/palarczyk
>>> 4256 /home/blast/jalthouse
>>> 6092 /home/blast/sbauer
>>> 6340 /home/blast/grubes
>>> 6976 /home/blast/kmike
>>> 13988 /home/blast/wchall
>>> 16900 /home/blast/maxcht
>>> 16976 /home/blast/lmgoggin
>>> 17524 /home/blast/vodhanel
>>> 18196 /home/blast/almgren
>>> 18564 /home/blast/sthong
>>> 20856 /home/blast/flan
>>> 28068 /home/blast/kovash
>>> 32916 /home/blast/zapoian
>>> 35952 /home/blast/tsentalovich
>>> 38556 /home/blast/zwart
>>> 41936 /home/blast/zhangchi
>>> 48916 /home/blast/zilong
>>> 55420 /home/blast/zhengyi
>>> 56232 /home/blast/jvieregg
>>> 57460 /home/blast/maurik
>>> 66368 /home/blast/cbdandrea
>>> 76220 /home/blast/ezyryder
>>> 85260 /home/blast/bibek
>>> 85808 /home/blast/alicrocker
>>> 88136 /home/blast/jmpavel
>>> 90964 /home/blast/jrc
>>> 96728 /home/blast/mcsziget
>>> 120368 /home/blast/kboddy
>>> 121756 /home/blast/franklin
>>> 122820 /home/blast/kdow
>>> 125580 /home/blast/ddutta
>>> 156540 /home/blast/nikolas
>>> 190180 /home/blast/msteadman
>>> 201944 /home/blast/edsix
>>> 212760 /home/blast/cmgreene
>>> 214336 /home/blast/rfatemi
>>> 221332 /home/blast/agoodhue
>>> 236164 /home/blast/dsflash
>>> 265756 /home/blast/mcilhany
>>> 269340 /home/blast/seely
>>> 276496 /home/blast/martina
>>> 313144 /home/blast/shariton
>>> 321648 /home/blast/egeis
>>> 325512 /home/blast/dukedoc02
>>> 362568 /home/blast/clasie
>>> 398248 /home/blast/cvsroot
>>> 408044 /home/blast/ajmasch
>>> 418976 /home/blast/amosser
>>> 425124 /home/blast/chris2
>>> 425424 /home/blast/elog
>>> 456716 /home/blast/degrush
>>> 481980 /home/blast/tong
>>> 659884 /home/blast/vziskin
>>> 673000 /home/blast/hasell
>>> 679032 /home/blast/akdogan
>>> 690788 /home/blast/hauke
>>> 717772 /home/blast/tavi
>>> 975452 /home/blast/tps
>>> 1160628 /home/blast/wangxu
>>> 1190484 /home/blast/karpiusp
>>> 1295580 /home/blast/kohlm
>>> 2617704 /home/blast/adrian
>>> 18884056 total
>>>
>>>
>>>
>>> Regards and merry Christmas,
>>>
>>> Michael
>>>
>>>
>>>
>>> +-------------------------------------+--------------------------+
>>> | Office: | Home: |
>>> |-------------------------------------|--------------------------|
>>> | Dr. Michael Kohl | Michael Kohl |
>>> | Laboratory for Nuclear Science | 5 Ibbetson Street |
>>> | MIT-Bates Linear Accelerator Center | Somerville, MA 02143 |
>>> | Middleton, MA 01949 | U.S.A. |
>>> | U.S.A. | |
>>> | - - - - - - - - - - - - | - - - - - - - - -|
>>> | Email: kohlm@mit.edu | K.Michael.Kohl@gmx.de |
>>> | Work: +1-617-253-9207 | Home: +1-617-629-3147 |
>>> | Fax: +1-617-253-9599 | Mobile: +1-978-580-4190 |
>>> | http://blast.lns.mit.edu | |
>>> +-------------------------------------+--------------------------+
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>
>



This archive was generated by hypermail 2.1.2 : Mon Feb 24 2014 - 14:07:32 EST