mikerochford.com » mrochford

Filesystem backups

mrochford — Thu, 16 Jun 2011 19:02:59 +0000

I always deal with friend and family's computers. They are always full of viruses and mail-ware. All they care is "Backup my music and pictures." Well I got tired of always trying to search and finding these files on there disk. So I wrote a quick little python script to gather all the files I want based on the file extension. Please see the script below and let me know what you think.

filefind.py

Find all the perl modules in your script and make sure they are installed

mrochford — Wed, 30 Mar 2011 01:38:22 +0000

Ever migrated code from one server to another and never remember if you captured all the modules that need to be installed? I have, its a pain in the ass sometimes. So I thought I would throw together a little script to check if I have all the modules I used installed. I have written it in python and perl (Dont ask!)

Versions:

Perl
Python

Example:
mrochford@mrochford-linux:~/bin$ ./perl_module_check.pl simpleMenu.pl Found 5 modules in simpleMenu.pl Testing Config: OK Testing Data::Dumper: OK Testing FindBin: OK Testing Strings::IO: NOT INSTALLED Testing strict: OK

Installing VMWare tools for Debian or Ubuntu

mrochford — Sun, 13 Mar 2011 21:10:50 +0000

Packages that are required to install VMWare Tools in debian or ubuntu

apt-get install make gcc linux-headers-$(uname -r)

Verifying your Linux Distro is 64bit.

mrochford — Thu, 20 Jan 2011 13:32:08 +0000

I ran into a situation that I had to verify that I was running a 64bit os. Below is a quick command line check. It checks based on the current kernel loaded.

mrochford@host1:~$ fgrep CONFIG_64BIT /boot/config-`uname -r` CONFIG_64BIT=y mrochford@host1:~$

Run a command randomly

mrochford — Wed, 22 Sep 2010 18:58:11 +0000

I wanted to run a command randomly everyday. Here is a one liner cron that I created.

echo "" | at now + `awk -vu=30 'BEGIN { srand(); printf( "%0.0f\n", rand() * u ); }'` minutes

Moving a directory from one host to another using tar over ssh

mrochford — Wed, 18 Nov 2009 17:28:00 +0000

tar cf - * | ssh "(cd && tar xf -)"

Naigos Plugin: Check for packages to update in Debian/Ubuntu

mrochford — Fri, 06 Nov 2009 04:13:47 +0000

Over the years I have manages a lot of systems, mostly debian based. The thing I really hate about having a lot of standalone systems is updating software. I am really bad at keeping track of new updates and I really dont want to have a cron script running to send me a email every day. Below is a script I used as a plugin for nagios.

The Script: check_for_updates.pl

Backup of your MYSQL server using mysqldump

mrochford — Thu, 22 Oct 2009 15:25:51 +0000

Over the years of being a admin I have seen many ideas on how to backup a mysql database server. Many people are satisfied with with one large dump of all databases into one flat text file. Others think copy the actual db files to other locations are the way to back things up. I have found dealing with customer and internal databases you need incremental backups. With all that said I developed a perl script that will log in grab all existing database names and do a mysqldump of each database. It will also keep a specified amount of backups and you also can choose to have some logs gzip'ed or left uncompressed. Below is the link to the code. You will have update login credentials and the ip address of the mysql server.

Link: mysql_backup.pl

Explanation of the script:

The script will login to your mysql server and issue a "show databases;". Once it the database names are retrieved it will run a mysqldump on each database and store the output in the specified directory. The name scheme of the out will be database_name-YYYYMMDD.sql. Doing this it will allow you to sort based on date. Once all mysqldumps have completed it will go through each database directory and audit what should be saved, deleted, gzipped or leave alone. You will be able to chose what the numbers of day you want to retain and the how many days you want to leave as a uncompressed file.

Changing the I/O timeout on your SCSI disk

mrochford — Thu, 23 Jul 2009 23:52:15 +0000

Changing your I/O timeout for your SCSI disks are rare. When you are running VMWare that houses the guest OS on a NFS/SAN mount you need to change the timeout. If you dont you will run into a mess with your guest OS. You will try running a snapshot and browsing your file system and bam its locks up. Below is what you need to change in your udev rules to change it.

Location: /etc/udev/rules.d/50-udev-default.rules

SUBSYSTEM=="scsi" , SYSFS{type}=="0|7|14", RUN+="/bin/sh -c 'echo 60 > /sys/block/sda/device/timeout'" SUBSYSTEM=="scsi" , SYSFS{type}=="0|7|14", RUN+="/bin/sh -c 'echo 190 > /sys/block/sda/device/timeout'" SUBSYSTEM=="scsi" , SYSFS{type}=="1", RUN+="/bin/sh -c 'echo 900 > /sys/block/sda/device/timeout'"

Connecting to a machine using sockets

mrochford — Wed, 27 May 2009 12:43:37 +0000

I work with a api system that connects on a high port. My co-work Matt came up with a great way to set the socket up and verify if the socket isn't stale. This sub-routine is specific to the api but you can use the theory and apply it to pretty much your socket needs.

sub cp_connect {
###############
#
# This function connects to a cp server
#
# Accepts:
# $remote_host The server to connect to
# $remote_port The port to connect to
#
# Returns:
# A critical Path mail server socket connection.
#
###############

my $remote_host = shift;
my $remote_port = shift;
my $remote_password = shift;
my $remote_conneciton_type = shift;
my $EOL = shift;

if($remote_conneciton_type =~ m/^rw$/){
$remote_password = $remote_password ." write";
}

my $socket = IO::Socket::INET->new(
PeerAddr => $remote_host,
PeerPort => $remote_port,
Proto => "tcp",
Type => SOCK_STREAM,
Timeout => 5 )
|| die "Couldn't open socket!\n\n";

my $answer = <$socket>;
print $socket "LOGIN $remote_password" . $EOL;
$answer = <$socket>;
if ($answer !~ /^OK/) {
print "Failed to login to $remote_host : $remote_port : $answer\n\n";
exit(1);
}
return $socket;
}

Once you have the understanding of how the sub-routine works. Building a script that interacts with the api is a piece of cake.

Here is an example of how we use the sub-routine in a script. This example will check to see if the socket is defined, if not it will try to connect and define the socket. Once the socket is defined it will issue a command and read the socket.

if(!defined $socket) {
$socket = cp_connect($remote_host, $remote_port, $remote_rwpass,"rw",$EOL);
}
print $socket "DOMAIN ENUMERATE". $EOL;
while (defined (chomp($answer = <$socket>))){
if($answer =~ /\*\s+(.+)\s/) {
$domains{$1}{'users'} = ();
}
elsif($answer =~ /^ERROR/){
$error = $answer;
return 0;
last;
}
elsif($answer =~ /OK/) {
return 1;
last;
}
}